Not really. Let's say your categorical encoded feature is the day of the week, and therefore it holds the values 1-7 (or 0-6). Does the mean of this means anything? If you have more or less the same number of rows per day, the mean is ~3.5, which is Tuesday/Wednesday. That has no real meaning.