If you just want to be "tidy" then I'd install deborphan on a Debian/Ubuntu system and keep using it until all packages without dependents are removed and sure, apt-get clean, will remove all installed and cached packages.
If you are desperate for a bit extra space then there are some more extreme things you could do like "rm -rf /usr/sahre/doc/*" which will reclaim ~40Mb and locales could be removed if you only need English and there is another 60Mb. Most font packages could go and save yet another 20Mb. If you built jailkit then gcc and friends could go and arguably should be removed from a server anyway.
A post install cleanup script with a couple of levels of intensity would be an interesting project. Perhaps someone already has such a thing?