SSH must be the only way to connect to your server remotely, forget about telnet. SearchEnterpriseLinux.com's Andrew Kutz writes a tutorial on how to compile and install OpenSSH on Ubuntu Feisty Fawn Server. Why do you need to compile it? The article states "the SSH version that ships with Ubuntu server does not include all of the latest functionality of the production release of the OpenSSH software."

So there you go, what are you waiting for? I think I will have to alert our sys-ads to do this right away.