Sometimes this is caused by issues with reverse DNS resolution. Set UseDNS no in /etc/ssh/sshd_config and reload SSH with kill -HUP `cat /var/run/sshd.pid` (this shouldn't kill your session)
/etc/ssh/sshd_config
kill -HUP `cat /var/run/sshd.pid`
« start
