yes, thats means that server does not allow ssh .
example :
when i will connect one linux server to another linux server i will type
ssh root@linuxserver2
it will connect me to linux server 2
but in your case it does not.
Now you need to find out why
(a)
does this 2nd linux server staying behind any firewall ?? if Yes
then you need to open or forward port 22 to this 2nd server
(b) you need to check if iptables of the server allowing port22 .
type, iptables -L
see what its saying