I read an article and found it very useful: http://www.howtoforge.com/ssh_key_based_logins_putty
I made two key pairs for root and the other user. But it only works for root
When it comes to the other one, the server shows:
Using username "theotheruser".
Server refused our key
theotheruser@mydomain.com's password: