Ah, just connected using the -v flag and found that it is indeed using my public key. I forgot that I had copied that over when I was adding the ssh file. So that clears things up. Sorry for wasting your time, my mistake!

2 Likes