Sorry @riban!
Perhaps i’m not understanding you, but … why not using SSH access? I do it all the time and never have a problem nor have to write a password (In fact, it doesn’t looks very different than using PATs)
My privates key are always on my computer, and i can choose to store them encrypted or as plain text, depending my level of trust on the given computer.
For instance, as i always use encrypted partitions for my personal data, i normally leave private keys unencrypted, so i only need to write my password when login.
If i’m using a 3rd person’s (or untrusted) computer, i always encrypt my private keys with good passwords.
Regards,