OpenSSH is the open-source version of the Secure Shell (SSH). OpenSSH was added to Windows 10 (build 1809 and later). This means that you can open a MS Windows Command Prompt window and run any of the SSH tools from the command line in MS Windows. Therefore you don't need to use PuTTY if you don't like that tool. OpenSSH for Windows has the following commands built in

     ssh         SSH client component that runs on the user's local system
     ssh-keygen  generates, manages and converts authentication keys for SSH
     ssh-agent   stores private keys used for public key authentication
     ssh-add     adds private keys to the list allowed by the server
     ssh-keyscan aids in collecting the public SSH host keys from hosts
     sftp        provides the Secure File Transfer Protocol, and runs over SSH
     scp         file copy utility that runs on SSH

You even have a %userProfile%/.ssh folder as well!

References:

Microsoft OpenSSH Overview

Configuring SSH Public Key Authentication Under Windows