Logging out of the web client is confusing. From the web client, click your picture (or the person avatar) in the upper left corner, then select "Exit Client". This should take you back to the login screen, where you can log back in with your Microsoft account.
