Change Theme, in the command palette, opens the theme list. Each row is a theme name and whether it is light or dark. The dialog says to select a theme to preview it. Change keeps that theme for the next start. Cancel puts the previous theme back.

The website’s light, dark, and system switch is separate. It does not change the program.