Under System Settings → Keyboard → Advanced there's currently an option "Caps Lock (while pressed); Alt+Caps Lock for the original Caps Lock action." I would love if there were an option that functions just like this without the Alt+Caps Lock bind. Basically, just a "Caps Lock (while pressed)" option with no extra behavior from the Alt key.

I use a non-Qwerty keyboard layout but a number of applications that support Vim motions. I've configured my system so that I'm always in my preferred layout, but while holding Caps Lock, it temporarily switches to Qwerty so I can easily use the home row for movement without rebinding my editor, terminal, etc.  In some applications, for example, Zellij (a terminal multiplexer), includes default keybinds Alt+[hjkl] to navigate between panes. However, I can't make use of it because Alt+Caps Lock will toggle capitalization instead.