This is so simple to do, yet totally changed my ability to CONVEY HOW EXCITED OR MAD I WAS to my friends without having to hit the shift arrow every time.
NB: If this isn’t working for you, go to Settings>General>Keyboard and make sure Caps Lock is enabled.