Use 'Shift' to turn off 'Caps Lock'

You can change this feature in the Registry Editor. Simply follow this feature

(1). Click on 'Start | Run'. Type regedit and press OK.

(2). Browse down to the following key:-
“HKEY_CURRENT _USER \ Keyboard Layout”

(3). In the right panel, right click and select ‘New | DWORD Value’.

(4). Name the new value ‘Attributes’. Now double click on the new Attributes Value.

(5). In the value box enter 00010000 and press OK.

(6). Exit the registry and Reboot your PC.

Now the Caps Lock key will always turn on but you must press either of the Shift key to turn it off.