Just in case anyone wishes to tweak a theme.colors file by hand I created a little reference image to show where the RGBA values apply. Hope it helps someone!
… and you don’t have to stop and restart Krita for the changes (to an existing .colors file) to take effect - just switch to another theme then back again. However, newly installed themes need a restart.