For me it works correctly (but the preview is in grayscale like you show). Make sure brush mode is set to Color Image when you select the brush tip. Does that work for you or still in grayscale?
(krita-nightly_7f1fe37 on macOS)
However I found that gimp image brush files (both gbr and gih) saves/exports and opens as grayscale in Krita 5. (File → Save/Save as…/Export)
.gih and .gbr files saved in Krita 4.4.8 opens as grayscale but appears correctly when used as brush stamp for me.
Hm. Yes. If I go to brush settings with newly created stump I can change it to color Image.
The confusing part is that in 4.4.8 you can see the thumbnail colored. In a new version it is grayed out.
So by the preview you assume that color information will be lost.