Even with a suitable size font, the text will have antialiasing applied to make it look better under normal viewing conditions.
One way to deal with that is to apply an alpha adjustment as explained here:
How to disable antialias in vector layer when drawing curve?
Try doing it with a Filter Mask on the vector text layer.