Well, I agree with you. It maybe a lot more complicated.
But when I make a selection to draw inside, I will expect not affected by the outside area.
Since I find a post here, maybe someone else have the same expectation 
Make Color Smudge Brush aware of selection while picking up colors
PS: To avoid picking outrange color now, just not move pass your brush center out of selection.