I don't see why it would ! Sometimes they look kind of sexy if they are nice. Shouldn't matter to a decent boy with a brain. Beauty is in the eye of the beholder.
Look at it philosophically. What's the difference between flirtatious winking and a good eye patch? Not much! If someone says something to you about it, just tell them to pretend you're winking at them.