I always have a yoyo in my pocket. Everywhere I go. I like to pull out my yoyo and noodle around instead of vegging out on my phone in public if I find myself with a short amount of time to kill.
That being said, some days I feel more shy and reserved than others. I find that most people generally could not care less about the fact that someone is actually doing something with a yoyo other than playing catch.
I have only met one other person who knows their way around an unresponsive yo-yo, and it was at a farmers market random enough. I had my yoyo on my belt clip and it was visible, and one of the guys at one of the booths was like, Hey man! Is that a yoyo? And I was like yeah dude. And he was like do you mind? And I was like, do you know how to use an unresponsive yo-yo? And he was like yeah of course!
So he busted out a cool little front style combo and then gave me back my yoyo. It was pretty cool. I never saw that guy again though, because I had to move to a different state that next month so I never got his info.