Carry a responsive plastic with you, and let them play with that. Who knows? Mabye you just inspired the next national champ?
And if someone asks you to walk the dog or something, do it (unless you’re using a metal over a hard surface, in which case, do and arm grind), and then blow their mind with some Moebius, or something that anyone can recognize as good. Heck, I was in a store, and people were AMAZED, and yes, I do mean amazed, when I did barrel rolls with my X-Convict.
Just be proud of your hobby. If people don’t like it, Oh well! That’s just not their interest. Don’t be ashamed or mad.