Yeah, I get it all the time. My answer depends on who's asking..
My standard reply is "I'm only out to impress one person.. The guy holding the handlebars."
And for the Lifestyle Riders, the answer varies, depending on the situation, but usually they won't understand, so it's not worth the effort.