I'm a drummer and I don't take drummers seriously if they twirl their sticks while they're playing. Call me a purist, but your only goal as a drummer should be to make every detail of the beat sound mesmerizing, not to demonstrate theatric dexterity that can only serve to distract you from the acoustic details.
I disclose that I, personally, am incapable of twirling my sticks as I play the drums. So, this could very well be the jealousy talking.