Hey Swing Chick...
Of course you always have the option to declin an invitation to dance, and if done so tactfully, with out insult.
I myself, though, rarely turn down an offer, even when the guy is a known "jungle dancer". I try to use it as an opportunity to test MYSELF. If you look at it as a puzzle or challenge then you can find some humor in the situation
"We are going this way...oh, no we are going here, oh hey oh, a promenade, or maye not...well I'll just back up" You get the picture?
Rhythm dances are a bit easier to do this in as you can simply put a bit more space between you and Jungle Boy. Let him do his thing, you just smile. The rest of the room will see him swinging and flailing...you just hold your head up and look calm and graceful, and make the other women nod knowingly...
Just a thought
Larinda