I agree with awake. The first thing I thought was: "oh great, an extreme political ideology for us to be identified with."
I don't care to be identified with them by the folks I encounter regularly whose first reaction is, unfailingly, "Esperanto? Didn't that die a long time ago?"
Then what?
"Oh, I see! Today it's being used by anti-globalisation anarchists!"

I don't really see any cause for concern. Esperanto has always appealed to... shall we say, off-beat types.

Personally I think it would be a big step up if the general public thought of Esperanto as controversial, instead of simply being ignorant of it altogether or seeing it as a failed project of the naively idealistic past.