Many secular people are very fond of pinning all the worlds problems on religion, so I think it's fair to use the term back at them when they constantly act in the same exact ways they decry.

It clearly hits a nerve too.