I didn't see anything wrong with calling them plants. I suppose taken out of context, Kurapika's "You are a plant" accusation would sound pretty weird, but in context I thought it was fine.