Sure he counted them to the lumpenproletariat, but do you have a text where he actually declares the lumpenproletariat enemy if the working class?
Recalling from memory he saw them as victims of capitalism who deserve better...
So he's not actually thinking they are class enemies by design. He thought its a class that shouldn't exist because the hardships they are forced to go through.
He didn't want people forced into protitution by the system, I dont think he would have something against emancipated sex workers who work in the field from a desire to do so.