I gotta agree with Fonic_Artes, you know people lurk because they are doing something else why watching a stream. it could be working, doing laundry, cooking or playing a game themselves. Hitting them with a message like "I see you lurking, please stop." while doing this will most likely make them leave cause they just want to watch, not chat. Just sharing my opinion, take this from a long time twitch user and moderator.

//Weenig