I had the very sad experience to be (and I am) in this situation , and what happen is simple:
When an imam does not take his responsibilities (whatever the reasons, mostly due to the umma), and treats his job as a simple procedure: just leading the salah, and make the Friday khutba. The umma will not treat him with respect, as well the prayer in group, the community and the masjid… This is just like a domino game, one fall, the rest follow.

There will be no activities, no fellowship, sometimes not even the adhan or salat, no unity… etcetera. In fact there will only be fitan after fitan and the umma will just talk about the new painting or the menu of the next iftar.

But wait there is more: Basically when a mimbar is empty, someone will hijack it. And most of the time it would be the worst man of the umma, the kind of brother who always think that everyone else does not know the deen except him. The kind of man who is a “silence pretentious hater”.

With the help of the authorities or others external organizations (who clearly want to put their toy in this empty mimbar), this man will take the masjid under his new association/organization, because they will always find something wrong in the registration of the old one, kick out the current iman, making threats to the ones who talk too much and the nightmare just begins. Next step might be the demolition of the masjid to rebuild a new that will never come…

I will paraphrase the author: If your imam is not the kind who wants to carry the umma on his back and keeps it safe from wolves and dogs, fired him ASAP and find one who wants.