I use WhatsApp without any Android rights other than foreground data usage. I still check my messages once a day, but if someone wants to reach me now, they have to use signal. It also makes it at least less bad for privacy.
My close circle of friends and family do use signal for me and I only get relevant messages every few days on WhatsApp, but getting rid of it still isn't possible in my situation.