Ideally, a full log of joins and leaves wouldn't be bound directly to a chat anyway, right?
Matrix development seems to be getting pulled in a lot of different directions: the membership history seems like it's an IRC-inspired feature, while communities are inspired by Discord and Slack.