When enabling lazy loading, the megolm room with +100 members showed the avatar of the last active member until members where downloaded (and didn't properly update after that). This room lacks a custom avatar, and we probably revert to checking if the personal avatar should be shown in case of a 1:1. Use the joined + invited count instead to determine.