Once synapse reports the correct number of invited and joined members again (right now it does but we're about to change this and give an estimate to speed up lazy loading in synapse, this will be accurate again once work on denormalizing room state has been implemented in synapse) in a room when LL members, we could avoid /members requests if the amount of members we already know about is the same as the invited + joined count reported in the summary.