Prefer the direct route for m.direct rooms and allow joined space children before roomToParents finishes backfilling.