Optimize realm migrations (#639)

Doing all these loops even when there's no work wastes a lot of time, so
lets skip them if necessary