Have the wise men completed their tortuous journey?
The time came for Joseph and Mary to perform the ceremony of purification, as the Law of Moses commanded. So they took the child to Jerusalem to present him to the Lord, as it is written in the law of the Lord: “Every first-born male is to be dedicated to the Lord.” They also went to offer a sacrifice of a pair of doves or two young pigeons, as required by the law of the Lord.
The "two doves" sacrifice was a specific concession for poorer people - which is why Mary's blue frock is wrong. Blue cloth was expensive!
It would seem likely that, by now, the "Holy Family" will have left the comfort (?) of their stable/cattle shed/cave and found somewhere to rent. Maybe carpenter Joe had found himself a bit of fettling work in and around Bethlehem.
This would save another lengthy walk back to Nazareth and back back to Jerusalem.