It has been narrated on the authority of Anas b. Malik that the Messenger of Allah ﷺ would not come (back) to his family by night. He would come to them in the morning or in the evening. Another version of the tradition narrated on the some authority is a little differently worded. It says: (He) would not enter (upon his household at night).

حَدَّثَنِي أَبُو بَكْرِ بْنُ أَبِي شَيْبَةَ، حَدَّثَنَا يَزِيدُ بْنُ هَارُونَ، عَنْ هَمَّامٍ، عَنْ إِسْحَاقَ،
بْنِ عَبْدِ اللَّهِ بْنِ أَبِي طَلْحَةَ عَنْ أَنَسِ بْنِ مَالِكٍ، أَنَّ رَسُولَ اللَّهِ ﷺ كَانَ
لاَ يَطْرُقُ أَهْلَهُ لَيْلاً وَكَانَ يَأْتِيهِمْ غُدْوَةً أَوْ عَشِيَّةً .