It was narrated from Aishah that:
the Messenger of Allah ﷺ swore to keep away from his wives, because Zainab had sent back her gift and 'Aishah said: "She has disgraced you." He became angry and swore to keep away from them.

حَدَّثَنَا سُوَيْدُ بْنُ سَعِيدٍ، حَدَّثَنَا يَحْيَى بْنُ زَكَرِيَّا بْنِ أَبِي زَائِدَةَ، عَنْ حَارِثَةَ بْنِ مُحَمَّدٍ، عَنْ عَمْرَةَ، عَنْ عَائِشَةَ، أَنَّ رَسُولَ اللَّهِ ـ ﷺ ـ إِنَّمَا آلَى لأَنَّ زَيْنَبَ رَدَّتْ عَلَيْهِ هَدِيَّتَهُ . فَقَالَتْ عَائِشَةُ لَقَدْ أَقْمَأَتْكَ . فَغَضِبَ ـ ﷺ ـ فَآلَى مِنْهُنَّ .