4 Therefore, my brethren, if any man who is a monk or a saint, who loves the solitary life, yet desires that a woman, bound by monastic vow like himself, should dwell with him, it would be better for him in that case to take (to wife) a woman openly and not be made wanton by lust. So also again the woman, if she be not separated from the solitary, it is better for her to marry openly. Woman then ought to dwell with woman, and man to dwell with man. And also whatever man desires to continue in holiness, let not his spouse dwell with him, lest he turn back to his former condition, and so be esteemed an adulterer.
Therefore this counsel is becoming and right and good, that I give to myself and you, my beloved solitaries, who do not take wives, and to the virgins who do not marry, and to those who have loved holiness. It is just and right and becoming, that even if a man should be distressed, he should continue alone. And thus it becomes him to dwell, as it is written in the Prophet Jeremiah:— Blessed is the man who shall take up Your yoke in his youth, and sit alone and be silent, because he has taken upon him Your yoke. For thus, my beloved, it becomes him who takes up the yoke of Christ, to preserve his yoke in purity.
Source: Demonstrations (New Advent)