Princes from other royal families weren't exactly a rarity. The previous Crown Prince, who was not just a Prince but the true Crown Prince, had only ever interacted with everyone for official matters.
Just a few years ago, before the Crown Prince was married, Tang Wanju had also recently joined the Demon Suppression Department; everyone still interacted for the sake of official duties. At that time, the Crown Prince had shown some desires, yet Tang Wanju had endured and never acted upon it, feeling absolutely no fondness and rather a significant dislike towards him.