The Togami family used to hire the Saionji family to dance at multiple parties, so they already vaguely knew each other by the time he entered Hope's Peak.

However, when guests were no longer entertained by traditional dancing, the two families stopped interacting. When Hiyoko met the Imposter, it had been enough time that she was still willing to believe he was the real one.