"You didn't sleep with anyone until Rachel?" Peter asks.

Even if Peter had been trying (and he wasn't), he'd have a hard time masking his surprise. He always just assumed that Alec had been sleeping around for years. None of his activities at the inn would have given him any reason to believe otherwise.