I always figured this was a Min thing—Min had seen them together in Baerlon, and Moiraine had said earlier in the book that she knew the face of the man she would marry better than Egwene/Elayne. Her attempt to deflect after she said that made it very clear that she DID know the face of the man...