Dang that is a neat trick! Embed the answers then dot product with the question embedding. All kinds of fun linear algebra tricks (centering, rescaling etc.) to improve outcomes.