A new paper says LLMs, on the other hand, seem to treat these as two distinct things?

This is the Reversal Curse. “A is B” and “B is A” are treated as distinct facts.

Owen Evans: Does a language model trained on “A is B” generalize to “B is A”? E.g. When trained only on “George Washington was the first US president”, can models automatically answer

... See more