语言模型的神奇之处,尽管只针对英语进行了训练,模型却能理解非英语的指令。
语言模型的神奇之处,尽管只针对英语进行了训练,模型却能理解非英语的指令。
Jan Leike: With the InstructGPT paper we found that our models generalized to follow instructions in non-English even though we almost exclusively trained on English.
We still don't know why.
I wish someone would figure this out.