MMLU 是特别重要的指标（如果不是最重要的话

MMLU 是特别重要的指标（如果不是最重要的话 包含了57个学科的综合知识能力 是很多模型的衍生能力的基础 Andrej Karpathy: Huge day indeed for AI and LLMs, congrats to Meta This is now the most capable LLM available directly as weights to anyone from researchers to companies. The models look quite strong, e.g. Table 4 in the paper: MMLU is good to look at, the 70B model is just below GPT-3.5. But…