跳到正文
原文
Hugging Face Blog·· 2024-04-23AI 评分33

Hugging Face 推出 Open Chain of Thought Leaderboard

Introducing the Open Chain of Thought Leaderboard

AI 导读

Hugging Face 发布 Open Chain of Thought Leaderboard,通过计算准确率增益(Δ = CoT准确率 - 无CoT准确率)评估LLM生成思维链的能力。该榜单基于LogiQA和LSAT等AGIEval任务,采用Classic与Reflect两种提示策略生成推理轨迹,旨在更稳健地衡量模型推理效能并抵抗训练数据污染。

来源:Hugging Face Blog · huggingface.co