Hugging Face Blog·· 2024-04-23AI 评分33
Hugging Face 推出 Open Chain of Thought Leaderboard
Introducing the Open Chain of Thought Leaderboard
AI 导读
Hugging Face 发布 Open Chain of Thought Leaderboard,通过计算准确率增益(Δ = CoT准确率 - 无CoT准确率)评估LLM生成思维链的能力。该榜单基于LogiQA和LSAT等AGIEval任务,采用Classic与Reflect两种提示策略生成推理轨迹,旨在更稳健地衡量模型推理效能并抵抗训练数据污染。
来源:Hugging Face Blog · huggingface.co