Ethan Mollick criticizes headline on AI math study: Solving 7/10 novel very hard problems is significant progress
English summary
Ethan Mollick pushes back against a headline suggesting AI 'did not live up to the task' when a study found it solved 7 out of 10 novel very hard math problems. He notes that 15 months ago LLMs could not do math at all, so this represents substantial improvement. The study itself illuminates both the flaws and successes of AI in mathematical reasoning. The tweet highlights the danger of misinterpreting AI benchmark results when progress is rapid. Mollick frames the result as impressive rather than a failure.
Chinese summary
伊桑·莫里克反驳了“AI未能完成任务”的标题说法，指出研究显示AI解出了10道新颖极难数学题中的7道。他强调15个月前大语言模型完全不会做数学，因此这是巨大进步。该研究本身揭示了AI在数学推理中的缺陷与成功。这条推文提醒，在技术飞速进步时，误读基准测试结果的风险。莫里克将这一结果定性为令人印象深刻，而非失败。
Key points
A research study found AI solved 7 out of 10 novel, very hard math problems.
一项研究发现，AI解出了10道新颖极难数学题中的7道。
Mollick argues this is a major success, given that 15 months prior LLMs could not do math.
莫里克认为这是一大成功，因为15个月前大语言模型完全不会做数学。
He criticizes a headline that framed this result as AI not living up to the task.
他批评一项将这一结果描述为AI未能完成任务的标题。
The study itself reveals both flaws and strengths of AI in mathematical reasoning.
该研究本身揭示了AI在数学推理中的缺陷和优势。