«Вице-премьер заявил, что между Пакистаном и Саудовской Аравией существует соглашение в сфере обороны. Пакистан связался с Ираном и попросил его не атаковать Саудовскую Аравию», — сказано в сообщении.
I wanted to test this claim with SAT problems. Why SAT? Because solving SAT problems require applying very few rules consistently. The principle stays the same even if you have millions of variables or just a couple. So if you know how to reason properly any SAT instances is solvable given enough time. Also, it's easy to generate completely random SAT problems that make it less likely for LLM to solve the problem based on pure pattern recognition. Therefore, I think it is a good problem type to test whether LLMs can generalize basic rules beyond their training data.
，推荐阅读safew官方版本下载获取更多信息
图片来源：银河通用机器人微信公众号
緊急避妊薬 “深刻な副作用が？” SNSの根拠ない情報に注意を