Jones Ray

ScholarPulse 日报 2026-11-05

2026-11-05 学术简报：2 篇。该研究提出了受控上下文丰富化框架与“选择性鲁棒性”验证准则，以解决LLM社会智能体在保持语义的提示扰动下行为脆弱的验证难题。

今日速览

序号标题来源日期主题推荐等级
1A Framework for Context Enrichment and Selective Robustness in LLM Social AgentsarXiv2026-11-04AI-Agent高
2FrontierPhysics: Evaluating Agents for End-to-End Physics ResearcharXiv2026-11-04AI-Agent高

重点论文与技术动态

1. A Framework for Context Enrichment and Selective Robustness in LLM Social Agents

一句话结论

该研究提出了受控上下文丰富化框架与“选择性鲁棒性”验证准则，以解决LLM社会智能体在保持语义的提示扰动下行为脆弱的验证难题。

核心内容

方法与数据

价值判断

摘要 Researchers use large language models as agents in social simulations, where agents are prompted with observations and background information intended to shape their actions. Yet LLM agents have been shown to substantially change their behavior under meaning-preserving prompt variations, creating a validation problem for social simulation. One plausible hypothesis is that this brittleness reflects a lack of grounding and can be reduced by enriching the context provided to the agents. Whether richer context improves robustness remains unclear, in part because context richness and robustness are rarely defined in ways that support controlled comparisons. We address the first need with controlled context enrichment, a set of prompt substitution rules that systematically enriches distinct types of context: neutral padding, generic social background, descriptive decision grounding, and normative decision grounding. We address the second by introducing selective robustness as a validation criterion: insensitivity to meaning-preserving prompt variation combined with a directional response to decision-relevant changes in the social world. We demonstrate the framework in a Prisoner's Dilemma-like game, showing how it can be used to identify which forms of context enrichment produce more desirable and robust agent behavior. We find that these forms of enrichment produce distinct behavioral patterns that vary between the two models tested.

2. FrontierPhysics: Evaluating Agents for End-to-End Physics Research

一句话结论

FrontierPhysics 是首个评估 AI 智能体端到端物理研究能力的基准，测试显示现有前沿模型因缺乏严密推理与专家直觉，完成质量普遍偏低。

核心内容

方法与数据

价值判断

摘要 AI agents are playing an increasingly important role in physics research. However, existing physics benchmarks only evaluate fixed questions, isolated sub-tasks, or paper reproduction with given solutions, and rarely check research quality alongside correctness. We introduce FrontierPhysics, an end-to-end benchmark with 56 tasks made by 42 physicists based on their own research, covering nine domains across theoretical, computational, and experimental physics. Each task requires agents to review the literature, develop a research plan, conduct research and experiments, and produce structured outputs and scientific manuscripts. Combining deterministic verifiers with expert-authored rubrics, FrontierPhysics evaluates whether agents' research is correct and publishable. Across 22 models in 26 configurations, no configuration passes more than 46 of its 168 rollouts. Manual review of agent trajectories shows that frontier agents' main weaknesses are insufficiently rigorous reasoning and limited expert intuition, rather than gaps in physics knowledge or execution errors.