跳到正文
Jones Ray

ScholarPulse 日报 2026-10-05

2026-10-05 学术简报:2 篇。NeutronGym是首个可执行中子仪器设计环境,LLM智能体通过验证工具构建仪器,McStas射线追踪,分级梯子无LLM评判评估语法、运行时、结构和科学,程序化家族提供无限实例,并可RL训练。

今日速览

序号标题来源日期主题推荐等级
1NeutronGym: Physics-Graded Neutron Instrument Design for LLM AgentsarXiv2026-10-02AI-Agent高
2HazardWeaver: Scientific Route Selection for Hazard Analysis AgentsarXiv2026-10-02RAG高

重点论文与技术动态

1. NeutronGym: Physics-Graded Neutron Instrument Design for LLM Agents

一句话结论

NeutronGym是首个可执行中子仪器设计环境,LLM智能体通过验证工具构建仪器,McStas射线追踪,分级梯子无LLM评判评估语法、运行时、结构和科学,程序化家族提供无限实例,并可RL训练。

核心内容

方法与数据

价值判断

摘要 Designing a scientific instrument tests whether language-model agents can do physics rather than recall it, provided the grading cannot be argued with. We introduce NeutronGym, to our knowledge the first executable environment for neutron instrument design: agents build instruments through validating tools, McStas ray-traces what they build, and a level-resolved ladder grades syntax, runtime, structure and science with no LLM judge. Procedural families supply unlimited instances of a fixed layout whose design parameters the agent must set, with held-out parameter regimes; a curated slice, McStasBench, adds 16 tasks from published instruments behind memorization probes and a sandbox. Seven models reproduce at most 7 of the 16, none retrieves a reference, and none meets an improvement target. The environment also trains. Reinforcement learning on its reward takes Qwen3-8B from 11% to 77% of held-out instances of a family whose targets come from a hidden design (69% at a second seed), past an untrained Qwen3-32B, and the recipe holds, at one seed each, on three further gated families. The analysis says what that gain is. Without the ladder's partial credit it collapses by 60 points. From reward alone the trained model reaches what a classical optimizer reaches, at the agent's simulation budget, only when handed the closed-form physics (77% against 81%, a gap that does not separate at this size), while frontier models still solve 98-99%. Getting a trustworthy result meant failing four task designs that no-model baselines could solve, and we release the probes that found them.

2. HazardWeaver: Scientific Route Selection for Hazard Analysis Agents

一句话结论

HazardWeaver将自然灾害分析中科学方法选择形式化为状态依赖路径选择,使AI代理能根据事件、数据和工具动态确定适用且可执行的工作流,并随新证据修订决策。

核心内容

方法与数据

价值判断

摘要 Understanding and assessing natural hazards is essential for disaster preparedness and risk reduction. Recent advances in large language models have spurred growing interest in AI agents for hazard analysis, particularly their ability to integrate scientific data, models, and tools into automated workflows. However, effective automation requires agents to determine which scientific methods are appropriate for a given event and executable with the available data and tools. As new evidence and execution results become available, these conditions can change, requiring agents to reconsider their choices. We formulate this problem as state-dependent scientific route selection and introduce HazardWeaver. Specifically, HazardWeaver first leverages the Hazard Knowledge Compiler to extract evidence-linked conditions governing scientific applicability, then its Hazard Capability Graph represents executable scientific capabilities and checks compatibility between their inputs and outputs. Using these complementary representations, the Hazard Weaver Agent component selects applicable and executable routes, carries out their workflows, and revises its decisions as the analysis state changes. To evaluate both the scientific outputs and the decisions that produce them, we introduce the Hazard Weaver Benchmark, comprising 141 instances across seven single-hazard domains and four multi-hazard interaction classes. The benchmark accommodates multiple valid scientific routes and evaluates output correctness, route validity, and justified abstention. Extensive experiments on this benchmark show that HazardWeaver outperforms existing agent systems, with the largest gains on tasks with multiple eligible scientific routes. Our code is publicly available at https://github.com/LabRAI/HazardWeaver.