跳到正文
Jones Ray

ScholarPulse 日报 2026-10-11

2026-10-11 学术简报:2 篇。本文提出ReTeach自蒸馏框架,仅靠模型自生成尝试与结果级验证,通过多轮反思与重试构建自教师,在保持单次推理的同时提升了推理表现。

今日速览

序号标题来源日期主题推荐等级
1ReTeach: Building a Self-Teacher through Multi-Round Reflection and RetryarXiv2026-10-08RAG高
2SSCBench: Evaluating the Evidential Validity of Fault-Injection Tests for Tool-Using LLM AgentsarXiv2026-10-08AI-Agent高

重点论文与技术动态

1. ReTeach: Building a Self-Teacher through Multi-Round Reflection and Retry

一句话结论

本文提出ReTeach自蒸馏框架,仅靠模型自生成尝试与结果级验证,通过多轮反思与重试构建自教师,在保持单次推理的同时提升了推理表现。

核心内容

方法与数据

价值判断

摘要 Self-distillation can improve reasoning without a separately trained, more capable teacher, but its effectiveness depends on how the self-teacher gains an advantage over the student. Conditioning the teacher on reference answers or solutions can provide such an advantage, but this information may be unavailable. Reflection offers a way to derive explicit error diagnoses and revision guidance from self-generated attempts, yet existing reflection-based methods often combine it with reference information, rich task feedback, or persistent memory. We introduce ReTeach, a Reflective self-distillation framework that constructs its self-Teacher through multi-round reflection and retry using only self-generated attempts and outcome-level verification. Starting from an unsuccessful student rollout, the teacher alternates explicit reflection with renewed attempts until success or the retry budget is exhausted, without reference answers or solutions, external diagnostic feedback, or cross-example memory. Each failed retry informs subsequent reflection, while successful correction provides outcome-level evidence for the potential utility of the resulting teacher context. An outcome-aware selection and weighting strategy distinguishes initially correct, reflection-corrected, and unresolved examples, assigning separate weights to their category-normalized distillation losses. Through on-policy distillation, the student matches the teacher's context-conditioned token-level predictive distributions at prefixes of its own rollouts, transferring the benefits of iterative correction while retaining single-pass inference. Across six benchmarks spanning mathematical reasoning, science question answering, and tool use, ReTeach improves average accuracy over GRPO by 1.39 percentage points.

2. SSCBench: Evaluating the Evidential Validity of Fault-Injection Tests for Tool-Using LLM Agents

一句话结论

本文研究了工具调用LLM智能体故障注入测试的“证据有效性”问题,提出SSCBench基准,强调评估需报告反证可见的时序条件。

核心内容

方法与数据

价值判断

摘要 Fault injection is increasingly used to evaluate the reliability of tool-using LLM agents. However, there has been limited study of how fault-adoption results should be interpreted when the agent itself determines which authoritative observations become visible during execution. In this paper, we present a systematic study of this evidential validity problem in agent fault-injection evaluation. We develop a measurement protocol that specifies what observations can refute an injected assertion, determines whether they can become visible before the affected fact is first used, and records whether the evaluated execution actually realizes this condition. We construct SSCBench as an instantiation of the protocol and evaluate four fault operators and five agent configurations over 1,191 faulted executions in two $τ$-bench environments. Our experiments show that an admitted fault case and agent configuration can realize substantially different evidential conditions across executions, and that aggregate adoption can remain well defined even when the population supporting a timely-counterevidence claim is sparse or absent. For example, among 44 adopted runs in which counterevidence eventually became visible, only 17 received it before first use, while 27 received it afterward. We also find that first-error timing and later stance revision need not coincide, and that automated trajectory analysis can recover adoption without reliably recovering the first faulty-reliance event needed for temporal diagnosis. We argue that the evidential condition realized by an execution and the population supporting a claim-specific interpretation are part of fault-injection evaluation itself and should be reported before adoption is interpreted as failure under pre-use counterevidence.