跳到正文
Jones Ray

ScholarPulse 日报 2026-10-02

2026-10-02 学术简报:2 篇。InterEvolve通过测试时进化奖励程序,使人形机器人无需重训练即可重用现有技能解决新的loco-manipulation任务,并从自身尝试中改进并保留所学。

今日速览

序号标题来源日期主题推荐等级
1InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-ManipulationarXiv2026-10-01AI-Agent高
2From Knowledge Access to Source Learning: Developing Source-Specific CompetencearXiv2026-10-01RAG高

重点论文与技术动态

1. InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation

一句话结论

InterEvolve通过测试时进化奖励程序,使人形机器人无需重训练即可重用现有技能解决新的loco-manipulation任务,并从自身尝试中改进并保留所学。

核心内容

方法与数据

价值判断

摘要 We study test-time evolution for humanoid loco-manipulation: solving tasks that a controller was never trained for by repurposing its existing skills, improving from its own attempts, and retaining what it learns, without retraining. Our key insight is that a broad controller already holds much of the competence a new task needs, and that this competence becomes accessible through an interface between planning and control that is expressive enough to specify contact-rich, multi-stage interactions, yet executable and measurable enough that execution feedback can guide planning from experience. InterEvolve realizes this interface with two components. First, we develop an object-aware forward-backward (FB) behavioral foundation model, whose object residuals on a frozen body prior turn a new reward about the body or objects into loco-manipulation behavior at test time. Second, we specify tasks as reward programs: staged rewards with completion conditions and tunable constants. A large language model (LLM) agent revises the program structure in context, drawing on execution feedback and a skill library of verified programs, while a numerical optimizer tunes its constants. With every candidate verified across parallel simulation scenarios, the program explores new ways to induce, repurpose, and compose the controller's existing motor competence for the task at hand, and thus improves over iterations. Experiments show that human-designed rewards leave much of the FB model's loco-manipulation competence untapped, whereas the programs InterEvolve evolves release it, sometimes through novel strategies. It further produces behaviors for diverse tasks, complex scenes, and long-horizon compositions in simulation, and evolved skills run autonomously on a physical Unitree G1 from egocentric onboard perception.

2. From Knowledge Access to Source Learning: Developing Source-Specific Competence

一句话结论

SourceLearn通过持续来源模型,将智能体对权威来源的重复使用从反复访问转为可复用来源特定能力学习,多数设置优于检索与记忆基线。

核心内容

方法与数据

价值判断

摘要 Large language model (LLM) agents increasingly rely on persistent external sources to solve sequences of knowledge-intensive tasks. Existing methods improve how source content is accessed and organized, while agent-memory systems preserve reusable knowledge from prior interactions, but repeated use of the same source is still largely treated as repeated access rather than an opportunity to progressively improve understanding of that source. We study source learning: developing reusable source-specific competence over a persistent authoritative source. We represent this competence with a persistent source model that captures reusable understanding of the source, including how its knowledge is structured, interpreted, and applied. To construct and progressively refine such models, we propose SourceLearn, which combines two complementary learning mechanisms. Self-Directed Source Learning identifies what remains incompletely understood and adaptively revisits the source, while Task-Guided Source Learning uses downstream experience to reveal local representational gaps and recurring needs in how source knowledge should be organized. In both cases, learning signals determine what should be reconsidered, while persistent updates are reconstructed from the authoritative source. Across five benchmarks and three LLM backends, SourceLearn achieves the best performance in 13 of 15 settings, with gains of up to 22.6 points over Hybrid RAG and substantial overall improvements over static source representations and experience-based memory baselines.