跳到正文
Jones Ray

ScholarPulse 日报 2026-10-26

2026-10-26 学术简报:2 篇。LLM智能体在观点模拟中违反互补一致性(正反命题概率和大于1),说明其模拟概率不能直接等同于内在信念。

今日速览

序号标题来源日期主题推荐等级
1Do “True” and “False” Add Up to One? Complement Consistency in LLM-Agent Opinion SimulationsarXiv2026-10-23RAG高
2J-Comm: Jacobian-Guided Latent Communication between LLM AgentsarXiv2026-10-23RAG高

重点论文与技术动态

1. Do “True” and “False” Add Up to One? Complement Consistency in LLM-Agent Opinion Simulations

一句话结论

LLM智能体在观点模拟中违反互补一致性(正反命题概率和大于1),说明其模拟概率不能直接等同于内在信念。

核心内容

方法与数据

价值判断

摘要 In LLM-agent opinion simulations, each agent reports the probability that a claim is true after seeing its own previous probability and the probabilities reported by its neighbors, and that number becomes its state in the next round. If the number describes the agent's position rather than the sentence it was shown, then rewriting the claim as its complement and replacing every probability p with 1 - p should return the complementary answer, so the two reports should sum to one. We test this with three small open models: Qwen3-4B, Llama-3.2-3B and Gemma-3-4B. On 2,304 agent states taken from a running network simulation, Qwen's paired reports sum to 1.18 on average, and on 48 real fact-checking claims from AVeriTeC they again exceed one. A controlled benchmark of 24 worlds, each with exactly two possible outcomes, shows the same failure in all three models. The discrepancy is two to ten times larger than the change produced by a same-meaning paraphrase, and it persists under repeated sampling and across peer group sizes and report strengths. When the reports are fed back into two populations that start from complementary states, the populations do not remain mirror images: their divergence is positive after five rounds for every model. Averaging each answer with the complement of its paired answer restores consistency by construction and lowers Brier loss averaged over the two wordings, but at the final round it beats the better of the two original wordings for only one of the three models. A schedule-by-targeting experiment on the same model gives a small, stable interaction because such sweeps keep the claim wording fixed. Consistency under rewording therefore needs its own test before simulated probabilities are read as beliefs

2. J-Comm: Jacobian-Guided Latent Communication between LLM Agents

一句话结论

J-Comm提出免训练几何共识与H+J隐式通信接口,实现了无需共享KV缓存或匹配模型宽度的跨LLM智能体高效协同推理。

核心内容

方法与数据

价值判断

摘要 Latent communication requires both an effective continuous reasoning process and an interface through which an external model can leverage its intermediate computation. We present J-Comm, a framework comprising two core components. First, a training-free Geometric Agreement for Latent Reasoning (GEAR) reweights token candidates over existing model embeddings, which monotonically optimizes geometric consensus among candidate tokens in embedding space at each step. Second, we introduce an H+J (Hidden-and-Jacobian) communication interface that gives the Receiver two complementary views of the Sender's reasoning. The H channel supplies continuous inputs derived from feedback distributions, while the J channel conveys intermediate-state cues in vocabulary-indexed Jacobian-lens coordinates. Intuitively, H provides inputs for the Receiver to reason from, while J offers additional guidance within its computation. The Receiver reconstructs these cues using its own dictionary and injects them into intermediate layers during prefill, enabling communication without sharing key-value caches or requiring identical model widths. In Qwen3-8B to Qwen3-4B communication, J-Comm achieves the highest mean score across seven benchmarks, including 94.80% on MATH500, 54.55% on GPQA-Diamond, 73.33% on AIME2024+2025, and 62.93% success on ALFWorld. Compared with TextMAS, it improves performance by 1.29-8.59 percentage points and reduces generated text tokens by 19.2-74.8%.