2026-07-02

AI Agents

An audit of popular code-optimization benchmarks finds their results are often unstable and rankings depend heavily on arbitrary scoring rules. Another paper introduces a transactional model for agent safety that treats all generated actions as untrusted proposals until validated. Today's research also covers trainable memory, legacy code rescue, and runtime-guided bug fixing.

5 papers 0 news 2 blogs 24 appendix 85 considered

Papers

5

AutoMem: Automated Learning of Memory as a Cognitive Skill

arxiv:arxiv-agents — Shengguang Wu, Hao Zhu, Yuhui Zhang, Xiaohan Wang, Serena Yeung-Levy 8/10 memoryplanningresearch
This paper frames memory management not as a fixed architecture, but as a trainable skill. AutoMem introduces a dual-loop system. The first loop has a powerful LLM meta-review agent trajectories to iteratively improve the memory structure (file schemas, action vocabulary). The second loop identifies and reinforces the agent's good memory decisions, fine-tuning its proficiency. On long-horizon tasks like NetHack, optimizing memory alone boosted a 32B model's performance by 2x-4x, making it competitive with much larger frontier models.

RepoRescue: An Empirical Study of LLM Agents on Whole-Repository Compatibility Rescue

arxiv:arxiv-software-eng — Zhihao Lin, Mingyi Zhou, Zhensu Sun, Yizhuo Yang, Renyu Yang, David Lo, Li Li 8/10 code-agentsevals
This paper introduces RepoRescue, a benchmark for the practical task of updating old repositories to run in modern environments. The setup is realistic: an agent is given a repo that passed its tests historically but now fails, and it must produce a patch. The evaluation is rigorous, including a runtime-enforced mode that blocks agents from editing the test files. Under these conditions, Kimi still rescues 41.5% of Python repos. The study also finds different agent systems are complementary, suggesting an ensemble could be highly effective.

SWE-Doctor: Guiding Software Engineering Agents with Runtime Diagnosis from Multi-Faceted Bug Reproduction Tests

arxiv:arxiv-agents — Yaoqi Guo, Yang Liu, Jie M. Zhang, Yun Ma, Yiling Lou, Zhenpeng Chen 8/10 code-agentsevals
Standard software engineering agents can be misled by bug reproduction tests (BRTs). This paper introduces SWE-Doctor, which finds that naively using BRTs leads to partial or incorrect fixes. Instead, SWE-Doctor generates multiple BRTs for different aspects of a reported issue, executes them to create runtime diagnosis records, and then feeds these diagnoses to the patch generation agent. This runtime grounding provides a much richer signal, significantly improving bug-fixing performance on SWE-bench across five different agent backends.

Mnemosyne: Agentic Transaction Processing for Validating and Repairing AI-generated Workflows

arxiv:arxiv-agents — Edward Y. Chang, Longling Geng, Emily J. Chang 8/10 safetyinfraobservability
How do you trust a workflow when any step can be an LLM hallucination? This paper proposes Agentic Transaction Processing (ATP), a model implemented in the Mnemosyne runtime. It treats all agent-generated actions as untrusted proposals that are only committed to state after passing a set of deterministic, executable constraints. This separates the competence of the proposing agent from the correctness of the committed state. The system includes proven safety guarantees and a protocol for localized, bounded reactive repairs.

Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents?

arxiv:arxiv-agents — Zhi Chen, Zhensu Sun, Yuling Shi, David Lo, Lingxiao Jiang 8/10 evalscode-agents
This sharp audit questions the reliability of popular performance-optimization benchmarks like GSO and SWE-Perf. The authors found that reference patches often fail their own validity rules when replayed on different cloud machines, with SWE-Perf being especially fragile. Leaderboard rankings are also unstable, sensitive to arbitrary scoring rules that can give huge weight to a few tasks. Perhaps most damning, at least one public submission already matches or beats the official reference patch on 85.3% of the tasks analyzed.

Blogs

2

Autoresearch: The feedback loop behind self-improving agents

rss:latent-space — Richard MacManus 6/10 code-agentsmulti-agentplanning
In an interview, Introspection co-founder Roland Gavrilescu discusses "autoresearch," the company's approach to building self-improving agent systems. The core idea involves creating agent "recipes" that define tasks, which are then refined through feedback loops. While the goal is increased automation, Gavrilescu emphasizes that humans remain central to defining the high-level goals and architecture of these software-producing agent factories. The piece offers high-level patterns rather than deep technical specifics.

How Cursor deploys AI inside the enterprise

rss:latent-space — Richard MacManus 6/10 code-agentsdevops-agents
This interview with Cursor's Pauline Brunet outlines their "Forward Deployed Engineer" model for enterprise agent adoption. The FDE team acts as a bridge, helping companies set up internal "software factories" powered by AI agents. They identify high-value use cases, integrate with existing dev workflows, and essentially product-manage the initial agent deployments. The approach mirrors Palantir's model, focusing on high-touch services to solve the last-mile problem of getting agents to work inside complex organizations.
24 more items the ranker flagged but didn't feature

Papers

Blogs