2026-07-02
AI Agents
An audit of popular code-optimization benchmarks finds their results are often unstable and rankings depend heavily on arbitrary scoring rules. Another paper introduces a transactional model for agent safety that treats all generated actions as untrusted proposals until validated. Today's research also covers trainable memory, legacy code rescue, and runtime-guided bug fixing.
Papers
5AutoMem: Automated Learning of Memory as a Cognitive Skill
This paper frames memory management not as a fixed architecture, but as a trainable skill. AutoMem introduces a dual-loop system. The first loop has a powerful LLM meta-review agent trajectories to iteratively improve the memory structure (file schemas, action vocabulary). The second loop identifies and reinforces the agent's good memory decisions, fine-tuning its proficiency. On long-horizon tasks like NetHack, optimizing memory alone boosted a 32B model's performance by 2x-4x, making it competitive with much larger frontier models.
RepoRescue: An Empirical Study of LLM Agents on Whole-Repository Compatibility Rescue
This paper introduces RepoRescue, a benchmark for the practical task of updating old repositories to run in modern environments. The setup is realistic: an agent is given a repo that passed its tests historically but now fails, and it must produce a patch. The evaluation is rigorous, including a runtime-enforced mode that blocks agents from editing the test files. Under these conditions, Kimi still rescues 41.5% of Python repos. The study also finds different agent systems are complementary, suggesting an ensemble could be highly effective.
SWE-Doctor: Guiding Software Engineering Agents with Runtime Diagnosis from Multi-Faceted Bug Reproduction Tests
Standard software engineering agents can be misled by bug reproduction tests (BRTs). This paper introduces SWE-Doctor, which finds that naively using BRTs leads to partial or incorrect fixes. Instead, SWE-Doctor generates multiple BRTs for different aspects of a reported issue, executes them to create runtime diagnosis records, and then feeds these diagnoses to the patch generation agent. This runtime grounding provides a much richer signal, significantly improving bug-fixing performance on SWE-bench across five different agent backends.
Mnemosyne: Agentic Transaction Processing for Validating and Repairing AI-generated Workflows
How do you trust a workflow when any step can be an LLM hallucination? This paper proposes Agentic Transaction Processing (ATP), a model implemented in the Mnemosyne runtime. It treats all agent-generated actions as untrusted proposals that are only committed to state after passing a set of deterministic, executable constraints. This separates the competence of the proposing agent from the correctness of the committed state. The system includes proven safety guarantees and a protocol for localized, bounded reactive repairs.
Are Performance-Optimization Benchmarks Reliably Measuring Coding Agents?
This sharp audit questions the reliability of popular performance-optimization benchmarks like GSO and SWE-Perf. The authors found that reference patches often fail their own validity rules when replayed on different cloud machines, with SWE-Perf being especially fragile. Leaderboard rankings are also unstable, sensitive to arbitrary scoring rules that can give huge weight to a few tasks. Perhaps most damning, at least one public submission already matches or beats the official reference patch on 85.3% of the tasks analyzed.
Blogs
2Autoresearch: The feedback loop behind self-improving agents
In an interview, Introspection co-founder Roland Gavrilescu discusses "autoresearch," the company's approach to building self-improving agent systems. The core idea involves creating agent "recipes" that define tasks, which are then refined through feedback loops. While the goal is increased automation, Gavrilescu emphasizes that humans remain central to defining the high-level goals and architecture of these software-producing agent factories. The piece offers high-level patterns rather than deep technical specifics.
How Cursor deploys AI inside the enterprise
This interview with Cursor's Pauline Brunet outlines their "Forward Deployed Engineer" model for enterprise agent adoption. The FDE team acts as a bridge, helping companies set up internal "software factories" powered by AI agents. They identify high-value use cases, integrate with existing dev workflows, and essentially product-manage the initial agent deployments. The approach mirrors Palantir's model, focusing on high-touch services to solve the last-mile problem of getting agents to work inside complex organizations.
24 more items the ranker flagged but didn't feature
Papers
- Multi-scale Mixture of World Models for Embodied Agents in Evolving Environmentsarxiv:arxiv-agents
- Towards Better Linux Kernel Fault Localization: Leveraging Contrastive Reasoning and Hierarchical Context Analysisarxiv:arxiv-software-eng
- Large Language Models for Multi-Lingual Equivalent Mutant Detection: An Extended Empirical Studyarxiv:arxiv-software-eng
- ASPIRE: Agentic /Skills Discovery for Roboticsarxiv:arxiv-agents
- Autonomous Scientific Discovery via Iterative Meta-Reflectionarxiv:arxiv-agents
- From Personas to Plot: Character-Grounded Multi-Agent Story Generation for Long-Form Narrativesarxiv:arxiv-agents
- Adversarial Pragmatics for AI Safety Evaluation: A Benchmark for Instruction Conflict, Embedded Commands, and Policy Ambiguityarxiv:arxiv-agents
- AutoRestTest at the SBFT 2026 Tool Competitionarxiv:arxiv-software-eng
- VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinementarxiv:arxiv-agents
- From Signals to Structure: How Memory Architecture Drives Language Emergence in LLM Agentsarxiv:arxiv-agents
- Rise From The Ashes: LLM-based Static Analysis for Deep Learning Framework Bugsarxiv:arxiv-software-eng
- EPC: A Standardized Protocol for Measuring Evaluator Preference Dynamics in LLM Agent Systemsarxiv:arxiv-llm-systems
- DigitalCoach: Communication and Grounding Gaps in Human and Agentic Computer Use Coachingarxiv:arxiv-agents
- Cheap Code, Costly Judgment: A Case Study on Governable Agentic Software Engineeringarxiv:arxiv-agents
- Coachable agents for interactive gameplayarxiv:arxiv-agents
- Optimal Resource Utilization for Autonomous Laboratory Orchestratorsarxiv:arxiv-agents
- PHREEQC-MCQ-200: A Diagnostic Benchmark for Tool-Augmented Scientific Simulator Agentsarxiv:arxiv-agents
- LLM-Guided ODE Discovery and Parameter Inference from Small-Cohort Aggregate Dataarxiv:arxiv-agents
- AGI Maze as a Benchmark Framework for World-Modeling Agentsarxiv:arxiv-agents
- Managed Autonomy at Runtime: Gear-Based Safety and Governance for Single- and Multi-Agent Cyber-Physical Systemsarxiv:arxiv-agents
- Agentic generation of verifiable rules for deterministic, self-expanding reaction classificationarxiv:arxiv-agents
- Bayesian Uncertainty Propagation for Agentic RAG Pipelines: A Proof-of-Concept Study on Multi-Hop Question Answeringarxiv:arxiv-agents