2026-05-25
AI Agents
This week's coverage converges on agent trustworthiness in production: evidence verification, contractual boundaries, failure taxonomies, and the human cost of AI-generated slop. The field is moving from capability demos to auditable, reliable systems.
Papers
5EVE-Agent: Evidence-Verifiable Self-Evolving Agents
EVE-Agent: Evidence-Verifiable Self-Evolving Agents
Training Language Agents to Learn from Experience
Current reflection methods only self-correct within single tasks. This paper introduces In-context Training, where a reflector model observes actor trajectories and generates system prompts to improve future unseen tasks. An RL pipeline learns reflections without human examples. Trained reflectors outperform baselines on ALFWorld and MiniHack, with some generalization to different environments. MetaGym library enables future research.
Contractual Skills: A GovernSpec Design Framework for Enterprise AI Agents
Enterprise skills need more than task guidance—they require inspectable goals, input boundaries, permissions, evidence requirements, output contracts, and human approval points. This GovernSpec-inspired framework organizes SKILL.md files as readable task contracts. Evaluation shows contractual skills outperform no-skill baselines across models, with gains mainly in checkability and maintainability rather than raw generation quality.
Parallel Context Compaction for Long-Horizon LLM Agent Serving
Long-horizon agents accumulate histories exceeding context windows. LLM summarization is lossy and blocks inference for seconds, with unpredictable output volume. Parallel compaction gives operators fine-grained control over summary volume and enables targeted prompt engineering per block. Evaluated across four backbones from 8B to 120B parameters, it reduces wall time and improves throughput at matched decode volume versus sequential baselines.
AgentAtlas: Beyond Outcome Leaderboards for LLM Agents
Agent benchmarks fragment across success rates, tool validity, trajectory safety, and attack robustness. AgentAtlas proposes a six-state control taxonomy, nine-category trajectory failure taxonomy, taxonomy-aware versus blind methodology, and benchmark coverage audit. Testing eight models shows removing explicit label menus drops trajectory accuracy 14-40 percentage points to a 0.54-0.62 floor regardless of model family.
News
3Constraint Decay: The Fragility of LLM Agents in Back End Code Generation
This HN-discussed paper analyzes failure modes when LLM agents generate backend code. The title suggests agents lose constraint adherence over longer generation tasks, creating reliability risks for production deployment. With 246 points and 143 comments, the community recognizes this as a critical safety concern for code agents operating in real systems.
DeepSeek reasonix, DeepSeek native coding agent with high caching and low cost
A community-built DeepSeek wrapper optimizes for production costs through aggressive caching. The thread notes DeepSeek made V4 Pro pricing discounts permanent, signaling competitive pressure on inference costs. 585 HN points suggest strong developer interest in cost-effective coding agents for production workloads.
Claude is not your architect. Stop letting it pretend
An opinion piece argues against delegating architectural decisions to Claude. The HN discussion reflects ongoing tension between agent capability claims and actual system design responsibility. Lower engagement suggests the community wants concrete engineering data over positional arguments about agent limitations.
Blogs
3datasette-agent 0.1a4
Datasette-agent 0.1a4 integrates the agent chat interface directly into Datasette's Jump menu, triggered by hitting
/. Users initiate conversations that execute data operations like counting entries, with results returned inline. The demo runs on agent.datasette.io with GitHub authentication. This represents a practical tool-use pattern where the agent operates within an existing data exploration workflow rather than as a standalone chatbot.The memory shortage is causing a repricing of consumer electronics
David Oks explains how AI datacenter demand is reshaping memory economics. HBM now claims 20% of wafer capacity versus 2% previously, and each HBM gigabyte consumes 3x the wafer space of DDR or LPDDR. With only three major memory manufacturers preferring under-provisioning, consumer device RAM faces multi-year constraints. Budget smartphones in emerging markets feel this first.
Quoting Armin Ronacher
Armin Ronacher documents a production failure mode: AI-generated issue reports that lack human voice and contain confident but inaccurate root cause analysis. These slop issues include fake minimal repros and wrong code analogies. He requests issue reports condense to: what command ran, what was expected, what happened, and the exact error log.
85 more items the ranker flagged but didn't feature
Papers
- Whose Good, Whose Place? The Moral Geography of Agentic AI for Social Goodarxiv:arxiv-agents
- JEDI: Java Evaluation of Declarative and Imperative Queriesarxiv:arxiv-software-eng
- Deterministic vs. Probabilistic Summarisation: An Empirical Trade-off Study in Design Pattern Centric Java Codearxiv:arxiv-software-eng
- AI Assurance: A Comprehensive Testing Strategy for Enterprise AI Systemsarxiv:arxiv-agents
- Leveraging LLMs for Grammar Adaptation: A Study on Metamodel-Grammar Co-Evolutionarxiv:arxiv-software-eng
- PITMuS: A Tool for Automated Bug Dataset Generation via Source-Level Mutant Reconstructionarxiv:arxiv-software-eng
- PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAarxiv:arxiv-agents
- Towards a General Intelligence and Interface for Wearable Health Dataarxiv:arxiv-agents
- Socially fluent AI decouples conversational signals from source identity in online interactionarxiv:arxiv-agents
- Advancing Mathematics Research with AI-Driven Formal Proof Searcharxiv:arxiv-agents
- "Refactoring Runaway": Understanding and Mitigating Tangled Refactorings in Coding Agents for Issue Resolutionarxiv:arxiv-software-eng
- Finding Missing Input Validation in TEEs via LLM-Assisted Symbolic Executionarxiv:arxiv-software-eng
- Deep Reinforcement Learning for Flexible Job Shop Scheduling with Random Job Arrivalsarxiv:arxiv-agents
- DeltaBox: Scaling Stateful AI Agents with Millisecond-Level Sandbox Checkpoint/Rollbackarxiv:arxiv-agents
- FAME: Failure-Aware Mixture-of-Experts for Message-Level Log Anomaly Detectionarxiv:arxiv-software-eng
- Co-ReAct: Rubrics as Step-Level Collaborators for ReAct Agentsarxiv:arxiv-agents
- DART: Semantic Recoverability for Structured Tool Agentsarxiv:arxiv-agents
- One Policy, Infinite NPCs: Persona-Traceable Shared RL Policies for Scalable Game Agentsarxiv:arxiv-agents
- Security of LLM-generated Code: A Comparative Analysisarxiv:arxiv-software-eng
- MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systemsarxiv:arxiv-agents
- Ratchet: A Minimal Hygiene Recipe for Self-Evolving LLM Agentsarxiv:arxiv-llm-systems
- Auto-Dreamer: Learning Offline Memory Consolidation for Language Agentsarxiv:arxiv-llm-systems
- LCGuard: Latent Communication Guard for Safe KV Sharing in Multi-Agent Systemsarxiv:arxiv-agents
- HarnessAPI: A Skill-First Framework for Unified Streaming APIs and MCP Toolsarxiv:arxiv-agents
- EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generationarxiv:arxiv-agents
- Human-in-the-Loop Multi-Agent Ventilator Decision Support with Contextual Bandit Preference Learningarxiv:arxiv-agents
- 6G Communication Networks Enabling Embodied Agents: Architecture and Prototypearxiv:arxiv-agents
- From Raw Experience to Skill Consumption: A Systematic Study of Model-Generated Agent Skillsarxiv:arxiv-agents
- Redrawing the AI Map: A Theory of Accountability Boundaries in Agentic Ecosystemsarxiv:arxiv-agents
- Beyond Acoustic Emotion Recognition: Multimodal Pathos Analysis in Political Speech Using LLM-Based and Acoustic Emotion Modelsarxiv:arxiv-agents
- Understanding Goal Generalisation in Sequential Reinforcement Learningarxiv:arxiv-agents
- Blind Spots in the Guard: How Domain-Camouflaged Injection Attacks Evade Detection in Multi-Agent LLM Systemsarxiv:arxiv-llm-systems
- LLM Code Smells: A Taxonomy and Detection Approacharxiv:arxiv-software-eng
- Are Frontier LLMs Ready for Cybersecurity? Evidence for Vertical Foundation Models from Dual-Mode Vulnerability Benchmarksarxiv:arxiv-agents
- ARMS: Automatic Reward Shaping for Sparse-Reward Multi-Agent Reinforcement Learningarxiv:arxiv-agents
- Design and Report Benchmarks for Knowledge Workarxiv:arxiv-agents
- DRL-Driven Edge-Aware Utility Optimization for Multi-Slice 6G Networksarxiv:arxiv-agents
- Benchmarking Autonomous Agents against Temporal, Spatial, and Semantic Evasionsarxiv:arxiv-software-eng
- SWE-Mutation: Can LLMs Generate Reliable Test Suites in Software Engineering?arxiv:arxiv-software-eng
- Positional Failures in Long-Context LLMs: A Blind Spot in Reasoning Benchmarksarxiv:arxiv-agents
- Infra-Bayesian Reinforcement Learning Agents Outperform Classical RL For Worst-Case Robustnessarxiv:arxiv-agents
- Foundation Protocol: A Coordination Layer for Agentic Societyarxiv:arxiv-agents
- VeriScale: Adversarial Test-Suite Scaling for Verifiable Code Generationarxiv:arxiv-software-eng
- Classical State Preparation for Variational Quantum Algorithms via Reinforcement Learningarxiv:arxiv-agents
- Goal-Conditioned Agents that Learn Everything All at Oncearxiv:arxiv-agents
- PrefBench: Evaluating Zero-Shot LLM Agents in Hidden-Preference Personalized Pricing Negotiationsarxiv:arxiv-llm-systems
- Superhuman Safe and Agile Racing through Multi-Agent Reinforcement Learningarxiv:arxiv-agents
- Mem-$π$: Adaptive Memory through Learning When and What to Generatearxiv:arxiv-llm-systems
- Curriculum reinforcement learning with measurable task representation learningarxiv:arxiv-agents
- Automated Repair of TEE Partitioning Issues via DSL-Guided and LLM-Assisted Patchingarxiv:arxiv-software-eng
- DeferMem: Query-Time Evidence Distillation via Reinforcement Learning for Long-Term Memory QAarxiv:arxiv-llm-systems
- SkillOpt: Executive Strategy for Self-Evolving Agent Skillsarxiv:arxiv-agents
- MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detectionarxiv:arxiv-agents
- A measurement substrate for agentic Kubernetes operations: Methodology and a case study in retrieval-compounding falsificationarxiv:arxiv-agents
- FastKernels: Benchmarking GPU Kernel Generation in Productionarxiv:arxiv-agents
- From Patches to Trajectories: Privileged Process Supervision for Software-Engineering Agentsarxiv:arxiv-software-eng
- CHRONOS: Temporally-Aware Multi-Agent Coordination for Evolving Data Marketplacesarxiv:arxiv-agents
- Push Your Agent: Measuring and Enforcing Quantitative Goal Persistence in Long-Horizon LLM Agentsarxiv:arxiv-software-eng
- When Planning Fails Despite Correct Execution: On Epistemic Calibration for LLM-Based Multi-Agent Systemsarxiv:arxiv-agents
- MadEvolve: Evolutionary Optimization of Trading Systems with Large Language Modelsarxiv:arxiv-agents
- What Training Data Teaches RL Memory Agents: An Empirical Study of Curriculum Effects in Memory-Augmented QAarxiv:arxiv-llm-systems
- FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproductionarxiv:arxiv-software-eng
- Quality and Security Signals in AI-Generated Python Refactoring Pull Requestsarxiv:arxiv-software-eng
- PhotoFlow: Agentic 3D Virtual Photography Missionsarxiv:arxiv-agents
- A Proactive Multi-Agent Dialogue Framework for Assessing Social Language Disorder Traits in Autismarxiv:arxiv-agents
- ASSEMBLAGE-DEEPHISTORY: A Cross-Build Binary Dataset with Temporal Coveragearxiv:arxiv-software-eng
- Benchmarking and Improving Monitors for Out-Of-Distribution Alignment Failure in LLMsarxiv:arxiv-software-eng
- Inductive Deductive Synthesis: Enabling AI to Generate Formally Verified Systemsarxiv:arxiv-agents
- MileStone: A Multi-Objective Compiler Phase Ordering Framework for Graph-based IR-Level Optimizationarxiv:arxiv-software-eng
- Why Are Agentic Pull Requests Merged or Rejected? An Empirical Studyarxiv:arxiv-software-eng
- MemGym: a Long-Horizon Memory Environment for LLM Agentsarxiv:arxiv-llm-systems
- Quality-Assured Fuzz Harness Generation via the Four Principles Frameworkarxiv:arxiv-software-eng
- Agentic Proving for Program Verificationarxiv:arxiv-agents
- Diagnosis Is Not Prescription: Linguistic Co-Adaptation Explains Patching Hazards in LLM Pipelinesarxiv:arxiv-llm-systems
- Philosophical Dispositions as Behavioral Constraints for AI-Assisted Code Review: An Empirical Studyarxiv:arxiv-agents
- GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Modelsarxiv:arxiv-agents
- The Deterministic Horizon: Impossibility Results as Design Specifications for Trustworthy AI Systemsarxiv:arxiv-agents
- OpenSkillEval: Automatically Auditing the Open Skill Ecosystem for LLM Agentsarxiv:arxiv-llm-systems
- SynAE: A Framework for Measuring the Quality of Synthetic Data for Tool-Calling Agent Evaluationsarxiv:arxiv-llm-systems
- Mix-Quant: Quantized Prefilling, Precise Decoding for Agentic LLMsarxiv:arxiv-llm-systems
- Sibyl-AutoResearch: Autonomous Research Needs Self-Evolving Trial-and-Error Harnesses, Not Paper Generatorsarxiv:arxiv-software-eng
- AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoveryarxiv:arxiv-agents
Blogs
- datasette-fixtures 0.1a0rss:simonw
- Mad House — Usborne Creepy Computer Gamesrss:simonw
- datasette 1.0a30rss:simonw