2026-05-25

AI Agents

This week's coverage converges on agent trustworthiness in production: evidence verification, contractual boundaries, failure taxonomies, and the human cost of AI-generated slop. The field is moving from capability demos to auditable, reliable systems.

5 papers 3 news 3 blogs 85 appendix 488 considered

Papers

5

Training Language Agents to Learn from Experience

arxiv:arxiv-llm-systems — Yuval Shalev, Zifeng Ding, Mateja Jamnik 10/10 researchframeworksmemory
Current reflection methods only self-correct within single tasks. This paper introduces In-context Training, where a reflector model observes actor trajectories and generates system prompts to improve future unseen tasks. An RL pipeline learns reflections without human examples. Trained reflectors outperform baselines on ALFWorld and MiniHack, with some generalization to different environments. MetaGym library enables future research.

Contractual Skills: A GovernSpec Design Framework for Enterprise AI Agents

arxiv:arxiv-software-eng — Ting Liu 10/10 frameworkssafetytool-use
Enterprise skills need more than task guidance—they require inspectable goals, input boundaries, permissions, evidence requirements, output contracts, and human approval points. This GovernSpec-inspired framework organizes SKILL.md files as readable task contracts. Evaluation shows contractual skills outperform no-skill baselines across models, with gains mainly in checkability and maintainability rather than raw generation quality.

Parallel Context Compaction for Long-Horizon LLM Agent Serving

arxiv:arxiv-agents — Musa Cim, Burak Topcu, Chita Das, Mahmut Taylan Kandemir 10/10 infracost-latencymemory
Long-horizon agents accumulate histories exceeding context windows. LLM summarization is lossy and blocks inference for seconds, with unpredictable output volume. Parallel compaction gives operators fine-grained control over summary volume and enables targeted prompt engineering per block. Evaluated across four backbones from 8B to 120B parameters, it reduces wall time and improves throughput at matched decode volume versus sequential baselines.

AgentAtlas: Beyond Outcome Leaderboards for LLM Agents

arxiv:arxiv-llm-systems — Parsa Mazaheri, Kasra Mazaheri 10/10 evalsresearchframeworks
Agent benchmarks fragment across success rates, tool validity, trajectory safety, and attack robustness. AgentAtlas proposes a six-state control taxonomy, nine-category trajectory failure taxonomy, taxonomy-aware versus blind methodology, and benchmark coverage audit. Testing eight models shows removing explicit label menus drops trajectory accuracy 14-40 percentage points to a 0.54-0.62 floor regardless of model family.

News

3

Constraint Decay: The Fragility of LLM Agents in Back End Code Generation

hn:hn-agent — wek 10/10 code-agentssafetyevals
This HN-discussed paper analyzes failure modes when LLM agents generate backend code. The title suggests agents lose constraint adherence over longer generation tasks, creating reliability risks for production deployment. With 246 points and 143 comments, the community recognizes this as a critical safety concern for code agents operating in real systems.

DeepSeek reasonix, DeepSeek native coding agent with high caching and low cost

hn:hn-agent — Alifatisk 7/10 code-agentscost-latency
A community-built DeepSeek wrapper optimizes for production costs through aggressive caching. The thread notes DeepSeek made V4 Pro pricing discounts permanent, signaling competitive pressure on inference costs. 585 HN points suggest strong developer interest in cost-effective coding agents for production workloads.

Claude is not your architect. Stop letting it pretend

hn:hn-claude — cdrnsf 6/10 code-agentsplanning
An opinion piece argues against delegating architectural decisions to Claude. The HN discussion reflects ongoing tension between agent capability claims and actual system design responsibility. Lower engagement suggests the community wants concrete engineering data over positional arguments about agent limitations.

Blogs

3

datasette-agent 0.1a4

rss:simonw 9/10 code-agentstool-use
Datasette-agent 0.1a4 integrates the agent chat interface directly into Datasette's Jump menu, triggered by hitting /. Users initiate conversations that execute data operations like counting entries, with results returned inline. The demo runs on agent.datasette.io with GitHub authentication. This represents a practical tool-use pattern where the agent operates within an existing data exploration workflow rather than as a standalone chatbot.

The memory shortage is causing a repricing of consumer electronics

rss:simonw 7/10 infracost-latency
David Oks explains how AI datacenter demand is reshaping memory economics. HBM now claims 20% of wafer capacity versus 2% previously, and each HBM gigabyte consumes 3x the wafer space of DDR or LPDDR. With only three major memory manufacturers preferring under-provisioning, consumer device RAM faces multi-year constraints. Budget smartphones in emerging markets feel this first.

Quoting Armin Ronacher

rss:simonw 7/10 code-agentssafety
Armin Ronacher documents a production failure mode: AI-generated issue reports that lack human voice and contain confident but inaccurate root cause analysis. These slop issues include fake minimal repros and wrong code analogies. He requests issue reports condense to: what command ran, what was expected, what happened, and the exact error log.
85 more items the ranker flagged but didn't feature

Papers

Blogs