2026-09-07
AI Agents
A controlled study asks whether an agent's memory survives a model upgrade and finds it depends entirely on format: fixed-schema knowledge graphs transfer with near-zero drift, while model-compressed notes swing by up to 13 points depending on migration direction. A separate measurement shows prefix caching plus 4-bit quantization silently changes agent trajectories on 75% of episodes. Two more papers on eval benchmarks under irreversible decisions and financial finality, plus stateful unlearning and OpenAI's take on monitoring internal coding agents.
Papers
5Forgetting Without Restarting: Execution-State Unlearning for Stateful LLM Agents
This formalizes execution-state unlearning: after a forget request, a stateful agent should behave as if it never saw the target — not just delete a plaintext memory row while summaries, tool plans, and the KV cache stay tainted. Modeling the runtime as a deterministic transition system, they prove exact unlearning needs at least T−τ+1 recomputed transitions. Provenance-Guided Selective Replay hits that bound by locating the injection point, cropping the KV cache, and replaying a sanitized suffix. Audited across three suites, nine baselines, three model families; naive deletion and instruction-based forgetting both leak fully.
Artificial Intelligence in Equity and Crypto Markets: Progress, Profitability Evidence, and the Limits of Automated Investing
A critical review of AI across equities and crypto through August 2026, organized around an 'alpha-translation chain': a signal must survive from point-in-time information to stable prediction, feasible positions, executable orders, and risk-adjusted net returns. The verdict is blunt — real progress upstream in prediction and workflow, but thin evidence for durable net alpha. Temporal contamination, survivorship, look-ahead, and execution costs repeatedly break the chain. No architecture is shown to deliver persistent, cross-regime, capacity-aware performance. Note the ranker's tag is mislabeled; this is a finance survey, not eval infrastructure.
FinalityBench: An Effect-Level Benchmark for Agent Decisions Under Delayed and Conflicting Financial Finality
FinalityBench scores agents on executed monetary effect rather than answer correctness. Four financial systems — processor, ledger, ERP, bank feed — hold contradictory beliefs while messages get delayed, dropped, reordered; an agent must ship, refund, re-capture, or wait knowing some actions are irreversible. A hidden canonical log grades the merchant's terminal position. The sharp result: 45 twin pairs are indistinguishable at decision time but require different dispositions, so single-task accuracy and paired loss disagree in 7 of 9 policies. A ship-on-first-sign policy ranks second by accuracy, worst by paired loss.
Same Request, Different Answer: Quantization Amplifies Cache-Induced Divergence in LLM Serving
Prefix caching is on by default in major serving stacks and treated as transparent. This measures otherwise: holding model, seed, decoding, and request order fixed on an 80-episode agentic tool-use workload, enabling the cache changed the agent's trajectory on 36.2% of episodes at 16-bit and 75.0% at 4-bit. Cache-disabled runs were bit-identical (0 of 800). A single server-level prompt-cache setting moves divergence 37.5 points. The cause is precise: cached serving is deterministic given cache state, but that state is absent from the request and never reset.
Does Your Agent's Memory Survive a Model Upgrade? A Controlled Study of Memory Portability
A controlled study of whether agent memory survives a model swap, comparing four storage formats: verbatim long-context, chunked RAG, model-compressed notes, and a fixed-schema knowledge graph. Fixed-schema KG transfers almost perfectly (+0.0004 accuracy after a writer swap); compressed notes swing asymmetrically by +9.91 or −13.28 points depending on migration direction. Diagnostics attribute 80% of the notes deficit to information lost at construction, and 81% of the RAG deficit to retrieval failure. Partial 50/50 re-embedding forfeits most of the gain from full re-embedding. Small models (<10B), 48 synthetic histories.
News
1How we monitor internal coding agents for misalignment
OpenAI describes how it monitors its own internal coding agents for misalignment — a rare look at production safety tooling from a lab running these systems at scale on real work. The HN thread is modest (47 points) and the post is a company writeup rather than a paper, so treat specifics accordingly, but the topic is squarely relevant: how do you detect an agent doing the wrong thing when it has host access and writes code you merge?
Blogs
1There's No Limit to How Bad Code Can Get
Simon Willison argues from experience that ground-up rewrites of tech-debt-laden systems rarely work: the old system stays a moving target because it still runs the business, its maintainers under-invest knowing it's doomed, and the rewrite team discovers nobody fully understands the behavior they're replacing — because if it were documented and tested, it wouldn't need replacing. Pressure to ship eventually forces a launch covering only a subset. Solid, familiar practitioner reasoning about migration dynamics, but no agent angle and no measurements.
24 more items the ranker flagged but didn't feature
Papers
- ARIA - An Agentic Framework for Autonomous Testing of Infotainment Systemsarxiv:arxiv-agents
- From Language Models to World-Acting Systems: Progress and Limits of Agentic AI across Digital, Social, Virtual, and Physical Environmentsarxiv:arxiv-agents
- RoboSPA: Can VLA Models Go Beyond Simple Scenes and Short-Horizon Tasks?arxiv:arxiv-agents
- Trace2Tower: Transition-Aware EigenTrace Induction of Multi-Level Skills for LLM Agentsarxiv:arxiv-agents
- Building a research-software catalog with a coding agent: from hackathon prototype to public deploymentarxiv:arxiv-agents
- A Structured Debate-Mixture-of-Agents Framework for Complex Clinical Diagnostic Decision Supportarxiv:arxiv-agents
- MABPD: Multi-Agent Bias Probing & Detection via Structured Argument Debatearxiv:arxiv-agents
- Persistent Teacher Anchoring for Tool-Using Agentsarxiv:arxiv-agents
- Software Engineering in the Agent Era From Trustworthy Change to Human Agent Software Organizationsarxiv:arxiv-software-eng
- Cost-Aware Hierarchical Multi-Agent Ransomware Detection and Family Attributionarxiv:arxiv-agents
- Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluationarxiv:arxiv-llm-systems
- RISE: Recursive Improvement via Self-Extrapolating Policy Distillationarxiv:arxiv-agents
- One Diffusion Model, Two Roles: Guided Trajectory Planning and Safety-Critical Scenario Generation in Closed-Loop Simulationarxiv:arxiv-agents
- TROVE: Adaptive Agent Skill Orchestration via Trace-Grounded Route Validation and Editingarxiv:arxiv-agents
- AutoLR: Automating the Path from Research to Launch Review in Industrial Recommender Systemsarxiv:arxiv-agents
- Beyond Code Generation: Reliability, Verification, and Cost Economics in the Agentic Software Development Lifecyclearxiv:arxiv-agents
- CABAL: Multi-Agent Simulacra for Tracing the Effects of Collusive Bidding in Peer Reviewarxiv:arxiv-agents
- How Developers Discuss Generative AI: A Longitudinal Study of the Visual Studio Code Communityarxiv:arxiv-software-eng
- Dynamic Adaptation of the LLM Context for Generating Routines with Coupled Semanticsarxiv:arxiv-software-eng
- Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignmentarxiv:arxiv-agents
- TruthInsightBench: An Evidence-Grounded Benchmark for Automated Evaluation of Open-Ended Scientific Discovery Agentsarxiv:arxiv-agents
- ElderBench: Benchmarking Autonomous Mobile Agents for Older Adultsarxiv:arxiv-agents