Applied Intelligenceby Arseny Gorokh · @agorokh
applied AI research · independent
in this issue ·ai-14 ·applied research note ·8 oct 2026 ·26 min read

The loop learned slowly from corrections and faster from verdicts.where a self-improvement loop's learning signal comes from, measured on one governed agent fleet through week 41, and what to feed your own.

Every agent program that learns from its own operation is already choosing what the loop consumes: the judgments people type when an agent goes wrong, or the machine's own verdicts about execution, a timeout, a non-zero exit, a refused command. I ran both channels on one governed fleet and measured the yield of each through calendar week 41. Adjudicated corrections produced one new behavioural rule from about twenty candidates escalated over eleven weeks and did real work as a filter; the July A/B this series owed its readers measured the mined generic rules as neutral to harmful, and three were archived. Execution friction, ranked by how many sessions paid for each failure and validated on held-out weeks, found the fleet's most expensive recurring defect and re-found it unprompted on a second corpus. The loop's first unattended selection was rejected with reasons; its first learner-selected fix measured 28 tool calls down to 11 across six trials per arm on one task, under a rule frozen before the trial; a second candidate measured no benefit and was withheld. The five-state ledger with every column dated, what is and is not established, and a one-week exercise plus a checklist an enterprise agent program can adopt now.

Read the note  ›
1 of ~20
candidate behavioural rules mined from operator corrections over eleven weeks and adopted after adjudication, across 22 panel verdicts written in the weeks after the last note. The rest were duplicates, noise, or single quotes.
0 of 7
generic mined rules that helped past the retirement floor in a real-agent A/B; every effect past the floor was harmful and three were archived. Promised in July as queued, published in this note.
58 of 207
foreground waits for pull-request state that failed in the held-out weeks, across eighteen sessions and three models, about 390 minutes lost. The first defect the friction method surfaced; its fix was delivered by applying the method by hand.
28 to 11
total tool calls across six trials per arm to finish one legitimate commit, before and after the first learner-selected fix, on one model under a rule frozen before the trial; the guarded restriction held in every valid control.

the archive

every note carries one folio. the magnitudes are corpus-specific; the structural claims are what transfer.
ai-148 oct 2026learning signal The loop learned slowly from corrections and faster from verdicts.Two learning channels on one governed fleet, measured through week 41: adjudicated operator corrections yielded one new rule from about twenty candidates escalated over eleven weeks and worked as a filter; the July A/B measured the mined generic rules as neutral to harmful; execution friction ranked by recurrence found the fleet's most expensive recurring defect, and the first learner-selected fix measured 28 tool calls down to 11 across six trials per arm under a frozen rule. The five-state ledger with every column dated, and a one-week exercise plus a checklist for enterprise agent programs. 26 min ai-1320 aug 2026governance stress test Governance is a metabolism, not a manifest.A deliberate stress test of agent governance on one production fleet: three deletions with the measurement behind each; the selection rule that decides what survives, bind to a named enforcer with a planted-violation proof, or expire; the self-hosted review daemon earning its life; and a dated audit of the previous note's claim, ratified and twice qualified. 13 min ai-1214 aug 2026agent memory An agent learns to remember in the harness, not the weights.Every agent program makes the memory bet; almost none measures it at the moment of use. I measured mine: the same convention went eight of eight delivered as versioned harness context and one of eight through the live retrieval layer, which added zero over a disciplined harness. The channel is the finding. The harness specified, and the two-week decision rule for your own stack. 12 min ai-1125 jul 2026self-improvement Self-improvement is an actuation problem.A weekly loop mines the operator's corrections out of fleet transcripts into versioned behavioural policy. The audit that found the loop was not closing without a human, the held-out acceptance gate that replaced the per-change reviewer, and three unattended weekly cycles honestly reported, including the one that ran green and blind. 13 min ai-094 jul 2026agent verification "It's done." The most expensive tokens an agent produces.Agent completion as a validated workspace state, independently replicated with a different agent family on the authors' released harness, unmodified; four refusals on the way, every one a real method error, and the science explicitly separated from the five practices an enterprise agent program can adopt now. 12 min ai-082 jul 2026engineering memory The meeting forgets. The pull request remembers.Conventional engineering culture discards the reasoning behind its decisions at a measured, well-documented rate; an agent-first workflow preserves the chain as queryable artifacts and enforces the reading. The measured half, the hypothesis half, and the falsifiers. 11 min ai-0730 jun 2026model routing Three open models drove Claude Code through its governance gatesGLM 5.2, Qwen 3.7 Plus, and Kimi K2.7 Code solved an identical fix perfectly, so they separate only under governance friction; a scan of 627 sessions found zero faked-compliance and exonerated the model the first read accused. 14 min ai-0613 jun 2026agent data MCP harvesting: trustworthy data when your agent has a connector, not an APIAn agent that can only reach a system through a flaky MCP connector treats its output as evidence to check, not a value to trust; an entailment gate caught 98 percent of unsupported claims where a similarity gate caught 27. 18 min ai-055 jun 2026agent memory A memory-and-policy layer above the model: the build-versus-buy caseA gateway routes a prompt but does not know the repository, policy, or budget; own the in-path layer that governs memory, policy, and cost while the model stays swappable, and prove it ports across providers. 12 min ai-0419 may 2026memory substrate Choosing the memory substrate for enterprise agents: LightRAG, Graphiti, and the weighting that decidesTwo purpose-built substrates and a filesystem baseline against a five-criterion adoption bar on an SDLC corpus; production weighting separates them by 36 points where uniform weighting calls it a tie, and the entity graph fabricated four times where the chunk-text retriever never did. 14 min ai-0315 may 2026agent telemetry Claude Code through DIAL: eight models, 192 runs, and metering every requestA POC connecting Claude Code to DIAL across eight models; the cheapest that passes everything is open-source, and the routing adapter meters every request for a per-project view of AI-coding cost. 17 min ai-0214 may 2026open models Which models can run Claude Code through DIAL? Five upstreams, and the costThree Anthropic tiers and two open Qwen coders through one gateway; an open 480B passed every task at $0.101 each, the cheapest of the field, and capability tracks scale, not vendor. 16 min ai-0128 apr 2026ingest model Picking the extraction LLM for knowledge-graph ingestion: breadth beats densityEleven models measured as the entity-extraction LLM for a knowledge-graph RAG system; Gemini 2.5 Flash cleared every retrieval cell at roughly three percent of the strongest commercial model's ingest cost, because breadth of extraction beats density of relations. 16 min

An applied-AI reading style, for work that has to survive diligence.

Applied Intelligence is an independent practitioner publication. Each note takes one piece of real engineering, an agent, an adapter, a gateway, a gate, and reports what held and what did not, with the magnitudes kept honest and the structural claims stated so another team can re-derive them.

The register is deliberate: calm on the surface, hard engineering underneath. A finding leads; the evidence follows; the method and the limits sit where a reader can check them. The companion repositories are artefacts, one click away, never decoration: sdlc-dial-adapter and agentic-memory-mcp.

Written by Arseny Gorokh. The notes draw on real systems and name the public platforms they study; all client-specific material is excluded, and the notes are not official publications of any employer.

the publication
notes13
latestai-14
registerapplied AI research
set inNewsreader
elsewhere
An Applied Intelligence publication · independent · 2026 by Arseny Gorokh Set in Newsreader & Spline Sans Mono · the Applied Intelligence reading style