All notes
In this note (8 sections)
Production Jun 15, 2026Updated Jul 6, 2026 10 min

Agentic AI content quality: 5 agents, one pipeline.

Last updated on Jul 6, 2026

Separate eval from rewrite, route models per agent, guard inputs and outputs. Run it on every page before publish.

Introduction

I built this pipeline after watching a client ship "optimized" landing pages where the eval agent invented passing scores for content it had also rewritten. The model was grading its own homework. Separation of read and write fixed that in one sprint.

Five agents, one fixed order, guardrails on both ends. It handles GEO (Generative Engine Optimization) and SEO quality for pages before they go live. The orchestration pattern is similar to what I describe in supervisor vs handoffs multi-agent systems, with explicit role boundaries.

The five agents

Agent roles and separation rule
AgentJobRead/Write
OrchestratorRoute tasks, manage stateNeither (directs only)
CORE Evaluator40 GEO criteria (C-O-R-E)Read only
EEAT Evaluator40 SEO criteria (E-E-A-T)Read only
Schema ValidatorJSON-LD and HTML semanticsRead only
Rewrite AgentFailing sections onlyWrite only

CORE, EEAT, and Schema run in parallel. Rewrite runs after eval completes. That cuts runtime about 60% versus sequential eval.

Model routing per agent

Do not run Opus on every step. Roughly 80% of calls stay on Haiku and Sonnet.

  • Orchestrator: Sonnet 4.6 for tool routing and state management.
  • CORE Evaluator: Sonnet 4.6 for 40-item structured eval and reliable function calling.
  • EEAT Evaluator: Haiku 4.5 for binary pattern checks at one-fifth Sonnet cost.
  • Schema Validator: Haiku 4.5 for deterministic JSON-LD classification.
  • Rewrite Agent: Opus 4.7 only on failing sections, with self-check every rewrite.

The cost rule matches what I cover in stop paying frontier prices for classification: one frontier call per failing section, not per page.

Input guardrails (zero tokens on bad inputs)

  • URL reachability: abort 404, 403, timeout within 200ms.
  • Content type detection: blog, FAQ, guide, landing. Wrong type means wrong rubric.
  • Content length floor: below 300 words, skip E and R dimensions.
  • Language detection: non-English scoped out before any model call.

Output guardrails (broken output never leaves)

  1. 01
    Score integrity
    Recalculate scores independently. If divergence exceeds 5 points, re-run eval.
  2. 02
    Fix completeness
    Every Fail must have a Fix. Orphan failures force a rewrite pass.
  3. 03
    Citation verification
    Fetch rewrite URLs. Remove non-200 links before delivery.
  4. 04
    Rewrite self-check
    Max 2 loops per section. Opus checks its own output against the criterion.
  5. 05
    Schema validation
    Strip invalid JSON-LD and flag for manual fix.

Three memory layers

Not one context dump. Three layers keep tokens lean.

  • CAG (cached in prompt): 80-item benchmarks, error patterns, schema mapping. Stable for months. ~90% cost reduction on cache hit.
  • RAG (retrieved at eval): schema.org specs and rewrite examples by criterion ID. Only 2–3 specs per run.
  • Session context: page content, eval results, rewrite task list. Cleared after every run, never persisted.

Memory layer choice follows the same rules as wrong memory, dead agent: CAG for stable rubrics, RAG for specs that change, session for ephemeral task state.

The fixed pipeline order

  1. 01
    Validate input
    Four input guardrails. Zero cost on bad URLs, wrong language, thin content.
  2. 02
    Evaluate in parallel
    CORE, EEAT, Schema simultaneously.
  3. 03
    Score and sort
    GEO-first failures first, then dual failures, then SEO-first.
  4. 04
    Rewrite to spec
    Failing sections only. Opus only. Self-check every output.
  5. 05
    Validate output
    Five output guardrails. Pass/fail confidence flag against all five.

Conclusion

Run this pipeline on every piece of content before publish. Same order every time. The deliverables are dimension scores across 8 dimensions, a priority fix list sorted by GEO impact, rewritten failing sections, and a pass/fail flag. Build it once, run it forever.

Key takeaways

  • 1Separating evaluation from rewriting cuts hallucinated scores roughly 3x versus one agent doing both jobs. Evaluators read only. The rewrite agent writes only. The orchestrator coordinates but never scores content.
  • 2Five agents: Orchestrator (route + state), CORE Evaluator (40 GEO criteria), EEAT Evaluator (40 SEO criteria), Schema Validator (JSON-LD + HTML semantics), Rewrite Agent (failing sections only). CORE, EEAT, and Schema run in parallel; rewrite runs after, which cuts runtime about 60%.
  • 3Route models per agent, not one frontier model for the pipeline. Sonnet 4.6 for orchestration and CORE structured eval. Haiku 4.5 for EEAT pattern checks and schema classification. Opus 4.7 only on the rewrite step. Roughly 80% of calls stay on Haiku and Sonnet.
  • 4Four input guardrails run before any model call: URL reachability (abort in ~200ms), content type detection, 300-word length floor (skip E+R on thin pages), language detection. Zero tokens on bad inputs.
  • 5Five output guardrails run before delivery: recalculate scores independently (>5pt divergence re-runs), every Fail must have a Fix, verify citation URLs, rewrite self-check with max 2 loops, validate JSON-LD against schema.org.
  • 6Three memory layers, not one context dump: CAG for stable benchmarks and rubrics (90% cost reduction on cache hit), RAG for 2-3 schema specs per run, session context for page content and eval results cleared after each run.
  • 7The fixed sequence: validate input, evaluate in parallel, score and sort (GEO-first, then dual, then SEO-first), rewrite failing sections only, validate output. Deliverables: 8 dimension scores, priority fix list, rewritten sections, pass/fail confidence flag against all output guardrails.
  • 8Run this pipeline on every piece of content before publish. Same order every time. The orchestration pattern matches what I describe in supervisor-style multi-agent systems, with explicit read/write separation at each step.

Frequently asked questions

Work with me

Need help shipping this in production?

I help teams design agent architectures, RAG pipelines, and production guardrails on consulting engagements.

Content quality pipeline consulting Agentic AI training programs
Tags
#AgenticAI#Multi-Agent#ContentQuality#GEO#SEO#EEAT#Guardrails#ModelRouting#Orchestration#Production#Schema

Get the visual notes by email

New agentic AI notes and breakdowns, plus what I am shipping for clients, one email on Thursdays.