Share E-Book
Scan to open this page

Scan with your phone to open this page

Author: Nicole Koenigstein

Rating No ratings yet

This book addresses what most books avoid: how to design, deploy, and maintain autonomous LLM agents that actually work in the real world. Written by Nicole Koenigstein, a leader in agentic AI with deep experience across finance, research, and engineering, this book offers the practical, system-level foundations needed to build robust, scalable, and secure agentic systems. Whether you're tasked with making agent prototypes production-ready or building mission-critical automation from the ground up, this book guides you through every layer of the stack. Published August 2026

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
【One-Line Pitch】 A system-level field guide to building autonomous LLM agents that survive contact with production—covering state, reasoning, tools, memory, evaluation, infrastructure, and governance. Best for engineers and technical leads who already have a prototype and need to make it robust, scalable, and secure. 【Book Arc】 - **Opening (~0%–10%)**: Frames the gap between demos and production, then lays the architectural foundation—stateful graphs, shared state schemas, subgraphs as superstates, and conditional edges that turn a single LLM call into a controllable think-act loop. - **Early (~10%–32%)**: Moves from orchestration into reasoning and learning: Tree-of-Thought as a staged workflow, human-in-the-loop interrupts (including parallel approvals), hierarchical multi-agent supervisors, and reinforcement-learning techniques (GRPO, hybrid rewards, RULER, ART, rLLM) for agents that improve from experience. - **Early–Middle (~32%–42%)**: Dives into model-level concerns—modernized encoder–decoder architectures, attention and memory optimization, the haystack problem, role-based prompting, and parameter-efficient fine-tuning (LoRA, adapters, quantization) as routine build steps. - **Middle (~42%–48%)**: Shifts to integration and execution: structured tool calls, interface contracts, policy hashing for auditability, concurrency-safe connections, and governance policies that constrain which tools an agent may touch. - **Late (~48%+)**: Hardens the system against real-world threats—path traversal and symlink attacks, sandboxing for model-generated code, and the security boundary changes that come with programmatic tool calling. - **Ending**: Excerpts do not cover the closing chapters in detail, but the trajectory points toward evaluation, deployment strategy, and operational governance as the final layer. 【Key Takeaways】 - **State is the backbone of reliable agents** (Opening): Treating agent execution as a stateful graph—with a shared bus, typed schemas, and explicit transitions—makes reasoning retrievable and failures diagnosable, rather than hidden inside a prompt. - **Reasoning strategies are workflows, not magic** (Early): Tree-of-Thought, solver–judge setups, and hierarchical supervisors are best implemented as staged graphs with separate generation, evaluation, and execution roles. - **Human-in-the-loop can be parallel, not just sequential** (Early): Interrupts support multiple simultaneous reviews—legal, technical, editorial—so approval bottlenecks don't serialize the whole pipeline. - **Reward design determines what agents actually learn** (Early): Hybrid rewards combine deterministic correctness checks with LLM-judge scoring for reasoning quality, making them applicable to math, code, and text tasks alike. - **Group-based RL stabilizes improvement** (Early): GRPO's clipping and KL penalty keep policy updates from drifting too far, enabling learning without a critic model or handcrafted reward scaling. - **Model efficiency is an operational concern** (Middle): Flash Attention, KV-cache reuse, prefix trimming, LoRA, and quantization are presented as routine parts of the build process, not research curiosities. - **Governance must be encoded, not assumed** (Middle): Policy hashes, tool access levels, and separation policies create auditable, enforceable boundaries around what an agent can do. - **Sandboxing is the precondition for code mode** (Late): Programmatic tool calling executes model-generated code; the efficiency win is real, but it changes the risk boundary and demands path validation and isolation. 【Reading Tips】 - **Deep-read the state and graph chapters** (Opening–Early): These mental models—shared state, subgraphs, conditional edges—recur throughout the book; skimming them will make later chapters feel like disconnected recipes. - **Skim the RL math if you're not training models**: The GRPO equations and reward-design sections are valuable conceptually, but practitioners deploying pre-trained agents can focus on the hybrid-reward intuition rather than the derivations. - **Treat the code examples as patterns, not prescriptions**: Framework-specific snippets (LangGraph, ART, rLLM) illustrate architecture; extract the design principle rather than copying the API calls. - **Read the governance and security chapters with your own threat model open** (Middle–Late): Path protection, tool policies, and sandboxing are where production incidents actually happen. - **Keep the book's stated goal in mind**: It aims to teach why systems work and where they fail—so when a framework changes, you can still reason about the underlying mechanics. 【Coverage Limits】 This guide is based on stratified excerpts covering roughly the first half of the book; the closing chapters on evaluation, deployment, and long-term operations are referenced but not detailed in the source material.
Excerpt 1
people on the production team whose work behind the scenes carried the manuscript through its final stages and into publication. Finally, I would like to tha...
View in text
Excerpt 2
sequence of supervisor decisions (messages again omitted): {'supervisor': {'next': 'research_team'}} {'supervisor': {'next': 'writing_team'}} {'supervisor':...
View in text
Excerpt 3
agents evaluate and improve their own behavior, while rLLM gives your entire system the ability to learn and reason as a unified, adaptive intelligence. MODE...
View in text
Excerpt 4
ability in multiprocess or concurrent workloads. Governance Don’t rely on the model alone to enforce policy. MCP servers are an important governance boundary...
View in text
Excerpt 5
= 4 MAX_NUM_SEQS = 64 DISABLE_LOG_STATS = True Number of GPUs for tensor parallelism Fraction of GPU VRAM vLLM may use Max context window (tokens) Either “au...
View in text
Excerpt 6
yload) task_completion = score_task_completion(payload) argument_correctness = score_argument_correctness(payload) step_efficiency = score_step_efficiency(pa...
View in text
Excerpt 7
warning = "" if stale_tools: stale_warning = ( f"\n\nThese tools were recently called and produced NO new information:" f"{stale_tools}. DON'T choose them ag...
View in text
Excerpt 8
e manipulated reasoning can result in real-world actions or long-term state corruption. Table 12-5 provides a structured way to align system characteristics...
View in text
Tags
AI categories
Artificial IntelligenceAISoftware
Publish Year: 2026
Language: English
File Format: PDF
File Size: 8.4 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…