Get up to speed on a new unified approach to building machine learning (ML) systems with a feature store. Using this practical book, data scientists and ML engineers will learn in detail how to develop and operate batch, real-time, and agentic ML systems.
Author Jim Dowling introduces fundamental principles and practices for developing, testing, and operating ML and AI systems at scale. You'll see how any AI system can be decomposed into independent feature, training, and inference pipelines connected by a shared data layer. Through example ML systems, you'll tackle the hardest part of ML systems&emdash;the data, learning how to transform data into features and embeddings, and how to design a data model for AI.
Develop batch ML systems at any scale
Develop real-time ML systems by shifting left or shifting right feature computation
Develop agentic ML systems that use LLMs, tools, and retrieval-augmented generation
Understand and apply...
AI Reading Assistant
Whole-book reading guide from stratified index samples; jump to passages in the text
Tip the Site
Support this siteYour recognition and a small knowledge-service contribution help keep this technical work open source.Scan the WeChat Pay or Alipay code below. Logged-in and guest visitors can both tip.
WeChat Pay
Alipay
Open WeChat or Alipay and scan. No login required.
AI guide
【One-Line Pitch】
A practical field guide to building ML systems around a shared feature store, showing how to decompose any AI application into feature, training, and inference pipelines. Best for data scientists, data engineers, and ML engineers who can train models but struggle to ship and operate them on dynamic data.
【Book Arc】
- **Opening (~0%–15%)**: Frames the core problem — models trained on static datasets don't create recurring value. Introduces the book's central thesis: any AI system decomposes into independent feature, training, and inference pipelines joined by a shared data layer, and defines the three system classes (batch, real-time, agentic).
- **Early (~15%–30%)**: Lays out the roadmap and a first hands-on build (an air-quality forecasting system with a dashboard and LLM querying), then introduces feature stores conceptually — feature groups, feature views, offline/online skew, and data modeling — before moving into Hopsworks APIs and project security.
- **Middle (~30%–55%)**: The data-heavy core. Covers transformations for feature pipelines (Pandas, Polars, Spark, Flink, Feldera) with validation via Great Expectations, training/inference transformations including real-time ones, and batch vs. streaming feature pipeline design with windowed and rolling aggregations. Also contrasts batch systems (e.g., Spotify-style weekly recommendations) with request-driven real-time systems.
- **Late (~55%–80%)**: Training and prediction at scale — building training datasets from the store, decision trees on time-series data, fine-tuning LLMs with LoRA, PyTorch training with Ray, and distributed-training challenges. Then batch inference with PySpark, model serving via KServe (with and without GPUs, including vLLM), and an introduction to agents, RAG, LlamaIndex, and tool/agent protocols like MCP and A2A.
- **Ending (~80%–100%)**: MLOps in depth — offline testing from feature-contract unit tests through pipeline integration and blue/green deployment to agent evals, plus governance and automatic containerization. Observability via logs, traces, and metrics feeding feature/model monitoring and autoscaling, closing with a personalized video recommender case study and the "dirty dozen fallacies of MLOps."
【Key Takeaways】
- **The feature store is the architectural spine** (Early): storing training and inference feature data in one place with feature groups and feature views is what prevents offline/online skew — the book's central design decision.
- **Pipelines, not notebooks, deliver value** (Middle): a model earns its keep only when feature, training, and inference pipelines run repeatedly on fresh data; the running example contrasts a one-off static-dataset model with an automated batch system feeding a dashboard.
- **Know which transformation belongs where** (Middle): the book offers a taxonomy for deciding whether a data transformation runs in the feature pipeline, training pipeline, or inference pipeline — the key lever for real-time systems via "shift left" or "shift right" feature computation.
- **Three system classes need different designs** (Early): batch (scheduled predictions), real-time (24/7 request-driven, personalized), and agentic (LLM + tools + RAG) systems share the FTI decomposition but differ in latency, freshness, and testing needs.
- **Data engineering is the hard part** (Middle): transformation frameworks (Pandas, Polars, Spark, Flink, Feldera), validation with Great Expectations, and streaming windowed aggregations get substantial treatment because that's where most ML system effort goes.
- **Training scales beyond tabular models** (Late): training datasets from the store, time-series decision trees, LoRA fine-tuning, and Ray-based PyTorch training — with distributed-training scalability flagged as a distinct challenge.
- **Serving spans batch to LLM** (Late): PySpark batch inference, KServe deployment with and without GPUs, and vLLM for LLMs; agents add RAG, LlamaIndex, and MCP/A2A protocols with their own development process.
- **Testing and observability are first-class** (Ending): feature-contract unit tests, pipeline integration tests, blue/green deploys, agent evals, and trace/metric-based monitoring with autoscaling — plus a catalog of common MLOps fallacies to avoid.
【Reading Tips】
- If you already train models comfortably, skim the ML-type refreshers and deep-read Parts II–III (feature store concepts and transformations) — that's where the book's distinctive value sits.
- Follow the recurring credit-card fraud example and the air-quality build; they anchor abstract pipeline concepts in concrete code.
- Treat the taxonomy of transformations as the takeaway to internalize: before writing any pipeline, decide where each transformation runs and why.
- The MLOps chapters (testing, observability, fallacies) are worth reading even if you skip implementation details — they're the checklist for production readiness.
- Have Python and SQL fluency ready; the exercises assume it, and the Hopsworks-specific APIs are best learned by doing.
【Coverage Limits】
These excerpts are dominated by front matter, preface, and chapter roadmap, so detailed technical content from the middle and later chapters is only summarized at the table-of-contents level; specific code, benchmarks, and case-study details are not covered here.
Excerpt 1
hie Vink, inventor of Polars, CEO and founder of Polars Inc. Nobody before has captured the essentials of building AI apps using modern data streaming system...
d) for stakeholder(s) to generate value from your ML system? How will you ensure the correctness and monitor the performance of your system? Here are some ex...
give credit to all the technologies and ideas it builds on. Conventions Used in This Book The following typographical conventions are used in this book: Ital...
’s performance on a test set drawn from your static dataset. Instead, you will have to build ML pipelines , which are programs that transform raw data into f...
engineering to get the relevant data into the LLM’s prompt. With in-context learning, the newly learned skill is forgotten directly after the LLM’s context w...
and the features created for batch inference are consistent. This can be achieved by building a batch program (or pipeline ) that is run in either training m...
ources (vector indexes, search engines, feature stores, etc.) to retrieve relevant context data and how to plan and execute tasks to achieve goals. Anthropic...
ration with an external system that consumes the prediction. The arcs connecting the circles represent the iterative nature of the development process, where...
Support this siteYour recognition and a small knowledge-service contribution help keep this technical work open source.
Scan the WeChat Pay or Alipay code below. Logged-in and guest visitors can both tip.
WeChat PayAlipay
Open WeChat or Alipay and scan. No login required.
Add Tag
Enter tag name (max 50 characters)
Share E-Book
Building Machine Learning Systems with a Feature Store (Jim Dowling)(Z-Library)
Scan QR code with your phone to access
Copy the link or scan the QR code to access this e-book on your phone
Share to WeChat Moments
Building Machine Learning Systems with a Feature Store (Jim Dowling)(Z-Library)
Scan the QR code with WeChat to open this book
Tap the ··· menu in the top-right corner
Choose Share to Moments
You are already in WeChat. Tap ··· in the top-right corner and choose Share to Moments.
Share E-Book via Email
Please enter email address
Donation Statistics
¥.00
Total Donations
0
Donation Count
Building Machine Learning Systems with a Feature Store (Jim Dowling)(Z-Library)
Find Your Favorite Books
Only registered users can comment after logging in. Comments need to be reviewed by administrators before being displayed
Loading comments...
Reply to Comment
Edit Comment