No. 170 of 500 No. 22 in Hands-On AI & Programming

Fundamentals of Data Engineering

Plan and Build Robust Data Systems

By Joe Reis and Matt Housley

Published
July 26, 2022
Print length
447 pages
Reading level
Intermediate
ISBN-13
978-1098108304
Publisher
O'Reilly Media
Written for
Engineers, analysts and technical managers building data platforms that feed analytics and ML.

Synopsis

Joe Reis and Matt Housley organize the discipline around a data engineering lifecycle of five stages: generation in source systems, storage, ingestion, transformation, and serving data for analytics and machine learning. Running beneath every stage are undercurrents that the authors treat as continuous responsibilities rather than phases: security, data management, DataOps, data architecture, orchestration and software engineering. Part I sets out the lifecycle, the data engineer's role, principles of good architecture such as loose coupling and reversible decisions, and a method for choosing technologies. Part II, the bulk of the book, works through each stage in depth, and Part III covers security and privacy and the authors' view of where the field is heading.

The authors deliberately avoid tying advice to particular vendors, so the book explains trade-offs, such as batch versus streaming processing or building versus buying, rather than configuration steps. Readers gain a framework for evaluating tools and architectures that outlasts any product cycle, which matters for AI teams because model quality depends on reliable pipelines. Reis has called the undercurrents the most useful part of the book. Published in 2022, it predates the wave of LLM applications, so retrieval pipelines and vector stores receive little attention.

Scorecard

Editorial score

How it scored

Editorial score: 78.1 / 1005 weighted criteria

  • Influence30%

    24.0/30
  • Authority25%

    18.8/25
  • Practical value20%

    16.0/20
  • Currency15%

    11.3/15
  • Readability10%

    8.0/10
  • Editorial score

    78.1/100

How the rank was computed

Rank No. 170 of 500 comes from a composite of 58.0: observable signals 22.9 of 55 points plus editorial review 35.1 of 45 points.

All 11 inputs
InputPoints
Observable signals22.9/55
Reach (Amazon ratings volume)10.9/16.5
Consensus across best-of lists2.8/13.8
Awards and bestseller evidence0.0/8.3
Reader rating, sample-adjusted7.4/8.3
Amazon sales rank1.8/5.5
Recency0.0/2.8
Editorial review35.1/45
Author authority8.4/11.3
Influence10.8/13.5
Practical value7.2/9.0
Readability3.6/4.5
Currency5.1/6.8

Each criterion is scored from 1 to 10 and weighted, and the points add up to the editorial score. The rank combines observable signals (55 percent) with this score (45 percent). Read the methodology.

Verdict

A clear, tool-agnostic map of modern data engineering, valuable for anyone building the data foundations on which AI systems depend.

Strengths

  • Vendor-neutral framework that ages well
  • Covers architecture, governance and security together
  • Accessible to managers as well as engineers

Keep in mind

It explains concepts rather than teaching hands-on implementation, and it predates the LLM era, so readers needing code or GenAI pipelines should look elsewhere.

Key takeaways

  1. Data engineering follows a lifecycle of generation, storage, ingestion, transformation and serving, and a weak link at any stage undermines analytics and ML.
  2. Security, data management, DataOps, architecture, orchestration and software engineering are undercurrents that cut across every lifecycle stage rather than separate phases.
  3. Favor loosely coupled designs and reversible decisions, because data technologies change quickly and costly lock-in is hard to undo.
  4. Choose technologies by total cost, team capability, interoperability and fit to requirements rather than vendor marketing or industry fashion.

Notable facts

  • The DeepLearning.AI and AWS Data Engineering Professional Certificate on Coursera, launched in September 2024 and led by Reis, is built on the book's framework. Source (opens in a new tab)

About the author

Joe Reis and Matt Housley

Joe Reis is a data engineer and architect with about twenty years in the industry, co-founder and CEO of the Salt Lake City consulting firm Ternary Data, and an instructor at the University of Utah; he leads the DeepLearning.AI and AWS Data Engineering Professional Certificate on Coursera. Co-author Matt Housley co-founded Ternary Data with Reis and advises teams on cloud data architecture.

Questions

What is Fundamentals of Data Engineering about?
Joe Reis and Matt Housley's 2022 book explains data engineering through a lifecycle of generation, storage, ingestion, transformation and serving, supported by undercurrents such as security, data management, DataOps, architecture, orchestration and software engineering. It focuses on principles and trade-offs rather than specific products, helping readers design data systems and choose technologies.
Is Fundamentals of Data Engineering useful for AI and machine learning teams?
Yes. Machine learning depends on reliable, well-governed data, and the book's serving stage explicitly covers delivering data for analytics and ML. It helps AI teams understand pipelines, storage choices and data quality responsibilities. It does not teach model building or LLM-specific infrastructure, so it works best alongside books on MLOps and AI engineering.
Is Fundamentals of Data Engineering still current in 2026?
Its framework has aged well because it avoids tying advice to particular tools, and Reis has said he would write it mostly the same way today. It predates the wave of LLM applications, however, so topics such as vector stores and retrieval pipelines need supplementing from newer sources.

Sources

As an Amazon Associate, Best AI Books earns from qualifying purchases. Best AI Books is sponsored by Iternal.ai, whose founder and CEO, John Byron Hanby IV, wrote The AI Strategy Blueprint, our #1 ranked book. How we rank books.