Share E-Book
Scan to open this page

Scan with your phone to open this page

AuthorEthan Cowan, Michael Shoemate, Mayana Pereira

Many organizations today analyze and share large, sensitive datasets about individuals. Whether these datasets cover healthcare details, financial records, or exam scores, it's become more difficult for organizations to protect an individual's information through deidentification, anonymization, and other traditional statistical disclosure limitation techniques. This practical book explains how differential privacy (DP) can help. Authors Ethan Cowan, Michael Shoemate, and Mayana Pereira explain how these techniques enable data scientists, researchers, and programmers to run statistical analyses that hide the contribution of any single individual. You'll dive into basic DP concepts and understand how to use open source tools to create differentially private statistics, explore how to assess the utility/privacy trade-offs, and learn how to integrate differential privacy into workflows. With this book, you'll learn: How DP guarantees privacy when other data anonymization methods don't What preserving individual privacy in a dataset entails How to apply DP in several real-world scenarios and datasets Potential privacy attack methods, including what it means to perform a reidentification attack How to use the OpenDP library in privacy-preserving data releases How to interpret guarantees provided by specific DP data releases

AI Reading Assistant

Whole-book reading guide from stratified index samples; jump to passages in the text

AI guide
# Hands-On Differential Privacy: Introduction to the Theory and Practice Using OpenDP ## 【One-Line Pitch】 A practical, code-first introduction to differential privacy that takes you from the core mathematical concepts to real deployments using the OpenDP library—ideal for data scientists, researchers, and engineers who handle sensitive datasets and need more than anonymization can offer. ## 【Book Arc】 - **Opening (~0%–9%)**: Sets the stage with the failure of traditional deidentification and anonymization methods, introduces the history of data privatization, and walks through a classroom exam-score example that builds intuition for key terms like sensitivity and adjacent datasets. - **Early (~9%–25%)**: Formalizes differential privacy—defining privacy loss, the formal DP guarantee, randomized response, and the central vs. local models of privacy—while introducing the Laplace mechanism and accuracy guarantees. - **Early–Middle (~25%–38%)**: Develops the foundational theory of stable transformations, c-stability, and metric spaces, showing how sensitivity emerges as a special case of stability and proving stability for basic functions like count, sum, and double. - **Middle (~38%–47%)**: Extends stability analysis to vector-valued aggregators, Lp norms, and bounded-norm settings, deriving sensitivities for sum, mean, and variance under different assumptions about dataset size and bounds. - **Middle (~47%–end of sample)**: Bridges from transformations to private mechanisms, replacing output metrics with privacy measures and generalizing the definition of privacy—the conceptual pivot that connects all prior theory to actual DP implementations. ## 【Key Takeaways】 - **Traditional anonymization is insufficient** (Opening): Deidentification and related statistical disclosure limitation techniques fail against modern attacks; DP provides formal, provable guarantees that anonymization cannot. This motivates the entire book. - **Sensitivity quantifies the worst-case impact of one individual** (Early): The global sensitivity of a statistic—like the maximum change in a classroom mean when one score is removed—determines how much noise is needed. The book emphasizes proving sensitivity mathematically rather than relying on ad hoc reasoning. - **Central vs. local models involve a trust/utility trade-off** (Early): The central model privatizes data after collection on a trusted authority, yielding better utility; the local model has individuals privatize their own data, requiring significantly more data for the same guarantee. Rule of thumb: privatize as late as possible. - **The Laplace mechanism provides calibrated noise with accuracy guarantees** (Early): For a given sensitivity, Laplace noise scaled appropriately yields (α, β)-accuracy, enabling confidence intervals around private outputs—demonstrated with a student family-size counting example. - **Stability is the unifying concept for DP** (Early–Middle): A transformation is c-stable if neighboring inputs map to neighboring outputs within a bounded distance; sensitivity is a special case of stability. This abstraction lets you reason about privacy systematically. - **Unbounded functions require input constraints** (Middle): The sum function is not stable without bounds on data values; adding assumptions like L and U bounds (or radius R and origin O) makes stability derivable and enables privacy guarantees. - **Private mechanisms generalize stable transformations** (Middle): The same structure applies, but the output metric is replaced by a privacy measure—making the definition of privacy itself a specialized kind of stability constraint. ## 【Reading Tips】 - **Read Chapters 1–2 carefully if you're new to DP** (per the authors' own recommendation): These establish the vocabulary—adjacent datasets, sensitivity, privacy loss, local vs. central models—that everything else builds on. Don't skip the classroom example; it grounds abstract concepts. - **Work through the stability proofs with pen and paper** (Early–Middle): The derivations for count, sum, and double transformations follow a repeatable pattern (start with the left side, simplify, identify the constant c). Replicating them yourself builds the mathematical maturity needed for later chapters. - **Skim the exercises for self-assessment** (throughout): Each chapter ends with conceptual, theoretical, and programming questions. The adjacency-detection and stability-derivation exercises are particularly good checks of understanding before moving forward. - **Expect a shift from intuition to formalism around the 25–40% mark**: The book deliberately becomes more abstract with metric spaces and c-stable transformations. If this feels heavy, remember the payoff: these tools let you derive privacy guarantees for any new function you encounter. - **Use the OpenDP code examples as anchors** (throughout): When theory gets dense, the library demonstrations—like computing stability for bounded datasets—show the practical application and help cement what the math means in practice. ## 【Coverage Limits】 This guide covers the conceptual and theoretical foundations visible in the sampled excerpts (roughly the first half of the book). The later parts—synthetic data generation, privacy attacks, setting privacy loss parameters, and project planning—are mentioned in the table of contents but not covered in detail here. ##
Page 7
y. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 History 3 Privatization Before Differential Privacy 6 Case Stu...
View in text
Excerpt 2
s scenario from the perspective of the students, let’s look at the professor’s role as the only person with access to the full data set. Since the 16 | Chapt...
View in text
Excerpt 3
the data without affecting the privacy guarantee. Let xLE3 denote the data set of records where famsize is equal to LE3, and likewise for xGT3. 40 | Chapter...
View in text
Excerpt 4
the metrics presented in this chapter are non-negative and symmetric, and obey the triangle inequality. 3. Identify the following transformations as either a...
View in text
Excerpt 5
t sampling is possible for some well-behaved distributions, like finite and piecewise constant. Many more algorithms have been developed for Private Mechanis...
View in text
Excerpt 6
the Gaussian mechanism is also Gaussian: N η, 2 · η , where η = Δ2 2 · σ2 , and Δ and σ represent the sensitivity and noise scale, respectively.22 Figure 5-7...
View in text
Excerpt 7
return np.array_split(data, num_partitions) return dp.t.make_user_transformation( input_domain=input_domain, input_metric=dp.symmetric_distance(), output_dom...
View in text
Excerpt 8
aussian mechanism: Data Set Truncation | 187 Unknown Domain In the asylum seeker example (“Example: Grouping on Asylum Seeker Data” on page 157), the domains...
View in text
Tags
AI categories
DataProgramming LanguageBackend
ISBN: 149209773X
Publisher: O'Reilly Media
Publish Year: 2024
Language: English
Pages: 326
File Format: PDF
File Size: 8.1 MB
Text Preview (First 20 pages)
Registered users can read the full content for free

Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.

Generating text preview…