Data Cleaning with Power BI (Gus Frazer)(Z-Library)
Data
Unlock the benefits of Power BI's data cleaning capabilities to simplify the process of preparing data for analysis with this guide to transforming your data.
18
Views
0
Downloads
0.00
Total Donations
Registered users can read the full content for free
Register as a Gaohf Library member to read the complete e-book online for free and enjoy a better reading experience.
Page
1
(This page has no text content)
Page
2
Data Cleaning with Power BI Copyright © 2024 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.
Page
3
Group Product Manager: Kaustubh Manglurkar Publishing Product Manager: Deepesh Patel Book Project Manager: Hemangi Lotlikar Senior Editor: Rohit Singh Technical Editor: Yash Bhanushali Copy Editor: Safis Editing Proofreader: Safis Editing Indexer: Subalakshmi Govindhan Production Designer: Alishon Mendonca Developer Relations Marketing Executive: Nivedita Singh First published: February 2024 Production reference: 1270224 Published by Packt Publishing Ltd. Grosvenor House 11 St Paul’s Square
Page
4
Birmingham B3 1RB, UK. ISBN 978-1-80512-640-9
Page
5
To my incredible wife, whose unwavering support and love sustained me throughout the writing of this book, even as we welcomed our son, Maximus, into the world. I am grateful for your patience and encouragement.
Page
6
Also, to the skilled team at Packt for their guidance and expertise in shaping this book.
Page
7
– Gus Frazer Contributors About the author Gus Frazer is a seasoned analytics consultant who focuses on business intelligence solutions. With over eight years of experience working for the two market-leading platforms, Power BI (Microsoft) and Tableau, he has amassed a wealth of knowledge and expertise. He also has experience in helping hundreds of customers to drive their digital and data transformations, scope data requirements, drive actionable insights, and most important of all, clean data ready for analysis.
Page
8
I want to thank the people who have been close to me and supported me during the journey of writing this book. About the reviewer Rajendra Ongole is a BI specialist/consultant and Power BI trainer. He likes to share his knowledge of different Microsoft technologies on Power Platform, such as Power BI, Power Apps, Power Automate, and Power Virtual Agents. He has more than 13 years of experience in software development in different domains, such as telecom, manufacturing, industrial automation, and a project management office. Every day, he uploads a new video on Power Platform to share his knowledge with his subscribers!
Page
9
Table of Contents Preface
Page
10
Part 1 – Introduction and Fundamentals 1 Introduction to Power BI Data Cleaning Technical requirements Cleaning your data in Power BI Understanding Power Query Understanding DAX Where do we begin with data? Summary Questions 2 Understanding Data Quality and Why Data Cleaning is Important What is data quality? Where do data quality issues come from? The role of data cleaning in improving data quality
Page
11
Data integrity and accuracy Decision-making and business outcomes Data ownership and accountability A holistic view of the data ecosystem Early detection of issues Continuous improvement and learning Empowerment and collaboration Best practices for data quality overall Establishing data quality standards Summary Questions 3 Data Cleaning Fundamentals and Principles Defining data cleaning Who’s responsible for cleaning data? Building a process for cleaning data Data assessment
Page
12
Data profil ing Data validation Data cleaning strategies Data transformations Data quality assurance Documentation Understanding quality over quantity in data cleaning Summary Questions 4 The Most Common Data Cleaning Operations Technical requirements Removing duplicates Removing missing data Splitting columns Merging columns
Page
13
Replacing values Creating calculated columns versus measures Calculated columns Measures Calculation group Considerations Summary Questions
Page
14
Part 2 – Data Import and Query Editor 5 Importing Data into Power BI Technical requirements Understanding data completeness Understanding data accuracy Understanding data consistency Assessing data relevance Assessing data formatting Assessing data normalization, denormalization, and star schemas Dimension modeling and star schema Denormalized data in dimension tables Summary Questions 6
Page
15
Cleaning Data with Query Editor Technical requirements Understanding the Query Editor interface Data cleaning techniques and functions Adding columns Data type conversions Date/time Rounding Pivot/unpivot columns Merge queries Using Query Editor versus DAX for transformation Power Query Editor Data Analysis Expressions (DAX) Workflow Summary Questions Further reading
Page
16
7 Transforming Data with the M Language Technical requirements Understanding the M language Structure of M Common use cases of M Filtering and sorting data with M Transforming data with M Working with data sources in M Creating parameters and variables Summary Questions 8 Using Data Profiling for Exploratory Data Analysis (EDA) Understanding EDA
Page
17
Exploring data profil ing features in Power BI Reviewing column quality, distribution, and profile Column distribution Column quality Column profile Turning data profiles into high-quality data Recommended actions on column distribution Value distribution Summary Questions
Page
18
Part 3 – Advanced Data Cleaning and Optimizations 9 Advanced Data Cleaning Techniques Technical requirements Using Power Query Editor from within Dataflow Gen1 – fuzzy matching and fil l down Fuzzy matching Fill down Best practices for using fuzzy matching and fil l down Using R and Python scripts Benefits of using R or Python scripts Getting started with using R or Python scripts in Power BI Using ML to clean data Data cleaning with anomaly detection Data preparation with AutoML
Page
19
Data enhancement with AI Insights Summary Questions 10 Creating Custom Functions in Power Query Planning for your custom function Defining the problem Identifying parameters Setting clear objectives Using parameters Types of parameters Defining parameters Best practices for using parameters Creating custom functions Defining the function structure Writing M code Testing and debugging
Page
20
Documentation Summary Questions 11 M Query Optimization Technical requirements Creating custom functions Filtering and reducing data Using native M functions Optimizing memory usage Parallel query execution Using Table.Buffer and Table.Split Summary Questions Further reading 12
The above is a preview of the first 20 pages. Register to read the complete e-book.
AI Reading Assistant
Whole-book reading guide from stratified index samples; jump to passages in the text
AI guide
【One-Line Pitch】
A practical, process-first guide to cleaning and preparing data inside Power BI, aimed at analysts and BI developers who already know the tool but want disciplined, repeatable ways to turn messy sources into trustworthy models. Read it if you want to move beyond ad-hoc fixes toward standards, Power Query/M fluency, and profiling-driven quality.
【Book Arc】
- **Opening (~0%–11%)**: Frames data quality as an organizational concern — integrity, ownership, accountability, and the roles (stewards, BI managers, leadership) who keep data trustworthy — before any tooling appears.
- **Early (~11%–29%)**: Establishes data cleaning fundamentals and principles, then moves into hands-on Power BI work: removing duplicates, handling gaps, and reading column quality/distribution in Power Query Editor.
- **Early–Middle (~29%–39%)**: Deepens the mechanics — applied-step naming and hygiene, DAX versus M roles, and M-language transformations (type conversion, multi-column transforms, parameters for deployment and conditional sources).
- **Middle (~39%–50%)**: Extends into dataflows, folder/helper-query automation, and exploratory profiling, including fill down/up, fuzzy matching, and Python-script steps for custom transformations.
- **Late (~50%+)**: Covers advanced and AI-assisted cleaning — dataflow actions (incremental refresh, ML model application), model training reports, and AI Insights via cognitive services — positioning automation as the endgame.
【Key Takeaways】
- **Data cleaning is a governance problem before it is a tooling problem** (Opening): standards, ownership, and leadership alignment determine whether cleaning sticks or becomes perpetual rework.
- **Seven planning principles precede any transformation** (Early): the book stresses documenting intent and impact so cleaning is deliberate rather than reactive.
- **Power Query Editor is the workhorse** (Early): duplicate removal, gap handling, and column quality/distribution checks are the everyday moves that fix completeness and accuracy.
- **Applied steps deserve real names** (Early–Middle): descriptive, consistent, concise step labels make transformation logic auditable and reusable by others.
- **Know when to use M versus DAX** (Middle): M handles extraction and shaping; DAX handles model-level calculations, measures, and business logic — mixing them up causes design debt.
- **Parameters turn one-off queries into deployable assets** (Middle): parameterized sources and conditional logic avoid manual edits when promoting to production workspaces.
- **Star schemas pay off at scale** (Early): the excerpts cite a flat-table query at ~29 seconds versus ~7 seconds in a star schema on comparable data, plus faster refreshes.
- **Automation and AI extend the cleaner's reach** (Late): dataflows, incremental refresh, ML models, and AI Insights reduce manual preparation for large or complex datasets.
【Reading Tips】
- Skim the governance and role chapters if you already own data quality; deep-read the Power Query and M chapters, where the practical value concentrates.
- Treat the M-language chapter as the hardest section — work the syntax, `let` blocks, and type-conversion examples alongside the book rather than reading passively.
- Use the profiling/EDA material as a checklist: run column quality and distribution on your own datasets before and after cleaning to see the difference.
- Note the star-schema versus flat-table performance discussion; it is the clearest argument in the excerpts for modeling discipline.
- The AI/ML and dataflow sections are the most advanced; read them after you are comfortable with Power Query basics.
【Coverage Limits】
This guide is based on stratified excerpts covering roughly the first half of the book plus late-chapter material on dataflows and AI Insights; the excerpts do not cover the full text of the custom-functions, advanced-techniques, or later chapters in detail, so chapter-level specifics beyond those noted may be incomplete.
Passage locations
Excerpt 1
u to what data profiling is and why it’s important. It also covers some of the benefits of using data profiling tools within Power BI, such as identifying da...
View in text
Excerpt 2
his page, you will need to carry out the following steps: 1. Provided you are in Report, Table, or Model view, navigate to the Home tab in the toolbar and th...
View in text
Excerpt 3
ns: Aggregations and calculations: DAX is used for creating aggregations, calculated columns, and measures. It’s not designed for the detailed data manipulat...
View in text
Excerpt 4
as you clean, prepare, and enhance your data for analysis, as well as to introduce you to working with dataflows from the Power BI service. all the cars in t...
View in text
Recommended for You
{{#thumbnailUrl}}
{{/thumbnailUrl}}
{{^thumbnailUrl}}
{{/thumbnailUrl}}
Loading recommended books...
Failed to load, please try again later
Tip the Site
Scan the WeChat Pay or Alipay code to tip. No login required.
WeChat Pay
Alipay