Practical Data Quality Engineering

The pipeline is green, every job reports success, and the number on the dashboard is still wrong. If you build or maintain tables that other people trust, this book shows you how to catch the problems that do not announce themselves. You will profile a table before writing rules, find exact and near duplicates, tell harmless gaps from harmful ones, write layered rules for invalid records, spot sch...