Metadata
- Author: Noah Kennedy
- Full Title:: Dbt: How We Improved Our Data Quality by Cutting 80% of Our Tests
- Category:: 🗞️Articles
- URL:: https://noahlk.medium.com/dbt-how-we-improved-our-data-quality-by-cutting-80-of-our-tests-78fc35621e4e
- Finished date:: 2023-01-31
Highlights
• Aggregating test failure results using Jinja macros and pre-configured metadata to pull together high level summary tables. • Building views on top of the base table to split tests by owner or severity, and creating visualizations using our tool of choice. (View Highlight)
any test that cannot be acted upon is a test that should not be implemented (View Highlight)
Context Driven Tests are more complex and look a lot more like models. Essentially, they’re data models that select bad data or records we don’t want, defined as SQL files that live in the
dbt/testsdirectory. An example is shown below - (View Highlight)