Metadata
- Author: Senior Powerpoint Engineer
- Full Title:: A Take: Data Lineage / Data Catalog Tools Are Really…
- Category:: tweets
- Document Tags:: Data Catalog,
- URL:: https://twitter.com/ryxcommar/status/1668630605876330504?s=12
- Finished date:: 2024-07-07
Highlights
catalogs just end up centralizing your mess and centralizing the discoverability problem. But the problem still exists! (Even if people actually read docs and they’re good docs.) It will still require knowledge of upstream services and a holistic context to navigate. (View Highlight)
Either become a dictator or build consensus. Get this right sooner rather than later because altering schemas is hard. (View Highlight)
Create tables so good that you’d be stupid to not use them, so people don’t create a web of slightly different but superfluous entities which ends up mucking up your downstream. Carrots not sticks. (View Highlight)
You don’t need a lineage tool to tell you your data is spaghetti. You already knew that. You need to proactively avoid spaghetti. There’s no substitute for that. (View Highlight)