- Tags:: Newsletter Modern Data Stack
- Author:: Tristan Hardy
- Link:: Airbnb’s Metrics Store. Plotting in Code. Systems Design (and Company Strategy!) in ML. [DSR #251] (getdbt.com)
- Source date:: 2021-05-09
- Finished date:: 2021-05-09
It makes sense to buy versus build, but integration will be hard.
In the build-vs-buy question, I think adopting best-of-breed modular solutions (open source or commercial) is the way to go. Which gets to what is so hard here. You can build a Data Catalog that’s aware of your internally-built metric system and integrates with it tightly—same for an A/B testing tool, BI tool, etc. But you can’t really buy one off the shelf with this same property. And since the “metrics Layer” sits right in the middle of everything (see the “Minerva Data API” box on the diagram above), integrations with the rest of the stack are critical. If we wanted to solve this in a more off-the-shelf way, how do we get an entire ecosystem to consolidate around a standard?