## Metadata - Author: [[Matt turck|Matt Turck]] - Full Title:: One Thought on “MAD 2023, PART III: TRENDS IN DATA INFRASTRUCTURE” - Category:: #🗞️Articles - URL:: https://mattturck.com/mad2023-part-iii/ - Finished date:: [[2023-02-23]] ## Highlights > They’re **more likely to pick established vendors that offer tightly integrated suites of products**, ([View Highlight](https://read.readwise.io/read/01gsyews5mjwfn4sm37vadjz69)) > there’s an **ocean of “single feature” data infrastructure (or MLOps) startups** (perhaps too harsh a term, as they’re just at an early stage) that are going to struggle to meet this new bar. ([View Highlight](https://read.readwise.io/read/01gsyex65er11xef1ky5yyrx4q)) > **Databricks** seems to be on a mission to release a product in just about every box of the MAD landscape. ([View Highlight](https://read.readwise.io/read/01gsyexpqrnwfjnzas72a9gpkv)) > it is unclear how many the market can sustain. It is also unclear whether data catalogs can be separate entities outside of broader data governance platforms ([View Highlight](https://read.readwise.io/read/01gsyf04w2emxdbz28sam22yhz)) > Now, the world has changed. As cost control becomes paramount, some **may question the philosophy that has been at the heart of the modern approach to data management since the Hadoop days – keep all your data, dump it all somewhere** (a data lake, lakehouse or warehouse) and figure out what to do with it later. This has turned out to be expensive, and not always that useful (read this good piece: “[Big Data is Dead](https://motherduck.com/blog/big-data-is-dead/)”). The MDS is now under pressure. In a world of tight budgets and rationalization, it is almost too obvious a target ([View Highlight](https://read.readwise.io/read/01gsygsg4w86jr6dspjw59vptg)) > announcing support for “zero-ETL” solution that tightly integrates [Amazon Aurora with Amazon Redshift](https://aws.amazon.com/about-aws/whats-new/2022/11/amazon-aurora-zero-etl-integration-redshift/). Under that integration, within seconds of transactional data being written into Aurora, the data is available in Amazon Redshift. ([View Highlight](https://read.readwise.io/read/01gsyf8pv0tn0x3cmxsdr22x97)) > The concept of [change data capture](https://www.estuary.dev/the-complete-introduction-to-change-data-capture-cdc/) is not new, but it’s gaining steam. ([View Highlight](https://read.readwise.io/read/01gsyf9a49yng75dcdwzdtmjyh)) - Note: Isn't kinda contradictory to link to [[Big data is dead|Big Data Is Dead]] and saying this in the same article?