Metadata
- Author: Benoit Pimpaud
- Full Title:: Good Data Engineers Are Lazy
- Category:: 🗞️Articles
- URL:: https://stkbailey.substack.com/p/good-data-engineers-are-lazy
- Finished date:: 2023-04-10
Highlights
Our main duty should be to design architecture, to build systems that allow us to be lazy, not manage all this stuff we have built. (View Highlight)
The link to the Airflow docs where it is pointed out that it is for batch oriented workflows
Airflow was not built for infinitely-running event-based workflows”. (View Highlight)