## Metadata - Author:: [[ananth-packkildurai|Ananth Packkildurai]] - Full Title:: Functional Data Engineering - A Blueprint - Category:: #🗞️Articles - URL:: https://www.dataengineeringweekly.com/p/functional-data-engineering-a-blueprint?ref=blef-fr - Finished date:: [[2022-12-25]] ## Highlights - 36% of developers found the data group too slow to work with. ([View Highlight](https://read.readwise.io/read/01gn4hme25grdzvdmkmxtv6pw3)) - growing gap in the advancement of software engineering and how the data management gap increases the cultural mismatch. ([View Highlight](https://read.readwise.io/read/01gn4hn8sg3h5ex18tdxjzhhp2)) - **[Maxime Beauchemin](https://maximebeauchemin.medium.com/)** wrote an influential article, **[Functional Data Engineering — a modern paradigm for batch data processing](https://maximebeauchemin.medium.com/functional-data-engineering-a-modern-paradigm-for-batch-data-processing-2327ec32c42a)**. It is a significant step to bring Software Engineering concepts into Data Engineering ([View Highlight](https://read.readwise.io/read/01gn4hwcm1hyqy0qfapr8g7yr1)) - Note: [[Functional data engineering a set of best practices|Functional Data Engineering A Set Of Best Practices]] - Every time asking the end users to add a ds partition in the query filter will cause more confusion. A simple logical view on top of the latest partition greatly simplifies the accessibility. ([View Highlight](https://read.readwise.io/read/01gn4ht51s2emvxj6apes44fm4))  ## Metadata - Author: [[ananth-packkildurai|Ananth Packkildurai]] - Full Title:: Functional Data Engineering - A Blueprint - Category:: #🗞️Articles - URL:: https://www.dataengineeringweekly.com/p/functional-data-engineering-a-blueprint?ref=blef-fr - Finished date:: [[2023-01-25]] ## Highlights - 36% of developers found the data group too slow to work with. ([View Highlight](https://read.readwise.io/read/01gn4hme25grdzvdmkmxtv6pw3)) - growing gap in the advancement of software engineering and how the data management gap increases the cultural mismatch. ([View Highlight](https://read.readwise.io/read/01gn4hn8sg3h5ex18tdxjzhhp2)) - **[Maxime Beauchemin](https://maximebeauchemin.medium.com/)** wrote an influential article, **[Functional Data Engineering — a modern paradigm for batch data processing](https://maximebeauchemin.medium.com/functional-data-engineering-a-modern-paradigm-for-batch-data-processing-2327ec32c42a)**. It is a significant step to bring Software Engineering concepts into Data Engineering ([View Highlight](https://read.readwise.io/read/01gn4hwcm1hyqy0qfapr8g7yr1)) - Note: [[Functional data engineering a set of best practices|Functional Data Engineering A Set Of Best Practices]] - Every time asking the end users to add a ds partition in the query filter will cause more confusion. A simple logical view on top of the latest partition greatly simplifies the accessibility. ([View Highlight](https://read.readwise.io/read/01gn4ht51s2emvxj6apes44fm4))