- Tags:: 🗞️Articles, Data Engineering, Data Team Vision And Mission
- Author:: Christophe Blefari
- Link:: Blef - Why is it almost impossible to meet deadlines?
- Source date:: 2021-08-31
- Finished date:: 2022-01-11
Amazing tips for a successful data engineering team
Because data engineers are historically seen as a support team, they need (or they want) to answer as fast as they can which obviously conflict with project deadlines. It’s hard to say no. I know. But to preserve your mental health you’ll need to learn
Start your journey to become a product team. Make people understand you build tools with them rather than only provide a service.
When you develop a pipeline, it will most likely fail one day. So do yourself a favor for the future, make it easy to debug and relaunch. And remember: it is simple to build complex, but complex to build simple
Challenge your choices and vision by presenting at public conferences and/or meetup. From this you will get questions and feedback that will help you to rate your platform.
Hire teams with diverse skills. If it suits your use-case prefer hire 2 generalists DE with 2 specialized ones (DevOps and streaming for instance) rather than 4 generalists. But be careful, specializing your team too early will also create issues. You don’t want to have only person in charge of streaming. Otherwise holidays will be hard for him.