Amazing tips for a successful data engineering team

Because data engineers are historically seen as a support team, they need (or they want) to answer as fast as they can which obviously conflict with project deadlines. It’s hard to say no. I know. But to preserve your mental health you’ll need to learn

Start your journey to become a product team. Make people understand you build tools with them rather than only provide a service.

When you develop a pipeline, it will most likely fail one day. So do yourself a favor for the future, make it easy to debug and relaunch. And remember: it is simple to build complex, but complex to build simple

Challenge your choices and vision by presenting at public conferences and/or meetup. From this you will get questions and feedback that will help you to rate your platform.

Hire teams with diverse skills. If it suits your use-case prefer hire 2 generalists DE with 2 specialized ones (DevOps and streaming for instance) rather than 4 generalists. But be careful, specializing your team too early will also create issues. You don’t want to have only person in charge of streaming. Otherwise holidays will be hard for him.