Job Description

We’re looking for a Lead Data Engineer to help our clients design, build and operate reliable data platforms that turn complex data into useful business insights.

You’ll work across the data lifecycle, from architecture and source integration through to data pipelines, semantic models, visualisation and reporting. You’ll bring strong engineering skills in Python and SQL, alongside hands-on experience with at least one of Databricks, Snowflake or Microsoft Fabric.

Working closely with clients, analysts, data scientists and fellow engineers, you’ll translate business requirements into secure, maintainable and scalable data solutions. You’ll also provide technical guidance, contribute to design decisions and help the team strengthen its engineering practices.

What you’ll do

- Work directly with clients to translate business requirments into technical solutions; Providing guidance and contributing to design decisions.
- Design, build and maintain data pipelines to ingest, transform and deliver data from a range of sources, including APIs.
- Develop solutions using Databricks, Snowflake or Microsoft Fabric,



selecting approaches that suit the client’s requirements and existing environment.
- Contribute to data architecture and solution design, including data storage, integration and modelling.
- Develop data models, ontologies and semantic layers that establish consistent business definitions and support analytics and reporting.
- Implement pipeline orchestration, scheduling, monitoring and operational support to keep data services reliable.
- Troubleshoot data and pipeline issues, improving performance, scalability and cost efficiency.
- Apply data quality controls, automated testing and validation throughout the data lifecycle.
- Implement role-based access control and follow security best practices for data platforms and integrations.
- Apply DevOps practices to data engineering, including version control, repository management, CI/CD and automated deployment.
- Build data visualisations and reports that make information clear and practical to business users.
- Document solutions, review code and share knowledge to support maintainable delivery and continuous improvement.

📌 Lead Data Engineer (Melbourne)
🏢 Endava
📍 Melbourne