23 Oct
|
INGRITY
|
Australia
Data Engineer – Databricks
Location: Sydney / Brisbane (Hybrid)
Contract: 12 Months
Industry: Financial Services / Insurance The Prospect
INGRITY is seeking an experienced Data Engineer to join a major financial services organisation undergoing a significant data modernisation program.
You'll work within a modern Databricks environment , building scalable data pipelines, transforming complex datasets and supporting the migration of legacy data platforms to a cloud-based lakehouse architecture.
Key Responsibilities
Design, develop and optimise data pipelines using Databricks, Python/PySpark and SQL.
Build and maintain data transformations using dbt and Delta Lake.
Develop scalable data models across Bronze, Silver and Gold layers.
Support data migration from legacy platforms, including SAS.
Implement data quality checks, testing and performance optimisation.
Collaborate with data engineers, analysts and business stakeholders.
Skills & Experience
Strong hands-on experience with Databricks, PySpark and SQL.
Experience with dbt, Delta Lake and lakehouse architecture.
Proven experience developing and maintaining ETL/ELT pipelines.
Experience with cloud platforms, ideally Azure or AWS.
Understanding of CI/CD, data testing and production support.
Experience in insurance or financial services highly regarded.
Exposure to AI-assisted development tools such as GitHub Copilot or Databricks Genie advantageous.
Why Join?
Work on a large-scale data transformation program.
Modern Databricks and cloud technology environment.
Cooperative engineering team with hybrid flexibility.
Opportunity to contribute to AI-enabled data engineering practices.
Apply Now If you're a Data Engineer with strong Databricks experience looking for your next prospect, we'd love to hear from you.
📌 Data Engineer Databricks Sydney (Australia)
🏢 INGRITY
📍 Australia