Responsibilities
5 years in a data engineering or closely related role.
Design, build, and optimise batch and streaming data pipelines using approved frameworks and tooling using Azure Databricks.
Ensure pipelines are resilient, performant, and cost optimised.
Implement monitoring, alerting, and automated recovery processes.
Apply data quality checks and reconciliation processes to ensure accuracy and completeness.
Maintain metadata, lineage, and documentation to support governance requirements.
Adhere to role-based access control, data privacy, and security standards.
Contribute to the development and maintenance of ingestion frameworks, transformation layers, and data models.
Implement and maintain CI/CD pipelines for automated testing and deployment.
Optimise data storage and retrieval strategies to meet performance needs.
Work closely with Technical Leads, Data Architects, Analysts, and business stakeholders to deliver fit for purpose solutions.
Participate in code reviews and knowledge sharing sessions to improve team capability.
adopt new tools, frameworks, and techniques to enhance engineering capability.




Identify opportunities to automate and streamline workflows.
Key Skills & Experience
Technical Skills
Proficient in SQL for data wrangling, transformation, and analysis
Solid programming skills in Python, Scala, or Java
Experience building ETL/ELT pipelines in cloud or distributed environments
Familiarity with cloud platforms and services
Knowledge of data modeling concepts
Experience with data orchestration tools
Familiar with version control and CI/CD pipelines
Understanding of data quality, validation, and observability practices
Works independently with minimal supervision on well scoped tasks
Collaborates effectively with stakeholders
Communicates clearly and documents work for others to maintain or build upon
Open to code reviews, feedback, and continuous learning
Able to troubleshoot and resolve data pipeline failures or performance issues
Interested Candidates can share their updated resumes on ****** or can reach me on ***************.
#J-*****-Ljbffr

📌 Data Engineer (Azure Databricks) (New South Wales)
🏢 CareCone Australia
📍 New South Wales