Job Description

Responsibilities

n

n
- 5 years in a data engineering or closely related role.
n
- Design, build, and optimise batch and streaming data pipelines using approved frameworks and tooling using Azure Databricks.
n
- Ensure pipelines are resilient, performant, and cost optimised.
n
- Implement monitoring, alerting, and automated recovery processes.
n
- Apply data quality checks and reconciliation processes to ensure accuracy and completeness.
n
- Maintain metadata, lineage, and documentation to support governance requirements.
n
- Adhere to role-based access control, data privacy, and security standards.
n
- Contribute to the development and maintenance of ingestion frameworks, transformation layers, and data models.
n
- Implement and maintain CI/CD pipelines for automated testing and deployment.
n
- Optimise data storage and retrieval strategies to meet performance needs.
n
- Work closely with Technical Leads, Data Architects, Analysts, and business stakeholders to deliver fit for purpose solutions.
n
- Participate in code reviews and knowledge sharing sessions to improve team capability.
n

adopt new tools, frameworks, and techniques to enhance engineering capability.

n




- Identify opportunities to automate and streamline workflows.
n

n

Key Skills & Experience

n

Technical Skills

n

n
- Proficient in SQL for data wrangling, transformation, and analysis
n
- Robust programming skills in Python, Scala, or Java
n
- Experience building ETL/ELT pipelines in cloud or distributed environments
n
- Familiarity with cloud platforms and services
n
- Knowledge of data modeling concepts
n
- Experience with data orchestration tools
n
- Familiar with version control and CI/CD pipelines
n
- Understanding of data quality, validation, and observability practices
n
- Works independently with minimal supervision on well scoped tasks
n
- Collaborates effectively with stakeholders
n
- Communicates clearly and documents work for others to maintain or build upon
n
- Open to code reviews, feedback, and continuous learning
n
- Able to troubleshoot and resolve data pipeline failures or performance issues
n

n

Interested Candidates can share their updated resumes on [email protected] or can reach me on +61 251 103 879.

#J-18808-Ljbffr

📌 Data Engineer (Azure Databricks) (New South Wales)
🏢 CareCone Group
📍 New South Wales