06 Oct
|
CareCone Group
|
Sydney
06 Oct
CareCone Group
Sydney
Job Description
n
We are looking for an experienced Senior Data Engineer to join our team in Sydney. This is a hands-on role for someone who can design, build, and support scalable data pipelines and curated datasets on AWS while working across modern data engineering practices.
About the Role n
The ideal candidate will bring strong SQL and Python capability, solid experience with AWS-native data services, and the ability to take ownership of complex data pipelines in a large-scale enterprise environment. You will work closely with analytics, data science, and business stakeholders to deliver reliable, high-quality data solutions.
What You’ll Be Doing n
n
- Design, develop, and maintain batch and near real-time data pipelines on AWS.
n
- Build ETL/ELT workflows using AWS Glue, S3, Redshift, Athena, EMR, dbt, and Airflow.
n
- Ingest data from databases, APIs, files, and event streams into raw, cleansed, and curated layers.
n
- Develop transformation logic using SQL, Python, PySpark, and Spark.
n
- Implement data quality checks, reconciliation controls, monitoring, and alerting.
n
- Support DataOps and DevOps practices including version control, CI/CD, testing,
releases, and production support.
n
- Maintain technical documentation including data flows, mappings, job schedules, runbooks, and operational procedures.
n
What We’re Looking For nn
- 8–10 years’ experience as a Data Engineer in enterprise-scale environments.
n
- Advanced SQL skills including query optimisation, complex joins, window functions, and performance tuning.
n
- Strong hands-on AWS data engineering experience across S3, Glue, Redshift, Athena, EMR, and dbt.
n
- Strong Python programming skills with PySpark and/or Spark experience.
n
- Experience with Teradata and Siebel CRM datasets.
n
- Positive understanding of data warehousing concepts including dimensional modelling, partitioning, incremental loads, and CDC.
n
- Experience with workflow orchestration tools such as Airflow.
n
- Strong communication skills with the ability to work closely with stakeholders and translate requirements into data deliverables.
n
- Telco industry experience is highly desirable.
n
n
#J-18808-Ljbffr
📌 Senior Data Engineer (Sydney)
🏢 CareCone Group
📍 Sydney