29 Sep
|
CareCone Group
|
Sydney
29 Sep
CareCone Group
Sydney
We are looking for an experienced Senior Data Engineer to join our team in Sydney. This is a hands-on role for someone who can design, build, and support scalable data pipelines and curated datasets on AWS while working across modern data engineering practices.
About the Role
The ideal candidate will bring strong SQL and Python capability, solid experience with AWS-native data services, and the ability to take ownership of complex data pipelines in a large-scale enterprise setting. You will work closely with analytics, data science, and business stakeholders to deliver reliable, high-quality data solutions.
What You’ll Be Doing
- Design, develop, and maintain batch and near real-time data pipelines on AWS.
- Build ETL/ELT workflows using AWS Glue, S3, Redshift, Athena, EMR, dbt, and Airflow.
- Ingest data from databases, APIs, files, and event streams into raw, cleansed, and curated layers.
- Develop transformation logic using SQL, Python, PySpark, and Spark.
- Implement data quality checks, reconciliation controls, monitoring, and alerting.
- Support DataOps and DevOps practices including version control, CI/CD, testing, releases,
and production support.
- Maintain technical documentation including data flows, mappings, job schedules, runbooks, and operational procedures.
What We’re Looking For
- 8–10 years’ experience as a Data Engineer in enterprise-scale environments.
- Advanced SQL skills including query optimisation, complex joins, window functions, and performance tuning.
- Solid hands-on AWS data engineering experience across S3, Glue, Redshift, Athena, EMR, and dbt.
- Strong Python programming skills with PySpark and/or Spark experience.
- Experience with Teradata and Siebel CRM datasets.
- Good understanding of data warehousing concepts including dimensional modelling, partitioning, incremental loads, and CDC.
- Experience with workflow orchestration tools such as Airflow.
- Strong communication skills with the ability to work closely with stakeholders and translate requirements into data deliverables.
- Telco industry experience is highly desirable.
#J-18808-Ljbffr
📌 Senior Data Engineer (Sydney)
🏢 CareCone Group
📍 Sydney