14 Nov
|
Sirius.
|
Sydney
SENIOR DATA ENGINEER | AWS, PYSPARK, PYTHON, DBT, POWERBI | 12-MONTH CONTRACT (EXTENDABLE) | SYDNEY | 2 DAYS ONSITE
Sirius Technology is working with an end-user operating across research, development and marketing services. They are looking for a Senior Data Engineer to design, build and maintain data pipelines and integration solutions across their modern AWS-based data platform.
You will play a key role in ensuring data is reliable, accessible and well-structured to support analytics, API integrations and AI initiatives.
Responsibilities
- Design, build and maintain scalable data pipelines and integration solutions across the AWS data platform.
- Develop and support ETL/ELT processes using AWS Glue, PySpark, Lambda and dbt.
- Design and optimise data models within Redshift to support reporting, analytics and wider business requirements.
- Lead the ingestion and integration of data from databases, APIs, files and event-driven sources.
- Monitor,
troubleshoot and optimise data pipelines to ensure data quality, reliability and performance.
- Implement and maintain metadata, data lineage and governance practices through DataHub and related tools.
Skills
- Extensive experience designing, building and supporting AWS-based data platforms.
- Robust hands‑on experience with AWS Glue, PySpark, Lambda, ECS/Fargate, Redshift and S3.
- Advanced SQL and Python development skills and Power BI.
- Experience with dbt, data modelling and ETL/ELT pipeline development.
- Experience building data ingestion, integration and API‑based solutions at scale.
- Comfortable using AI‑assisted development tools, with an interest in applying AI within data engineering.
Applicants must be an Australian Citizen or Permanent Resident.
#J-18808-Ljbffr
📌 Senior Data Engineer (Sydney)
🏢 Sirius.
📍 Sydney