12 Nov
|
Sirius People
|
Australia
12 Nov
Sirius People
Australia
SENIOR DATA ENGINEER | AWS, PYSPARK, PYTHON, DBT | 12-MONTH CONTRACT (EXTENDABLE) | SYDNEY | 2 DAYS ONSITE Sirius Technology is working with an end-user operating across research, development and marketing services. They are looking for a Senior Data Engineer to design, build and maintain data pipelines and integration solutions across their modern AWS-based data platform. You will play a key role in ensuring data is reliable, accessible and well-structured to support analytics, API integrations and AI initiatives. Responsibilities Design, build and maintain scalable data pipelines and integration solutions across the AWS data platform. Develop and support ETL/ELT processes using AWS Glue, PySpark, Lambda and dbt. Design and optimise data models within Redshift to support reporting, analytics and wider business requirements. Lead the ingestion and integration of data from databases, APIs, files and event-driven sources. Monitor, troubleshoot and optimise data pipelines to ensure data quality,
reliability and performance. Implement and maintain metadata, data lineage and governance practices through DataHub and related tools. Skills Extensive experience designing, building and supporting AWS-based data platforms. Robust hands-on experience with AWS Glue, PySpark, Lambda, ECS/Fargate, Redshift and S3. Advanced SQL and Python development skills and Power BI. Experience with dbt, data modelling and ETL/ELT pipeline development. Experience building data ingestion, integration and API-based solutions at scale. Comfortable using AI-assisted development tools, with an interest in applying AI within data engineering. Applicants must be an Australian Citizen or Permanent Resident. If you would like to find out more, please apply or get in touch directly. Many thanks, Jake Johal
📌 Senior data engineer (Australia)
🏢 Sirius People
📍 Australia