Senior Data Engineer – AWS and Snowflake

- Design, develop, and maintain scalable real‑time, event‑driven, CDC‑based, and batch data pipelines on AWS and Snowflake to support analytics.
- Build and optimise data ingestion frameworks leveraging streaming technologies, event‑based architectures, and Change Data Capture (CDC) patterns.
- Develop and manage cloud‑native data solutions preferably on AWS that ensure high availability, reliability, scalability, and performance.
- Optimise Snowflake data models, queries, workloads, and storage strategies to improve performance and cost efficiency.
- Implement and maintain robust data quality, governance, security, privacy, and compliance controls across the data platform.
- Design and manage ETL/ELT processes for integrating data from multiple internal and external sources.
- Automate infrastructure provisioning, testing, deployment, and monitoring using CI/CD pipelines and Infrastructure‑as‑Code practices.
- Collaborate closely with solution architects, application development teams, data scientists, business analysts, and key stakeholders to deliver data solutions aligned with business objectives.

Experience and Qualifications

- Strong hands‑on experience with Python and SQL for data engineering, transformation, and automation.




- Extensive experience designing and implementing data solutions on AWS, including services such as S3, Glue, Lambda, EMR, Kinesis, EventBridge, Redshift, Step Functions, and related data services.
- Strong expertise in Snowflake, including data modelling, performance tuning, workload optimisation, security, and administration.
- Experience building real‑time streaming, event‑driven, and CDC‑based data ingestion architectures.
- Solid understanding of ETL/ELT frameworks, distributed data processing, and modern data engineering patterns.
- Experience with DevOps practices, CI/CD pipelines, version control systems (e.g., Git), and infrastructure automation.
- Knowledge of data governance, data quality frameworks, metadata management, security, and compliance requirements.
- Experience working with large‑scale structured and unstructured datasets in cloud environments.

Advantages

- Exposure to transformational programs in AI and Data portfolio.
- Career growth through learning platforms, certifications, and global mobility.
- Inclusive culture backed by the “Inclusive Future for All” commitment.
- Competitive total rewards and recognition programs.

#J-18808-Ljbffr

📌 Senior Data Engineer - AWS and Snowflake at Capgemini (City of Sydney)
🏢 Capgemini
📍 City of Sydney