20 Aug
|
Capgemini
|
New South Wales
20 Aug
Capgemini
New South Wales
Job Description
Senior Data Engineer – AWS and Snowflake
n
n
Design, develop, and maintain scalable real‐time, event‐driven, CDC‐based, and batch data pipelines on AWS and Snowflake to support analytics.
n
Build and optimise data ingestion frameworks leveraging streaming technologies, event‐based architectures, and Change Data Capture (CDC) patterns.
n
Develop and manage cloud‐native data solutions preferably on AWS that ensure high availability, reliability, scalability, and performance.
n
Optimise Snowflake data models, queries, workloads, and storage strategies to improve performance and cost efficiency.
n
Implement and maintain robust data quality, governance, security, privacy, and compliance controls across the data platform.
n
Design and manage ETL/ELT processes for integrating data from multiple internal and external sources.
n
Automate infrastructure provisioning, testing, deployment, and monitoring using CI/CD pipelines and Infrastructure‐as‐Code practices.
n
Collaborate closely with solution architects, application development teams, data scientists, business analysts, and key stakeholders to deliver data solutions aligned with business objectives.
n
n
Experience and Qualifications
n
n
Strong hands‐on experience with Python and SQL for data engineering, transformation, and automation.
n
Extensive experience designing and implementing data solutions on AWS, including services such as S3, Glue, Lambda, EMR, Kinesis, EventBridge, Redshift, Step Functions, and related data services.
n
Strong expertise in Snowflake, including data modelling, performance tuning, workload optimisation, security, and administration.
n
Experience building real‐time streaming, event‐driven, and CDC‐based data ingestion architectures.
n
Solid understanding of ETL/ELT frameworks, distributed data processing, and modern data engineering patterns.
n
Experience with DevOps practices, CI/CD pipelines, version control systems (e.g., Git), and infrastructure automation.
n
Knowledge of data governance, data quality frameworks, metadata management, security, and compliance requirements.
n
Experience working with large‐scale structured and unstructured datasets in cloud environments.
n
n
Benefits
n
n
Exposure to transformational programs in AI and Data portfolio.
n
Growth opportunities through learning platforms, certifications, and global mobility.
n
Inclusive culture backed by the "Inclusive Future for All" commitment.
n
Competitive total rewards and recognition programs.
n
#J-*****-Ljbffr
📌 Senior Data Engineer - Aws And Snowflake At Capgemini (New South Wales)
🏢 Capgemini
📍 New South Wales