Senior Data Engineer (Sydney)

Senior Data Engineer (Sydney)

11 Oct
|
Tata Consultancy Services
|
Sydney

11 Oct

Tata Consultancy Services

Sydney

Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven worldview with digital innovation, collaborating with customers, communities and governments to lead and shape innovative solutions for a sustainable future.

TCS has been carbon neutral in its operations across 11 countries, 12 delivery centres and 18 offices in Asia Pacific since 2022. This is only the initial stage in TCS’ journey as we strive to achieve long-term net zero emissions by 2030.

Corporate sustainability is embedded in our triple-bottom-line, focusing on people, the planet, and our purpose. Our offices are designed with eco-friendly features that significantly reduce our carbon footprint and enhance energy efficiency. We actively champion green initiatives, such as promoting paperless operations, implementing energy-efficient practices, and fostering employee engagement in sustainability efforts.

When you become part of the TCS family, you will play an essential role dedicated to innovation, excellence, and crafting a brighter, greener future together. Join us and be a part of our mission to drive sustainability through technology and talent at Tata Consultancy Services, APAC today.

Role : Senior Data Engineer

Location : Sydney

Years of Experience : 8+Yrs

:

Must have :

- AWS
- Python
- Airflow
- SQL
- Pyspark

- AWS SageMaker Unified Studio Expertise:
- Proficiency with AWS SageMaker Unified Studio, including its various components Discover, Build and Govern.
- Experience with development in Sagemaker IDE and Application (Jupyterlab, Spaces and Partner AI Apps).
- Data Analysis and Integrations ( Query Editor, Visual ETL Jobs and Data Processing jobs)
- Orchestration of workflows and ML Pipelines
- Understanding and expertise to work with ML and Gen AI tools available in unified studio are ad-on values.
- Setting up projects and data governance in SageMaker Unified studio
- Advanced Data Ingestion & Processing (Real-time & Batch):
- Framework Development: Proven ability to design, develop, and implement highly reusable and adaptable data ingestion frameworks capable of handling diverse source types (e.g., databases, APIs, message queues, file systems).
- Low-Latency Real-time: Deep expertise in building real-time data pipelines with stringent sub-second latency requirements, utilising services like AWS Kinesis (Data Streams/Firehose), Apache Kafka, or similar streaming technologies.
- Batch Processing: Experience with robust batch ingestion patterns and tools (e.g., AWS Glue, Apache Spark) for productive processing of larger datasets.
- Data Transformation: Strong skills in designing and implementing efficient data transformation logic for both streaming and batch data.
- Programming and Scripting:
- Advanced proficiency in Python, particularly for developing scalable data ingestion and export frameworks, API integration, and extensive use of the AWS SDK (Boto3).
- Experience with performance optimisation techniques for Python applications in data-intensive environments.
- Familiarity with other relevant languages (e.g., Scala, Spark) for high-performance streaming applications is beneficial.
- AWS Services for Data and Infrastructure:
- In-depth knowledge of core AWS services: Lambda, S3, DynamoDB, CloudWatch, SQS,



SNS, and API Gateway.
- Strong understanding of AWS networking (VPC, security groups, private endpoints) and IAM for secure, fine-grained access control.
- Databases (Relational and No-SQL):
- Expertise with Amazon RDS (Relational Database Service) for both real-time data ingestion and efficient batch export. This includes optimising database performance, connection pooling, and transaction management for high-throughput, low-latency operations.
- Proficiency with Amazon Redshift for large-scale data warehousing, including data loading strategies (e.g., COPY command), query optimisation, and managing Redshift clusters for analytical workloads and batch export.
- Experience with No-SQL databases such as Amazon DynamoDB, MongoDB

- for high-performance, low-latency data storage and retrieval, particularly for real-time applications and feature serving.
- Orchestration and Workflow Management:
- Experience with AWS Managed Apache Airflow (MWAA) for orchestrating complex data pipelines, scheduling batch jobs, and managing dependencies between ingestion, processing, and export tasks.
- Ability to write, deploy, and manage Airflow DAGs (Directed Acyclic Graphs) for robust workflow automation.
- Monitoring and Observability (Real-time Heartbeat Export):
- Ability to design and implement comprehensive real-time monitoring solutions, including custom metrics, detailed logging, and tracing.
- Experience with AWS CloudWatch for collecting, analysing, and acting on operational data, specifically for generating and exporting "heartbeat" signals to external systems or dashboards.
- Knowledge of setting up proactive alerts and automated notifications for system health, performance degradation, and data pipeline anomalies.
- Software Development Practices & Architecture:
- Strong understanding of software engineering principles, design patterns, and architectural best practices for building scalable, maintainable, and reusable data frameworks.
- Proficiency with version control systems (Git) and collaborative development workflows.
- Experience with CI/CD pipelines for automated testing, deployment, and release management of data ingestion and export solutions.
- Familiarity with Infrastructure as Code (e.g., AWS CloudFormation, Terraform) for managing and provisioning AWS resources

Key Skillset

1. Previous experience in developing framework for batch and real time data ingestions in relation and no-sql databases or filesystems.
2. Previous experience in Real time data ingestion with low latency with experience on AWS Kinesis Stream, Apache Kafka or similar streaming technologies
3. Proven experience in various database technologies (e.g. Oracle, Teradata, MongoDB, Snowflake etc)
4. Sound knowledge and experience in building Data Warehouses and Data Lakehouses.
5. Data Modeling experience is a plus point

Top Reasons to Join Our Team at TCS Australia

Attractive compensation & rewards

We offer a highly competitive salary package aligned with the Australian market, complemented by performance-based incentives, recognition programs, and comprehensive employee benefits.



Your achievements are celebrated, and your contributions truly matter.

Global exposure with local impact

At TCS, you’ll work with leading Australian enterprises across diverse industries while collaborating with our global network of experts. This means access to world-class practices, transformative technologies, and the chance to shape solutions that have a real impact — locally and globally.

Empowering leadership & supportive environment

Our leadership team is committed to helping you succeed. We encourage initiative, reward innovation, and provide a collaborative environment where your ideas are heard and valued.

Long-term career growth

We believe in careers, not just jobs. With continuous learning, certification support, career mobility, and clear progression pathways, TCS empowers you to grow and evolve — whether you want to deepen your expertise, explore new domains, or take on leadership roles.

Inclusive, collaborative culture

Diversity, inclusion, and respect are central to who we are. At TCS Australia, you’ll join a workplace where collaboration thrives, individuality is valued, and everyone can contribute to meaningful outcomes.

Continuous learning & cutting-edge innovation

We invest heavily in your development, offering structured learning programs, global certifications, leadership development, and opportunities to work with emerging technologies. You’ll be part of an environment that constantly challenges and expands your capabilities.

A Great Fit for the TCS Culture

We’re looking for people who are:

- Passionate about technology and transformation
- Driven by curiosity, innovation, and continuous learning
- Excited to work in a collaborative, purpose-driven environment
- Motivated by delivering real impact for clients, communities, and society

Our core values — Integrity, Excellence, Responsibility, Pioneering Spirit, and Unity — shape how we work and how we grow together. The TCS Community in Australia and Beyond

- Global strength: Over 600,000+ associates in 55+ countries, united by a shared purpose — to innovate and make a difference.
- Local presence: A trusted partner to Australia’s leading enterprises across financial services, government, retail, healthcare, telecom, and more.
- Social impact: Deeply committed to sustainability, digital inclusion, and community engagement initiatives in Australia and around the world.
- Empowered workplace: We foster a culture where diversity, equity, and accessibility are integral to how we operate.

We don’t just imagine a better future — we help build it.

About TCS

Tata Consultancy Services (TCS) is a global leader in IT services, consulting, and business solutions. We have partnered with many of the world’s largest organisations to help them transform their businesses, operating models, and technology ecosystems.

Learn more at www.tcs.com.

Equal Opportunity Employer

TCS is an equal opportunity employer. All qualified applicants will be considered without regard to race, colour, religion, gender, gender identity, sexual orientation, national origin, disability, veteran status, or any other characteristic protected by applicable law.

Note: Compensation details are accurate as of this posting and may be adjusted in line with Australian laws and market conditions. Applicants may be asked to attend interviews in person or via video conference and present valid identification during the process.

📌 Senior Data Engineer (Sydney)
🏢 Tata Consultancy Services
📍 Sydney

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (sydney) / sydney

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (sydney) / sydney