Senior Data Engineer (Sydney)

Senior Data Engineer (Sydney)

21 Oct
|
Tech Mahindra
|
Sydney

21 Oct

Tech Mahindra

Sydney

At Tech Mahindra (Tech Mahindra | Connected World, Connected Experiences), we live the philosophy of connected world and connected experiences. We thrive on change that is powered by the intelligent symphony of technology and humans designing meaningful and sustainable experiences. Consumer ‘experiences’ are driving and disrupting industries like never before. Businesses must build seamless yet easy enterprises that collaborate, synergize, and drive the change. Change that connects us all and empowers us to deliver experiences that span across the digital, the physical, the convergent, and everything in between. That’s when truly connected experiences manifest.

Extraordinary is when experiences come together – a continuous convergence of digital technologies, touchpoints, and most importantly people. It’s time to reimagine, reinvent, and revolutionize business models & operations as well as to transform enterprises into living, breathing, and connected businesses. We are the Digital Change makers who strive to change the way the world, communities, businesses, and humans interact digitally. We are harnessing the power of change, brought in by technologies, that makes it the most exciting time to be alive in the human history. Our universe, as we build it, disrupt it, and redesign it, is powering the digital change.

Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences, enabling Enterprises, Associates, and the Society to Rise. It has 150,000+ professionals working for 1000+ Global Customers (including Fortune 500 companies) in 90 Countries. We’re part of the esteemed Mahindra group, headquartered in India. Under a new CEO,



Tech Mahindra is committed to a transformative journey with 'Scale @ Speed' as our guiding principle.

- Proficiency with AWS SageMaker Unified Studio, including its various components Discover, Build and Govern.
- Experience with development in Sagemaker IDE and Application (Jupyterlab, Spaces and Partner AI Apps).
- Data Analysis and Integrations ( Query Editor, Visual ETL Jobs and Data Processing jobs)
- Orchestration of workflows and ML Pipelines
- Understanding and expertise to work with ML and Gen AI tools available in unified studio are ad-on values.
- Setting up projects and data governance in SageMaker Unified studio

Advanced Data Ingestion & Processing (Real-time & Batch):

- Framework Development: Proven ability to design, develop, and implement highly reusable and adaptable data ingestion frameworks capable of handling diverse source types (e.g., databases, APIs, message queues, file systems).
- Low-Latency Real-time: Deep expertise in building real-time data pipelines with stringent sub-second latency requirements, utilising services like AWS Kinesis (Data Streams/Firehose), Apache Kafka, or similar streaming technologies.
- Batch Processing: Experience with robust batch ingestion patterns and tools (e.g., AWS Glue, Apache Spark) for efficient processing of larger datasets.
- Data Transformation:



Strong skills in designing and implementing efficient data transformation logic for both streaming and batch data.

Programming and Scripting:

- Advanced proficiency in Python, particularly for developing scalable data ingestion and export frameworks, API integration, and extensive use of the AWS SDK (Boto3).
- Experience with performance optimisation techniques for Python applications in data-intensive environments.
- Familiarity with other relevant languages (e.g., Scala, Spark) for high-performance streaming applications is beneficial.

AWS Services for Data and Infrastructure:

- In-depth knowledge of core AWS services: Lambda, S3, DynamoDB, CloudWatch, SQS, SNS, and API Gateway.
- Strong understanding of AWS networking (VPC, security groups, private endpoints) and IAM for secure, fine-grained access control.

Databases (Relational and No-SQL):

- Expertise with Amazon RDS (Relational Database Service) for both real-time data ingestion and efficient batch export. This includes optimising database performance, connection pooling, and transaction management for high-throughput, low-latency operations.
- Proficiency with Amazon Redshift for large-scale data warehousing, including data loading strategies (e.g., COPY command), query optimisation, and managing Redshift clusters for analytical workloads and batch export.
- Experience with No-SQL databases such as Amazon DynamoDB, MongoDB
- for high-performance, low-latency data storage and retrieval, particularly for real-time applications and feature serving.

Orchestration and Workflow Management:

- Experience with AWS Managed Apache Airflow (MWAA)for orchestrating complex data pipelines, scheduling batch jobs, and managing depend

📌 Senior Data Engineer (Sydney)
🏢 Tech Mahindra
📍 Sydney

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (sydney) / sydney

Subscribe to this job alert:

Get the latest job offers by email for: senior data engineer (sydney) / sydney