Job Description

Exp: 7+Yrs

Key Responsibilities

- Design, develop, and optimize data pipelines using Azure Databricks and Apache Spark .
- Build and maintain robust ETL/ELT frameworks to ingest, transform, and load data from multiple source systems.
- Develop scalable data solutions leveraging Azure Data Factory (ADF) , Azure Data Lake Storage (ADLS) , and Azure Synapse Analytics .
- Implement data quality, validation, and monitoring frameworks to ensure data integrity and reliability.
- Collaborate with solution architects, business analysts, data scientists, and stakeholders to deliver project outcomes.
- Optimize Spark workloads, cluster configurations, and data processing performance.
- Support deployment activities through CI/CD pipelines and DevOps practices.
- Troubleshoot production issues and provide timely resolution of data platform incidents.
- Contribute to technical documentation, knowledge transfer, and operational handover activities.
- Ensure adherence to security, governance, compliance, and enterprise data standards.

Mandatory Technical Skills

- Apache Spark (PySpark, Spark SQL)
- Python
- SQL
- Data Warehousing Concepts
- ETL/ELT Development
- Git

Preferred Technical Skills

- Power BI
- Terraform
- Data Governance and Metadata Management
- Real-Time Data Processing Solutions
- 5+ years of Data Engineering experience in enterprise environments.
- 3+ years of hands‑on experience working with Azure Databricks and Apache Spark.
- Proven experience delivering data solutions on Azure cloud platforms.
- Experience designing and implementing scalable data pipelines and data lake architectures.
- Strong experience with Agile delivery methodologies.




- Ability to work independently and contribute immediately within a project‑based environment.
- Strong stakeholder management and communication skills.

Nice to Have

- Experience within Telecommunications, Banking, Utilities, Government, or Large Enterprise environments.
- Experience supporting cloud migration and data modernization programs.
- Azure Solutions Architect Expert

Advantages

Attractive compensation & rewards

We offer a highly competitive salary package aligned with the Australian market, complemented by performance‑based incentives, recognition programs, and comprehensive employee benefits. Your achievements are celebrated, and your contributions truly matter.

Global exposure with local impact

At TCS, you’ll work with leading Australian enterprises across diverse industries while collaborating with our global network of experts. This means access to world‑class practices, transformative technologies, and the chance to shape solutions that have a real impact — locally and globally.

Empowering leadership & supportive environment

Our leadership team is committed to helping you succeed. We encourage initiative, reward innovation, and provide a collaborative environment where your ideas are heard and valued.

Career Growth

We believe in careers, not just jobs. With continuous learning,



certification support, career mobility, and clear progression pathways, TCS empowers you to grow and evolve — whether you want to deepen your expertise, explore new domains, or take on leadership roles.

Inclusive, collaborative culture

Diversity, inclusion, and respect are central to who we are. At TCS Australia, you’ll join a workplace where collaboration thrives, individuality is valued, and everyone can contribute to meaningful outcomes.

Continuous learning & cutting-edge innovation

We invest heavily in your development, offering structured learning programs, global certifications, leadership development, and opportunities to work with emerging technologies. You’ll be part of an environment that constantly challenges and expands your capabilities.

Ideal Candidate

- Passionate about technology and transformation
- Driven by curiosity, innovation, and continuous learning
- Excited to work in a collaborative, purpose‑driven environment
- Motivated by delivering real impact for clients, communities, and society

Equal Opportunity Employer

TCS is an equal opportunity employer. All qualified applicants will be considered without regard to race, colour, religion, gender, gender identity, sexual orientation, national origin, disability, veteran status, or any other characteristic protected by applicable law.

Note: Compensation details are accurate as of this posting and may be adjusted in line with Australian laws and market conditions. Applicants may be asked to attend interviews in person or via video conference and present valid identification during the process.

#J-18808-Ljbffr

📌 Data Engineer (Azure Databricks & Apache Spark) (Melbourne)
🏢 Tata Consultancy Services
📍 Melbourne