Job Description

n

We are hiring a hands-on Data Engineer to design, build, and optimize scalable data pipelines on Azure Databricks . This role is ideal for someone with solid experience in Spark, Scala, SQL, Python, and modern cloud-based data engineering platforms.

n

Location: Sydney

Key Responsibilities n

n
- Design and develop scalable ETL/ELT pipelines using Azure Databricks, Spark/Scala, and SQL.
n
- Build data solutions following medallion architecture and Delta Lake best practices.
n
- Develop real-time and near real-time data integrations using Spark Streaming and Kafka.
n
- Operationalize data workloads through scheduling, CI/CD, Git-based workflows, secrets management, and observability.
n
- Collaborate with stakeholders to deliver reliable, high-quality data engineering solutions.
n

Required Skills nn




- Strong hands-on experience with Azure Databricks.
n
- Proficiency in Scala Spark, SQL, and Python.
n
- Experience with data warehousing concepts and big data technologies.
n
- Exposure to Azure and/or AWS cloud platforms.
n
- Knowledge of Hive, Impala, Sqoop, Spark Streaming, Apache Kafka, or Confluent Kafka will be advantageous.
n
- Familiarity with CI/CD tools such as Azure DevOps, GitHub, Jenkins, Jira, or Confluence.
n
- Strong communication and stakeholder management skills.
n

n

If you are passionate about building high-performing data platforms and enjoy solving complex data engineering challenges, we would love to hear from you.

n

#J-18808-Ljbffr

📌 Data Engineer - Azure Databricks (Sydney)
🏢 Tech Mahindra
📍 Sydney