Job Description
n
We are looking for a
Lead Data & AI Engineer
to design and deliver data platforms and applications across a range of client engagements. This role combines hands-on data engineering, technical leadership, and practical experience with AI, both in the solutions you build and in your daily development work.
n
You will work across different cloud platforms and technology stacks, helping teams build reliable data pipelines, well-governed data products, and AI-enabled applications.
Responsibilitiesn
n
Lead the design and development of scalable data pipelines, platforms, and data products
n
Build batch and streaming solutions for ingestion, transformation, and delivery
n
Use AI coding assistants effectively in daily work to accelerate development, testing, debugging, and documentation, while reviewing and validating their output
n
Apply software engineering practices, including testing, code review, CI/CD, observability, and infrastructure automation
n
Design for data quality, security, governance, reliability, and performance
n
Contribute to AI applications, including data preparation, retrieval, integration, evaluation, and deployment
n
Help design and build agentic applications that use tools, APIs, and enterprise data to support business workflows
n
Make sound architectural choices across cloud services, processing frameworks, storage technologies, and orchestration tools
n
Work with clients and stakeholders to clarify requirements, explain trade-offs, and guide delivery
n
Mentor engineers and contribute to reusable patterns and engineering standards
n
Requirementsn
n
Strong experience in data engineering, including technical leadership on delivered projects
n




Hands-on programming skills in Python and strong SQL proficiency
n
Experience with distributed data processing, such as Apache Spark or equivalent technologies
n
Experience designing data pipelines and working with modern lakehouse, warehouse, or event-driven architectures
n
Practical experience with at least one major cloud platform: Azure, AWS, or Google Cloud
n
Experience with orchestration, automated deployment, testing, monitoring, and production support
n
Understanding of data governance, access control, and secure handling of enterprise data
n
Practical experience using AI development tools as part of an engineering workflow, with the ability to assess generated code for correctness, maintainability, and security
n
Experience developing AI applications, such as solutions using LLM APIs, retrieval-augmented generation, or AI-powered workflows
n
Working knowledge of agentic application patterns, including tool use, orchestration, state management, and evaluation
n
Solid communication skills and the ability to work directly with clients, architects, and delivery teams
n
Nice to haven
n
Experience with Databricks, Snowflake, Microsoft Fabric, BigQuery, or similar platforms
n
Experience with Unity Catalog or other data governance tools
n
Experience with Terraform or other infrastructure as code tools
n
Experience building reusable frameworks or accelerators
n
Experience with streaming technologies such as Kafka
n
Experience with AI frameworks or platforms such as LangChain, LangGraph, Azure AI Foundry, Vertex AI, or Amazon Bedrock
n
Familiarity with AI application observability, guardrails, and responsible AI practices
n
Consulting or presales experience, including discovery workshops, solution design, and estimation
n
n

📌 Lead Data & Ai Engineer (Melbourne)
🏢 EPAM Systems
📍 Melbourne