Data And Ai Architect (Melbourne)

Data And Ai Architect (Melbourne)

15 Nov
|
EPAM Systems
|
Melbourne

15 Nov

EPAM Systems

Melbourne

We are seeking a

Data and AI Architect

to design shared data architecture for Agentic AI solutions on Databricks. You will shape secure ingestion, modeling and governance for IoT and time-series data and enable RAG retrieval patterns using Delta Lake, Unity Catalog, Spark and Vector Search. You simplify complexity and guide teams toward scalable, reusable designs.

You will define the shared data architecture for Agentic AI solutions built on Databricks. Your focus is creating a secure, scalable and reusable foundation for ingestion, modeling, governance and retrieval patterns that enable AI-ready data products.

You bring a pragmatic systems mindset, and you can translate complex data and AI requirements into clear architecture decisions. You collaborate across engineering, product and security teams, challenge assumptions constructively and manage risks early.

Responsibilities

Design shared data and AI architecture on Databricks across Agentic AI solutions

Define data modeling standards for IoT and time-series domains aligned to analytics and RAG needs

Architect ingestion and processing pipelines using Spark and Delta Lake

Establish governance, lineage and access controls with Unity Catalog

Define secure data access patterns for internal teams and downstream consumption

Design RAG retrieval patterns including indexing strategy and datasets for Vector Search

Produce architecture decision records, reference designs and reusable templates

Partner with stakeholders to align scope, manage risks and drive implementation quality

Requirements

Databricks architecture experience in production environments

Data modeling expertise including event, time-series, dimensional and canonical modeling patterns

Ingestion pipeline experience across batch and streaming patterns

IoT and time-series data experience including scale, retention and query optimization

Delta Lake expertise including table design,



performance tuning and lifecycle management

Databricks Unity Catalog experience covering governance, lineage and fine-grained access control

Apache Spark expertise for large-scale processing and optimization

Data governance and security experience including policy design and secure-by-default architecture

Nice to have

Experience implementing Vector Search and managing embedding lifecycle

Familiarity with retrieval quality, evaluation signals and RAG tuning considerations

Experience enabling shared data products across multiple teams

We offer

By choosing EPAM, you're getting a job at Outstanding Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023.

Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.

You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.

We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.

At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

Life at EPAM

We are a leading global provider of digital platform engineering and development services that has rapidly grew in Australia since 2013.

We adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. With a multinational talented team, we have been delivering innovative solutions for cloud migration, cyber security, digital transformation, etc.

You will work in an open and friendly work environment where your professional skills and experience can stand out.

#J-18808-Ljbffr

📌 Data And Ai Architect (Melbourne)
🏢 EPAM Systems
📍 Melbourne

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data and ai architect (melbourne) / melbourne

Subscribe to this job alert:

Get the latest job offers by email for: data and ai architect (melbourne) / melbourne