Job Description

Design, develop, and maintain scalable and robust machine learning pipelines on Azure Databricks.

n

Implement and optimize ML workflows, including data ingestion, feature engineering, model training, evaluation, and deployment.

n

Utilize Azure Machine Learning (Azure ML) services for model management, experimentation, and MLOps best practices (e.g., MLflow).

n

Develop and deploy Large Language Models (LLMs) and Generative AI (GenAI) solutions on Databricks, including RAG architectures and fine-tuning.

n

Work with PySpark, Python, and SQL for data processing, analysis, and model development.

n

Monitor and troubleshoot deployed models, ensuring data quality, model performance, and detecting drift.

n

Required Skills & Qualifications:

n





2+ years of hands-on experience in AI/ML engineering, with a strong focus on MLOps and cloud-based deployments.

n

Proven expertise with Azure Databricks and its ecosystem (Delta Lake, MLflow, Unity Catalog).

n

Proficiency in Python (including PySpark) and SQL.

n

Experience with Azure Machine Learning services.

n

Robust understanding of machine learning algorithms, deep learning concepts, and statistical analysis.

n

Experience with building and deploying Generative AI/LLM solutions is highly desirable.

n

Excellent problem-solving, communication, and collaboration skills.

#J-18808-Ljbffr

📌 AI/ML Engineer (Azure & Databricks) (New South Wales)
🏢 RESOURCE CORNER
📍 New South Wales