This is a remote contract prospect for an experienced Azure Engineer to architect, implement, and manage the Azure infrastructure supporting a large-scale enterprise data and AI platform. The role centers on designing robust cloud solutions, establishing platform standards, and collaborating closely with Databricks administration, data engineering, and data science teams. You will provide technical leadership on complex platform decisions, ensuring secure, scalable, and cost-effective operations across Azure Databricks, ADLS Gen2, Azure Data Factory, and Azure Machine Learning environments.

Responsibilities

- Design, implement, and administer Azure-based data and AI platform infrastructure
- Define and enforce platform standards, reference architectures, and best practices
- Oversee Databricks administration, including Unity Catalog, cluster policies, and identity federation (Entra ID, SCIM)
- Manage Azure networking, security, observability, and cost optimization
- Lead platform automation using Terraform and Python
- Support ADF platform operations and troubleshoot Spark/SQL infrastructure issues
- Collaborate with cross-functional teams to deliver scalable, secure, and high-performing solutions
- Contribute to capacity planning, policy as code, and FinOps initiatives




- Provide guidance on multi-region Databricks deployments and ML workflows

Skills And Requirements

- Minimum 6 years of cloud infrastructure or platform engineering experience, with at least 4 years focused on Azure
- Advanced hands-on expertise in Terraform and Databricks administration
- Proficient in Unity Catalog, Entra ID, SCIM, cluster policies, and identity federation
- Strong knowledge of Azure networking, security, and observability tools
- Experience with ADLS Gen2, Azure Data Factory, and Python automation
- Ability to diagnose and resolve Spark and SQL infrastructure issues
- Familiarity with Azure Machine Learning, MLflow, Databricks Asset Bundles, Kubernetes, policy as code, and FinOps is a plus
- Experience with multi-region Databricks deployments preferred
- Excellent communication and technical leadership skills
- Availability for remote contract work

About Twine Twine is a leading freelance marketplace connecting top freelancers, consultants, and contractors with companies needing creative and tech expertise. Trusted by Fortune 500 companies and innovative startups alike, Twine enables companies to scale their teams globally. Our Mission Twine's mission is to empower creators and businesses to thrive in an AI-driven, freelance-first world.

📌 Freelance Azure Engineer – Data Platform (Australia)
🏢 Twine
📍 Australia