04 Nov
|
Accenture
|
Canberra
04 Nov
Accenture
Canberra
We are seeking a highly skilled Data Engineer / Databricks Platform Administrator to join our Data & AI team. This hybrid role combines Databricks platform engineering and administration with hands-on data engineering delivery responsibilities. You will play a key role in establishing and operating a secure, scalable, enterprise-grade Databricks platform on AWS while also contributing to data pipeline development, governance initiatives, and engineering best practices.
Key Responsibilities
- Design, build, and implement Databricks workspaces on AWS from the ground up.
- Configure and manage Unity Catalog, metastores, catalogs, schemas, storage credentials, and access controls.
- Design secure network architectures using AWS VPCs, Private Link, network isolation, and enterprise security best practices.
- Implement and manage IAM roles, instance profiles, and cloud access models.
- Develop and maintain Infrastructure-as-Code solutions using Terraform or equivalent tooling.
- Establish CI/CD pipelines for platform configuration, deployment, and governance controls.
- Define and enforce cluster policies, workspace standards, and operational guardrails. Required Skills & Experience
- Strong hands-on experience administering Databricks environments.
- Experience implementing and managing Unity Catalog and Databricks governance frameworks.
- Experience building and supporting production-grade data pipelines.
- Strong Python and SQL development skills.
- Strong AWS experience including: VPC Private Link IAM S3 Networking and security architecture
- Robust Infrastructure-as-Code experience using Terraform (preferred) or equivalent tools.
- Experience implementing CI/CD pipelines for infrastructure and platform deployments.
📌 Data Engineer (Canberra)
🏢 Accenture
📍 Canberra