22 Sep
|
Talent
|
Queensland
Job Description
We're looking for an experienced Data Engineer with strong, hands-on Databricks experience to join a modern cloud and AI-focused data environment.
Databricks is a mandatory requirement for this role.
We're particularly interested in engineers who have spent several years building and optimising production data solutions on the Databricks Lakehouse Platform, rather than candidates with limited or incidental exposure.
The Role
You'll work across modern data engineering and cloud integration initiatives, designing scalable data solutions using Databricks, AWS, Python, SQL and PySpark.
What You'll Be Doing
Build and optimise Databricks data pipelines and Lakehouse solutions
Develop scalable ingestion, transformation and orchestration workflows
Design and deliver cloud-native data integrations across AWS
Work extensively with Python, SQL, Spark/PySpark
Improve data performance, quality, security and governance
Support AI-enabled data and integration initiatives
Collaborate with engineering,
architecture and business teams
Contribute to engineering standards, automation and best practices
What We're Looking For
5+ years' Data Engineering experience
Proven experience building and optimising production Databricks pipelines
Strong understanding of the Databricks Lakehouse Platform
Strong Spark/PySpark, Python and SQL
Solid AWS experience across services such as S3, Glue, Lambda, Athena, Redshift, IAM and API Gateway
Experience with cloud-native data integration and orchestration
Understanding of APIs and modern integration patterns
Strong communication and problem-solving skills
Experience with Delta Lake, Unity Catalog, Medallion Architecture,Terraform/CloudFormation,CI/CD, Docker/Kubernetes or AI development tools would be highly regarded.
This is a 6 month contract with strong possibility for an extension paying $950 - $**** per day inc super.
📌 Data Engineer - (Databricks) (Queensland)
🏢 Talent
📍 Queensland