12 month contract

Sydney

Senior Data Engineer

About the Role

We are seeking an experienced Data Engineer to join a high-performing enterprise technology team, delivering modern cloud-based data solutions that enable analytics, reporting, and business intelligence across the organisation.

This is a hands-on engineering role where you will design, build, and optimise scalable data pipelines and cloud data platforms using Databricks and Snowflake. Working closely with Data Architects, Analytics Engineers, Data Scientists, and Business stakeholders, you will develop robust data solutions that support enterprise-wide decision making and digital transformation initiatives.

Key Responsibilities

- Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks and Snowflake.
- Build and optimise data ingestion frameworks for structured, semi-structured, and streaming data from multiple enterprise source systems.
- Develop high-performance data models and curated datasets to support reporting, analytics, machine learning, and operational use cases.
- Collaborate with Solution Architects and Data Architects to implement modern data platform solutions aligned with enterprise architecture standards.
- Optimise Snowflake performance through warehouse tuning, clustering, partitioning, and cost optimisation strategies.
- Develop Databricks notebooks, Delta Lake solutions, and Spark applications for large-scale data processing.
- Implement data quality, validation, reconciliation, and monitoring frameworks to ensure trusted data across the platform.
- Build reusable, automated CI/CD deployment pipelines and support DevOps best practices.




- Troubleshoot production issues and continuously improve platform performance, reliability, and scalability.
- Participate in Agile ceremonies, technical design workshops, code reviews, and sprint planning.

Required Skills & Experience

Data Engineering

- 5 years' experience in Data Engineering within enterprise or corporate environments.
- Strong hands-on experience building enterprise data platforms using Databricks and Snowflake.
- Experience developing scalable ETL/ELT pipelines supporting large data volumes.
- Strong understanding of data modelling principles including dimensional modelling and Data Vault methodologies.

Databricks
- Strong experience with Databricks, Apache Spark, and Delta Lake.
- Proficiency in PySpark and SQL.
- Experience implementing Medallion Architecture (Bronze, Silver, Gold layers).
- Knowledge of Databricks Workflows, Unity Catalog, and Delta Live Tables is highly regarded.

Snowflake
- Experience designing and developing solutions within Snowflake.
- Strong SQL development skills.
- Experience with Snowflake performance tuning, virtual warehouses, secure data sharing, and Snowpipe.
- Understanding of data governance, security, and role-based access controls.

Cloud & Integration
- Experience working within Azure, AWS,



or GCP cloud environments.
- Experience integrating enterprise applications using APIs, event-driven architecture, or messaging platforms.
- Familiarity with cloud storage services such as Azure Data Lake, Amazon S3, or Google Cloud Storage.

DevOps & Engineering
- Experience with Git-based source control and CI/CD pipelines.
- Exposure to Azure DevOps, GitHub Actions, or similar deployment tooling.
- Experience with Infrastructure as Code (Terraform or equivalent) is advantageous.
- Solid understanding of software engineering best practices including testing, monitoring, and automation.

Technical Skills
- Databricks
- Snowflake
- Apache Spark
- PySpark
- SQL
- Python
- Delta Lake
- Delta Live Tables
- Unity Catalog
- Azure Data Factory (ADF) or equivalent orchestration tools
- Azure, AWS, or GCP
- Git
- Azure DevOps / GitHub
- REST APIs

Nice to Have
- Experience working in financial services, insurance, retail, healthcare, or other enterprise environments.
- Exposure to streaming technologies such as Kafka or Event Hubs.
- Knowledge of dbt, Airflow, or other modern data transformation tools.
- Experience implementing enterprise data governance and metadata management.
- Cloud certifications or Databricks/Snowflake certifications.

What We're Looking For

We're looking for a collaborative Data Engineer who enjoys solving complex data challenges and building scalable cloud-native solutions. You'll have a strong engineering mindset, excellent problem-solving skills, and experience delivering high-quality data platforms in fast-paced Agile environments.

📌 Senior Data Engineer (Sydney)
🏢 SKL Technology
📍 Sydney