21 Oct
|
Intrinzic
|
Harman
- Upto $140k package
- Databricks / AWS Kinesis
- Canberra or Melbourne
- AGSVA Security clearance required (Baseline - minimum)
We're partnering with a leading technology organisation who are looking for an experienced Data Engineer to join a collaborative engineering team delivering modern, cloud-based data solutions.
This is an opportunity to work with a cutting-edge AWS and Databricks technology stack, designing and developing scalable, real-time data pipelines that process high volumes of data.
If you're passionate about data engineering, enjoy working with streaming technologies and want to make a genuine technical impact, we'd love to hear from you.
The Opportunity
You'll play a key role in building and optimising real-time data pipelines, leveraging Amazon Kinesis, Databricks, Apache Spark and Delta Lake to deliver reliable, scalable data solutions.
Working alongside experienced data engineers and cloud specialists, you'll help develop robust streaming architectures, improve data-processing performance and contribute to the delivery of business-critical data platforms.
This is a genuinely hands-on engineering position where you'll have the opportunity to solve interesting technical challenges and work with modern cloud technologies.
What You'll Be Doing
- Design, develop and maintain high-performance, real-time data pipelines using Amazon Kinesis Data Streams and Kinesis Data Firehose.
- Build scalable streaming solutions using Databricks and Apache Spark Structured Streaming.
- Develop and optimise data ingestion into Delta Lake tables.
- Improve pipeline performance, reliability, latency and cost efficiency.
- Implement monitoring and alerting using AWS CloudWatch.
- Collaborate with engineering teams to integrate streaming and batch data solutions.
- Write clean,
maintainable and testable Python and SQL code.
- Troubleshoot complex data-processing challenges and continuously improve engineering practices.
What We're Looking For
We're looking for an engineer who enjoys being hands-on and has experience building and supporting production-grade data platforms.
Essential experience
- Strong commercial experience with Amazon Kinesis Data Streams and/or Kinesis Data Firehose.
- Solid programming skills in Python and SQL.
- Hands-on experience with Apache Spark Structured Streaming.
- Experience working with Databricks in a production environment.
- Good understanding of AWS services, including S3, IAM and CloudWatch.
- Experience designing scalable, reliable data pipelines.
- Strong analytical, troubleshooting and problem-solving capabilities.
Nice to have
- Experience with Delta Lake and Unity Catalog.
- Exposure to Apache Kafka or other event-streaming technologies.
- Experience working with large-scale enterprise data platforms.
Why This Opportunity?
- Modern technology stack: Work extensively with AWS, Kinesis, Databricks, Spark and Delta Lake.
- Interesting technical challenges: Build and optimise high-volume, real-time data-processing solutions.
- Flexibility: Enjoy adaptable working arrangements that support work-life balance.
- Professional development: Access training, certifications and opportunities to develop your technical expertise.
- Career progression: Join an organisation offering long-term growth and exposure to impactful projects.
- Supportive environment: Collaborate with experienced engineers in an inclusive, technically focused team.
- Competitive remuneration: Attractive salary package and employee benefits.
To apply or for a confidential conversation, click APPLY or email ***email_hidden***
📌 Data Engineer (Harman)
🏢 Intrinzic
📍 Harman