24 Aug
|
Simple Machines
|
New South Wales
24 Aug
Simple Machines
New South Wales
Job Description
Principal Data Platforms Engineer
n
Who We Are
n
Simple Machines is a global, independent technology consultancy operating across Sydney, Current Zealand, London, Poland and San Francisco. We design and build up-to-date data platforms, intelligent systems, and bespoke software at the intersection of Data Engineering, Software Engineering and AI.
n
We work with enterprises, scale-ups, and government to turn messy, high-value data into products, platforms, and decisions that actually move the needle.
n
We don't do generic. We build things that matter - We engineer data to life.
n
Requirements
n
The Role
n
This is a hands-on principal engineering role, not an architecture-only seat and not a support function. You'll be responsible for technical direction, platform design and architectural decision-making.
n
You'll design and build greenfield data platforms, real-time pipelines, and data products for clients who are serious about using data properly. You'll work in small, high-calibre teams and operate close to both the problem and the client.
n
If you enjoy solving hard data problems, shaping modern architectures (data mesh, data products, contracts), and delivering real outcomes — this is your lane.
n
What You'll Be Doing
n
Lead Platform & Architecture Design
n
n
Own the end-to-end architecture of modern, cloud-native data platforms
n
Design scalable data ecosystems using data mesh, data products, and data contracts
n
Make high-impact architectural decisions across ingestion, storage, processing, and access layers
n
Ensure platforms are secure, compliant, and production-grade by design
n
n
Build Modern Data Platforms
n
n
Design and deliver cloud-native data platforms using Databricks, Snowflake, AWS, and GCP
n
Apply modern architectural patterns: data mesh, data products, and data contracts
n
Integrate deeply with client systems to enable scalable, consumer-oriented data access
n
n
Develop High-Performance Pipelines
n
n
Build and optimise batch and real-time pipelines
n
Work with streaming and event-driven tech such as Kafka, Flink, Kinesis, Pub/Sub
n
Orchestrate workflows using Airflow, Dataflow, Glue
n
n
Work at Scale
n
n
Process and transform large datasets using Spark and Flink
n
Design systems that perform in production - not just on paper
n
n
Own Data Storage & Performance
n
n
Work across relational, NoSQL, and analytical stores (Postgres, BigQuery, Snowflake, Cassandra, MongoDB)
n
Optimise storage formats and access patterns (Parquet, Delta, ORC, Avro)
n
n
Cloud, Security & Governance
n
n
Implement secure, compliant data solutions with security by design
n
Embed governance without killing developer velocity
n
n
Consult and Influence
n
n
Work directly with clients to understand problems and shape solutions
n
Translate business needs into pragmatic engineering decisions
n
Act as a trusted technical advisor, not just an order taker
n
n
Technical Leadership & Quality
n
n
Set engineering standards, patterns, and best practices across teams
n
Review designs and code,
providing clear technical direction and mentorshipRaise the bar on data quality, testing, observability, and operational excellence
n
n
What We're Looking For
n
Core Engineering Strength
n
n
Strong Python and SQL
n
Deep experience with Spark and modern data platforms (Databricks / Snowflake)
n
Solid grasp of cloud data services (AWS or GCP)
n
n
Architecture & Design Judgement
n
n
Demonstrated ownership of large-scale data platform architectures
n
Strong data modelling skills and architectural decision‐making ability
n
Comfortable balancing trade-offs between performance, cost, and complexity
n
n
Data Platform Experience
n
n
Built and operated large-scale data pipelines in production
n
Robust data modelling capability and architectural judgement
n
Comfortable with multiple storage technologies and formats
n
n
Engineering Discipline
n
n
Infrastructure-as-code experience (Terraform, Pulumi)
n
CI/CD pipelines using tools like GitHub Actions, ArgoCD
n
Data testing and quality frameworks (dbt, Great Expectations, Soda)
n
n
Delivery & Consulting Mindset
n
n
Experience in consulting or professional services environments
n
Strong consulting instincts — able to challenge assumptions and guide clients toward better outcomes
n
Comfortable mentoring senior engineers and influencing technical culture
n
n
Benefits
n
Why Simple Machines
n
n
You'll work on interesting, high-impact problems
n
You'll build modern platforms, not maintain legacy mess
n
You'll be surrounded by senior engineers who actually know their craft
n
You'll have autonomy, influence, and room to grow
n
#J-*****-Ljbffr
📌 Principal Data Platforms Engineer (New South Wales)
🏢 Simple Machines
📍 New South Wales