07 Nov
|
Internetwork Expert
|
Sydney
07 Nov
Internetwork Expert
Sydney
Principal Data and Platform EngineerWho We AreSimple Machines is a global, independent technology consultancy operating across Sydney, New Zealand, London, Poland and San Francisco.
We design and build contemporary data platforms, intelligent systems, and bespoke software at the intersection of Data Engineering, Software Engineering and AI.We work with enterprises, scale-ups, and government to turn messy, high-value data into products, platforms, and decisions that actually move the needle.We don't do generic.
We build things that matter - We engineer data to lifeTM.The RoleThis is a hands-on principal engineering role, not an architecture-only seat and not a support function.
You'll be responsible for technical direction, platform design and architectural decision-making.You'll design and build greenfield data platforms, real-time pipelines, and data products for clients who are serious about using data properly.
You'll work in small, high-calibre teams and operate close to both the problem and the client.If you enjoy solving hard data problems, shaping modern architectures (data mesh, data products, contracts), and delivering real outcomes this is your lane.What You'll Be DoingLead Platform & Architecture DesignOwn the end-to-end architecture of modern, cloud-native data platformsDesign scalable data ecosystems using data mesh, data products, and data contractsMake high-impact architectural decisions across ingestion, storage, processing, and access layersEnsure platforms are secure, compliant, and production-grade by designBuild Modern Data PlatformsDesign and deliver cloud-native data platforms using Databricks, Snowflake, AWS, and GCPApply modern architectural patterns: data mesh, data products, and data contractsIntegrate deeply with client systems to enable scalable, consumer-oriented data accessDevelop High-Performance PipelinesBuild and optimise batch and real-time pipelinesWork with streaming and event-driven tech such as Kafka, Flink, Kinesis, Pub/SubOrchestrate workflows using Airflow, Dataflow,
GlueWork at ScaleProcess and transform large datasets using Spark and FlinkDesign systems that perform in production - not just on paperConsult and InfluenceWork directly with clients to understand problems and shape solutionsTranslate business needs into pragmatic engineering decisionsAct as a trusted technical advisor, not just an order takerTechnical Leadership & QualitySet engineering standards, patterns, and best practices across teamsReview designs and code, providing clear technical direction and mentorshipRaise the bar on data quality, testing, observability, and operational excellenceWhat We're Looking ForCore Engineering StrengthStrong Python and SQLDeep experience with Spark and modern data platforms (Databricks / Snowflake)Solid grasp of cloud data services (AWS or GCP)Architecture & Design JudgementDemonstrated ownership of large-scale data platform architecturesStrong data modelling skills and architectural decision-making abilityComfortable balancing trade-offs between performance, cost, and complexityData Platform ExperienceBuilt and operated large-scale data pipelines in productionStrong data modelling capability and architectural judgementComfortable with multiple storage technologies and formatsEngineering DisciplineInfrastructure-as-code experience (Terraform, Pulumi)CI/CD pipelines using tools like GitHub Actions, ArgoCDData testing and quality frameworks (dbt, Great Expectations, Soda)Delivery & Consulting MindsetExperience in consulting or professional services environmentsStrong consulting instincts able to challenge assumptions and guide clients toward better outcomesComfortable mentoring senior engineers and influencing technical cultureWhy Simple MachinesYou'll work on interesting, high-impact problemsYou'll build modern platforms, not maintain legacy messYou'll be surrounded by senior engineers who actually know their craftYou'll have autonomy, influence, and room to growAmazing Darlinghurst office spaceTeam lunches on Monday & WednesdaysTraining & Conference fundIf you're a passionate data engineer who wants to build properly, think clearly, and deliver real outcomes - we should talk.
#J-*****-Ljbffr
📌 Lead Data Platform Engineer: Cloud-Native Pipelines (Sydney)
🏢 Internetwork Expert
📍 Sydney