21 Aug
|
Humanforce
|
New South Wales
21 Aug
Humanforce
New South Wales
Job Description
Overview
Join to apply for the Data Engineer role at Humanforce.
Humanforce's vision is to make work easier and life better for frontline and flexible workforces.
Our HCM suite covers Workforce Management, HR, Talent, Payroll, and Wellbeing, and is designed to be highly integrated and composable.
Since ****, we've helped over **** customers with almost 1 million employees under management in 30+ countries, with offices in Australia, New Zealand, the United Kingdom, North America and the Philippines.
We enable an exceptional employee experience and connect talent flows with growth, productivity and efficiency objectives for frontline and flexible workforces.
Who you are
You will help build and run the data infrastructure for our real-time, customer-facing analytics platform.
You'll focus on reliable and performant CDC ingestion, transformation, governance, and operational excellence so analysts can publish high-quality analytics within our analytics platform.
You'll collaborate with a cross-functional squad and partner with our Senior Data Engineer to work across Streamkap, dbt Core, ClickHouse, and AWS to continually improve our data platform.
You'll enjoy owning an evolving architecture, solving ambiguous problems, and delivering pragmatic, innovative solutions with clear impact on a customer-visible product suite.
What you will do
Build and maintain reliable data pipelines that ingest CDC streams (Streamkap) and batch data into ClickHouse, transforming with dbt Core.
Implement the orchestrator to schedule, monitor, and recover pipelines.
Enhance ELT performance and stability; troubleshoot issues across staging and production.
Implement and uphold data governance practices: testing, documentation, and service levels (e.g.,freshness/completenessSLIs/SLOs) with lineage.
Operate and observe pipelines using AWS services.
Collaborate with a cross-functional team to deliver trustworthy datasets consumed in ThoughtSpot.
Ensure integrity, reliability, and security of the data engineering architecture.
Our stack
Warehouse: ClickHouse
Ingestion/CDC: Streamkap
Transformations: dbt Core
Cloud: AWS (S3, Lambda, ECS, EventBridge)
Infra/CI: Terraform, GitHub Actions
What you'll need
3+ years of hands-on data engineering.
Strong SQL and Python (non-negotiable).
Experience building and maintaining Cloud Data Warehouse Infrastructure (ideally ClickHouse orSnowflake/BigQuery/Redshiftwith willingness to learn ClickHouse).
Experience building and operating production data pipelines (e.g., with dbt Core).
Practical experience with AWS and Dockerised workloads.
Understanding of modern ELT practices, testing, and documentation.
Direct experience using AI tools in day-to-day work, or openness to learn how to apply them to enhance outcomes.
Nice to have
Experience with CDC+Kafka-based ingestion tools (e.g., Streamkap) for near-real-time ingestion.
Terraform and infrastructure-as-code workflows.
CI/CD workflows with GitHub Actions.
Security-minded habits (IAM, tenancy isolation, PII handling).
Agile delivery experience (Jira) and code review via GitHub PRs.
Our values
We are bold
We are all in
We are customer obsessed
We do what we say
We are good humans
Our approach to flexibility
We support hybrid working where possible to help people be effective, empowered, and productive to achieve career and personal goals.
Flexible working exists in many forms.
Flexible workplace through our Flex@HF approach
Fast-growing global tech company
Learning and development through Humanforce HR
Talent referral program
12 weeks paid parental leave for primary careers, 4 weeks for secondary
4 extra days leave for wellbeing
Employee Assistance Program
Reward and recognition program
Access to Thrive for financial wellbeing, budgeting and perks
Collaborative culture with passionate people
We are a diverse and dispersed organization and welcome applicants from all backgrounds, cultures, ages, genders, neurodiversity, religions, sexual orientations, and experiences.
Seniority level
Mid-Senior level
Employment type
Full time
Job function
Product Management
Industries
Software Development
Referrals increase your chances of interviewing at Humanforce.
Get notified about new Data Engineer jobs in Sydney, NSW, Australia.
#J-*****-Ljbffr
📌 Data Engineer (New South Wales)
🏢 Humanforce
📍 New South Wales