21 Aug
|
Humanforce
|
New South Wales
21 Aug
Humanforce
New South Wales
Job Description
Overview
n
Join to apply for the Data Engineer role at Humanforce.
n
Humanforce's vision is to make work easier and life better for frontline and flexible workforces. Our HCM suite covers Workforce Management, HR, Talent, Payroll, and Wellbeing, and is designed to be highly integrated and composable.
n
Since 2002, we've helped over 2300 customers with almost 1 million employees under management in 30+ countries, with offices in Australia, New Zealand, the United Kingdom, North America and the Philippines.
n
We enable an exceptional employee experience and connect talent flows with growth, productivity and efficiency objectives for frontline and flexible workforces.
n
Who you are
n
You will help build and run the data infrastructure for our real-time, customer-facing analytics platform. You'll focus on reliable and performant CDC ingestion, transformation, governance, and operational excellence so analysts can publish high-quality analytics within our analytics platform. You'll collaborate with a cross-functional squad and partner with our Senior Data Engineer to work across Streamkap, dbt Core, ClickHouse, and AWS to continually improve our data platform.
n
You'll enjoy owning an evolving architecture, solving ambiguous problems, and delivering pragmatic, innovative solutions with clear impact on a customer-visible product suite.
n
What you will do
n
n
- Build and maintain reliable data pipelines that ingest CDC streams (Streamkap) and batch data into ClickHouse, transforming with dbt Core.
n
- Implement the orchestrator to schedule, monitor, and recover pipelines.
n
- Enhance ELT performance and stability; troubleshoot issues across staging and production.
n
- Implement and uphold data governance practices: testing, documentation, and service levels (e.g., freshness/completeness SLIs/SLOs) with lineage.
n
- Operate and observe pipelines using AWS services.
n
- Collaborate with a cross-functional team to deliver trustworthy datasets consumed in ThoughtSpot.
n
- Ensure integrity, reliability, and security of the data engineering architecture.
n
n
Our stack
n
n
- Warehouse: ClickHouse
n
- Ingestion/CDC: Streamkap
n
- Transformations: dbt Core
n
- Cloud: AWS (S3, Lambda, ECS, EventBridge)
n
- Infra/CI: Terraform, GitHub Actions
n
n
What you'll need
n
n
- 3+ years of hands-on data engineering.
n
- Solid SQL and Python (non-negotiable).
n
- Experience building and maintaining Cloud Data Warehouse Infrastructure (ideally ClickHouse or Snowflake/BigQuery/Redshift with willingness to learn ClickHouse).
n
- Experience building and operating production data pipelines (e.g., with dbt Core).
n
- Practical experience with AWS and Dockerised workloads.
n
- Understanding of modern ELT practices, testing, and documentation.
n
- Direct experience using AI tools in day-to-day work, or openness to learn how to apply them to enhance outcomes.
n
n
Nice to have
n
n
- Experience with CDC+Kafka-based ingestion tools (e.g., Streamkap)
for near-real-time ingestion.
n
- Terraform and infrastructure-as-code workflows.
n
- CI/CD workflows with GitHub Actions.
n
- Security-minded habits (IAM, tenancy isolation, PII handling).
n
- Agile delivery experience (Jira) and code review via GitHub PRs.
n
n
Our values
n
n
- We are bold
n
- We are all in
n
- We are customer obsessed
n
- We do what we say
n
- We are good humans
n
n
Our approach to flexibility
n
We support hybrid working where possible to help people be effective, empowered, and productive to achieve career and personal goals. Flexible working exists in many forms.
n
n
- Flexible workplace through our Flex@HF approach
n
- Fast-growing global tech company
n
- Learning and development through Humanforce HR
n
- Talent referral program
n
- 12 weeks paid parental leave for primary careers, 4 weeks for secondary
n
- 4 extra days leave for wellbeing
n
- Employee Assistance Program
n
- Reward and recognition program
n
- Access to Thrive for financial wellbeing, budgeting and perks
n
- Collaborative culture with passionate people
n
n
We are a diverse and dispersed organization and welcome applicants from all backgrounds, cultures, ages, genders, neurodiversity, religions, sexual orientations, and experiences.
n
Seniority level
n
n
- Mid-Senior level
n
n
Employment type
n
n
- Full-time
n
n
Job function
n
n
- Product Management
n
n
Industries
n
n
- Software Development
n
n
Referrals increase your chances of interviewing at Humanforce. Get notified about new Data Engineer jobs in Sydney, NSW, Australia.
#J-18808-Ljbffr
📌 Data Engineer (New South Wales)
🏢 Humanforce
📍 New South Wales