28 Aug
|
The HR Ally
|
Victoria
28 Aug
The HR Ally
Victoria
Job Description
Role: Kafka Technical Consultant
n
Location: Melbourne, VIC Experience:8+ years
n
Eligibility: Australian PRs & Citizens only. No sponsorship provided
n
Job Description
n
n
Develop custom integration code using Java / Spring Boot for source system connectivity where managed connectors are not applicable.
n
Build and maintain Kafka producers / consumers, topic integration logic, and event-driven services on Confluent Cloud / NGIP.
n
Develop and maintain Flink SQL / stream processing logic for transformation, enrichment, validation, routing, and de-duplication.
n
Implement integration with Schema Registry, topic schemas, and message validation controls.
n
Support HTTP/API-based integrations through Kong Gateway for NGIP to target application communication.
n
Configure and support HTTP Sink delivery patterns, payload mapping, retries, and failure handling.
n
Perform unit / component testing for custom code, Flink jobs, and interface logic.
n
Support SIT, pipeline testing, defect fixing, replay, and root-cause analysis during test execution.
n
Support E2E testing with downstream teams and resolve integration issues across connectors, transformations, APIs, and Kafka topics.
n
Work with GitLab CI/CD pipelines for build, deployment, regression automation, and release support.
n
n
Desired Competencies
(Technical/Behavioral
Competency)
n
Must-Have:
n
Develop custom integration code using Java / Spring Boot for source system connectivity where managed connectors are not applicable.
n
n
Build and maintain Kafka producers / consumers,
topic integration logic, and event-driven services on Confluent Cloud / NGIP.
n
Develop and maintain Flink SQL / stream processing logic for transformation, enrichment, validation, routing, and de-duplication.
n
Implement integration with Schema Registry, topic schemas, and message validation controls.
n
Support HTTP/API-based integrations through Kong Gateway for NGIP to target application communication.
n
Configure and support HTTP Sink delivery patterns, payload mapping, retries, and failure handling.
n
Perform unit / component testing for custom code, Flink jobs, and interface logic.
n
Support SIT, pipeline testing, defect fixing, replay, and root-cause analysis during test execution.
n
Support E2E testing with downstream teams and resolve integration issues across connectors, transformations, APIs, and Kafka topics.
n
Work with GitLab CI/CD pipelines for build, deployment, regression automation, and release support.
n
n
Skills
n
n
Java, Spring Boot
n
Apache Kafka / Confluent Cloud
n
Kafka Connect
n
Flink SQL / stream processing
n
Schema Registry
n
REST / API integration
n
Kong Gateway
n
GitLab CI/CD
n
Unit testing, SIT support, E2E support
n
n
Positive-to-Have
n
n
Confluent Certified
Developer/Administrator
n
Experience with stream governance, RBAC, and tiered storage
n
Background in data engineering, ETL, or microservices architecture
n
Familiarity with traditional messaging systems and data warehouses
n
Experience in Agile methodologies and DevOps practices.
n
📌 Kafka Technical Consultant + Java - Melbourne (Victoria)
🏢 The HR Ally
📍 Victoria