15 Oct
|
The HR Ally
|
Melbourne
15 Oct
The HR Ally
Melbourne
Role: Kafka Flink Engineer
Location: Melbourne, VIC
Experience: 7+ yrs
Job Type: Permanent
Key Responsibilities
- Develop custom integration code using Java / Spring Boot for source system connectivity where managed connectors are not applicable.
- Build and maintain Kafka producers and consumers, topic integration logic and event-driven services on Confluent Cloud / NGIP.
- Develop and maintain Flink SQL / stream processing logic for transformation, enrichment, validation, routing and de-duplication.
- Implement integration with Schema Registry, topic schemas and message validation controls.
- Support HTTP / API-based integrations through Kong Gateway for NGIP to target application communication.
- Configure and support HTTP Sink delivery patterns, including payload mapping, retries and failure handling.
- Troubleshoot and resolve integration,
streaming and message-delivery issues in collaboration with platform and application teams.
- Document integration designs, schemas and operational procedures, and contribute to team standards and best practices.
Must-Have Skills
- Java / Spring Boot development for custom source-system integration.
- Kafka producer / consumer development and topic integration logic on Confluent Cloud / NGIP.
- Flink SQL / stream processing for transformation, enrichment, validation, routing and de-duplication.
- Schema Registry integration, topic schema management and message validation controls.
- HTTP / API-based integration via Kong Gateway (NGIP to target application communication).
- HTTP Sink configuration and support: payload mapping, retries and failure handling.
📌 Kafka Flink Engineer (Melbourne)
🏢 The HR Ally
📍 Melbourne