16 Sep
|
AYAN INFOTECH
|
Sydney
16 Sep
AYAN INFOTECH
Sydney
AYAN InfoTech is looking for Kafka Administrator / Developer (Kafka & AWS EKS) to join an exciting project based in Sydney. The role offers you the opportunity to contribute towards an extremely well structured and mature environment, working on sophisticated enhancement projects.
Role: Kafka Administrator / Developer (Kafka & AWS EKS)
Location: Sydney
Contract Duration: 6+ Months with high possible extensions
Experience: 7+ Years
Job Summary:
The Kafka Administrator / Developer will design, build, operate and improve enterprise Kafka and event-streaming platforms across AWS and Kubernetes, including Amazon EKS. The role requires strong hands-on Kafka administration, integration development, cloud-native operations and production support experience.
The role works closely with application, integration, cloud, security and operations teams to deliver reliable event-driven solutions, resolve complex issues, automate repeatable tasks and support platform lifecycle, governance and service improvement activities.
Key Responsibilities:
- Administer and support Kafka platforms, including brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and related services.
- Design and develop Kafka producers, consumers, stream-processing components and reusable integration patterns using Java, Spring Boot, Python or similar technologies.
- Deploy, operate and improve Kafka and supporting components on Kubernetes and Amazon EKS using Helm, CI/CD, GitOps and approved cloud-native patterns.
- Manage platform reliability, resilience, capacity, performance, patching, upgrades, backup, recovery and lifecycle activities across production and non-production environments.
- Troubleshoot complex issues across applications, brokers, connectors, schemas, networking, storage, certificates and cloud infrastructure.
- Implement monitoring, alerting and dashboards for broker health, throughput, latency, replication, disk usage, consumer lag and connector health.
- Apply security and governance controls, including TLS, authentication, authorisation, ACLs, secrets, certificates, least-privilege access and vulnerability remediation.
- Support incidents, problems, changes and releases, including root-cause analysis, runbook improvement and automation of recurring operational tasks.
- Guide application teams on topic design, partitioning, message contracts, schema evolution, retries, dead-letter handling, idempotency and supportability.
- Maintain architecture, configuration, operational, recovery and support documentation.
Key Skills & Experience:
- Robust hands-on experience administering Apache Kafka or Confluent Platform in complex enterprise environments.
- Solid understanding of Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and MirrorMaker.
- Experience developing Kafka producers, consumers and integration services using Java, Spring Boot, Python or equivalent technologies.
- Hands-on experience with Kubernetes and Amazon EKS, including Docker, Helm, storage, networking, ingress, secrets and identity integration.
- Working knowledge of AWS services such as EKS, EC2, S3, IAM, CloudWatch, Route 53 and core networking services.
- Experience with CI/CD, GitOps and Infrastructure as Code tools such as Jenkins, Argo CD, Terraform or CloudFormation.
- Strong Linux, networking, TLS, DNS, certificate and distributed-systems troubleshooting capability.
- Experience with observability tools such as Prometheus, Grafana, CloudWatch, Dynatrace, Splunk or equivalent.
Contact: 61-(02) 7207 6926 for more details.
Please note we will be able to contact only shortlisted candidates for this role. We thank you in advance for your interest.
📌 Kafka Administrator / Developer (Kafka & AWS EKS) - Sydney
🏢 AYAN INFOTECH
📍 Sydney