07 Oct
|
Hastha Solutions
|
Melbourne
07 Oct
Hastha Solutions
Melbourne
Job Description
nUrgent requirement of
Confluent Consultant (Kafka & Data Streaming Specialist) - Contract - Melbourne
n
Requirements
n
n
n
n
n
Must Have :
n
n
n
n
Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
n
n
5+ years hands-on experience with Apache Kafka / Confluent Platform
n
n
Architecture & Design: Define topic strategy (naming, partitions, RF,
retention/compaction),
idempotency/ordering
; size and configure Confluent clusters; plan DR using Cluster Linking; leverage Tiered Storage as needed.
n
n
Build & Integration: Implement/tune producers & consumers; design Kafka Connect integrations (managed/self‐managed connectors,
REST/File/JDBC/CDC)
; use Schema Registry for contracts and compatibility; optional ksqlDB for stream transformations.
n
n
Security & Compliance: Enforce RBAC, API keys/service accounts, mTLS/OAuth/OIDC; manage secrets; implement encryption in transit/rest; align retention, PII handling, and audit. Support private networking (VPC
peering/PrivateLink)
in Confluent Cloud.
n
n
Observability & Operations: Set up Control Centre dashboards/alerts (lag, throughput, error rates, connector health); create run books for DLQ triage, replay, offset resets, connector/broker incidents; capacity planning and performance testing.
n
n
Delivery & Governance: Produce HLD/LLD, participate in design reviews, release/cutover plans, DR drills, and knowledge transfer.
n
n
n
Valuable to Have:
n
n
n
n
Confluent Certified
Developer/Administrator
n
n
Experience with stream governance, RBAC, and tiered storage
n
n
Background in data engineering, ETL, or micro services architecture
n
n
Familiarity with traditional messaging systems and data warehouses
n
n
Experience in Agile methodologies and DevOps practices
n
n
n
Responsibility:
n
n
n
n
Architecture & Design: Define topic strategy (naming, partitions, RF,
retention/compaction),
idempotency/ordering
; size and configure Confluent clusters; plan DR using Cluster Linking; leverage Tiered Storage as needed.
n
n
Build & Integration: Implement/tune producers & consumers; design Kafka Connect integrations (managed/self‐managed connectors,
REST/File/JDBC/CDC)
; use Schema Registry for contracts and compatibility; optional ksqlDB for stream transformations.
n
n
Security & Compliance: Enforce RBAC, API keys/service accounts, mTLS/OAuth/OIDC; manage secrets; implement encryption in transit/rest; align retention, PII handling, and audit. Support private networking (VPC
peering/PrivateLink)
in Confluent Cloud.
n
n
Observability & Operations: Set up Control Centre dashboards/alerts (lag, throughput, error rates, connector health); create run books for DLQ triage, replay, offset resets, connector/broker incidents; capacity planning and performance testing.
n
n
Delivery & Governance: Produce HLD/LLD, participate in design reviews, release/cutover plans, DR drills, and knowledge transfer.
n
n
n
Duration: 06 Months
and possible extensionn
Eligibility:
Australian/NZ Citizens/PR Holders onlyn
Email:
n
📌 Confluent Consultant (Kafka & Data Streaming Specialist) - Contract - Melbourne
🏢 Hastha Solutions
📍 Melbourne