14 Oct
|
Hastha Solutions
|
Melbourne
14 Oct
Hastha Solutions
Melbourne
Job Description
nUrgent requirement of Confluent Consultant (Kafka & Data Streaming Specialist) - Contract - Melbourne n
Requirements n
n
n
n
n
Must Have : n
n
n
n
- Bachelorâs or Masterâs degree in Computer Science, Information Systems, or a related field.
n
n
- 5+ years hands-on experience with Apache Kafka / Confluent Platform
n
n
- Architecture & Design: Define topic strategy (naming, partitions, RF, retention/compaction), idempotency/ordering; size and configure Confluent clusters; plan DR using Cluster Linking; leverage Tiered Storage as needed.
n
n
- Build & Integration: Implement/tune producers & consumers; design Kafka Connect integrations (managed/selfâmanaged connectors, REST/File/JDBC/CDC); use Schema Registry for contracts and compatibility; optional ksqlDB for stream transformations.
n
n
- Security & Compliance: Enforce RBAC, API keys/service accounts, mTLS/OAuth/OIDC; manage secrets; implement encryption in transit/rest; align retention, PII handling, and audit. Support private networking (VPC peering/PrivateLink) in Confluent Cloud.
n
n
- Observability & Operations: Set up Control Centre dashboards/alerts (lag, throughput, error rates, connector health); create run books for DLQ triage, replay, offset resets, connector/broker incidents; capacity planning and performance testing.
n
n
- Delivery & Governance: Produce HLD/LLD, participate in design reviews, release/cutover plans, DR drills, and knowledge transfer.
n
n
n
Positive to Have: n
n
n
n
- Confluent Certified Developer/Administrator
n
n
- Experience with stream governance, RBAC, and tiered storage
n
n
- Background in data engineering, ETL, or micro services architecture
n
n
- Familiarity with traditional messaging systems and data warehouses
n
n
- Experience in Agile methodologies and DevOps practices
n
n
n
Responsibility: n
n
n
n
- Architecture & Design: Define topic strategy (naming, partitions, RF, retention/compaction), idempotency/ordering; size and configure Confluent clusters; plan DR using Cluster Linking; leverage Tiered Storage as needed.
n
n
- Build & Integration: Implement/tune producers & consumers; design Kafka Connect integrations (managed/selfâmanaged connectors, REST/File/JDBC/CDC); use Schema Registry for contracts and compatibility; optional ksqlDB for stream transformations.
n
n
- Security & Compliance: Enforce RBAC, API keys/service accounts, mTLS/OAuth/OIDC; manage secrets; implement encryption in transit/rest; align retention, PII handling, and audit. Support private networking (VPC peering/PrivateLink) in Confluent Cloud.
n
n
- Observability & Operations: Set up Control Centre dashboards/alerts (lag, throughput, error rates, connector health); create run books for DLQ triage, replay, offset resets, connector/broker incidents; capacity planning and performance testing.
n
n
- Delivery & Governance: Produce HLD/LLD, participate in design reviews, release/cutover plans, DR drills, and knowledge transfer.
n
n
n
Duration: 06 Months and possible extensionn
Eligibility: Australian/NZ Citizens/PR Holders onlyn
Email: n
📌 Confluent Consultant (Kafka & Data Streaming Specialist) - Contract - Melbourne
🏢 Hastha Solutions
📍 Melbourne