19 Nov
|
Balance Recruitment and Balance Consulting
|
Sydney
19 Nov
Balance Recruitment and Balance Consulting
Sydney
Global Cyber Security product company seeks a Senior Data Engineer to work on world class low-latency systems. Mostly Work-From-Home. 1 year renewable contract. $950 Daily.
Position Overview:
Senior Data Engineer with expertise in building and maintaining high-performance data streaming solutions at scale.
Core Requirements & Qualifications:
- Streaming Data Ingestion Pipelines.
- Extensive hands-on experience designing and implementing distributed streaming architectures.
- Proven ability to process terabytes of data daily with sub-second to low-latency requirements.
- Expertise in one or more streaming platforms: Apache Kafka, AWS Kinesis, Apache Spark Streaming, Flink, Google Pub/Sub.
- NoSQL Database Expertise
- 2 years with NoSQL databases in production environments
- Hands-on experience with multiple types: Document stores (MongoDB, Couchbase), Key-value stores (DynamoDB, Redis), Search engines(Elasticsearch, Solr), Time-series databases (InfluxDB,
Prometheus).
- 2 years building, maintaining, and optimizing continuous integration/continuous deployment pipelines: Jenkins, GitLab CI, GitHub Actions, CircleCI, and artifact repositories.
- Kubernetes & Container Orchestration
Additional Valuable Skills:
- Data Processing Orchestration: Apache Airflow, dbt, or similar workflow tools
- Cloud Platforms: AWS, Azure, or GCP experience
- Observability: Distributed tracing, logging aggregation, metrics collection
- Performance Optimization: Query tuning, latency analysis, throughput optimization.
Solid Java/general programming fundamentals are assumed and required—this role focuses on specialized datainfrastructure expertise.
For more information, please call Bob Wallace at 02 9091 8212.
📌 Senior Data Engineer (Sydney)
🏢 Balance Recruitment and Balance Consulting
📍 Sydney