05 Aug
|
NCS Australia
|
Sydney
05 Aug
NCS Australia
Sydney
Job Description
We are seeking an experienced Solution Designer / Lead Data Engineer to drive a high-priority enterprise transformation initiative: uplifting, modernizing, and scaling our enterprise Data Ingestion framework across cloud platforms.
In this dual-capability role, you will combine high-level architectural design with deep data engineering expertise. While Google Cloud Platform (GCP) forms a key part of our ecosystem, this role requires a cloud-generic perspective—designing modular, cloud-agnostic data patterns that can ingest, process, and govern batch and streaming data from diverse sources across multi-cloud and hybrid environments. If you excel at bridging complex business data requirements with up-to-date, resilient cloud architectures, this is an opportunity to shape an enterprise data strategy from the ground up.
What You’ll Be Doing
- Framework Modernization: Architect and lead the end-to-end design of a modern, scalable, and automated enterprise Data Ingestion framework, transitioning legacy ingestion systems toward real-time, event-driven cloud workflows.
- Solution Architecture & Design:
Author comprehensive Solution Design Documents (SDDs), architectural blueprints, data mapping specifications, and reusable ingestion patterns for both batch and streaming datasets.
- Pipeline Engineering Leadership: Provide technical leadership and hands-on guidance to engineering squads building high-throughput data pipelines across major cloud provider environments (GCP, AWS, or Azure).
- Data Integration & Governance: Design secure, standardized ingestion interfaces connecting on-premises databases, enterprise SaaS tools, APIs, and streaming brokers into modern cloud data lakes and enterprise warehouses.
- Quality, Lineage & Security: Embed automated data quality checks, data lineage tracking, enterprise encryption, and governance controls (IAM, Data Catalog, DLP) directly into the ingestion lifecycle.
- Performance & Cost Optimization: Optimize data pipeline latency, ensure high system availability, and govern multi-cloud compute/storage costs.
📌 Solution Designer / Lead Data Engineer (Sydney)
🏢 NCS Australia
📍 Sydney