26 Aug
|
NCS Australia
|
Australia
26 Aug
NCS Australia
Australia
Job Description
We are seeking an experienced Solution Designer / Lead Data Engineer to drive a high-priority enterprise transformation initiative: uplifting, modernizing, and scaling our enterprise Data Ingestion framework across cloud platforms.
In this dual-capability role, you will combine high-level architectural design with deep data engineering expertise. While Google Cloud Platform (GCP) forms a key part of our ecosystem, this role requires a cloud-generic perspective—designing modular, cloud-agnostic data patterns that can ingest, process, and govern batch and streaming data from diverse sources across multi-cloud and hybrid settings. If you excel at bridging complex business data requirements with contemporary, resilient cloud architectures, this is an chance to shape an enterprise data strategy from the ground up.
What You’ll Be Doing
Framework Modernization: Architect and lead the end-to-end design of a modern, scalable, and automated enterprise Data Ingestion framework, transitioning legacy ingestion systems toward real-time, event-driven cloud workflows.
Solution Architecture & Design:
Author comprehensive Solution Design Documents (SDDs), architectural blueprints, data mapping specifications, and reusable ingestion patterns for both batch and streaming datasets.
Pipeline Engineering Leadership: Provide technical leadership and hands-on guidance to engineering squads building high-throughput data pipelines across major cloud provider environments (GCP, AWS, or Azure).
Data Integration & Governance: Design secure, standardized ingestion interfaces connecting on-premises databases, enterprise SaaS tools, APIs, and streaming brokers into modern cloud data lakes and enterprise warehouses.
Quality, Lineage & Security: Embed automated data quality checks, data lineage tracking, enterprise encryption, and governance controls (IAM, Data Catalog, DLP) directly into the ingestion lifecycle.
Performance & Cost Optimization: Optimize data pipeline latency, ensure high system availability, and govern multi-cloud compute/storage costs.
📌 Solution Designer / Lead Data Engineer Sydney (Australia)
🏢 NCS Australia
📍 Australia