02 Aug
|
Nityo Infotech
|
Melbourne
02 Aug
Nityo Infotech
Melbourne
We are seeking a highly skilled Data Integration Engineer (Level 3) to design, build, and manage enterprise-scale data integration solutions on Azure. This role requires strong expertise in cloud-native data services, integration patterns, DevOps practices, and L3 production support to ensure reliability, performance, and scalability of data platforms.
Key Responsibilities
- Design, develop, and maintain end-to-end data integration solutions across enterprise systems.
- Build scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Data Flows.
- Develop high-performance data processing solutions using Azure Databricks (ADB) and Python.
- Implement event-driven architectures using Azure Service Bus.
- Develop and manage serverless applications using Azure Functions.
- Design and expose APIs using Azure API Management (APIM).
- Build and maintain NoSQL data solutions using Cosmos DB.
- Manage secure access to secrets and credentials using Azure Key Vault.
- Monitor and troubleshoot applications using:
- Deploy and manage containerized applications using Azure Kubernetes Service (AKS).
- Implement CI/CD pipelines using Azure DevOps and GitOps practices via ArgoCD.
- Automate infrastructure provisioning and configuration using Terraform.
- Ensure effective use of Azure services for integration (eventing, messaging, API, compute).
- Provide Level 3 (L3) operational support, including:
- Incident management and resolution
- Root cause analysis (RCA)
- Performance optimization and system tuning
- Collaborate with architects, data engineers, and business stakeholders to deliver robust solutions.
- Implement best practices for security, monitoring, governance, and reliability.
Must-Have Skills & Experience
- Strong experience in Data Integration / Data Engineering.
- Hands-on expertise in: Python programming
- Experience with: Monitoring and observability tools
- Experience with: Containerization and orchestration
- Experience with: Infrastructure as Code (Terraform)
- Strong understanding of Azure services related to integration (messaging, APIs, serverless, data pipelines).
- Experience in performance tuning and cost optimization on Azure.
- Exposure to API-led and microservices-based architectures.
- Proven operations/support (L3) experience in production environments.
- Good understanding of:
- Distributed systems
- Data modelling & data warehousing
- Cloud architecture and scalability patterns
Positive‑to‑Have Skills
- Experience with legacy or enterprise ETL tools: IBM DataStage
- Advanced monitoring/observability tools: Splunk
- Knowledge of hybrid integration patterns.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, IT, or related field.
- Total integration experience of 12+ years with 6 to 8+ years of relevant experience in data integration, data engineering, or related roles.
#J-18808-Ljbffr
📌 Data Integration Specialist (Melbourne)
🏢 Nityo Infotech
📍 Melbourne