29 Aug
|
Peritos Solutions
|
Brisbane
29 Aug
Peritos Solutions
Brisbane
Role Overview
We are looking for a Cloud & Data Engineer with hands-on experience across AWS and Microsoft Azure to design, implement, automate, and support cloud infrastructure and up-to-date data platforms. The role combines cloud engineering, DevOps, data engineering, security, and cost optimisation , working across customer projects and internal solutions.
Key Responsibilities
Cloud Engineering – AWS & Azure
- Design, deploy, and manage cloud environments across AWS and Azure .
- Implement cloud infrastructure using Infrastructure as Code (IaC) such as Terraform, AWS CloudFormation, Bicep, or ARM templates.
- Configure networking including VPC/VNet, subnets, routing, security groups/NSGs, load balancers, VPNs, DNS and private endpoints .
- Implement secure identity and access using AWS IAM, Microsoft Entra ID, RBAC, roles and policies .
- Build and maintain compute solutions using EC2, Lambda, ECS/EKS, Azure VMs, Functions and AKS .
- Implement storage solutions using Amazon S3, EBS, Azure Blob Storage, ADLS Gen2 and Azure Files .
- Support cloud migrations and application modernisation initiatives.
- Perform AWS Well-Architected and Azure architecture reviews covering security, reliability, performance, operational excellence and cost.
- Configure monitoring, logging and alerting using CloudWatch, CloudTrail, Azure Monitor, Log Analytics and Application Insights .
- Implement backup, disaster recovery, high availability and business continuity solutions.
- Analyse cloud consumption and recommend cost optimisation and FinOps improvements .
Data Engineering
- Design and develop scalable data ingestion and transformation pipelines .
- Build batch and near-real-time data processing solutions.
- Work with structured, semi-structured and unstructured datasets.
- Develop ETL/ELT pipelines using services such as:
- AWS Glue, Lambda, S3, Athena, Redshift, RDS and Step Functions
- Azure Data Factory, Synapse Analytics, Fabric,
Databricks, ADLS and Azure SQL
- Design data lake and lakehouse architectures .
- Develop data transformation processes using SQL, Python and PySpark .
- Implement data quality, validation, reconciliation and monitoring processes.
- Optimise data pipelines and queries for performance and cost.
- Support reporting and analytics platforms including Power BI and QuickSight .
- Implement appropriate data security, encryption, access controls and governance.
DevOps & Automation
- Build and maintain CI/CD pipelines using Azure DevOps, GitHub Actions, AWS CodePipeline or similar platforms.
- Automate cloud provisioning, deployment and operational activities.
- Work with Git-based branching, release and deployment processes.
- Implement environment management across Development, Test/UAT and Production .
- Support containerised workloads using Docker, Kubernetes, EKS and AKS .
- Implement automated security and compliance checks within deployment pipelines.
- Troubleshoot cloud infrastructure, deployment and application issues.
Security & Governance
- Apply AWS and Azure cloud security best practices.
- Implement least-privilege access and secure secrets management.
- Configure encryption, logging, monitoring and security controls.
- Support cloud governance, tagging, policies and compliance requirements.
- Assist with security assessments, vulnerability remediation and DevSecOps initiatives.
- Support implementation of AWS Control Tower/Security Hub/GuardDuty and Azure Policy/Defender for Cloud where applicable.
Required Technical Skills
- Strong hands-on experience with AWS and/or Microsoft Azure , with practical exposure to both preferred.
- AWS: EC2, S3, IAM, VPC, Lambda, RDS, CloudWatch, CloudTrail and Glue.
- Azure: VMs, Storage, VNet, Entra ID, Azure SQL, Data Factory, ADLS, Functions and Azure Monitor.
- Strong knowledge of SQL .
- Working knowledge of Python and/or PySpark .
- Experience with Terraform or another Infrastructure as Code technology .
- Experience building CI/CD pipelines.
- Understanding of REST APIs and system/data integration.
- Good understanding of cloud networking and security.
- Experience troubleshooting production cloud and data workloads.
Desirable Skills
- Microsoft Fabric, Databricks, Synapse or Redshift experience.
- Generative AI services such as Amazon Bedrock or Azure AI Foundry/Azure OpenAI .
- AWS Well-Architected Framework and Azure Cloud Adoption Framework knowledge.
- Power BI or Amazon QuickSight.
- Kubernetes/EKS/AKS.
- FinOps and cloud cost optimisation.
- Experience working in consulting or customer-facing cloud projects.
Preferred Certifications
- AWS Certified Solutions Architect / Data Engineer / DevOps Engineer.
- Microsoft Certified Azure Administrator / Azure Solutions Architect.
- Microsoft Azure Data Engineer or Fabric certification.
- Terraform Associate or equivalent certification.
Key Competencies
- Strong analytical and troubleshooting skills.
- Ability to independently own technical deliverables.
- Good written and verbal communication.
- Ability to translate business requirements into technical solutions.
- Comfortable working across multiple customer environments and technologies.
- Strong documentation and knowledge-transfer skills.
- Ability to work collaboratively with architects, developers, data engineers, security teams and customer stakeholders
📌 Cloud & Data Engineer (Brisbane)
🏢 Peritos Solutions
📍 Brisbane