Job Description

My client is seeking a Senior Data Engineer with solid AWS data engineering experience to design, build and optimise scalable data pipelines across both batch and real-time environments. This role is ideal for someone with expertise in Python, PySpark, Airflow and AWS services, who enjoys working on modern cloud data platforms and high-volume data processing.

n

Key Responsibilities

n

n
- Design, develop and maintain scalable batch and real-time data ingestion frameworks.
n
- Build and optimise data pipelines using Python, PySpark, SQL and AWS services.
n
- Develop streaming solutions using AWS Kinesis, Kafka or similar technologies.
n
- Build and manage workflows using Apache Airflow (MWAA).
n
- Work with Amazon Redshift, RDS, S3 and NoSQL databases to support data warehousing and analytics.
n
- Implement data transformation, monitoring and observability solutions.
n
- Collaborate with cross-functional teams to deliver secure, high-performing data solutions.
n

n

Must Have Skills

n

n
- Strong commercial experience with AWS data services.
n




- Advanced Python, PySpark and SQL skills.
n
- Experience with Apache Airflow (MWAA).
n
- Hands‐on experience with Amazon Redshift.
n
- Experience building batch and real-time data pipelines.
n
- Strong knowledge of AWS Kinesis, Kafka or other streaming technologies.
n
- Experience working with Data Warehouses and Data Lake/Lakehouse architectures.
n
- Experience with relational and NoSQL databases such as Oracle, Snowflake, MongoDB, DynamoDB or Teradata.
n

n

Nice to Have

n

n
- Experience with AWS SageMaker Unified Studio.
n
- Exposure to ML or Generative AI pipelines.
n
- Data modelling experience.
n
- Infrastructure as Code using Terraform or CloudFormation.
n
- CI/CD and Git experience.
n

n

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability.

#J-18808-Ljbffr

📌 Data Engineer (New South Wales)
🏢 Paxus
📍 New South Wales