We are seeking a highly skilledSenior Software Engineer (SSE) / Staff Data Engineerto design, build, and optimize large-scale data solutions.
The ideal candidate will have strong expertise inPython,Spark, andAWS, with a proven track record in developing robust data pipelines, enabling advanced analytics, and ensuring data governance and security.
Key Responsibilities
Design and implement scalableETL pipelinesfor data ingestion, transformation, and integration.
Ensure data quality, governance, and compliance across all stages.
Develop and optimize solutions usingApache Spark,Hadoop,Hive, andKafka.
Handle large-scale data processing and real-time streaming.
Build and maintain data solutions onAWS(S3, Glue, Redshift, Athena, IAM).
Implement secure and cost-effective cloud architectures.
APIs & Automation
DevelopRESTful APIsand automation scripts for data services and integrations.
Collaborate with application teams to enable data-driven microservices.
DevOps & CI/CD
ImplementCI/CD pipelinesusing Jenkins, Git, Docker, and Kubernetes.
Ensure smooth deployment and monitoring of data applications.
Security & Compliance
Apply best practices fordata governance, risk management, and regulatory compliance.




Work closely with cross-functional squads and stakeholders to deliver data solutions in anAgile environment.
Required Skills & Experience
Strong programming skills inPython(Scala experience is a plus).
Hands‐on experience withSpark,Hadoop,Hive, andKafka.
Expertise inAWS services(S3, Glue, Redshift, Athena, IAM).
Solid understanding ofETL processes, data modeling, and pipeline orchestration.
Familiarity withRESTful APIs, microservices, and automation scripting.
Knowledge ofCI/CD tools, containerization (Docker), and orchestration (Kubernetes).
Understanding ofdata security, compliance, and governance principles.
Excellent problem‐solving skills and ability to work in a fast‐paced Agile environment.
Preferred Qualifications
Experience withdata lakeanddata warehousearchitectures.
Exposure tomachine learning pipelinesor advanced analytics.
Certification inAWSor Big Data technologies.
Seniority level
Mid‐Senior level
Employment type
Contract
Job function
Information Technology
Industries
Software Development
Location: Sydney, New South Wales, Australia
Salary: A$140,000 - A$180,000
#J-*****-Ljbffr

📌 Data Engineer (Sse / Staff Engineer) - Python & Spark & Aws (New South Wales)
🏢 N2S.Global
📍 New South Wales