09 Aug
|
XPT Software
|
Melbourne
09 Aug
XPT Software
Melbourne
XPT SoftwareAustralia PTY Ltd, incorporated in ****, is a Software Services company
XPT works with topclients across Australia in Banking, Insurance, Telecom,Retail, Energy, Mining and Manufacturingdomains.
We have 120+technocrats in Australia working at our clientlocations.
XPT SoftwareAustralia is part of group companies which has globalpresence across India & Europe.
We have served100+ clients globally, fulfilling their onsite-offshoreneeds.
Must Have Skills:
Robust hands‐on experiencewithAzure Data Lake Gen2, Synapse, Databricks
Solid experience in PySpark / Spark SQL, Databricks performance tuning & joboptimization
Proficient inComplex SQL (window functions, CTEs, execution plans)
Strong understanding in Mentoring junior and mid‐level engineers, Communicating trade‐offsto architects and product teams
Experience working withAzure DevOps or GitHub Actions
Nice to Have Skills:
Experience withStreaming& Real‐Time Data Processingon Designing low‐latencypipelines.
Exposure toData Governance & Metadata Managementin Data classification & sensitivity labels
Familiarity withAdvanced Python Engineering Practiceson Performance‐aware Python design
Experience working inAnalytics & BI Awareness
Knowledge ofCloud Cost Optimization & FinOps
Detailed Job Description
The Senior Data Engineer will beresponsible for designing, building, and operatingscalable, secure, and high‐performance data platforms.
The role involves criticaldata pipelines and architectures that power analytics, reporting, andadvanced data use cases such as machine learning and real‐time insights.
The candidate will collaborate closely with analytics,data science, product, and business teams while mentoring engineers anddriving engineering best practices across the data organization.
The role combines technical leadership,architecture ownership, and business impact.
Top 3 responsibilities youwould expect the Subcon to shoulder and execute
Design & Own ScalableData Architecture:
Design batch and streaming data architectures, Choosethe right storage, compute, and processing patterns, Ensure scalability,reliability, fault tolerance, and cost efficiency.
Build Reliable, High‐QualityData Pipelines:
Developand maintain ETL/ELT pipelines at scale, Handle incremental loads, CDC, andfailure recovery, Implement data quality checks and monitoring.
Technical Leadership &Collaboration;:
Review code, data models, and designs, Translatebusiness requirements into technical solutions, Communicate trade‐offs to stakeholdersand leadership
#J-*****-Ljbffr
📌 Senior Data Engineer (Melbourne)
🏢 XPT Software
📍 Melbourne