Purpose: provide data engineering and analysis skills to data heavy deliverables.
Seniority: Mid to senior.
Reports to: Data Architect.
Responsibilities
- Build version controlled pipelines for profiling, cleansing, transformation and migration.
- Automate reconciliation between legacy and target (counts, control totals, field comparisons).
- Provide masked test data for non production environments.
- Document pipelines and pair with ASIC data staff.
Essential
data engineering on a contemporary platform; SQL and Python or Spark; data quality and reconciliation.
Desirable
Databricks; mainframe or Informix data extraction; registry or financial data.
Requirements
- Build version controlled pipelines for profiling, cleansing, transformation and migration.
- Automate reconciliation between legacy and target (counts, control totals, field comparisons).
- Provide masked test data for non production environments.
- Document pipelines and pair with ASIC data staff.
Mid / Senior Data Engineer or Analyst (Citizens with Baseline) Melbourne, NSW, au
#J-18808-Ljbffr
📌 Mid / Senior Data Engineer Or Analyst (Citizens With Baseline) (Sydney)
🏢 Xpt Software Australia
📍 Sydney
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.