23 Sep
|
N2S.Global
|
New South Wales
23 Sep
N2S.Global
New South Wales
Job Description
We are seeking an experienced Lead Data Engineer with strong expertise in Microsoft SQL Server, data warehousing, ETL/ELT development, and cloud-based data platforms. The successful candidate will lead the design, development, and optimization of enterprise data solutions, ensuring scalability, performance, security, and reliability across the organization's data ecosystem.
n
Key Responsibilities
n
n
- Lead the design and development of enterprise-scale data platforms and data pipelines.
n
- Design, build, and maintain high-performance Microsoft SQL Server databases, data warehouses, and data marts.
n
- Develop and optimize ETL/ELT processes using SQL Server Integration Services (SSIS) and up-to-date data integration tools.
n
- Collaborate with business stakeholders, architects, analysts, and developers to understand data requirements and translate them into technical solutions.
n
- Design and implement data models supporting reporting, analytics, and operational systems.
n
- Optimize database performance through indexing, partitioning, query tuning, and performance monitoring.
n
- Lead data migration and modernization initiatives from legacy platforms to cloud environments.
n
- Implement data quality, data governance, and master data management best practices.
n
- Establish standards for data engineering, coding, deployment, and documentation.
n
- Mentor and guide data engineers and developers.
n
- Work closely with DevOps and Cloud teams to automate deployment and monitoring processes.
n
- Ensure compliance with security, privacy, and regulatory requirements.
n
n
Mandatory Skills
n
Database & SQL
n
n
- 8+ years of hands-on experience with Microsoft SQL Server.
n
- Strong expertise in:
n
- T-SQL
n
- Stored Procedures
n
- Functions
n
- Views
n
- Triggers
n
- Query Optimization
n
- Performance Tuning
n
- Strong experience building:
n
- Data Warehouses
n
- Data Lakes
n
- Data Integration Solutions
n
- Expertise in ETL/ELT development.
n
- Experience with:
n
- SSIS
n
- SQL Server Agent
n
- Data Migration projects
n
- Strong understanding of:
n
- Snowflake Schema
n
- Data Vault
n
- Kimball Methodologies
n
- Experience with one or more:
n
- Microsoft Fabric
n
- Databricks
n
n
Programming
n
n
- Experience with:
n
- Python
n
- PowerShell
n
- C# (preferred)
n
n
Leadership Responsibilities
n
n
- Lead technical design discussions and solution reviews.
n
- Own data architecture decisions and roadmap planning.
n
- Drive best practices around database design, coding standards, and deployment automation.
n
- Coach and mentor junior and mid-level data engineers.
n
- Manage stakeholder expectations and delivery timelines.
n
- Participate in project estimations, planning, and risk management.
n
n
Preferred Skills
n
n
- Microsoft Fabric experience.
n
- Experience with Power BI datasets and semantic models.
n
- Exposure to Spark or Databricks.
n
- Experience with real-time data streaming technologies.
n
- Knowledge of Data Governance and Data Quality frameworks.
n
n
Qualifications
n
n
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related discipline.
n
- 8-15+ years of overall IT experience.
n
- 5+ years of experience leading data engineering teams or large-scale data initiatives.
n
n
Preferred Certifications
n
n
- Microsoft Certified: Fabric Analytics Engineer Associate
n
📌 Lead Data Engineer (MS SQL) (New South Wales)
🏢 N2S.Global
📍 New South Wales