22 Sep
|
N2S.Global
|
New South Wales
22 Sep
N2S.Global
New South Wales
Job Description
We are seeking an experienced Lead Data Engineer with strong expertise in Microsoft SQL Server, data warehousing, ETL/ELT development, and cloud-based data platforms. The successful candidate will lead the design, development, and optimization of enterprise data solutions, ensuring scalability, performance, security, and reliability across the organization's data ecosystem.
n
Key Responsibilities
n
n
Lead the design and development of enterprise-scale data platforms and data pipelines.
n
Design, build, and maintain high-performance Microsoft SQL Server databases, data warehouses, and data marts.
n
Develop and optimize ETL/ELT processes using SQL Server Integration Services (SSIS) and modern data integration tools.
n
Collaborate with business stakeholders, architects, analysts, and developers to understand data requirements and translate them into technical solutions.
n
Design and implement data models supporting reporting, analytics, and operational systems.
n
Optimize database performance through indexing, partitioning, query tuning, and performance monitoring.
n
Lead data migration and modernization initiatives from legacy platforms to cloud environments.
n
Implement data quality, data governance, and master data management best practices.
n
Establish standards for data engineering, coding, deployment, and documentation.
n
Mentor and guide data engineers and developers.
n
Work closely with DevOps and Cloud teams to automate deployment and monitoring processes.
n
Ensure compliance with security, privacy, and regulatory requirements.
n
n
Mandatory Skills
n
Database & SQL
n
n
8+ years of hands-on experience with Microsoft SQL Server.
n
Robust expertise in:
n
T-SQL
n
Stored Procedures
n
Functions
n
Views
n
Triggers
n
Query Optimization
n
Performance Tuning
n
Strong experience building:
n
Data Warehouses
n
Data Lakes
n
Data Integration Solutions
n
Expertise in ETL/ELT development.
n
Experience with:
n
SSIS
n
SQL Server Agent
n
Data Migration projects
n
Strong understanding of:
n
Snowflake Schema
n
Data Vault
n
Kimball Methodologies
n
Experience with one or more:
n
Microsoft Fabric
n
Databricks
n
n
Programming
n
n
Experience with:
n
Python
n
PowerShell
n
C# (preferred)
n
n
Leadership Responsibilities
n
n
Lead technical design discussions and solution reviews.
n
Own data architecture decisions and roadmap planning.
n
Drive best practices around database design, coding standards, and deployment automation.
n
Coach and mentor junior and mid-level data engineers.
n
Manage stakeholder expectations and delivery timelines.
n
Participate in project estimations, planning, and risk management.
n
n
Preferred Skills
n
n
Microsoft Fabric experience.
n
Experience with Power BI datasets and semantic models.
n
Exposure to Spark or Databricks.
n
Experience with real-time data streaming technologies.
n
Knowledge of Data Governance and Data Quality frameworks.
n
n
Qualifications
n
n
Bachelor's degree in Computer Science, Information Technology, Engineering, or related discipline.
n
8-15+ years of overall IT experience.
n
5+ years of experience leading data engineering teams or large-scale data initiatives.
n
n
Preferred Certifications
n
n
Microsoft Certified: Fabric Analytics Engineer Associate
n
📌 Lead Data Engineer (Ms Sql) (New South Wales)
🏢 N2S.Global
📍 New South Wales