Job Description

We are seeking a Software Engineer with a strong Data Engineering background to support enterprise data migration, platform modernization, and security initiatives. This role will focus on migrating data between systems, improving data quality and reliability, implementing secure engineering practices, and supporting the overall health of our data platform.

The ideal candidate is first and foremost a software engineer who enjoys solving technical problems but also possesses hands-on experience with data engineering tools and cloud-based data platforms. This individual will work closely with the team to understand current systems, support migration efforts, and contribute to secure, scalable solutions.

Responsibilities

- Support ongoing data migration efforts, including moving data between SQL-based systems and Azure Data Explorer (Kusto).
- Design, develop, and maintain data pipelines and integrations across Azure-based platforms.
- Partner with engineering teams to understand existing systems and help drive platform improvements.
- Ensure data quality, consistency, and reliability throughout migration and modernization initiatives.
- Develop and maintain solutions using Python and Spark for data processing and transformation.
- Build and support data workflows utilizing Azure Data Factory (ADF), Azure Blob Storage, and Azure Data Lake Storage Gen2.
- Implement and enhance CI/CD pipelines to support secure and reliable deployments.
- Apply security best practices throughout the software development lifecycle, including network security, firewall configurations, and secure infrastructure design.
- Troubleshoot data, infrastructure, and application issues as they arise.
- Collaborate closely with teammates, contribute ideas, and continuously learn current technologies and approaches.

Skills and Requirements

- 3+ years of experience in Software Engineering,



Data Engineering, or a related field.
- Strong Python development experience.
- Experience working with Apache Spark for large-scale data processing.
- Experience building and supporting data pipelines using Azure Data Factory (ADF).
- Experience with Azure Blob Storage and/or Azure Data Lake Storage Gen2.
- Experience working with SQL databases and data migration projects.
- Understanding of CI/CD concepts and deployment automation.
- Familiarity with cloud security best practices, including network security and firewall concepts.
- Strong problem-solving skills and the ability to learn new technologies quickly.
- Ability to collaborate effectively within a team environment.
- Experience with Azure Data Explorer (Kusto).
- Experience migrating enterprise-scale datasets between platforms.
- Familiarity with cloud-native architectures and Microsoft Azure services.
- Experience supporting data quality, governance, and operational excellence initiatives.
- Experience working within environments where security and compliance are critical considerations.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [email protected].

📌 SDE 3 (Redmond)
🏢 Insight Global
📍 Redmond