Role -Databricks Data Engineer Senior Analyst

About the Role

We are seeking experienced Databricks Data Engineers to join our Data & AI. You will play a pivotal role in designing, developing, and maintaining scalable data pipelines and transformation workflows on Azure Databricks, enabling advanced analytics and data engineering initiatives.

Key Responsibilities

- Design, develop, and optimize scalable data ingestion pipelines using Azure Data Factory, Databricks, and Apache Spark.

- Build and maintain Databricks notebooks using PySpark for data preparation, transformation, and enrichment to support Data Science use cases.

- Collaborate closely with Data Scientists to understand data requirements and ensure timely delivery of clean, st...

Qualifications

Required Skills & Qualifications

Technical Skills

- Experience in data engineering, with at least 2 years hands-on experience in Azure Databricks.

- Strong proficiency in Apache Spark, especially PySpark for distributed data processing.

- Experience with Azure Data Factory, Azure Synapse, Azure Blob Storage, and Delta Lake.

- Solid understanding of ETL/ELT processes, data modeling, and data warehousing concepts.

- Proficiency in Python and/or Scala for data processing.

- Experience with CI/CD pipelines using tools like Azure DevOps, Git, and Terraform (preferred).

- Familiarity with SQL, NoSQL, and data lake architectures.

- Knowledge of data governance, security, and compliance in financial services.

<...





Additional Information

Equal Employment Prospect Statement

All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process.

Avanade is committed to providing veteran employment opportunities to our service men and women.

Please read Avanade's Hiring and Privacy Statement...

About Avanade

As you bring your skills and abilities to Avanade, you’ll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and communities. You’ll join a community of smart, supportive collaborators to lift, mentor, and guide you, and to lean on your expertise.

You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It’s all here, so take a closer look!

Create a future for our people that focuses on

- Expanding your thinking
- Experimenting courageously &bull...;

📌 Databricks Data Engineer Senior Analyst (Brisbane)
🏢 Avanade
📍 Brisbane