Senior Software Engineer Data Engineer Databricks PySpark (Coffs Harbour City Council)

Senior Software Engineer Data Engineer Databricks PySpark (Coffs Harbour City Council)

10 Sep
|
Société Générale
|
Coffs Harbour City Council

10 Sep

Société Générale

Coffs Harbour City Council

Vos missions au quotidien

Azure Data Engineer needs core skills in:

- Creating effective and scalable data structures in SQL &
- Python
- Azure Cloud Fundamentals and ETL/Data Pipelines focusing on integrating, transforming, building and managing end-to-end data pipelines, combining data from several sources and storing data using services like ADLS Gen2
- Synapse Analytics
- Databricks
- Proficiency in administering Azure databases, and securing data, plus strong data modeling and big data tech (Spark)

Core Technical Skills
- A proven track record of delivering complex data products.
- Expertise in ELT flows using Databricks (PySpark), ADLS, ADF, SQL, and Python.
- Experience with DevOps CI/CD and GIT.
- Experience with infra as code approaches such as Terraform.
- Experience with Linux, Docker and Kubernetes.
- A software engineering background as a plus.
- Fluency in English (written and spoken); additional languages are a plus.

Foundational Knowledge Data Modeling: Designing productive data structures (star/snowflake schemas).

Data Architecture: Understanding data lakes vs. warehouses.

Security: Data encryption, access control, compliance within Azure.

Important Tools &

- Concepts:

Microsoft Fabric;

DevOps: CI/CD practices.

Soft Skills

Problem-solving, analytical thinking, communication, teamwork.

Preferred Knowledge of

Hadoop, MapReduce, Oracle DB.

Et si c’était vous ?

Azure Data Engineer needs core skills in:

- Creating effective and scalable data structures in SQL &
- Python
- Azure Cloud Fundamentals and ETL/Data Pipelines focusing on integrating, transforming, building and managing end-to-end data pipelines, combining data from several sources and storing data using services like ADLS Gen2
- Synapse Analytics
- Databricks
- Proficiency in administering Azure databases, and securing data,



plus strong data modeling and big data tech (Spark)

Core Technical Skills
- A proven track record of delivering complex data products.
- Expertise in ELT flows using Databricks (PySpark), ADLS, ADF, SQL, and Python.
- Experience with DevOps CI/CD and GIT.
- Experience with infra as code approaches such as Terraform.
- Experience with Linux, Docker and Kubernetes.
- A software engineering background as a plus.
- Fluency in English (written and spoken); additional languages are a plus.

Foundational Knowledge Data Modeling: Designing efficient data structures (star/snowflake schemas).

Data Architecture: Understanding data lakes vs. warehouses.

Security: Data encryption, access control, compliance within Azure.

Important Tools &

- Concepts:

Microsoft Fabric;

DevOps: CI/CD practices.

Soft Skills

Problem-solving, analytical thinking, communication, teamwork.

Preferred Knowledge of

Hadoop, MapReduce, Oracle DB.

Plus qu’un poste, un tremplin

“We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.

Pourquoi nous choisir ?

At Société

- Générale, we are convinced that people are drivers of change,



and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.

We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.

Diversité et inclusion

Nous sommes un employeur garantissant l'égalité des chances et nous sommes fiers de faire de la diversité une force pour notre entreprise. Le groupe s’engage à reconnaître et à promouvoir tous les talents, quels que soient leurs croyances, âge, handicap, parentalité, origine ethnique, nationalité, identité de genre, orientation sexuelle, appartenance à une organisation politique, religieuse, syndicale ou à une minorité, ou toute autre caractéristique qui pourrait faire l’objet d’une discrimination.

Partager

📌 Senior Software Engineer Data Engineer Databricks PySpark (Coffs Harbour City Council)
🏢 Société Générale
📍 Coffs Harbour City Council

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior software engineer data engineer databricks pyspark (coffs harbour city council) / coffs harbour city council

Subscribe to this job alert:

Get the latest job offers by email for: senior software engineer data engineer databricks pyspark (coffs harbour city council) / coffs harbour city council