Full-Stack Data Engineer (Databricks, FastAPI & Next.js)

Location: REMOTE or Hybrid from Brisbane QLD 4000Duration: 6 months++ Experience: 3–5 years of software development experience, with hands‑on expertise in Python, Databricks, and Next.js/React.

Job Summary

We are seeking a highly motivated Full Stack Developer to build up-to-date, scalable, cloud-native applications that leverage Databricks for data processing, Python for backend services and APIs, and Next.js for responsive web applications. The ideal candidate will have experience developing enterprise‑grade applications that integrate with analytics platforms, data pipelines, AI/ML services, and cloud‑native technologies.

Key Responsibilities

Databricks & ComputeDevelop and maintain data processing workloads using Databricks. Build PySpark notebooks and workflows for data transformation and analytics.

Integrate applications with Databricks Jobs, Workflows, SQL Warehouses, and REST APIs. Optimize Spark jobs for performance, scalability, and cost efficiency. Work with Delta Lake, Unity Catalog, and Medallion Architecture.

Develop data APIs and services that consume Databricks datasets. Backend Development (Python)Design and develop scalable backend services using Python (FastAPI, Flask, or Django). Build RESTful APIs and microservices.

Develop authentication and authorization mechanisms (OAuth2, JWT, SSO). Integrate backend services with Databricks, Azure services, and third‑party APIs. Implement asynchronous processing and background jobs.

Write reusable, well‑tested, and maintainable code. Build logging, monitoring,



and error‑handling capabilities.

Frontend Development (Next.js)Develop responsive web applications using

Next.js and React. Create reusable UI components and modern dashboards. Integrate frontend applications with backend APIs.

Implement authentication and role‑based access control. Optimize application performance and user experience. Ensure responsive design across desktop and mobile devices.

Integration & CloudIntegrate applications with Azure cloud services. Consume APIs from enterprise applications and external systems. Implement secure API communication and data exchange.

Participate in cloud deployment and infrastructure discussions. DevOps & CI/CDUse Git for source control and collaborative development. Build and maintain CI/CD pipelines using Azure DevOps or GitHub Actions.

Support automated testing and deployment processes. Participate in code reviews and enforce coding standards.

Quality & SecurityDevelop unit and integration tests.

Ensure applications meet enterprise security and compliance requirements. Implement secure coding practices and vulnerability remediation. Troubleshoot production issues and support release activities.

Must Have

Must Have:Data Engineering core conceptsDatabricksETL Pipelines, Medallion Architecture, PySparkDatabricks Automation BundlesPython BackendFastAPI (Must) REST API DevelopmentAuthN Basics (JWT, OAuth2)Databricks App builder exp including deploymentGeneral EngineeringAgile Unit TestingCI/CDAzure DevOps Good to

Good to

Have:Front end design/development Next.js or similar Html/css frameworkAI EngineeringML EngineeringMLOps

📌 Senior Full-Stack Engineer (Brisbane)
🏢 Work Initiatives
📍 Brisbane