About The Company

Bailey Abbott is a progressive IT consultancy working across public and private sectors. The company brings people together to explore what is possible and deliver transformational outcomes for its clients. Its work is grounded in the belief that people are central to success, and that strong relationships, trust, and accountability help organisations move forward with confidence.

Bailey Abbott’s people are creative, collaborative, and passionate about positive change. The team challenges established ways of working through fresh thinking, technology, and practical approaches to simplifying complexity. By combining knowledge and skills with a positive mindset, Bailey Abbott helps clients solve problems, improve the way they work, and achieve meaningful outcomes.

About The Role

Bailey Abbott is seeking a Machine Learning Engineer with a strong software engineering foundation to productionise, scale, and maintain advanced analytical and predictive models. In this role, you will connect data science experimentation with robust engineering practices, helping transform analytical solutions into reliable services and workflows that can operate at scale.

You will design and develop data pipelines and automated machine learning lifecycles within Databricks, using Apache Spark and R alongside modern development practices. Working closely with data scientists, data engineers, architects, and business stakeholders, you will help ensure models and their supporting data are dependable, maintainable, and integrated effectively into downstream systems.

Qualifications





You will bring practical experience applying software engineering principles to data or machine learning solutions. This includes building modular code, using Git and CI/CD practices, and developing automated unit or integration tests. You will also have hands-on experience with Databricks and a strong understanding of Apache Spark, including distributed processing, data partitioning, query optimization, and memory management.

Strong R skills are required, particularly for statistical modelling, data manipulation, or forecasting workflows. Experience using SparkR or sparklyr to run R workloads across distributed data is valuable. You should be comfortable querying relational data and working with large-scale tabular or time-series datasets, including data stored in Delta Lake formats.

Experience with MLflow, Unity Catalog, model deployment, versioning, monitoring, and automated retraining will be beneficial. Familiarity with Python or PySpark, cloud platforms such as Azure, AWS, or GCP, and Infrastructure as Code tools such as Terraform is also desirable. Knowledge of model drift, data lineage, and enterprise data governance will be an advantage.

Responsibilities

Build, test,



and optimize production-grade data processing and model training pipelines using Apache Spark and Databricks. Develop repeatable workflows that support the full machine learning lifecycle, from experimentation and deployment through monitoring and retraining. Apply sound software architecture, version control, testing, and CI/CD practices to analytical codebases.

Optimize R-based modelling workflows for distributed environments, and collaborate with data architects, engineers, and analysts to integrate predictive outputs into relevant systems and platforms. Monitor pipeline performance, including latency and compute usage, and help ensure reliable processing, data integrity, and appropriate governance across production workspaces.

Benefits

Join a team-oriented consultancy where people are encouraged to share ideas, challenge the status quo, and find simpler ways to solve complex problems. You will have the opportunity to work on meaningful client challenges across public and private sectors, contribute to modern data and machine learning solutions, and collaborate with colleagues who value ownership, trust, and continuous improvement.

Bailey

Abbott supports an environment where varied experience and perspectives can contribute to innovation and strong outcomes.

Equal Opportunity

Bailey Abbott welcomes talented people from all backgrounds and walks of life. The company values the diverse experience and perspectives people bring and encourages applications from candidates who can contribute to an inclusive, collaborative, and innovative workplace.

📌 Machine Learning Engineer (Australia)
🏢 TaskVerse
📍 Australia