Job Description

We're working with a globally recognised financial services business looking to build on their AI function. They're well past the experiment stage, with executive backing, a growing engineering team and real budget behind the roadmap. The systems this team builds go into production and get used at reliable scale, not parked in a demo environment.

n

This is a newly created senior role, so you'll have a real say in how things get built rather than inheriting someone else's decisions.

n

Sydney CBD, hybrid (3 days in office)

n

$160,000 to $200,000 + super

n

Permanent, full time

n

Day to day you'll be:

n

n
Designing and shipping LLM powered features into production, including RAG pipelines, agentic workflows and evaluation frameworks
n
Building and maintaining the infrastructure behind it: vector databases, embedding pipelines, model serving and monitoring
n
Managing cost, latency and quality trade-offs across model providers (OpenAI, Anthropic, open source)
n
Writing production Python and deploying on AWS or Azure with proper CI/CD
n
Setting engineering standards for how AI gets built across the business, including guardrails, testing and responsible use
n




Working closely with product managers, data engineers and stakeholders to take ideas from prototype to production
n
Mentoring mid-level engineers as the team grows
n

n

What you'll bring

n

n
Solid software engineering fundamentals with 5+ years experience, including recent production AI or ML work
n
Hands-on experience building with LLMs: RAG, prompt engineering, fine tuning, model APIs and evals
n
Solid Python and experience with cloud platforms (AWS or Azure)
n
Experience getting models into production, not just notebooks. You know what monitoring, versioning and rollback look like for AI systems
n
The ability to talk trade-offs with non-technical stakeholders and push back when something shouldn't be built
n
Full working rights in Australia
n

n

Nice to have

n

n
Experience with LangChain, LlamaIndex or similar frameworks
n
Classical ML background (scikit-learn, PyTorch, TensorFlow)
n
Exposure to MLOps tooling like MLflow, SageMaker or Azure ML
n
Experience in a scale-up or enterprise setting where you've built AI capability from early days
n

📌 Senior Ai Engineer Llm /genai New South Wales
🏢 Excolo
📍 New South Wales