Role Description

We are seeking a skilled and innovative LLM Engineer to design, develop, evaluate, and deploy applications powered by large language models. The role involves building reliable AI solutions, integrating foundation models into products and workflows, developing prompt and retrieval strategies, and improving model performance, accuracy, and efficiency.

Key responsibilities include designing LLM-based applications, developing prompt engineering and evaluation frameworks, implementing Retrieval-Augmented Generation (RAG) pipelines, integrating APIs and AI services, and working with structured and unstructured data. The role also involves evaluating model outputs, improving response quality, implementing safeguards, monitoring application performance, and collaborating with software, data, and product teams to translate business requirements into practical AI solutions.

Qualifications

- Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Engineering, or a related technical field.




- Strong understanding of machine learning, natural language processing, and contemporary LLM architectures.
- Proficiency in Python and familiarity with software development best practices.
- Knowledge of transformer architectures, embeddings, tokenization, and model inference.
- Familiarity with prompt engineering, RAG, vector databases, fine-tuning, and LLM evaluation techniques.
- Experience working with APIs, databases, cloud platforms, and AI/ML frameworks is an advantage.
- Understanding of tools and frameworks such as PyTorch, TensorFlow, Hugging Face, LangChain, or similar technologies.
- Strong analytical, problem-solving, and debugging skills.
- Ability to evaluate model quality using appropriate metrics and testing methodologies.
- Strong communication and collaboration skills with a willingness to continuously learn emerging AI technologies.

📌 LLM Engineer (Sydney)
🏢 FIRST Model Management
📍 Sydney