Job Description
n
CommonAI CIC is a non-profit membership organisation, founded on a belief in collaborative engineering for the safe and responsible development of foundational AI technologies. A place where AI startups, enterprises large and small, public sector bodies and academia can share resources and knowledge, to codevelop and grow businesses, fast.
n
We are led by experienced founders, investors and engineers who believe that collaborative engineering drives faster AI innovation and are backed by a mix of UK Government and private funding in order to design, build and deploy innovative AI systems.
The Opportunityn
We are seeking a Senior Software Engineer with a passion for open-source AI infrastructure to work on deploying, extending and optimising vLLM (and potentially other inference serving engines) to support our projects. You will play a crucial, high-impact role across both our key programmes, the Scaling Inference Lab
()
and the High Assurance programme.
n
As an AI-first company, we strongly believe in collaborative engineering powered by the tools we are helping to build. This role places a major emphasis on using LLMs, AI coding assistants, and autonomous agents for software development.
What You'll Don
n
Deploy, instrument and monitor open weight models served using vLLM.
n
Implement new features within vLLM to support novel hardware architectures as part of the Scaling Inference Lab.
n
Work with the Panopticon team to identify opportunities to extend vLLM to enhance accuracy, explainability, and accountability when using it to serve models in regulated environments.
n
Actively collaborate with the open-source vLLM community to propose, review, and upstream core changes.
n
Troubleshoot, profile, and optimise inference performance,



focusing on latency, throughput, and hardware utilisation.
n
n
n
Proven experience working as a Senior Software Engineer with deep expertise in both Python and low-level programming (e.g. C/C++, Rust, assembly or CUDA).
n
A history of direct contributions to vLLM or similar high-performance open-source ML/AI projects (e.g. PyTorch, Hugging Face TGI, TensorRT-LLM, Ray).
n
Strong understanding of LLM inference mechanics (e.g. KV caching, continuous batching, memory management, model quantisation).
n
Experience interacting with, and upstreaming code to, active open-source communities.
n
Hands-on experience working on performance optimisation for hardware accelerators (GPUs, TPUs, CPU vector units or other accelerators).
n
A strong enthusiasm for using LLMs, coding assistants, and agents as core tools in your own software development process.
n
We also value:n
n
Experience working on software systems that operate in highly regulated or high-assurance environments (e.g. financial services).
n
An understanding of the latest AI safety research and active involvement in that community.
n
Deep knowledge of modern MLOps practices, CI/CD, and large-scale deployments.
n
n
n
A collaborative and supportive work environment
n
The prospect to have a high impact in a growing organisation
n
Competitive salary package and pension
n
Professional development opportunities
n
Networking opportunities with influential people from across the tech sector, financial services, and academia
n
A vibrant office environment located a few minutes' walk away from Cambridge train station
n
n
CommonAI CIC is an equal opportunity employer and is committed to creating an inclusive and diverse workplace.
n
#J-*****-Ljbffr

📌 Senior Software Engineer (Vllm) (Western Australia)
🏢 CommonAI
📍 Western Australia