Hyphen Connect in Launceston, TAS, Australia is seeking a highly skilled LLM Pre-training & Distributed Systems Engineer to orchestrate large-scale training runs and optimize distributed infrastructure.
You will manage 1,000+ GPU clusters with PyTorch, DeepSpeed, or Megatron-LM, optimize InfiniBand networking and memory, and automate checkpointing for long-running jobs.
Solid systems engineering background with C++, CUDA, and Python is essential for this role.