Hyphen Connect is seeking a highly skilled LLM Pre-training & Distributed Engineer to orchestrate large-scale training runs and optimize distributed infrastructure in Albury, NSW, AU. You will design and manage GPU clusters, provide robust automation for month-long training campaigns, and ensure reliable throughput.
The role demands deep expertise in 3D parallelism (Data, Tensor, Pipeline), experience with SLURM or Kubernetes GPU clusters, and a solid systems background in C++, CUDA, and