20 Aug
|
CommonAI
|
Hobart
Job Description
CommonAI CIC is a non-profit membership organisation, founded on a belief in collaborative engineering for the safe and responsible development of foundational AI technologies. A place where AI startups, enterprises large and small, public sector bodies and academia can share resources and knowledge, to codevelop and grow businesses, quick.
n
We support technology-focused start ups, each with unique data management challenges, and are seeking an experienced Storage Architect to help them design, deploy and maintain high-performance storage systems for their AI and data-driven workloads. The successful candidate will combine deep experience architecting and managing distributed, cloud, and tiered storage solutions with solid Linux and automation skills.
n
In this role you will:
n
n
Design, implement, and maintain storage platforms that support large-scale AI and data pipelines
n
Manage distributed storage systems such as Ceph, Lustre, or BeeGFS.
n
Oversee tiered storage architectures, optimizing data movement across high-performance, object, and archival tiers.
n
Ensure data integrity, availability, and security across on-premises and cloud environments.
n
Develop automation and monitoring tools using Bash, Python, or similar scripting languages.
n
Manage and secure container images and related storage used for AI and ML workloads.
n
Integrate storage systems with public cloud services (AWS, Azure, GCP) and hybrid environments.
n
Troubleshoot complex storage and data flow issues, collaborating closely with AI platform and infrastructure teams.
n
Contribute to ongoing architecture improvements, performance tuning, and capacity planning.
n
n
To be considered candidates should meet most of the following requirements:
n
n
Strong Linux system administration background.
n
Proven experience installing, configuring, and maintaining Ceph clusters or similar technologies in a production environment.
n
Familiarity with distributed filesystems (e.g., Lustre, BeeGFS) and cloud-based storage services (e.g. EC2).
n
Experience with tiered storage management and lifecycle data policies.
n
Scripting and automation proficiency (e.g. Bash, Python,
Terraform/OpenTofu,
Ansible).
n
Understanding of data security best practices and compliance considerations.
n
Experience working with container technologies (e.g. Docker, Kubernetes) and image storage registries.
n
Strong analytical, troubleshooting, communication and documentation skills.
n
n
We also value:
n
n
Knowledge of GPU compute environments or AI training infrastructure.
n
Experience with monitoring and observability tools (Prometheus, Grafana, etc.).
n
Contributions to open-source storage, data management, or infrastructure projects.
n
Familiarity with object storage systems (S3, RADOS Gateway, MinIO, etc.).
n
n
n
A collaborative and supportive work environment.
n
The opportunity to have a high impact in a growing organisation.
n
Competitive salary package and pension.
n
Professional development opportunities.
n
Networking opportunities with influential people from across the tech sector and academia.
n
A vibrant office environment located a few minutes walk away from Cambridge train station.
n
n
CommonAI CIC is an equal opportunity employer and is committed to creating an inclusive and diverse workplace.
#J-*****-Ljbffr
📌 Ai Infrastructure Engineer (Storage) (Hobart)
🏢 CommonAI
📍 Hobart