Job Description
About the Role
n
n
Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project.
n
Contributors help evaluate and improve frontier AI coding models through structured technical assessments.
n
The work focuses on realistic infrastructure engineering workflows and model evaluation.
n
Spots are limited and filling quickly on a first come, first serve basis.
n
n
What You'll Do
n
n
Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
n
Review model-generated implementations involving cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation.
n
Identify bugs, edge cases, reliability issues, and failure modes.
n
Compare outputs from multiple frontier models and assess their strengths and weaknesses.
n
Apply skilled engineering judgment to realistic infrastructure engineering scenarios.
n
n
Time Commitment




n
n
Sprint based project that runs in ***** hour stretches based on client requirement.
n
n
Compensation
n
n
$400 per accepted task.
n
Typical tasks take approximately 2–3 hours after ramp-up.
n
Compensation is tied to accepted work.
n
n
Who Should Apply
n
n
2+ years of professional DevOps, SRE, or Cloud Engineering experience.
n
Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling.
n
Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
n
Ability to evaluate model-generated infrastructure and reliability engineering solutions.
n
Experience supporting production-scale systems is preferred.
n
#J-*****-Ljbffr

📌 Devops Engineer - Ai Model Evaluator (New South Wales)
🏢 Mercor
📍 New South Wales