About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Senior Software Engineering Experts
Type: Contract
Compensation: $120–$180/hour
Location: Remote
Role Responsibilities
- Design realistic, challenging software engineering tasks from real-world work. Tasks include feature changes, debugging, root-cause analysis, code review, system design, and technical documentation.
- Write clear task proposals explaining task realism, verification, and challenges for current AI models .
- Illustrate "what good looks like" with reference solutions, tests, and criteria covering correctness, architecture, maintainability, style, and scope.
- Assess AI-generated code and engineering work, collaborating with AI coding agents to evaluate success and failure.
- Apply consistent,
evidence-based judgment for reproducible and defensible assessments.
- Take structured feedback from senior reviewers and iterate on submitted work.
Qualifications
Must-Have
- 4+ years of skilled software engineering experience at leading technology, quantitative, or financial firms.
- Strong command of at least one major language like Python , Java , C++ , Go , TypeScript , or Rust .
- Proven ability to work in large, complex production codebases and judge code quality.
- Excellent written English for explaining technical decisions and trade-offs.
- Bachelor's degree from an English-speaking country.
- Detail-oriented and consistent in evaluating complex work.
- Comfortable receiving feedback and calibrating judgment against set standards.
#J-18808-Ljbffr
📌 Software Engineering Expert - Fully Remote | Up To $180/Hr (Sydney)
🏢 Mercor
📍 Sydney