Job Description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Quality based in Australia.

n

This role focuses on building the next generation of quality engineering through AI-powered testing and intelligent automation.
n You will design, build, and operate agents that support test creation, execution, maintenance, evaluation, and failure triage.
n The role combines hands-on software engineering with test infrastructure, distributed systems, CI at scale, and emerging LLM technologies.
n You will help product teams take greater ownership of quality by providing reliable tooling, patterns, and practices rather than acting as a traditional QA safety net.
n You will also shape how AI-driven testing is evaluated and apply those methods to non-deterministic AI capabilities.
n Working across a fully remote, global engineering organization, you will have substantial ownership and influence over technical direction.
n The environment emphasizes autonomy, collaboration, experimentation, and engineering quality, with opportunities to solve complex problems at scale.

Accountabilities n

n
- n

Build and operate AI agents across the testing lifecycle, including test design, generation, maintenance, execution, and failure triage.

n
- n

Own the infrastructure required to make agent-driven testing dependable, including test environments, test data, tool interfaces, guardrails, runtime management, and cost controls.

n
- n

Establish reliable methods for evaluating agent output quality so engineering teams can trust automated results without extensive manual review.

n
- n

Apply AI-driven evaluation practices to testing the platform's own non-deterministic and AI-powered capabilities.

n
- n





Work closely with product engineering teams as new features are developed to ensure testing tools remain relevant, effective, and grounded in real product needs.

n
- n

Develop reusable testing patterns, tooling, and enablement practices that allow engineers to own quality independently.

n
- n

Drive adoption of quality engineering capabilities across teams that do not report directly to you.

n
- n

Contribute to technical decisions, system design, and continuous improvement of testing infrastructure and engineering practices.

n

Requirements nn
- n

5+ years of professional software engineering experience, with a strong track record of writing and shipping production software.

n
- n

Hands-on experience building and owning test infrastructure, developer tooling, internal platforms, or comparable systems used by other engineers.

n
- n

Practical experience with LLMs or agent frameworks, including prompt and context design, tool use, non-deterministic behavior, and evaluation of AI-generated outputs.

n
- n

Strong understanding of distributed systems and continuous integration at scale, including reasoning about concurrency, state, timing, and system reliability.

n
- n

Ability to influence engineering teams without direct management authority and demonstrate that you have successfully driven adoption of tools or practices across teams.

n
- n

Ability and willingness to use and understand the product deeply enough to build effective quality solutions.

n
- n





Strong engineering judgment and an ability to balance quality, maintainability, delivery speed, and practical business needs.

n
- n

Excellent collaboration and communication skills, with the ability to work effectively in a distributed, cross-functional environment.

n
- n

Preferred experience with LLM evaluation or benchmarking, open-source software development, or developer tooling and platform engineering.

n
- n

Experience with Java, TypeScript, or Python, as well as Kubernetes and Helm, is advantageous.

n

Benefits nn
- n

U.S. annual total target cash compensation ranging from $143,800 to $231,900 , depending on market, location, skills, experience, and qualifications.

n
- n

Equity through a Virtual Stock Option Plan (VSOP), where applicable.

n
- n

Fully remote and flexible work environment with the ability to work from anywhere, subject to applicable employment arrangements.

n
- n

Home office budget and co-working space support.

n
- n

Adaptable time off designed to support meaningful rest and recharge.

n
- n

Locally tailored healthcare benefits and global mental wellbeing support.

n
- n

Live Well Lifestyle Spending Account, providing adaptable support for wellbeing, family, personal interests, experiences, and financial wellbeing.

n
- n

Retirement and pension plans, often including company contributions, plus life and disability insurance where applicable.

n
- n

Up to $1,000 per year for self-directed career development, including courses, certifications, and books.

n
- n

Annual company gatherings, team offsites, local meetups, and budgets supporting in-person connection.

n
- n

Inclusive, global workplace committed to welcoming people across diverse cultures and backgrounds.

n

n

We appreciate your interest and wish you the best!

#J-18808-Ljbffr

📌 Senior Software Engineer, Quality (Adelaide)
🏢 Lever
📍 Adelaide