Join to apply for the AI Product Engineer role at Janison .

The AI Product Engineer will drive innovation in Janison's Jai platform, leveraging cutting-edge AI technologies to revolutionise educational assessment. This role is for a technologist who thrives at the intersection of AI, product development, and education technology. You'll co‑create capabilities with AI tools, shape product direction, and build systems that transform how assessments are created and delivered. Ideal candidates are passionate about AI's potential in education and comfortable working in a rapid‑paced, experimental environment.

Duties & Responsibilities

- Co‑create innovative features using AI tools (Copilot, Cursor, Claude, etc.) as primary development partner
- Design and implement advanced prompt engineering strategies for assessment generation
- Build and optimise AI pipelines for creating, validating, and scoring educational assessments
- Develop data analytics solutions to measure assessment quality and AI performance
- Contribute to product strategy based on emerging AI capabilities and educational needs
- Rapidly prototype and iterate on AI‑powered features using Python, TypeScript, and React
- Design and implement PostgreSQL schemas optimized for AI‑generated content and analytics
- Collaborate with educators and assessment experts to translate pedagogical needs into technical solutions
- Stay current with AI advancements and evaluate new models/tools for integration
- Build evaluation frameworks for AI‑generated assessment quality
- Design and implement comprehensive testing strategies using AI‑assisted tools to ensure assessment quality and system reliability
- Develop automated test suites that validate AI‑generated content against educational standards and psychometric requirements
- Create integration tests for API endpoints, generation pipelines, and scoring systems using AI to generate edge cases and test scenarios




- Build validation frameworks that catch template artifacts, formatting issues, and content quality problems in AI‑generated assessments
- Develop AI capabilities responsibly, ensuring data security, IP protection, and privacy are upheld throughout the product lifecycle

What success looks like?

- You thrive when collaborating with your team, solving complex problems together
- You are excited to experiment with new AI models and techniques daily
- You can rapidly prototype ideas using AI as your co‑developer
- You think in terms of user outcomes, not just technical implementation
- You are comfortable with ambiguity and can define your own path
- You contribute to the vision of AI‑powered assessment, not just execute tasks
- You will partner closely with Product and UX/ teams in rapid prototyping cycles, translating user insights and design concepts into functional AI‑powered features through iterative development
- You adapt fluidly to evolving customer requirements and feedback, working outside traditional ticket‑based workflows to quickly validate assumptions and deliver solutions that meet pedagogical needs

Experience, Skills & Qualifications

- Demonstrated experience using AI tools (GitHub Copilot, Cursor, Claude, ChatGPT) for development.
- Strong Python skills with focus on AI/ML libraries and API integrations
- Experience with prompt engineering and LLM optimisation techniques
- Proficiency in React, TypeScript, and modern frontend development
- PostgreSQL expertise including JSON operations and vector databases




- Product‑minded approach with ability to translate user needs into technical solutions
- Data analytics skills for evaluating AI performance and assessment quality
- Self‑directed learner who stays current with AI developments
- Experience with AI‑assisted testing tools and test generation
- Understanding of testing strategies for non‑deterministic AI systems
- Experience with or passion for educational technology
- Understanding of assessment design principles and psychometrics
- Experience with QTI standards or educational interoperability
- Knowledge of voice synthesis, audio processing for assessments

What We Offer

We are a purpose‑driven organisation, offering a ‘flexible’ approach to work. We understand one size doesn’t fit all, so whatever works for the business, the team and your role means endless possibilities for the flexibility you need.

- Access to our Employee Share Ownership Program. We will match your shares of up to $2,000 per year
- A fifth week of annual leave (conditions apply), a day off for your birthday and various ‘freebie days’ throughout the year
- Parental leave benefit including paid leave, continued super contributions and more
- Discretionary annual pay review and bonus program
- A focus on virtual engagement and inclusivity to support our distributed workforce across the globe
- A focus on development and upskilling opportunities (if that’s what you’re after)

Next Steps

If you are looking for an organisation that will support your growth, provide you with the flexibility you need and are looking for a greater purpose to exercise your skills, then please submit your application. We can’t wait to hear from you!

By submitting your application with Janison, you confirm acknowledgement of Janison’s Applicant Privacy Notice which you can view at this link.

#J-18808-Ljbffr

📌 AI Product Engineer (City of Sydney)
🏢 Janison
📍 City of Sydney