Software Engineer

We are looking for experienced software engineers to help train and evaluate AI models on real-world programming work. You will build and validate coding tasks, review AI-generated code, and write the reference solutions and tests that models are measured against. Your engineering judgment directly shapes how reliably AI systems write, debug and refactor code. Key Responsibilities

• Design realistic coding tasks (bug fixes, feature implementation, refactoring, performance optimisation) with clear specifications.
• Build reproducible environments (Git, Docker) and write automated test suites that verify solutions.
• Write high-quality reference solutions and explain the design decisions behind them.
• Evaluate AI-generated code for correctness, performance, security and readability.
• Rank and compare model outputs and justify your judgments in clear written rationale.
• Identify recurring failure patterns in model output and report them to the project team.
• Follow project guidelines, take part in calibration and review sessions, and incorporate feedback to keep quality consistent.

Required Qualifications

• Degree in computer science or a related field, or equivalent professional experience.
• 3+ years of professional software engineering experience.
• Strong Python, plus at least one of Java, C++, TypeScript, Go or Rust.
• Proficiency with Git, Docker and automated testing.
• Ability to read and navigate unfamiliar codebases.
• Fluent written English and clear technical communication.
• Reliable, detail-oriented, and able to work independently and meet deadlines in a remote setting.

Preferred Qualifications

• Open-source contributions or code-review experience.
• Experience with test automation, CI/CD or developer tooling.
• Prior LLM evaluation or data annotation experience.
• Experience with large or distributed codebases.

Legal and Compliance Notice

• All content you submit must be lawful, and you must have the right to share it.
• Do not submit confidential or proprietary material belonging to an employer, client or third party, or personal data without a lawful basis.
• Rex may verify identity, credentials, ownership and licensing; may reject or remove any submission; and may report unlawful submissions to the relevant authorities.
• Engagement and payment are subject to successful verification and to applicable sanctions, export-control, tax and employment laws.
• The contractor agreement will set out ownership and licence terms for the work you deliver (to be confirmed by Rex Legal).

Compensation

USD $65–105 per hour, adjusted by country of residence.