AI Research Engineer - USA (Google DeepMind RE-Bench Project)

Research Engineer (AI Evaluation & Benchmarking) – Google DeepMind RE-Bench Project

About the Opportunity

We are hiring experienced Research Engineers, AI Researchers, Machine Learning Engineers, Applied Scientists, and Research Scientists to contribute to a cutting-edge AI evaluation initiative supporting the Google DeepMind RE-Bench Project.

The project focuses on developing the next generation of AI evaluation benchmarks by creating challenging, real-world research engineering tasks that assess the capabilities of advanced AI systems.

This is a unique opportunity to work on frontier AI research alongside leading researchers and help shape the future of AI evaluation.

What You'll Do

As a Research Engineer (RE) Curator, you will design, implement, and review complex, multi-step research tasks that simulate real-world machine learning and software engineering challenges.

Your responsibilities will include:

• Design challenging research engineering tasks for advanced AI systems.
• Implement solutions using Python and modern software development tools.
• Plan, execute, and analyze machine learning experiments.
• Perform statistical analysis and interpret experimental results.
• Create reproducible research workflows using Jupyter Notebook or Google Colab.
• Evaluate AI system performance through structured benchmarking and testing.
• Collaborate closely with researchers in an iterative feedback environment.
• Document findings and produce high-quality technical reports.

Required Qualifications

Education

• MSc or PhD in a STEM discipline such as:

  • Computer Science
  • Artificial Intelligence
  • Machine Learning
  • Data Science
  • Statistics
  • Mathematics
  • Physics
  • Computational Science
  • Engineering

• Equivalent research-intensive experience involving coding, experimentation, and data analysis will also be considered.

Professional Experience

• 1+ years of experience in one or more of the following roles:

  • Research Engineer
  • Research Scientist
  • Applied Scientist
  • Machine Learning Engineer
  • AI Researcher
  • Data Scientist
  • Software Engineer (ML/AI)

• Experience working on research, experimentation, or AI development projects.

Required Technical Skills

Programming

• Strong Python programming skills
• Code debugging and software development best practices

Software Engineering

• Git version control
• Modern IDEs (VS Code, PyCharm, etc.)
• Clean, maintainable code

Machine Learning & AI

• Machine Learning fundamentals
• Model training and evaluation
• Large Language Models (LLMs)
• AI experimentation
• Prompt engineering or AI agent workflows
• Understanding of AI coding assistants is a plus

Data Science

• Data analysis and visualization
• Statistical analysis
• Data cleaning and interpretation
• Jupyter Notebook / Google Colab

Research & Experimentation

• Experimental design
• Scientific methodology
• Hypothesis testing
• Research documentation
• Analytical problem-solving

Preferred Qualifications

Candidates with experience in any of the following will be highly preferred:

• AI Evaluation
• Benchmark Development
• LLM Evaluation
• AI Red Teaming
• Reinforcement Learning (RL)
• Test Engineering
• Quality Assurance for AI systems
• Research publications in AI, ML, Data Science, or related fields
• Experience working with Research Scientists on experimental projects

What We're Looking For

The ideal candidate demonstrates:

• Strong research mindset
• Exceptional attention to detail
• Creativity in solving open-ended technical problems
• Ability to work independently with minimal supervision
• Comfort working in ambiguous, research-driven environments
• Excellent written and spoken English communication skills

Ensure you submit resume covering:

• Research experience
• Publications (if any)
• AI/ML expertise
• Python coding background
• Experience with AI evaluation, benchmarking, testing, or LLM red teaming
• Relevant research engineering or experimentation projects

Why Join?

• Work on a frontier AI research program supporting Google DeepMind.
• Contribute to the development of next-generation AI evaluation benchmarks.
• Solve challenging real-world research engineering problems.
• Collaborate with world-class AI researchers.
• Competitive hourly compensation with a flexible remote work model.

We are actively reviewing applications and moving quickly. Qualified candidates are encouraged to apply as soon as possible.