Research Scientist

In this role, you’ll be at the forefront of developing benchmarks and evaluation methodologies for large language models. You’ll help shape how the most advanced AI systems are tested and validated before being deployed in enterprise environments.

Key Responsibilities

• Evaluate new AI models as they’re released (such as DeepSeek, Gemini, etc.)

• Create new benchmarks from scratch, including hiring labelers, constructing datasets, and writing white papers

• Improve underlying methods for auto-evaluation of generated text

• Work closely with engineering to implement and scale evaluation methodologies

• Collaborate with top AI labs and enterprise customers to understand evaluation needs