Member of Technical Staff, Evaluation Execution
METR · Berkeley
Extracted from the posting
Runs and publishes AI model evaluations by integrating models into agent scaffolds and infrastructure, and communicates results to audiences including regulators. Builds software to make evaluations faster and more reliable, and manages multiple concurrent evaluations. Works with METR's platform team and lab contacts.
[Due to capacity constraints, we may be slow to get back to you about this role.]
About METR
We are a nonprofit research organization that develops scientific methods to assess AI capabilities, risks, and mitigations, with a specific focus on threats related to AI R&D automation and misalignment.
We believe it is robustly good for policymakers and civil society to have a clear understanding of risks from AI systems, and we are extremely excited to build a team of ambitious, excellent people to tackle one of the most important challenges of our time.
What this role looks like
Why this role matters
How METR's evaluations are changing over 2026
Required skills
- Software engineering. You're a strong engineer with solid infra fundamentals. You can dig into unfamiliar systems, debug from logs, and identify and fix performance bottlenecks.
- Speed and scrappiness. You get things done quickly. You’re able to quickly identify what 80/20 looks like, and then do that.
- High attention to detail. You read closely, can spot bugs in transcripts, and pay attention to the important fiddly bits.
Nice to haves
- Research understanding and taste. You understand research ideas and priorities, and have good intuitions for which plots are informative and which analyses are worth running to poke at the data.
- Strong external communicator. You communicate well with external stakeholders, and we trust you to stay on the ball with communications with, e.g., lab contacts.
- Project management. You can juggle many balls at once, keep stakeholders updated, and track and anticipate blockers.
- Strong writing ability. You can be a solid contributor to METR’s writeups of evaluation results, see e.g. our GPT-5 report.
Our culture
Hybrid Preferred:
Our technical team members are in our office in Berkeley 3-5 days/week. We would ideally like for you to be in person too, but we are happy to be flexible here. If you lack US work authorization and would like to work in-person, we can likely sponsor a cap-exempt H-1B visa for this role.
We encourage you to apply even if your background may not seem like the perfect fit! We would rather review a larger pool of applications than risk missing out on a promising candidate for the position.
We are committed to diversity and equal opportunity in all aspects of our hiring process. We do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We welcome and encourage all qualified candidates to apply for our open positions.
Compensation: USD 328,380 – 578,583 per year salary
Company stack
This posting doesn’t list technologies. These are the ones METR uses across its other roles.
