Today's models aren't ready for regulated work. We help close the gap.
Benchmarks that show where they fall short,
and environments to train on that work.
We build companies. Not prompts: whole companies, with the files a regulator would ask for. Havenor Therapeutics has 789 of them, 120 colleagues, and the usual mess: superseded SOPs, executed copies, reports that disagree with their own protocols.
Then an expert gives a model a real assignment. In Task 03: review the sterile-filter validation and write the brief an inspector will read.
The model wrote a fluent brief and caught a 30-minute window the approved protocol never contained. Here is a check it missed.
AVT-VAL-106 · Wetting & integrity report
Limits: bubble point NLT 3.45 bar, diffusive flow NMT 18.0 mL/min. Criterion 5: “Integrity result remains correlated to the bacterial-retention qualification.”
?Correlated by what?
AVT-VAL-107 · Bacterial retention report
Bubble point before and after challenge on three filter lots. No diffusive-flow result.
§The only retention evidence.
Model's brief · Claude Opus 5.5 · Claude Code
“Bubble point ≥3.45 bar / diffusion ≤18.0 mL/min are valid release limits”
✗Credited both limits. Only one is tied to retention.
Nothing in that line reads wrong. It is wrong because a criterion signed Pass is not the evidence behind it. Every task we write turns on a judgment like this, and every criterion is checked by someone who has made it for a living.
Biopharma Bench V0.2: 81 tasks across 24 companies, 908 criteria, grouped by the kind of work. Each bar is one task; full height means every criterion met.
- 1GPT-6 Astra63.0%
66.9%
55.5%
60.3%
67.6%
61.5%
54.7%
- 2GPT-6.1 Sol62.1%
64.1%
59.4%
57.3%
68.3%
60.5%
57.5%
- 3Muse Wonder 1.061.4%
64.4%
53.6%
57.5%
67.0%
60.1%
61.8%
- 4Claude Fable 5.157.4%
61.4%
52.6%
48.9%
57.1%
54.0%
62.9%
- 5Grok 4.756.3%
57.4%
50.3%
52.8%
64.5%
58.6%
58.0%
- 6Kimi K3.1 Pro55.0%
59.2%
47.5%
56.9%
49.7%
44.3%
59.1%
- 7Grok 4.654.3%
54.1%
49.6%
55.2%
58.8%
56.7%
57.0%
- 8Claude Opus 5.553.4%
56.0%
52.7%
50.9%
48.6%
46.6%
55.9%
- 9Gemini 4 Argon52.8%
55.4%
61.8%
47.1%
36.4%
37.0%
61.3%
- 10Claude Sonnet 5.549.3%
51.1%
49.8%
48.5%
44.9%
39.5%
53.6%
- 11DeepSeek V4.1 Flash45.8%
49.6%
33.7%
41.2%
45.6%
51.4%
55.8%
- 12GLM-5.3 Flash42.5%
45.0%
41.3%
37.4%
40.7%
47.8%
35.1%
- 13GPT-6.1 Terra40.4%
46.5%
35.6%
31.8%
40.6%
23.8%
43.2%
The best model, GPT-6 Astra, scores 63.0% on the average task. GPT-6 Astra finishes the most assignments outright: 5 of 81. No model does better.
The gap is not between labs. DeepSeek V4.1 Flash, an open model, scores 45.8%; Claude Opus 5.5 scores 53.4%. The gap is between all of them and the work.
Benchmarks, training environments, and deployments for work that lives in thousands of interlocking documents: biopharma dossiers, device files, and EPC project records.
| 01 | DeploymentDomain workflows across biopharma (CMC, quality, regulatory, clinical) and energy & EPC (submittal disposition, MDR/ITP, turnover). | Biopharma · Energy & EPC | ☐ |
| 02 | EvaluationYour data or ours: component task families and end-to-end role seats, co-built with your experts and our Fellows for offline regression and online monitoring. | 81 tasks · 908 requirements | ☐ |
| 03 | Post-training, OTS data & strategyArchitecture diagnosis, containerized RL environments with isolated verifiers, coupled partial-credit rubrics, SFT reference deliverables, and licensed corpora. | 24 drug & device programs · EPC packs | ☐ |
Tell us what you need to measure.
A lab, an AI company, or an expert who wants to write tasks.
Request · RC-REQ
Talk to us