Today's models aren't ready for regulated work. We help close the gap.
Benchmarks that show where they fall short,
and environments to train on that work.
We build companies. Not prompts: whole companies, with the files a regulator would ask for. Havenor Therapeutics has 789 of them, 120 colleagues, and the usual mess: superseded SOPs, executed copies, reports that disagree with their own protocols.
Then an expert gives a model a real assignment. In Task 03: review the sterile-filter validation and write the brief an inspector will read.
The model wrote a fluent brief and caught a 30-minute window the approved protocol never contained. Here is a check it missed.
AVT-VAL-106 · Wetting & integrity report
Limits: bubble point NLT 3.45 bar, diffusive flow NMT 18.0 mL/min. Criterion 5: “Integrity result remains correlated to the bacterial-retention qualification.”
?Correlated by what?
AVT-VAL-107 · Bacterial retention report
Bubble point before and after challenge on three filter lots. No diffusive-flow result.
§The only retention evidence.
Model's brief · Claude Opus 5.5 · Claude Code
“Bubble point ≥3.45 bar / diffusion ≤18.0 mL/min are valid release limits”
✗Credited both limits. Only one is tied to retention.
Nothing in that line reads wrong. It is wrong because a criterion signed Pass is not the evidence behind it. Every task we write turns on a judgment like this, and every criterion is checked by someone who has made it for a living.
Biopharma Bench V0.2: 81 tasks across 24 companies, 908 criteria, grouped by the kind of work. Each bar is one task; full height means every criterion met.
- 1Claude Fable 5.158.2%
61.9%
55.0%
49.7%
57.4%
52.7%
64.5%
- 2GPT-6.1 Sol57.1%
59.3%
51.5%
55.6%
62.3%
50.4%
57.6%
- 3Kimi K3.1 Pro56.5%
59.5%
50.3%
55.4%
51.6%
58.8%
58.5%
- 4GPT-6 Astra56.0%
56.3%
50.3%
59.7%
57.8%
51.3%
63.7%
- 5Claude Opus 5.553.0%
55.5%
53.2%
48.5%
50.8%
42.8%
56.6%
- 6Claude Sonnet 5.550.3%
49.9%
54.0%
49.4%
49.3%
46.3%
50.5%
- 7DeepSeek V4.1 Flash47.0%
50.4%
39.4%
41.3%
50.2%
42.5%
54.7%
- 8Grok 4.741.8%
38.6%
35.5%
49.8%
59.0%
36.0%
45.0%
- 9GLM-5.3 Flash40.8%
42.5%
41.0%
35.6%
37.3%
37.3%
46.8%
- 10Grok 4.635.5%
34.9%
32.0%
45.8%
40.3%
24.4%
29.8%
- 11GPT-6.1 Terra32.2%
36.0%
32.1%
27.5%
31.4%
18.7%
28.7%
The best model, Claude Fable 5.1, scores 58.2% on the average task. Claude Opus 5.5 finishes the most assignments outright: 2 of 81. No model does better.
The gap is not between labs. DeepSeek V4.1 Flash, an open model, scores 47.0%; Claude Opus 5.5 scores 53.0%. The gap is between all of them and the work.
We build where the record system is the problem: biopharma dossiers and EPC project packs.
| 01 | DeploymentDomain workflows across biopharma (CMC, quality, regulatory, clinical) and energy & EPC (submittal disposition, MDR/ITP, turnover). | Biopharma · Energy & EPC | ☐ |
| 02 | EvaluationYour data or ours: component task families and end-to-end role seats, co-built with your experts and our Fellows for offline regression and online monitoring. | 81 tasks · 908 requirements | ☐ |
| 03 | Post-training, OTS data & strategyArchitecture diagnosis, containerized RL environments with isolated verifiers, coupled partial-credit rubrics, SFT reference deliverables, and licensed corpora. | 24 drug & device programs · EPC packs | ☐ |
Tell us what you need to measure.
A lab, an AI company, or an expert who wants to write tasks.
Request · RC-REQ
Talk to us →