Today's models aren't ready for regulated work. We help close the gap.
Benchmarks that show where they fall short,
and environments to train on that work.
We build companies. Not prompts: whole companies, with the files a regulator would ask for. Havenor Therapeutics has 789 of them, 120 colleagues, and the usual mess: superseded SOPs, executed copies, reports that disagree with their own protocols.
Then an expert gives a model a real assignment. In Task 03: review the sterile-filter validation and write the brief an inspector will read.
The model wrote a fluent brief and caught a 30-minute window the approved protocol never contained. Here is a check it missed.
AVT-VAL-106 · Wetting & integrity report
Limits: bubble point NLT 3.45 bar, diffusive flow NMT 18.0 mL/min. Criterion 5: “Integrity result remains correlated to the bacterial-retention qualification.”
?Correlated by what?
AVT-VAL-107 · Bacterial retention report
Bubble point before and after challenge on three filter lots. No diffusive-flow result.
§The only retention evidence.
Model's brief · Claude Opus 5.5 · Claude Code
“Bubble point ≥3.45 bar / diffusion ≤18.0 mL/min are valid release limits”
✗Credited both limits. Only one is tied to retention.
Nothing in that line reads wrong. It is wrong because a criterion signed Pass is not the evidence behind it. Every task we write turns on a judgment like this, and every criterion is checked by someone who has made it for a living.
Biopharma Bench V0.2: 81 tasks across 24 companies, 1045 criteria, grouped by the kind of work. Each bar is one task; full height means every criterion met.
- 1GPT-6 Astra59.5%
61.4%
56.9%
53.0%
61.7%
50.2%
64.1%
- 2Claude Fable 5.158.9%
62.4%
58.2%
54.8%
52.3%
52.8%
59.7%
- 3GPT-6.1 Sol58.8%
61.5%
53.9%
56.5%
61.4%
56.4%
59.1%
- 4Grok 4.754.0%
54.5%
46.0%
52.0%
61.3%
52.1%
62.3%
- 5Grok 4.653.4%
54.9%
46.2%
59.4%
49.3%
47.8%
59.6%
- 6DeepSeek V4.1 Flash51.0%
49.9%
51.3%
46.5%
55.2%
55.9%
61.1%
- 7Claude Opus 5.550.2%
52.6%
56.4%
43.7%
44.2%
40.4%
59.9%
- 8GLM-5.3 Flash42.6%
46.9%
40.6%
39.0%
40.9%
40.0%
30.0%
- 9GPT-6.1 Terra37.1%
40.3%
31.8%
29.7%
41.3%
26.9%
45.3%
The best model, GPT-6 Astra, scores 59.5% on the average task. It finishes 1 of 81 tasks. No model does better.
The gap is not between labs. DeepSeek V4.1 Flash, an open model, scores 51.0%; Claude Opus 5.5 scores 50.2%. The gap is between all of them and the work.
We build where the record system is the problem: biopharma dossiers and EPC project packs.
| 01 | DeploymentDomain workflows across biopharma (CMC, quality, regulatory, clinical) and energy & EPC (submittal disposition, MDR/ITP, turnover). | Biopharma · Energy & EPC | ☐ |
| 02 | EvaluationYour data or ours: component task families and end-to-end role seats, co-built with your experts and our Fellows for offline regression and online monitoring. | 81 tasks · 1045 requirements | ☐ |
| 03 | Post-training, OTS data & strategyArchitecture diagnosis, containerized RL environments with isolated verifiers, coupled partial-credit rubrics, SFT reference deliverables, and licensed corpora. | 24 drug & device programs · EPC packs | ☐ |
Tell us what you need to measure.
A lab, an AI company, or an expert who wants to write tasks.
Request · RC-REQ
Talk to us →