- Organizations
- Arca
Arca: AI benchmarks & research
Regulatory-affairs AI company. Maintains the LifeSci Diamond benchmark.
Maintained by Arca
1 benchmark- LifeSci Diamond (2026-11)
LifeSci Diamond is Arca's benchmark of 55 regulatory-affairs tasks (FDA/EMA submissions, labeling, compliance); practising specialists wrote or reviewed the answer keys for 44 of them. Scores are the strict pass rate: a task counts only when every rubric line is fully met and no penalty fires, as judged by GPT-6.1 Sol. One answer per task per model on the plain API with a web_search tool (Exa), provider default settings. 10 tasks are public; 45 are held out. Results are Arca's 4 November 2026 edition.
- Leader
GPT-6 Astra20.0%
- Models scored
- 18