HealthBench

Verified by Mdexa · 2026-11-14Checked against the source text under public rules.How we check

Commercial use: Yes
Derivatives: Yes
Redistribution: Yes
File on Mdexa: NoLink only

first-hand data-scope statement(s) allow commercial use and redistribution

PermissiveLink onlyMITSave

Badge

[![Mdexa verified · Permissive · 2026-11](https://mcp.mdexa.com/v1/badge/datasets/healthbench.svg)](https://mdexa.com/datasets/healthbench/)

<a href="https://mdexa.com/datasets/healthbench/"><img src="https://mcp.mdexa.com/v1/badge/datasets/healthbench.svg" alt="Mdexa verified · Permissive · 2026-11" height="20"></a>

Place it on a repository or dataset page; the status and date follow the verification. About badges

Cite this pageMdexa, HealthBench, https://mdexa.com/datasets/healthbench/, verified 2026-11-14.

Key facts

Domain: Clinical medicine Modern medicine
Content: Question banks and benchmarksContains the data for the HealthBench eval.
Size: —
Language / modality: English / Text
Publisher: openai
Year: —
Expert review: —
Verification: Verified: license text seen

Commercial use of HealthBench

Commercial use: Yes. License status: Permissive.

Conditions: Notice kept

Quoted statements and their sources are in HealthBench license evidence.

Verdicts record what sources state and are not legal advice.

HealthBench license evidence 1

Hugging Face card metadataPage opened

MIT
Third-party text · Hugging Face card metadatalicense: mit
Statement found in snapshot s09 (readme)

huggingface.co2026-11-12 · s09

Source and lineage

No upstream or downstream datasets recorded.

Known issues with HealthBench

—

Preflight

Not run Runs only on ingested data; says nothing about quality.

Downloading HealthBench and API access

No file on Mdexa (see the verdict). Get it from the source and confirm the terms there:

huggingface.co/datasets/openai/healthbench

6 files · 246.0 MB

curl -L --create-dirs -o ".gitattributes" "https://huggingface.co/datasets/openai/healthbench/resolve/40ee1968852fc57f625934251ac22be47077a8fb/.gitattributes"
curl -L --create-dirs -o "2025-05-07-06-14-12_oss_eval.jsonl" "https://huggingface.co/datasets/openai/healthbench/resolve/40ee1968852fc57f625934251ac22be47077a8fb/2025-05-07-06-14-12_oss_eval.jsonl"
echo "e99dd3c6372c10d6fcc5e385c5fae69d0dd40392dae56836ef9493ae324ecd2f  2025-05-07-06-14-12_oss_eval.jsonl" | sha256sum -c
curl -L --create-dirs -o "2025-05-07-06-14-12_oss_meta_eval.jsonl" "https://huggingface.co/datasets/openai/healthbench/resolve/40ee1968852fc57f625934251ac22be47077a8fb/2025-05-07-06-14-12_oss_meta_eval.jsonl"
echo "6a343ed3fcb6f28353c2c6c157ae30ddf2db874c947b27ba474ad54da9c5dbac  2025-05-07-06-14-12_oss_meta_eval.jsonl" | sha256sum -c
curl -L --create-dirs -o "README.md" "https://huggingface.co/datasets/openai/healthbench/resolve/40ee1968852fc57f625934251ac22be47077a8fb/README.md"
curl -L --create-dirs -o "consensus_2025-05-09-20-00-46.jsonl" "https://huggingface.co/datasets/openai/healthbench/resolve/40ee1968852fc57f625934251ac22be47077a8fb/consensus_2025-05-09-20-00-46.jsonl"
echo "fabe37553327238928b05357d8b309737b5d426d6dee432a3376da618d0969d6  consensus_2025-05-09-20-00-46.jsonl" | sha256sum -c
curl -L --create-dirs -o "hard_2025-05-08-21-00-10.jsonl" "https://huggingface.co/datasets/openai/healthbench/resolve/40ee1968852fc57f625934251ac22be47077a8fb/hard_2025-05-08-21-00-10.jsonl"
echo "b0320430e5cd974e746585594c1dd10b5a3fc2aff9c72b26106c2c4a069d74e9  hard_2025-05-08-21-00-10.jsonl" | sha256sum -c

Citing HealthBench

Mdexa, HealthBench, https://mdexa.com/datasets/healthbench/, verified 2026-11-14.

More citation details

The source gives no citation text; the line above cites this card.

Machine-readable

healthbench.jsonhealthbench.mdcatalog.json

Change log 1

2026-11-14

Added via the automated pipeline and passed all checks (gates, verbatim quotes, rule engine, two independent extractions).

Listed in

Medical datasets for evaluation that have a permissive license

Datasets similar to HealthBench

CBLUEVerified by MdexaNamed entity recognitionEvaluation UnstatedPending 8 tasks 2026-11-12

License unstated: Only a code repository license; no data license stated; link only until resolved.
Clinical medicine · Question banks and benchmarks · Annotated corpora
Open the card Save

Shared: Intended use Evaluation · domain Clinical medicine · content Question banks and benchmarks
CMBChinese Medical BenchmarkVerified by MdexaMultiple-choice (single answer)EvaluationWith explanations PermissiveLink only 11.2K questions 2026-11-12

License is permissive, but source risk: questions come from copyrighted exams; link only.
Clinical medicine · Question banks and benchmarks · Clinical cases · Exam-derived
Open the card Save

Shared: Intended use Evaluation · domain Clinical medicine · content Question banks and benchmarks
CMExamVerified by MdexaMultiple-choice (single answer)EvaluationWith explanations RestrictedLink only 68.1K questions 2026-11-12

License is restricted: The official README restricts use to academic research and prohibits commercial misuse; the unofficial mirror card does not count; link only.
Clinical medicine · Question banks and benchmarks · Exam-derived
Open the card Save

Shared: Intended use Evaluation · domain Clinical medicine · content Question banks and benchmarks
DiagnosisArenaVerified by MdexaMultiple-choice (single answer)Evaluation RestrictedLink only — 2026-11-14

License restricted: restrictions are read broadly: forbids commercial use. Risk flag(s): Real patient text. Link only.
Clinical medicine · Question banks and benchmarks · Clinical cases · Real patient text
Open the card Save

Shared: Intended use Evaluation · domain Clinical medicine · content Question banks and benchmarks
ESL-benchEvent-driven Synthetic Longitudinal BenchmarkVerified by MdexaOpen-ended QAEvaluationWith explanations ConflictPending — 2026-11-14

License conflict: the publisher's own statements contradict each other (permissive license vs restriction). Link only.
Clinical medicine · Question banks and benchmarks · Knowledge graphs
Open the card Save

Shared: Intended use Evaluation · domain Clinical medicine · content Question banks and benchmarks

Modern medicine75

Traditional medicine24

Cross-cutting12

Collections

Models8