License status and Mdexa hosting, recorded separatelyAll datasets

DiagnosisArena

Verified by Mdexa · Checked against the source text under public rules.How we check

Commercial use
No
Derivatives
UnclearUnstated
Redistribution
UnclearUnstated
File on Mdexa
NoLink only

restrictions are read broadly: forbids commercial use

RestrictedLink onlyNOASSERTIONSave

Badge

Mdexa verified · Restricted · 2026-11Mdexa verifiedRestricted · 2026-11

[![Mdexa verified · Restricted · 2026-11](https://mcp.mdexa.com/v1/badge/datasets/diagnosisarena.svg)](https://mdexa.com/datasets/diagnosisarena/)

Place it on a repository or dataset page; the status and date follow the verification. About badges

Cite this pageMdexa, DiagnosisArena, https://mdexa.com/datasets/diagnosisarena/, verified 2026-11-14.

Source riskReal patient text

Key facts

Domain
Clinical medicine Modern medicine
Content
Question banks and benchmarks · Clinical casesA medical benchmark of 915 segmented patient case and diagnosis pairs spanning 28 specialties, derived from clinical case reports in 10 high-impact medical journals.
Size
—As stated: 915 pairs
Language / modality
English / Text
Publisher
SII-SPIRAL-MED
Year
2025
Expert review
—
Verification
Verified: license text seen

Commercial use of DiagnosisArena

Commercial use: No. License status: Restricted.

Quoted statements and their sources are in DiagnosisArena license evidence.

Verdicts record what sources state and are not legal advice.

Tags

Task format
Multiple-choice (single answer)
Intended use
Evaluation

Quoted from the sourcedesigned to assess the diagnostic reasoning abilities of LLMs in clinical settings.Snapshot s01

Specialty
Multi-specialty

Quoted from the sourcespanning 28 medical specialtiesSnapshot s01

Source type
Research literature

Quoted from the sourcederiving from clinical case reports published in 10 high-impact medical journalsSnapshot s01

Official split
Evaluation split only

Author-statedInferredHuman-confirmed

DiagnosisArena license evidence 2

  1. READMEPage opened
    Third-party text · READMEThis dataset is provided for research and model evaluation purposes only. It must not be used for clinical decision-making or medical diagnosis.

    Statement found in snapshot s01 (readme)

    huggingface.co2026-11-12 · s01
  2. Dataset pagePage opened
    Third-party text · Dataset pageDisclaimer and Terms of Use

    Statement found in snapshot s02 (page)

    huggingface.co2026-11-12 · s02

Source and lineage

No upstream or downstream datasets recorded.

Known issues with DiagnosisArena

—

Preflight

Not run Runs only on ingested data; says nothing about quality.

Downloading DiagnosisArena and API access

No file on Mdexa (see the verdict). Get it from the source and confirm the terms there:

The terms are restricted; no download command is given. See the verdict.

Citing DiagnosisArena

Mdexa, DiagnosisArena, https://mdexa.com/datasets/diagnosisarena/, verified 2026-11-14.
More citation details

The source gives no citation text; the line above cites this card.

Machine-readable

diagnosisarena.jsondiagnosisarena.mdcatalog.json

Change log 2
2026-11-14Re-adjudicated under the current rules; all machine checks still pass.
2026-11-14Added via the automated pipeline and passed all checks (gates, verbatim quotes, rule engine, two independent extractions).

Listed in

Datasets similar to DiagnosisArena

  • CMBChinese Medical BenchmarkVerified by MdexaMultiple-choice (single answer)EvaluationWith explanations PermissiveLink only 11.2K questions

    License is permissive, but source risk: questions come from copyrighted exams; link only.

    Clinical medicine · Question banks and benchmarks · Clinical cases · Exam-derived

    Open the cardSave

    Shared: Task format Multiple-choice (single answer) · Intended use Evaluation · Specialty Multi-specialty · domain Clinical medicine · content Question banks and benchmarks, Clinical cases

  • MedMCQAVerified by MdexaMultiple-choice (single answer)Fine-tuningWith explanations PermissiveLink only —

    License permissive: first-hand data-scope statement(s) allow commercial use and redistribution. Risk flag(s): Exam-derived, scraped. Link only.

    Clinical medicine · Question banks and benchmarks · QA, dialogue and instruction data · Exam-derived · Scraped

    Open the cardSave

    Shared: Task format Multiple-choice (single answer) · Intended use Evaluation · Specialty Multi-specialty · domain Clinical medicine · content Question banks and benchmarks

  • CMExamVerified by MdexaMultiple-choice (single answer)EvaluationWith explanations RestrictedLink only 68.1K questions

    License is restricted: The official README restricts use to academic research and prohibits commercial misuse; the unofficial mirror card does not count; link only.

    Clinical medicine · Question banks and benchmarks · Exam-derived

    Open the cardSave

    Shared: Task format Multiple-choice (single answer) · Intended use Evaluation · Specialty Multi-specialty · domain Clinical medicine · content Question banks and benchmarks

  • INCLUDEVerified by MdexaMultiple-choice (single answer)Evaluation PermissiveLink only —

    License permissive: first-hand data-scope statement(s) allow commercial use and redistribution. Risk flag(s): Exam-derived. Link only.

    Clinical medicine · Question banks and benchmarks · Exam-derived

    Open the cardSave

    Shared: Task format Multiple-choice (single answer) · Intended use Evaluation · Specialty Multi-specialty · domain Clinical medicine · content Question banks and benchmarks

  • MedBench上海人工智能实验室Verified by MdexaEvaluationReviewed, method unspecified UnverifiablePending 300.9K questions (claimed)

    License unverifiable: Data license not found; repositories returned 404 and the platform requires login; link only until resolved.

    Clinical medicine · Question banks and benchmarks

    Open the cardSave

    Shared: Intended use Evaluation · Specialty Multi-specialty · domain Clinical medicine · content Question banks and benchmarks