# R2MED Benchmark

License: permissive (CC-BY-4.0); Mdexa hosting: link-only. first-hand data-scope statement(s) allow commercial use and redistribution

- Commercial use: Yes · Derivatives: Yes · Redistribution: Yes · File on Mdexa: No
- License status: Permissive (CC-BY-4.0)
- Mdexa hosting: Link only — License permissive: first-hand data-scope statement(s) allow commercial use and redistribution. Link only.
- Last verified: 2026-11-14
- Card: https://mdexa.com/datasets/medqa-diag/

## Key facts

- Domain: Clinical medicine
- Content type: Annotated corpora
- Size: — — 10M<n<100M
- Language: English
- Modality: Text
- Publisher: R2MED
- Year: 2025-05-21

## Commercial use of R2MED Benchmark

- Commercial use: Yes.
- License status: Permissive.
- Conditions: Attribution
Verdicts record what sources state and are not legal advice.

## R2MED Benchmark license evidence

first-hand data-scope statement(s) allow commercial use and redistribution

- **Hugging Face card metadata** — CC-BY-4.0: Statement found in snapshot s04 (readme) — "license: cc-by-4.0" — https://huggingface.co/datasets/R2MED/MedQA-Diag (2026-11-12; Page opened)

## Source and lineage

—

## Known issues with R2MED Benchmark

—

## Preflight

Not run (data not ingested).

## Downloading R2MED Benchmark and API access

Mdexa does not serve files. Original source:
- https://huggingface.co/datasets/R2MED/MedQA-Diag

### Access recipe

- .gitattributes · 3 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/.gitattributes
- README.md · 4 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/README.md
- corpus.jsonl · 46.9 MB · sha256 2767063e36589bcda9ea87a898effd91529548838d645adccbc9e9c22bdd0f12 · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/corpus.jsonl
- hyde/gpt4/query_with_hydoc.jsonl · 334 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/gpt4/query_with_hydoc.jsonl
- hyde/huatuo-o1-70b/query_with_hydoc.jsonl · 441 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/huatuo-o1-70b/query_with_hydoc.jsonl
- hyde/llama-70b/query_with_hydoc.jsonl · 283 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/llama-70b/query_with_hydoc.jsonl
- hyde/o3-mini/query_with_hydoc.jsonl · 253 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/o3-mini/query_with_hydoc.jsonl
- hyde/qwen-32b/query_with_hydoc.jsonl · 349 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/qwen-32b/query_with_hydoc.jsonl
- hyde/qwen-72b/query_with_hydoc.jsonl · 378 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/qwen-72b/query_with_hydoc.jsonl
- hyde/qwen-7b/query_with_hydoc.jsonl · 332 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/qwen-7b/query_with_hydoc.jsonl
- hyde/qwq-32b/query_with_hydoc.jsonl · 1.2 MB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/qwq-32b/query_with_hydoc.jsonl
- hyde/r1-llama-70b/query_with_hydoc.jsonl · 658 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/r1-llama-70b/query_with_hydoc.jsonl
- hyde/r1-qwen-32b/query_with_hydoc.jsonl · 619 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/r1-qwen-32b/query_with_hydoc.jsonl
- lamer/gpt4/query_with_hydoc.jsonl · 179 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/lamer/gpt4/query_with_hydoc.jsonl
- lamer/qwen-72b/query_with_hydoc.jsonl · 191 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/lamer/qwen-72b/query_with_hydoc.jsonl
- lamer/qwen-7b/query_with_hydoc.jsonl · 179 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/lamer/qwen-7b/query_with_hydoc.jsonl
- qrels.jsonl · 33 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/qrels.jsonl
- query.jsonl · 110 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/query.jsonl
- query2doc/gpt4/query_with_hydoc.jsonl · 292 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/query2doc/gpt4/query_with_hydoc.jsonl
- query2doc/qwen-72b/query_with_hydoc.jsonl · 387 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/query2doc/qwen-72b/query_with_hydoc.jsonl
- query2doc/qwen-7b/query_with_hydoc.jsonl · 329 KB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/query2doc/qwen-7b/query_with_hydoc.jsonl
- search-o1/qwen3-32b/query_with_hydoc.jsonl · 1.2 MB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/search-o1/qwen3-32b/query_with_hydoc.jsonl
- search-o1/qwq-32b/query_with_hydoc.jsonl · 1.6 MB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/search-o1/qwq-32b/query_with_hydoc.jsonl
- search-r1/qwen-3b-ins/query_with_hydoc.jsonl · 2.2 MB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/search-r1/qwen-3b-ins/query_with_hydoc.jsonl
- search-r1/qwen-7b-ins/query_with_hydoc.jsonl · 1.6 MB · https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/search-r1/qwen-7b-ins/query_with_hydoc.jsonl

```sh
curl -L --create-dirs -o ".gitattributes" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/.gitattributes"
curl -L --create-dirs -o "README.md" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/README.md"
curl -L --create-dirs -o "corpus.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/corpus.jsonl"
echo "2767063e36589bcda9ea87a898effd91529548838d645adccbc9e9c22bdd0f12  corpus.jsonl" | sha256sum -c
curl -L --create-dirs -o "hyde/gpt4/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/gpt4/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/huatuo-o1-70b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/huatuo-o1-70b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/llama-70b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/llama-70b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/o3-mini/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/o3-mini/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/qwen-32b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/qwen-32b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/qwen-72b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/qwen-72b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/qwen-7b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/qwen-7b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/qwq-32b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/qwq-32b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/r1-llama-70b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/r1-llama-70b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "hyde/r1-qwen-32b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/hyde/r1-qwen-32b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "lamer/gpt4/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/lamer/gpt4/query_with_hydoc.jsonl"
curl -L --create-dirs -o "lamer/qwen-72b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/lamer/qwen-72b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "lamer/qwen-7b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/lamer/qwen-7b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "qrels.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/qrels.jsonl"
curl -L --create-dirs -o "query.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/query.jsonl"
curl -L --create-dirs -o "query2doc/gpt4/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/query2doc/gpt4/query_with_hydoc.jsonl"
curl -L --create-dirs -o "query2doc/qwen-72b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/query2doc/qwen-72b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "query2doc/qwen-7b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/query2doc/qwen-7b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "search-o1/qwen3-32b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/search-o1/qwen3-32b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "search-o1/qwq-32b/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/search-o1/qwq-32b/query_with_hydoc.jsonl"
curl -L --create-dirs -o "search-r1/qwen-3b-ins/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/search-r1/qwen-3b-ins/query_with_hydoc.jsonl"
curl -L --create-dirs -o "search-r1/qwen-7b-ins/query_with_hydoc.jsonl" "https://huggingface.co/datasets/R2MED/MedQA-Diag/resolve/78b585990279cc01a493f876c1b0cf09557fba57/search-r1/qwen-7b-ins/query_with_hydoc.jsonl"
```

## Citing R2MED Benchmark

No recommended citation text.
- arXiv:2505.14558

## Machine-readable

- JSON: https://mdexa.com/datasets/medqa-diag.json
- 2026-11-14 Added via the automated pipeline and passed all checks (gates, verbatim quotes, rule engine, two independent extractions).

## Continue in this database

This record is one of 109 processed and verified records (datasets, data resources and open models). To find others, call `https://mcp.mdexa.com/v1/datasets?q=<words>` or connect the MCP server at `https://mcp.mdexa.com/mcp`; no key is needed for 20 calls per minute. Rows are under 1 KB; an empty result means "not listed". For a list of items, one batch check (free account) returns a report. Guide: /agents.md. Similar records: PMC-Patients-ReCDS (https://mdexa.com/datasets/pmc-patients-recds/); PromptCBLUE (https://mdexa.com/datasets/promptcblue/); PubMedQA (https://mdexa.com/datasets/pubmedqa/).