Glossary

Task format task_format

What does each example look like?

Multiple-choice (single answer) choice-question

Items with options and one correct answer.

Multiple-answer choice multi-answer

Options with more than one correct answer allowed.

True/false true-false

Answered true or false.

Fill-in-the-blank fill-in-blank

Short answer filling a gap.

Open-ended QA open-qa

Single-turn question with free-text answer, incl. instructions.

Multi-turn dialogue multi-turn-dialogue

Conversations with several turns.

Named entity recognition ner

Entity spans and types annotated in text.

Relation extraction relation-extraction

Relations between entities annotated in text.

Term normalization term-normalization

Map mentions to standard terms or codes.

Text classification text-classification

Assign a label to a text or utterance.

Text matching text-matching

Similarity or relevance between texts, incl. answer selection.

Summarization / report generation summarization

Produce a summary or report from source text.

Visual QA visual-qa

Questions that require reading an image.

Intended use intended_use

What is it meant for?

Pretraining pretraining

Raw text intended for (continued) pretraining.

Fine-tuning fine-tuning

Supervised or instruction fine-tuning data.

Evaluation evaluation

Intended as a benchmark or test set.

Retrieval knowledge base retrieval-kb

Intended as a corpus or KB to retrieve from.

Specialty specialty

Which specialty?

Specialty and disease class (ICD-11 chapter) are two parallel facets, each with its own basis. The mapping below is many-to-many and is used for navigation and for derivation when evidence is missing; it never replaces either facet.

Internal medicine (general) internal-medicine

Datasets explicitly limited to internal medicine (general).ICD-11 chapters01 Certain infectious or parasitic diseases03 Diseases of the blood or blood-forming organs04 Diseases of the immune system05 Endocrine, nutritional or metabolic diseases08 Diseases of the nervous system11 Diseases of the circulatory system12 Diseases of the respiratory system13 Diseases of the digestive system16 Diseases of the genitourinary system21 Symptoms, signs or clinical findings, not elsewhere classified

Cardiology cardiology

Datasets explicitly limited to cardiology.ICD-11 chapters11 Diseases of the circulatory system

Respiratory medicine respiratory

Datasets explicitly limited to respiratory medicine.ICD-11 chapters12 Diseases of the respiratory system

Gastroenterology gastroenterology

Datasets explicitly limited to gastroenterology.ICD-11 chapters13 Diseases of the digestive system

Endocrinology endocrinology

Datasets explicitly limited to endocrinology.ICD-11 chapters05 Endocrine, nutritional or metabolic diseases

Nephrology nephrology

Datasets explicitly limited to nephrology.ICD-11 chapters16 Diseases of the genitourinary system

Hematology hematology

Datasets explicitly limited to hematology.ICD-11 chapters03 Diseases of the blood or blood-forming organs

Neurology neurology

Datasets explicitly limited to neurology.ICD-11 chapters08 Diseases of the nervous system07 Sleep-wake disorders

Rheumatology and immunology rheumatology-immunology

Datasets explicitly limited to rheumatology and immunology.ICD-11 chapters04 Diseases of the immune system15 Diseases of the musculoskeletal system or connective tissue

Infectious diseases infectious-diseases

Datasets explicitly limited to infectious diseases.ICD-11 chapters01 Certain infectious or parasitic diseases

Surgery general-surgery

Datasets explicitly limited to surgery.ICD-11 chapters02 Neoplasms13 Diseases of the digestive system22 Injury, poisoning or certain other consequences of external causes

Orthopedics orthopedics

Datasets explicitly limited to orthopedics.ICD-11 chapters15 Diseases of the musculoskeletal system or connective tissue22 Injury, poisoning or certain other consequences of external causes

Urology and andrology urology-andrology

Datasets explicitly limited to urology and andrology.ICD-11 chapters16 Diseases of the genitourinary system17 Conditions related to sexual health

Obstetrics and gynecology obstetrics-gynecology

Datasets explicitly limited to obstetrics and gynecology.ICD-11 chapters16 Diseases of the genitourinary system17 Conditions related to sexual health18 Pregnancy, childbirth or the puerperium

Pediatrics pediatrics

Datasets explicitly limited to pediatrics.ICD-11 chapters19 Certain conditions originating in the perinatal period20 Developmental anomalies

Ophthalmology ophthalmology

Datasets explicitly limited to ophthalmology.ICD-11 chapters09 Diseases of the visual system

Otorhinolaryngology otorhinolaryngology

Datasets explicitly limited to otorhinolaryngology.ICD-11 chapters10 Diseases of the ear or mastoid process12 Diseases of the respiratory system

Stomatology and dentistry stomatology

Datasets explicitly limited to stomatology and dentistry.ICD-11 chapters13 Diseases of the digestive system

Dermatology dermatology

Datasets explicitly limited to dermatology.ICD-11 chapters14 Diseases of the skin

Psychiatry psychiatry

Datasets explicitly limited to psychiatry.ICD-11 chapters06 Mental, behavioural or neurodevelopmental disorders07 Sleep-wake disorders

Oncology oncology

Datasets explicitly limited to oncology.ICD-11 chapters02 Neoplasms

Emergency and critical care emergency-critical-care

Datasets explicitly limited to emergency and critical care.ICD-11 chapters22 Injury, poisoning or certain other consequences of external causes23 External causes of morbidity or mortality21 Symptoms, signs or clinical findings, not elsewhere classified

Anesthesiology anesthesiology

Datasets explicitly limited to anesthesiology.

Rehabilitation medicine rehabilitation

Datasets explicitly limited to rehabilitation medicine.ICD-11 chapters15 Diseases of the musculoskeletal system or connective tissue08 Diseases of the nervous system

General practice and basic medical sciences general-practice-basic

Datasets explicitly limited to general practice and basic medical sciences.ICD-11 chapters21 Symptoms, signs or clinical findings, not elsewhere classified24 Factors influencing health status or contact with health services

Medical imaging medical-imaging

Datasets explicitly limited to medical imaging.

Laboratory medicine and pathology laboratory-pathology

Datasets explicitly limited to laboratory medicine and pathology.

Pharmacy pharmacy

Datasets explicitly limited to pharmacy.

Nursing nursing

Datasets explicitly limited to nursing.

Public health and preventive medicine public-health-preventive

Datasets explicitly limited to public health and preventive medicine.ICD-11 chapters01 Certain infectious or parasitic diseases23 External causes of morbidity or mortality24 Factors influencing health status or contact with health services

TCM internal medicine tcm-internal

Datasets explicitly limited to tcm internal medicine.ICD-11 chapters26 Supplementary Chapter Traditional Medicine Conditions - Module 1

TCM surgery tcm-surgery

Datasets explicitly limited to tcm surgery.ICD-11 chapters26 Supplementary Chapter Traditional Medicine Conditions - Module 114 Diseases of the skin

TCM gynecology tcm-gynecology

Datasets explicitly limited to tcm gynecology.ICD-11 chapters26 Supplementary Chapter Traditional Medicine Conditions - Module 118 Pregnancy, childbirth or the puerperium

TCM pediatrics tcm-pediatrics

Datasets explicitly limited to tcm pediatrics.ICD-11 chapters26 Supplementary Chapter Traditional Medicine Conditions - Module 119 Certain conditions originating in the perinatal period

Acupuncture and tuina acupuncture-tuina

Datasets explicitly limited to acupuncture and tuina.ICD-11 chapters26 Supplementary Chapter Traditional Medicine Conditions - Module 1

TCM orthopedics and traumatology tcm-orthopedics-traumatology

Datasets explicitly limited to tcm orthopedics and traumatology.ICD-11 chapters26 Supplementary Chapter Traditional Medicine Conditions - Module 115 Diseases of the musculoskeletal system or connective tissue22 Injury, poisoning or certain other consequences of external causes

Chinese materia medica and formulas tcm-materia-formulas

Datasets explicitly limited to chinese materia medica and formulas.

TCM fundamentals and classics tcm-basics-classics

Datasets explicitly limited to tcm fundamentals and classics.ICD-11 chapters26 Supplementary Chapter Traditional Medicine Conditions - Module 1

Multi-specialty multi-specialty

Datasets explicitly limited to multi-specialty.

Disease classification (ICD-11 chapter) condition_scope

Which diseases?

Certain infectious or parasitic diseases icd11-01

Restricted to ICD-11 chapter 01.SpecialtiesInternal medicine (general)Infectious diseasesPublic health and preventive medicine

Neoplasms icd11-02

Restricted to ICD-11 chapter 02.SpecialtiesSurgeryOncology

Diseases of the blood or blood-forming organs icd11-03

Restricted to ICD-11 chapter 03.SpecialtiesInternal medicine (general)Hematology

Diseases of the immune system icd11-04

Restricted to ICD-11 chapter 04.SpecialtiesInternal medicine (general)Rheumatology and immunology

Endocrine, nutritional or metabolic diseases icd11-05

Restricted to ICD-11 chapter 05.SpecialtiesInternal medicine (general)Endocrinology

Mental, behavioural or neurodevelopmental disorders icd11-06

Restricted to ICD-11 chapter 06.SpecialtiesPsychiatry

Sleep-wake disorders icd11-07

Restricted to ICD-11 chapter 07.SpecialtiesNeurologyPsychiatry

Diseases of the nervous system icd11-08

Restricted to ICD-11 chapter 08.SpecialtiesInternal medicine (general)NeurologyRehabilitation medicine

Diseases of the visual system icd11-09

Restricted to ICD-11 chapter 09.SpecialtiesOphthalmology

Diseases of the ear or mastoid process icd11-10

Restricted to ICD-11 chapter 10.SpecialtiesOtorhinolaryngology

Diseases of the circulatory system icd11-11

Restricted to ICD-11 chapter 11.SpecialtiesInternal medicine (general)Cardiology

Diseases of the respiratory system icd11-12

Restricted to ICD-11 chapter 12.SpecialtiesInternal medicine (general)Respiratory medicineOtorhinolaryngology

Diseases of the digestive system icd11-13

Restricted to ICD-11 chapter 13.SpecialtiesInternal medicine (general)GastroenterologySurgeryStomatology and dentistry

Diseases of the skin icd11-14

Restricted to ICD-11 chapter 14.SpecialtiesDermatologyTCM surgery

Diseases of the musculoskeletal system or connective tissue icd11-15

Restricted to ICD-11 chapter 15.SpecialtiesRheumatology and immunologyOrthopedicsRehabilitation medicineTCM orthopedics and traumatology

Diseases of the genitourinary system icd11-16

Restricted to ICD-11 chapter 16.SpecialtiesInternal medicine (general)NephrologyUrology and andrologyObstetrics and gynecology

Conditions related to sexual health icd11-17

Restricted to ICD-11 chapter 17.SpecialtiesUrology and andrologyObstetrics and gynecology

Pregnancy, childbirth or the puerperium icd11-18

Restricted to ICD-11 chapter 18.SpecialtiesObstetrics and gynecologyTCM gynecology

Certain conditions originating in the perinatal period icd11-19

Restricted to ICD-11 chapter 19.SpecialtiesPediatricsTCM pediatrics

Developmental anomalies icd11-20

Restricted to ICD-11 chapter 20.SpecialtiesPediatrics

Symptoms, signs or clinical findings, not elsewhere classified icd11-21

Restricted to ICD-11 chapter 21.SpecialtiesInternal medicine (general)Emergency and critical careGeneral practice and basic medical sciences

Injury, poisoning or certain other consequences of external causes icd11-22

Restricted to ICD-11 chapter 22.SpecialtiesSurgeryOrthopedicsEmergency and critical careTCM orthopedics and traumatology

External causes of morbidity or mortality icd11-23

Restricted to ICD-11 chapter 23.SpecialtiesEmergency and critical carePublic health and preventive medicine

Factors influencing health status or contact with health services icd11-24

Restricted to ICD-11 chapter 24.SpecialtiesGeneral practice and basic medical sciencesPublic health and preventive medicine

Codes for special purposes icd11-25

Restricted to ICD-11 chapter 25.

Supplementary Chapter Traditional Medicine Conditions - Module 1 icd11-26

Restricted to ICD-11 chapter 26.SpecialtiesTCM internal medicineTCM surgeryTCM gynecologyTCM pediatricsAcupuncture and tuinaTCM orthopedics and traumatologyTCM fundamentals and classics

Source type source_type

Where does the content come from?

Exam questions exam

Licensing or entrance exam questions. Derived from risk_flags; never stored.

Textbooks and reference books textbook-reference

Compiled from textbooks or reference books.

Clinical guidelines guideline

From clinical guidelines or consensus.

Research literature literature

From papers or journal articles.

Expert-written expert-written

Newly written by clinicians or experts.

Built from a knowledge base knowledge-base

Built from a structured KB or KG.

Classical texts classical-text

From pre-modern classical texts.

Official publication official-publication

Published by a government or standards body.

Real patient text real-patient-text

From real consultations or records. Derived from risk_flags; never stored.

Model-generated model-generated

Generated by a model. Derived from risk_flags; never stored.

Web-scraped web-scraped

Scraped from websites. Derived from risk_flags (scraped); never stored.

Derived from other datasets derived-dataset

Built from other datasets. Derived from risk_flags (derived); never stored.

Annotation depth annotation_depth

What comes beyond the answer?

With explanations with-explanation

Reference explanations or rationales included.

With reasoning traces with-reasoning

Step-by-step reasoning included.

With evidence citations with-evidence

Answers cite source passages.

Expert involvement expert_involvement

Did experts check it, and how?

None none

Explicitly no expert review.

Reviewed, method unspecified review-unspecified

Experts reviewed; method not stated.

Sample review sample-review

Experts reviewed a sample.

Per-item review per-item-review

Every item (or a stated subset) reviewed.

Multiple independent reviewers multi-reviewer

Independent reviews with agreement recorded.

Data format data_format

What file format?

JSON json

Data files provided as json.

JSONL jsonl

Data files provided as jsonl.

CSV csv

Data files provided as csv.

TSV tsv

Data files provided as tsv.

PARQUET parquet

Data files provided as parquet.

TXT txt

Data files provided as txt.

XLSX xlsx

Data files provided as xlsx.

Official split official_split

Official train/test split?

Train and test splits full-split

Official training and test splits.

Evaluation split only eval-only

Only test or validation splits.

No split no-split

Single undivided set.

Benchmark status benchmark_status

Leaderboard or human baseline?

Public leaderboard public-leaderboard

An official public leaderboard exists.

Human expert baseline human-expert-baseline

Expert human performance reported.