MedConceptsQA

Overview edit

Variants: MedConceptsQA

Associated Benchmarks

This dataset is used in 2 benchmarks:

• Few-Shot Learning - Metrics: Accuracy
• Zero-Shot Learning - Metrics: Accuracy

Recent Benchmark Submissions

Research Papers

Recent papers with results on this dataset:

• MedConceptsQA: Open Source Medical Concepts QA Benchmark (2024) -
• Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks (2024) -
• BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains (2024) -
• MEDITRON-70B: Scaling Medical Pretraining for Large Language Models (2023) -
• Zephyr: Direct Distillation of LM Alignment (2023) -
• BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine (2023) -
• GPT-4 Technical Report (2023) -
• LLaMA: Open and Efficient Foundation Language Models (2023) -
• GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records (2022) -
• Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences (2022) -
• Language Models are Few-Shot Learners (2020) -
• BioBERT: a pre-trained biomedical language representation model for biomedical text mining (2019) -