Expert STEM Problems
Original research-level science problems with expert-written solutions.
- Subjects
- 4
- Level
- Research
- Language
- English
- Solutions
- Step-by-step
Illustrative rendering of annotation layers.
01Overview
Original problems in mathematics, physics, chemistry and biology written by domain experts, each with a reference answer and a step-by-step solution. Problems are long, multi-constraint research scenarios with multi-part answers, written to stay hard for current frontier models.
Modalities
- Text
- LaTeX
Use cases
- Reinforcement learning with verifiable answers
- Supervised fine-tuning on expert reasoning
- Held-out evaluation of frontier reasoning models
02Specification
Content
- Subjects
- Mathematics, physics, chemistry and biology
- Problem style
- Open-ended research scenarios with several constraints and a multi-part answer
- Answers
- Reference answer per problem, suited to automatic checking
- Solutions
- Step-by-step expert analysis in Markdown with LaTeX
- Language
- English
Provenance
- Authoring
- Original problems written by subject experts
- Excluded
- Published competition problems and figures reproduced from papers are not part of this dataset
- Volume
- Confirmed per order
03Schema
| Field | Type | Description |
|---|---|---|
| id | string | Unique problem identifier. |
| subject | string | Mathematics, physics, chemistry or biology. |
| question | string | Problem statement (Markdown + LaTeX). |
| analysis | string | Step-by-step expert solution. |
| answer | string | Reference final answer. |
04File structure
expert-stem-problems/ # indicative; final layout confirmed per delivery
├── data_card.md
└── problems/
├── biology.jsonl
├── chemistry.jsonl
├── mathematics.jsonl
└── physics.jsonl05Sample
Sample on request.
- Original problems from each subject with solutions and answers
- Size
- On request
- Formats
- JSON
06License
Graviti Commercial Data License
Commercial training and evaluation rights. Volume and exclusivity agreed per order.
How we license data →07FAQ
Questions about Expert STEM Problems
What is the Expert STEM Problems dataset?
Expert STEM Problems (GR-LLM-01) is a LLM training dataset from Graviti. Original problems in mathematics, physics, chemistry and biology written by domain experts, each with a reference answer and a step-by-step solution. Problems are long, multi-constraint research scenarios with multi-part answers, written to stay hard for current frontier models.
What is Expert STEM Problems used for?
Typical uses: reinforcement learning with verifiable answers, supervised fine-tuning on expert reasoning and held-out evaluation of frontier reasoning models.
What modalities and annotations does Expert STEM Problems include?
Expert STEM Problems includes Text and LaTeX. Its schema has the fields id, subject, question, analysis and answer.
How can I get a sample of Expert STEM Problems?
Expert STEM Problems is early access. Pilot data is available on request at graviti.com/datasets/expert-stem-problems/sample.
How is Expert STEM Problems licensed?
Graviti Commercial Data License. Commercial training and evaluation rights. Volume and exclusivity agreed per order.
Related datasets
Human Preference Pairs
Pairwise and graded comparisons for RLHF, DPO and reward modeling.
- Comparisons
- 400,000+
- Avg. turns
- 4.2
Agentic Coding Environments
Containerized software and tool-use tasks with automated verifiers.
- Task format
- Harbor
- Verification
- Automated
Professional Work Tasks
Expert-graded finance, legal and office tasks with real deliverables.
- Domains
- Finance · Law · Office
- Deliverables
- XLSX · DOCX · PPTX
Get started
Need more than Expert STEM Problems?
We extend catalog datasets with new environments, tasks, languages and annotation layers — or collect from scratch to your spec.