Skip to content
Graviti
Early accessLLMGR-LLM-03

Agentic Coding Environments

Containerized software and tool-use tasks with automated verifiers.

Task format
Harbor
Verification
Automated
Reference solutions
Included
Repo languages
5+
TRAJ 22,019 · 23 STEPSENV · SPREADSHEET + REST01OBSERVESpreadsheet 'Q3 vendors.xlsx' opened02THINKNeed totals grouped by vendor03ACTinsert_pivot(range='A1:F412')04RESULTPivot table created on Sheet205ACThttp.post('/api/report', …)06RESULT201 Created · report_id=88f2OUTCOME · SUCCESS

Illustrative rendering of annotation layers.

01Overview

Runnable tasks for training and evaluating coding and tool-use agents: feature work in real open-source repositories, long-horizon engineering projects, terminal tasks, skill-based tasks and multi-service enterprise workflows. Every task ships with its environment, an automated verifier and a reference solution, ready for reinforcement learning.

Modalities

  • Code
  • Docker environments
  • Tests
  • Tool calls

Use cases

  • Reinforcement learning for coding and tool-use agents
  • Agent evaluation beyond public benchmarks
  • Regression testing of agent harnesses

02Specification

Task families

Repository tasks
Feature requests in real open-source repositories (Python, TypeScript, JavaScript, Go, Rust), graded by fail-to-pass and pass-to-pass tests
Long-horizon engineering
Reimplementation and performance work with byte-exact or benchmark-based verifiers
Terminal
Linux command-line and scientific-computing tasks in containers
Skills
Tasks solved with packaged agent skills and checked by output tests
Enterprise services
Workflows across self-hosted GitLab, ownCloud, Plane and Rocket.Chat for fictional companies, scored against checkpoints
MCP tool use
Multi-step tasks over MCP servers with rule-based ground truth

Each task includes

Instruction
Task statement in English (some skill tasks in Chinese)
Environment
Dockerfile and repository snapshot or seeded services
Verifier
Tests, grader script or checkpoint rubric
Reference solution
Patch or script that passes the verifier

Provenance

Tasks
Newly written; not copies of public benchmark tasks
Upstream code
Open-source repositories under their original licenses
Model trajectories
Not included
Volume
Confirmed per order

03Schema

FieldTypeDescription
task.tomltomlTask metadata, environment and timeouts.
instruction.mdmarkdownTask given to the agent.
environment/directoryDockerfile and task inputs.
tests/directoryVerifier that scores the agent's result.
solution/directoryReference solution.

04File structure

Directory layout
agentic-coding-environments/  # indicative; final layout confirmed per delivery
└── tasks/<task_id>/
    ├── task.toml
    ├── instruction.md
    ├── environment/
    │   └── Dockerfile
    ├── tests/
    │   └── test.sh
    └── solution/
        └── solve.sh

05Sample

Sample on request.

  • Runnable tasks from each family with verifiers and reference solutions
Size
On request
Formats
Harbor tasks, Docker

06License

Graviti Commercial Data License

Commercial training and evaluation rights. Upstream open-source code keeps its own license.

How we license data →

07FAQ

Questions about Agentic Coding Environments

What is the Agentic Coding Environments dataset?

Agentic Coding Environments (GR-LLM-03) is a LLM training dataset from Graviti. Runnable tasks for training and evaluating coding and tool-use agents: feature work in real open-source repositories, long-horizon engineering projects, terminal tasks, skill-based tasks and multi-service enterprise workflows. Every task ships with its environment, an automated verifier and a reference solution, ready for reinforcement learning.

What is Agentic Coding Environments used for?

Typical uses: reinforcement learning for coding and tool-use agents, agent evaluation beyond public benchmarks and regression testing of agent harnesses.

What modalities and annotations does Agentic Coding Environments include?

Agentic Coding Environments includes Code, Docker environments, Tests and Tool calls. Its schema has the fields task.toml, instruction.md, environment/, tests/ and solution/.

How can I get a sample of Agentic Coding Environments?

Agentic Coding Environments is early access. Pilot data is available on request at graviti.com/datasets/agentic-coding-environments/sample.

How is Agentic Coding Environments licensed?

Graviti Commercial Data License. Commercial training and evaluation rights. Upstream open-source code keeps its own license.

Related datasets

Get started

Need more than Agentic Coding Environments?

We extend catalog datasets with new environments, tasks, languages and annotation layers — or collect from scratch to your spec.