Dataset Preview
The full dataset viewer is not available (click to read why). Only showing a preview of the rows.
The dataset generation failed
Error code: DatasetGenerationError
Exception: TypeError
Message: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'
Traceback: Traceback (most recent call last):
File "/usr/local/lib/python3.14/site-packages/datasets/builder.py", line 1531, in _prepare_split_single
for key, record in generator:
^^^^^^^^^
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 613, in wrapped
for item in generator(*args, **kwargs):
~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/packaged_modules/webdataset/webdataset.py", line 127, in _generate_examples
for example_idx, example in enumerate(self._get_pipeline_from_tar(tar_path, tar_iterator)):
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/packaged_modules/webdataset/webdataset.py", line 32, in _get_pipeline_from_tar
for filename, f in tar_iterator:
^^^^^^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/utils/track.py", line 49, in __iter__
for x in self.generator(*self.args):
~~~~~~~~~~~~~~^^^^^^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/utils/file_utils.py", line 1405, in _iter_from_urlpath
with xopen(urlpath, "rb", download_config=download_config, block_size=0) as f:
~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/utils/file_utils.py", line 982, in xopen
file_obj = fs.open(paths[0], mode)
File "<string>", line 3, in open
File "/usr/local/lib/python3.14/unittest/mock.py", line 1176, in __call__
return self._mock_call(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.14/unittest/mock.py", line 1180, in _mock_call
return self._execute_mock_call(*args, **kwargs)
~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.14/unittest/mock.py", line 1247, in _execute_mock_call
result = effect(*args, **kwargs)
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 786, in wrapped
tracker.files[urlpath] = {"read": 0, "size": int(f.size)}
~~~^^^^^^^^
TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 1369, in compute_config_parquet_and_info_response
parquet_operations, partial, estimated_dataset_info = stream_convert_to_parquet(
~~~~~~~~~~~~~~~~~~~~~~~~~^
builder, max_dataset_size_bytes=max_dataset_size_bytes
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/src/services/worker/src/worker/job_runners/config/parquet_and_info.py", line 948, in stream_convert_to_parquet
builder._prepare_split(split_generator=splits_generators[split], file_format="parquet")
~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.14/site-packages/datasets/builder.py", line 1393, in _prepare_split
for job_id, done, content in self._prepare_split_single(
~~~~~~~~~~~~~~~~~~~~~~~~~~^
gen_kwargs=gen_kwargs, job_id=job_id, **_prepare_split_args
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
):
^
File "/usr/local/lib/python3.14/site-packages/datasets/builder.py", line 1571, in _prepare_split_single
raise DatasetGenerationError("An error occurred while generating the dataset") from e
datasets.exceptions.DatasetGenerationError: An error occurred while generating the datasetNeed help to make the dataset viewer work? Make sure to review how to configure the dataset viewer, and open a discussion for direct support.
jsonl unknown | __key__ string | __url__ string |
|---|---|---|
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/0/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/10/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/105/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/108/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/109/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/11/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/111/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/114/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/116/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/117/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/118/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
[
123,
34,
101,
118,
101,
110,
116,
34,
58,
32,
34,
109,
111,
100,
101,
108,
34,
44,
32,
34,
115,
116,
101,
112,
34,
58,
32,
49,
44,
32,
34,
112,
114,
111,
116,
111,
99,
111,
108,
34,
58,
32,
34,
100,
97,
116,
97,
109,
105... | dabstep/datamind_7b/controlled_local_a800_dabench_dabstep_v2_seed42/dabench/items/123/trace | hf://datasets/noel7Y/data-agent-benchmarks@fb83e09ee2a30305169225a02660f4b06c7f93bf/baseline_trajectory/dabstep.tar.zst |
End of preview.
LongHorizon Full Data-Agent Benchmarks
Companion data artifacts for five complete evaluation tracks:
- DataSciBench full55 / 167 metric entries
- DABStep full450
- DABStep-Research full100
- DSBench Modeling full74
- LongDS full68 / 2,225 turns
The companion GitHub repository contains processed manifests, evaluation code,
historical API ReAct baseline code, download/preparation tools, and the frozen
source lock. artifact_manifest.json records every uploaded object's size,
SHA-256, installation path, and archive contents.
DataSciBench runtime trees and DSBench extracted directories are intentionally not duplicated here. They are reconstructed from the compact source artifacts. DABStep leaderboard submission history is excluded; all 450 task definitions and all seven context files are included. LongDS is split by dataset family so downloads can resume without a monolithic 19 GB archive.
The DABStep project metric uses six official public-dev references and 444 DataCOPE Genesis proxy references. It is not an official hidden-leaderboard full-test score.
- Downloads last month
- 349