#366
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_01
| kind | tokenized |
|---|---|
| status | active |
| samples | 1,769,932 |
| counted via | megatron idx |
| size | 11.4 GB |
| files | 193 |
| first seen | 2026-07-22 13:40 |
| last seen | 2026-07-22 13:40 |
| registered | 2026-07-22 13:40 |
# dataset #366 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_01 kind: tokenized | status: active samples: 1,769,932 (megatron idx) | size: 11.4 GB | files: 193 tree (truncated): ``` dataset_info.json rank_0_shard_27_64.bin rank_0_shard_27_64.idx rank_0_shard_45_64.bin rank_0_shard_45_64.idx rank_0_shard_9_64.bin rank_0_shard_9_64.idx rank_10_shard_11_64.bin rank_10_shard_11_64.idx rank_10_shard_34_64.bin rank_10_shard_34_64.idx rank_10_shard_57_64.bin rank_10_shard_57_64.idx rank_11_shard_10_64.bin rank_11_shard_10_64.idx rank_11_shard_28_64.bin rank_11_shard_28_64.idx rank_11_shard_47_64.bin rank_11_shard_47_64.idx rank_12_shard_39_64.bin rank_12_shard_39_64.idx rank_12_shard_48_64.bin rank_12_shard_48_64.idx rank_12_shard_4_64.bin rank_12_shard_4_64.idx ... (+168 more) ```