#213
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_02
| kind | tokenized |
|---|---|
| status | active |
| samples | 2,135,247 |
| counted via | megatron idx |
| size | 13.9 GB |
| files | 193 |
| first seen | 2026-07-22 13:32 |
| last seen | 2026-07-22 13:32 |
| registered | 2026-07-22 13:32 |
# dataset #213 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_02 kind: tokenized | status: active samples: 2,135,247 (megatron idx) | size: 13.9 GB | files: 193 tree (truncated): ``` dataset_info.json rank_0_shard_2_64.bin rank_0_shard_2_64.idx rank_0_shard_38_64.bin rank_0_shard_38_64.idx rank_0_shard_54_64.bin rank_0_shard_54_64.idx rank_10_shard_10_64.bin rank_10_shard_10_64.idx rank_10_shard_23_64.bin rank_10_shard_23_64.idx rank_10_shard_58_64.bin rank_10_shard_58_64.idx rank_11_shard_1_64.bin rank_11_shard_1_64.idx rank_11_shard_37_64.bin rank_11_shard_37_64.idx rank_11_shard_51_64.bin rank_11_shard_51_64.idx rank_12_shard_13_64.bin rank_12_shard_13_64.idx rank_12_shard_22_64.bin rank_12_shard_22_64.idx rank_12_shard_46_64.bin rank_12_shard_46_64.idx ... (+168 more) ```