#608
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_05
| kind | tokenized |
|---|---|
| status | active |
| samples | 6,377,542 |
| counted via | megatron idx |
| size | 50.0 GB |
| files | 211 |
| first seen | 2026-07-22 13:49 |
| last seen | 2026-07-22 13:49 |
| registered | 2026-07-22 13:49 |
# dataset #608 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_05 kind: tokenized | status: active samples: 6,377,542 (megatron idx) | size: 50.0 GB | files: 211 tree (truncated): ``` dataset_info.json rank_0_shard_1_64.bin rank_0_shard_1_64.idx rank_0_shard_34_64.bin rank_0_shard_34_64.idx rank_0_shard_50_64.bin rank_0_shard_51_64.bin rank_0_shard_51_64.idx rank_10_shard_38_64.bin rank_10_shard_38_64.idx rank_10_shard_59_64.bin rank_10_shard_8_64.bin rank_10_shard_8_64.idx rank_11_shard_10_64.bin rank_11_shard_10_64.idx rank_11_shard_32_64.bin rank_11_shard_32_64.idx rank_11_shard_55_64.bin rank_11_shard_61_64.bin rank_11_shard_61_64.idx rank_12_shard_22_64.bin rank_12_shard_22_64.idx rank_12_shard_3_64.bin rank_12_shard_3_64.idx rank_12_shard_45_64.bin ... (+186 more) ```