#424
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_03
| kind | tokenized |
|---|---|
| status | active |
| samples | 3,660,732 |
| counted via | megatron idx |
| size | 23.3 GB |
| files | 193 |
| first seen | 2026-07-22 13:42 |
| last seen | 2026-07-22 13:42 |
| registered | 2026-07-22 13:42 |
# dataset #424 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_03 kind: tokenized | status: active samples: 3,660,732 (megatron idx) | size: 23.3 GB | files: 193 tree (truncated): ``` dataset_info.json rank_0_shard_1_64.bin rank_0_shard_1_64.idx rank_0_shard_33_64.bin rank_0_shard_33_64.idx rank_0_shard_47_64.bin rank_0_shard_47_64.idx rank_0_shard_61_64.bin rank_0_shard_61_64.idx rank_10_shard_18_64.bin rank_10_shard_18_64.idx rank_10_shard_35_64.bin rank_10_shard_35_64.idx rank_10_shard_57_64.bin rank_10_shard_57_64.idx rank_11_shard_23_64.bin rank_11_shard_23_64.idx rank_11_shard_48_64.bin rank_11_shard_48_64.idx rank_11_shard_63_64.bin rank_11_shard_63_64.idx rank_11_shard_9_64.bin rank_11_shard_9_64.idx rank_12_shard_16_64.bin rank_12_shard_16_64.idx ... (+168 more) ```