#206
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_06
| kind | tokenized |
|---|---|
| status | active |
| samples | 16,498,313 |
| counted via | megatron idx |
| size | 103.7 GB |
| files | 193 |
| first seen | 2026-07-22 13:32 |
| last seen | 2026-07-22 13:32 |
| registered | 2026-07-22 13:32 |
# dataset #206 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1Tpdf_06 kind: tokenized | status: active samples: 16,498,313 (megatron idx) | size: 103.7 GB | files: 193 tree (truncated): ``` 64x128_2048x2048/dataset_info.json 64x128_2048x2048/rank_0_shard_51_512.bin 64x128_2048x2048/rank_0_shard_51_512.idx 64x128_2048x2048/rank_107_shard_22_512.bin 64x128_2048x2048/rank_107_shard_22_512.idx 64x128_2048x2048/rank_108_shard_6_512.bin 64x128_2048x2048/rank_108_shard_6_512.idx 64x128_2048x2048/rank_10_shard_16_512.bin 64x128_2048x2048/rank_10_shard_16_512.idx 64x128_2048x2048/rank_110_shard_35_512.bin 64x128_2048x2048/rank_110_shard_35_512.idx 64x128_2048x2048/rank_112_shard_38_512.bin 64x128_2048x2048/rank_112_shard_38_512.idx 64x128_2048x2048/rank_113_shard_32_512.bin 64x128_2048x2048/rank_113_shard_32_512.idx 64x128_2048x2048/rank_116_shard_14_512.bin 64x128_2048x2048/rank_116_shard_14_512.idx 64x128_2048x2048/rank_118_shard_53_512.bin 64x128_2048x2048/rank_118_shard_53_512.idx 64x128_2048x2048/rank_119_shard_21_512.bin 64x128_2048x2048/rank_119_shard_21_512.idx 64x128_2048x2048/rank_11_shard_24_512.bin 64x128_2048x2048/rank_11_shard_24_512.idx 64x128_2048x2048/rank_121_shard_54_512.bin 64x128_2048x2048/rank_121_shard_54_512.idx ... (+168 more) ```