#117
/capstor/store/cscs/swissai/infra01/vision-datasets/archive/Apertus1p5_stage2_tokenized
| kind | tokenized |
|---|---|
| status | active |
| samples | 4,888,615 |
| counted via | megatron idx |
| size | 27.5 GB |
| files | 876 |
| first seen | 2026-07-22 13:27 |
| last seen | 2026-07-22 13:27 |
| registered | 2026-07-22 13:27 |
# dataset #117 path: /capstor/store/cscs/swissai/infra01/vision-datasets/archive/Apertus1p5_stage2_tokenized kind: tokenized | status: active samples: 4,888,615 (megatron idx) | size: 27.5 GB | files: 876 tree (truncated): ``` textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/dataset_info.json textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_12_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_12_24.idx textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_13_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_16_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_16_24.idx textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_17_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_1_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_1_24.idx textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_20_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_20_24.idx textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_21_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_3_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_4_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_4_24.idx textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_5_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_8_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_8_24.idx textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_0_shard_9_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_1_shard_0_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_1_shard_10_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_1_shard_11_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_1_shard_11_24.idx textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_1_shard_14_24.bin textAtlas5M/tokenized_apertus_emu3_5_paired/CleanTextSynth_image2text/64x128_2048x2048/rank_1_shard_15_24.bin ... (+851 more) ```