#359
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1THTML
| kind | tokenized |
|---|---|
| status | active |
| samples | 125,004,498 |
| counted via | megatron idx |
| size | 914.1 GB |
| files | 76,522 |
| first seen | 2026-07-22 13:39 |
| last seen | 2026-07-22 13:39 |
| registered | 2026-07-22 13:39 |
# dataset #359 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-mint1THTML kind: tokenized | status: active samples: 125,004,498 (megatron idx) | size: 914.1 GB | files: 76,522 tree (truncated): ``` first20perc/dataset_info.json first20perc/rank_0_shard_10234_25507.bin first20perc/rank_0_shard_10234_25507.idx first20perc/rank_0_shard_11006_25507.bin first20perc/rank_0_shard_11006_25507.idx first20perc/rank_0_shard_11779_25507.bin first20perc/rank_0_shard_11779_25507.idx first20perc/rank_0_shard_12606_25507.bin first20perc/rank_0_shard_12606_25507.idx first20perc/rank_0_shard_13301_25507.bin first20perc/rank_0_shard_13301_25507.idx first20perc/rank_0_shard_14028_25507.bin first20perc/rank_0_shard_14028_25507.idx first20perc/rank_0_shard_1467_25507.bin first20perc/rank_0_shard_1467_25507.idx first20perc/rank_0_shard_15191_25507.bin first20perc/rank_0_shard_15191_25507.idx first20perc/rank_0_shard_15983_25507.bin first20perc/rank_0_shard_15983_25507.idx first20perc/rank_0_shard_16745_25507.bin first20perc/rank_0_shard_16745_25507.idx first20perc/rank_0_shard_17552_25507.bin first20perc/rank_0_shard_17552_25507.idx first20perc/rank_0_shard_1786_25507.bin first20perc/rank_0_shard_1786_25507.idx ... (+76,497 more) ```