#383
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/medical-mammoth
| kind | tokenized |
|---|---|
| status | active |
| samples | 1,500,306 |
| counted via | megatron idx |
| size | 12.4 GB |
| files | 301 |
| first seen | 2026-07-22 13:41 |
| last seen | 2026-07-22 13:41 |
| registered | 2026-07-22 13:41 |
# dataset #383 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/medical-mammoth kind: tokenized | status: active samples: 1,500,306 (megatron idx) | size: 12.4 GB | files: 301 tree (truncated): ``` 64x128_2048x2048/dataset_info.json 64x128_2048x2048/rank_0_shard_13_100.bin 64x128_2048x2048/rank_0_shard_13_100.idx 64x128_2048x2048/rank_0_shard_42_100.bin 64x128_2048x2048/rank_0_shard_42_100.idx 64x128_2048x2048/rank_0_shard_87_100.bin 64x128_2048x2048/rank_0_shard_87_100.idx 64x128_2048x2048/rank_10_shard_12_100.bin 64x128_2048x2048/rank_10_shard_12_100.idx 64x128_2048x2048/rank_10_shard_56_100.bin 64x128_2048x2048/rank_10_shard_56_100.idx 64x128_2048x2048/rank_10_shard_84_100.bin 64x128_2048x2048/rank_10_shard_84_100.idx 64x128_2048x2048/rank_11_shard_16_100.bin 64x128_2048x2048/rank_11_shard_16_100.idx 64x128_2048x2048/rank_11_shard_49_100.bin 64x128_2048x2048/rank_11_shard_49_100.idx 64x128_2048x2048/rank_11_shard_88_100.bin 64x128_2048x2048/rank_11_shard_88_100.idx 64x128_2048x2048/rank_12_shard_4_100.bin 64x128_2048x2048/rank_12_shard_4_100.idx 64x128_2048x2048/rank_12_shard_65_100.bin 64x128_2048x2048/rank_12_shard_65_100.idx 64x128_2048x2048/rank_13_shard_22_100.bin 64x128_2048x2048/rank_13_shard_22_100.idx ... (+276 more) ```