#560
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/medical-openpmc18m
| kind | tokenized |
|---|---|
| status | active |
| samples | 17,313,702 |
| counted via | megatron idx |
| size | 19.4 GB |
| files | 3,001 |
| first seen | 2026-07-22 13:47 |
| last seen | 2026-07-22 13:47 |
| registered | 2026-07-22 13:47 |
# dataset #560 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/medical-openpmc18m kind: tokenized | status: active samples: 17,313,702 (megatron idx) | size: 19.4 GB | files: 3,001 tree (truncated): ``` 64x128_2048x2048/dataset_info.json 64x128_2048x2048/rank_0_shard_20_1000.bin 64x128_2048x2048/rank_0_shard_20_1000.idx 64x128_2048x2048/rank_0_shard_273_1000.bin 64x128_2048x2048/rank_0_shard_273_1000.idx 64x128_2048x2048/rank_0_shard_377_1000.bin 64x128_2048x2048/rank_0_shard_377_1000.idx 64x128_2048x2048/rank_0_shard_516_1000.bin 64x128_2048x2048/rank_0_shard_516_1000.idx 64x128_2048x2048/rank_0_shard_664_1000.bin 64x128_2048x2048/rank_0_shard_664_1000.idx 64x128_2048x2048/rank_0_shard_858_1000.bin 64x128_2048x2048/rank_0_shard_858_1000.idx 64x128_2048x2048/rank_100_shard_215_1000.bin 64x128_2048x2048/rank_100_shard_215_1000.idx 64x128_2048x2048/rank_100_shard_371_1000.bin 64x128_2048x2048/rank_100_shard_371_1000.idx 64x128_2048x2048/rank_100_shard_535_1000.bin 64x128_2048x2048/rank_100_shard_535_1000.idx 64x128_2048x2048/rank_100_shard_668_1000.bin 64x128_2048x2048/rank_100_shard_668_1000.idx 64x128_2048x2048/rank_100_shard_844_1000.bin 64x128_2048x2048/rank_100_shard_844_1000.idx 64x128_2048x2048/rank_100_shard_969_1000.bin 64x128_2048x2048/rank_100_shard_969_1000.idx ... (+2,976 more) ```