#525
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/bio-treeoflife10m
| kind | tokenized |
|---|---|
| status | active |
| samples | 765,502 |
| counted via | megatron idx |
| size | 17.6 GB |
| files | 190 |
| first seen | 2026-07-22 13:46 |
| last seen | 2026-07-22 13:46 |
| registered | 2026-07-22 13:46 |
# dataset #525 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/bio-treeoflife10m kind: tokenized | status: active samples: 765,502 (megatron idx) | size: 17.6 GB | files: 190 tree (truncated): ``` 64x128_2048x2048/dataset_info.json 64x128_2048x2048/rank_0_shard_35_800.bin 64x128_2048x2048/rank_0_shard_35_800.idx 64x128_2048x2048/rank_0_shard_5_800.bin 64x128_2048x2048/rank_0_shard_5_800.idx 64x128_2048x2048/rank_101_shard_36_800.bin 64x128_2048x2048/rank_101_shard_36_800.idx 64x128_2048x2048/rank_110_shard_47_800.bin 64x128_2048x2048/rank_110_shard_47_800.idx 64x128_2048x2048/rank_112_shard_28_800.bin 64x128_2048x2048/rank_112_shard_28_800.idx 64x128_2048x2048/rank_113_shard_51_800.bin 64x128_2048x2048/rank_113_shard_51_800.idx 64x128_2048x2048/rank_117_shard_46_800.bin 64x128_2048x2048/rank_117_shard_46_800.idx 64x128_2048x2048/rank_118_shard_29_800.bin 64x128_2048x2048/rank_118_shard_29_800.idx 64x128_2048x2048/rank_11_shard_16_800.bin 64x128_2048x2048/rank_11_shard_16_800.idx 64x128_2048x2048/rank_121_shard_39_800.bin 64x128_2048x2048/rank_121_shard_39_800.idx 64x128_2048x2048/rank_122_shard_33_800.bin 64x128_2048x2048/rank_122_shard_33_800.idx 64x128_2048x2048/rank_12_shard_55_800.bin 64x128_2048x2048/rank_12_shard_55_800.idx ... (+165 more) ```