#542
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-laion_aestetics12mumap
| kind | tokenized |
|---|---|
| status | active |
| samples | 4,411,399 |
| counted via | megatron idx |
| size | 34.7 GB |
| files | 3,629 |
| first seen | 2026-07-22 13:47 |
| last seen | 2026-07-22 13:47 |
| registered | 2026-07-22 13:47 |
# dataset #542 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/general-laion_aestetics12mumap kind: tokenized | status: active samples: 4,411,399 (megatron idx) | size: 34.7 GB | files: 3,629 tree (truncated): ``` dataset_info.json rank_0_shard_1001_1210.bin rank_0_shard_1001_1210.idx rank_0_shard_1111_1210.bin rank_0_shard_1111_1210.idx rank_0_shard_1170_1210.bin rank_0_shard_1170_1210.idx rank_0_shard_158_1210.bin rank_0_shard_158_1210.idx rank_0_shard_1_1210.bin rank_0_shard_1_1210.idx rank_0_shard_235_1210.bin rank_0_shard_235_1210.idx rank_0_shard_318_1210.bin rank_0_shard_318_1210.idx rank_0_shard_392_1210.bin rank_0_shard_392_1210.idx rank_0_shard_472_1210.bin rank_0_shard_472_1210.idx rank_0_shard_534_1210.bin rank_0_shard_534_1210.idx rank_0_shard_575_1210.bin rank_0_shard_575_1210.idx rank_0_shard_676_1210.bin rank_0_shard_676_1210.idx ... (+3,604 more) ```