#557
/capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/ocr-bigDocs7_5m
| kind | tokenized |
|---|---|
| status | active |
| samples | 2,150,183 |
| counted via | megatron idx |
| size | 24.6 GB |
| files | 1,095 |
| first seen | 2026-07-22 13:47 |
| last seen | 2026-07-22 13:47 |
| registered | 2026-07-22 13:47 |
# dataset #557 path: /capstor/store/cscs/swissai/infra01/vision-datasets/Apertus1p5_stage1_tokenized/ocr-bigDocs7_5m kind: tokenized | status: active samples: 2,150,183 (megatron idx) | size: 24.6 GB | files: 1,095 tree (truncated): ``` arxiv_ocr/dataset_info.json arxiv_ocr/rank_0_shard_12_188.bin arxiv_ocr/rank_0_shard_12_188.idx arxiv_ocr/rank_0_shard_130_188.bin arxiv_ocr/rank_0_shard_130_188.idx arxiv_ocr/rank_0_shard_164_188.bin arxiv_ocr/rank_0_shard_164_188.idx arxiv_ocr/rank_0_shard_53_188.bin arxiv_ocr/rank_0_shard_53_188.idx arxiv_ocr/rank_0_shard_87_188.bin arxiv_ocr/rank_0_shard_87_188.idx arxiv_ocr/rank_10_shard_104_188.bin arxiv_ocr/rank_10_shard_104_188.idx arxiv_ocr/rank_10_shard_138_188.bin arxiv_ocr/rank_10_shard_138_188.idx arxiv_ocr/rank_10_shard_180_188.bin arxiv_ocr/rank_10_shard_180_188.idx arxiv_ocr/rank_10_shard_34_188.bin arxiv_ocr/rank_10_shard_34_188.idx arxiv_ocr/rank_10_shard_64_188.bin arxiv_ocr/rank_10_shard_64_188.idx arxiv_ocr/rank_11_shard_137_188.bin arxiv_ocr/rank_11_shard_137_188.idx arxiv_ocr/rank_11_shard_182_188.bin arxiv_ocr/rank_11_shard_182_188.idx ... (+1,070 more) ```