#173
/capstor/store/cscs/swissai/infra01/vision-datasets/tokenized/image2text/datikz_v4
| kind | tokenized |
|---|---|
| status | active |
| samples | 427,753 |
| counted via | megatron idx |
| size | 1.7 GB |
| files | 66 |
| first seen | 2026-07-22 13:31 |
| last seen | 2026-07-22 13:31 |
| registered | 2026-07-22 13:31 |
# dataset #173 path: /capstor/store/cscs/swissai/infra01/vision-datasets/tokenized/image2text/datikz_v4 kind: tokenized | status: active samples: 427,753 (megatron idx) | size: 1.7 GB | files: 66 tree (truncated): ``` dry_run_stats.json rank_0000_checkpoint.pt rank_0000_chunk_0000.bin rank_0000_chunk_0000.idx rank_0000_stats.json rank_0001_checkpoint.pt rank_0001_chunk_0000.bin rank_0001_chunk_0000.idx rank_0001_stats.json rank_0002_checkpoint.pt rank_0002_chunk_0000.bin rank_0002_chunk_0000.idx rank_0002_stats.json rank_0003_checkpoint.pt rank_0003_chunk_0000.bin rank_0003_chunk_0000.idx rank_0003_stats.json rank_0004_checkpoint.pt rank_0004_chunk_0000.bin rank_0004_chunk_0000.idx rank_0004_stats.json rank_0005_checkpoint.pt rank_0005_chunk_0000.bin rank_0005_chunk_0000.idx rank_0005_stats.json ... (+41 more) ```