#323
/capstor/store/cscs/swissai/infra01/vision-datasets/tokenized/sft/sensenova_si_8m/stage2
| kind | tokenized |
|---|---|
| status | active |
| samples | 5,205,020 |
| counted via | megatron idx |
| size | 87.6 GB |
| files | 338 |
| first seen | 2026-07-22 13:38 |
| last seen | 2026-07-22 13:38 |
| registered | 2026-07-22 13:38 |
# dataset #323 path: /capstor/store/cscs/swissai/infra01/vision-datasets/tokenized/sft/sensenova_si_8m/stage2 kind: tokenized | status: active samples: 5,205,020 (megatron idx) | size: 87.6 GB | files: 338 tree (truncated): ``` rank_0000_chunk_0000.bin rank_0000_chunk_0000.idx rank_0001_chunk_0000.bin rank_0001_chunk_0000.idx rank_0002_chunk_0000.bin rank_0002_chunk_0000.idx rank_0003_chunk_0000.bin rank_0003_chunk_0000.idx rank_0004_chunk_0000.bin rank_0004_chunk_0000.idx rank_0005_chunk_0000.bin rank_0005_chunk_0000.idx rank_0006_chunk_0000.bin rank_0006_chunk_0000.idx rank_0007_chunk_0000.bin rank_0007_chunk_0000.idx rank_0008_chunk_0000.bin rank_0008_chunk_0000.idx rank_0009_chunk_0000.bin rank_0009_chunk_0000.idx rank_0010_chunk_0000.bin rank_0010_chunk_0000.idx rank_0011_chunk_0000.bin rank_0011_chunk_0000.idx rank_0012_chunk_0000.bin ... (+313 more) ```