#658
/capstor/store/cscs/swissai/infra01/vision-datasets/tokenized/sft/sensenova_si_8m/lct
| kind | tokenized |
|---|---|
| status | active |
| samples | 2,745,331 |
| counted via | megatron idx |
| size | 412.8 GB |
| files | 868 |
| first seen | 2026-07-22 13:52 |
| last seen | 2026-07-22 13:52 |
| registered | 2026-07-22 13:52 |
# dataset #658 path: /capstor/store/cscs/swissai/infra01/vision-datasets/tokenized/sft/sensenova_si_8m/lct kind: tokenized | status: active samples: 2,745,331 (megatron idx) | size: 412.8 GB | files: 868 tree (truncated): ``` rank_0000_chunk_0000.bin rank_0000_chunk_0000.idx rank_0001_chunk_0000.bin rank_0001_chunk_0000.idx rank_0002_chunk_0000.bin rank_0002_chunk_0000.idx rank_0003_chunk_0000.bin rank_0003_chunk_0000.idx rank_0004_chunk_0000.bin rank_0004_chunk_0000.idx rank_0012_chunk_0000.bin rank_0012_chunk_0000.idx rank_0013_chunk_0000.bin rank_0013_chunk_0000.idx rank_0014_chunk_0000.bin rank_0014_chunk_0000.idx rank_0015_chunk_0000.bin rank_0015_chunk_0000.idx rank_0016_chunk_0000.bin rank_0016_chunk_0000.idx rank_0017_chunk_0000.bin rank_0017_chunk_0000.idx rank_0018_chunk_0000.bin rank_0018_chunk_0000.idx rank_0019_chunk_0000.bin ... (+843 more) ```