#13
/capstor/store/cscs/swissai/infra01/audio-datasets/tokenized/sft/tcm_shizhengpt_speech
| kind | tokenized |
|---|---|
| status | active |
| samples | 58,415 |
| counted via | megatron idx |
| size | 239.3 MB |
| files | 21 |
| first seen | 2026-07-22 13:20 |
| last seen | 2026-07-22 13:20 |
| registered | 2026-07-22 13:20 |
# dataset #13 path: /capstor/store/cscs/swissai/infra01/audio-datasets/tokenized/sft/tcm_shizhengpt_speech kind: tokenized | status: active samples: 58,415 (megatron idx) | size: 239.3 MB | files: 21 tree (truncated): ``` _STAGE_MANIFEST.json _SUCCESS sft_materialize_summary.json stage2/rank_0000_chunk_0000.bin stage2/rank_0000_chunk_0000.cut_ids.jsonl.zst stage2/rank_0000_chunk_0000.idx stage2/rank_0001_chunk_0000.bin stage2/rank_0001_chunk_0000.cut_ids.jsonl.zst stage2/rank_0001_chunk_0000.idx stage2/rank_0002_chunk_0000.bin stage2/rank_0002_chunk_0000.cut_ids.jsonl.zst stage2/rank_0002_chunk_0000.idx stage2/rank_0003_chunk_0000.bin stage2/rank_0003_chunk_0000.cut_ids.jsonl.zst stage2/rank_0003_chunk_0000.idx stage2/rank_0004_chunk_0000.bin stage2/rank_0004_chunk_0000.cut_ids.jsonl.zst stage2/rank_0004_chunk_0000.idx stage2/rank_0005_chunk_0000.bin stage2/rank_0005_chunk_0000.cut_ids.jsonl.zst stage2/rank_0005_chunk_0000.idx ```