#356
/capstor/store/cscs/swissai/infra01/audio-datasets/reality_gap/tokenized
| kind | tokenized |
|---|---|
| status | active |
| samples | 43,180,543 |
| counted via | megatron idx |
| size | 55.2 GB |
| files | 1,289 |
| first seen | 2026-07-22 13:39 |
| last seen | 2026-07-22 13:39 |
| registered | 2026-07-22 13:39 |
# dataset #356 path: /capstor/store/cscs/swissai/infra01/audio-datasets/reality_gap/tokenized kind: tokenized | status: active samples: 43,180,543 (megatron idx) | size: 55.2 GB | files: 1,289 tree (truncated): ``` real/transcribe/pl_cv25_real/.tokenize_start.json real/transcribe/pl_cv25_real/_SUCCESS real/transcribe/pl_cv25_real/_shar_work_manifest.json real/transcribe/pl_cv25_real/_tokenize_assignment.json real/transcribe/pl_cv25_real/rank_0000_chunk_0000.bin real/transcribe/pl_cv25_real/rank_0000_chunk_0000.cut_ids.jsonl.zst real/transcribe/pl_cv25_real/rank_0000_chunk_0000.idx real/transcribe/pl_cv25_real/rank_0000_stats.json real/transcribe/pl_cv25_real/rank_0001_chunk_0000.bin real/transcribe/pl_cv25_real/rank_0001_chunk_0000.cut_ids.jsonl.zst real/transcribe/pl_cv25_real/rank_0001_chunk_0000.idx real/transcribe/pl_cv25_real/rank_0001_stats.json real/transcribe/pl_cv25_real/rank_0002_chunk_0000.bin real/transcribe/pl_cv25_real/rank_0002_chunk_0000.cut_ids.jsonl.zst real/transcribe/pl_cv25_real/rank_0002_chunk_0000.idx real/transcribe/pl_cv25_real/rank_0002_stats.json real/transcribe/pl_cv25_real/rank_0003_chunk_0000.bin real/transcribe/pl_cv25_real/rank_0003_chunk_0000.cut_ids.jsonl.zst real/transcribe/pl_cv25_real/rank_0003_chunk_0000.idx real/transcribe/pl_cv25_real/rank_0003_stats.json real/transcribe/pl_cv25_real/stats_summary.json real/transcribe/pl_cv25_real/tokenize_state.json real/transcribe/pl_mls_real/.tokenize_start.json real/transcribe/pl_mls_real/_SUCCESS real/transcribe/pl_mls_real/_shar_work_manifest.json ... (+1,264 more) ```