#141

# dataset #141
path: /capstor/store/cscs/swissai/infra01/audio-datasets/tokenized/stage_1_rebuild
kind: tokenized | status: active
samples: 54,607,912 (megatron idx) | size: 451.1 GB | files: 2,579

tree (truncated):
```
audio_only/audioset_balanced/.tokenize_start.json
audio_only/audioset_balanced/_SUCCESS
audio_only/audioset_balanced/_shar_work_manifest.json
audio_only/audioset_balanced/_tokenize_assignment.json
audio_only/audioset_balanced/rank_0000_chunk_0000.bin
audio_only/audioset_balanced/rank_0000_chunk_0000.cut_ids.jsonl.zst
audio_only/audioset_balanced/rank_0000_chunk_0000.idx
audio_only/audioset_balanced/rank_0000_stats.json
audio_only/audioset_balanced/rank_0001_chunk_0000.bin
audio_only/audioset_balanced/rank_0001_chunk_0000.cut_ids.jsonl.zst
audio_only/audioset_balanced/rank_0001_chunk_0000.idx
audio_only/audioset_balanced/rank_0001_stats.json
audio_only/audioset_balanced/rank_0002_chunk_0000.bin
audio_only/audioset_balanced/rank_0002_chunk_0000.cut_ids.jsonl.zst
audio_only/audioset_balanced/rank_0002_chunk_0000.idx
audio_only/audioset_balanced/rank_0002_stats.json
audio_only/audioset_balanced/rank_0003_chunk_0000.bin
audio_only/audioset_balanced/rank_0003_chunk_0000.cut_ids.jsonl.zst
audio_only/audioset_balanced/rank_0003_chunk_0000.idx
audio_only/audioset_balanced/rank_0003_stats.json
audio_only/audioset_balanced/stats_summary.json
audio_only/audioset_balanced/tokenize_state.json
audio_only/audioset_unbalanced/.tokenize_start.json
audio_only/audioset_unbalanced/_SUCCESS
audio_only/audioset_unbalanced/_shar_work_manifest.json
... (+2,554 more)
```