#96

# dataset #96
path: /capstor/store/cscs/swissai/infra01/vision-datasets/tokenized/sft/gmai_vl_permissive
kind: tokenized | status: active
samples: 1,306,989 (megatron idx) | size: 2.9 GB | files: 50

tree (truncated):
```
dry_run_stats.json
lct/rank_0000_chunk_0000.bin
lct/rank_0000_chunk_0000.idx
lct/rank_0003_chunk_0000.bin
lct/rank_0003_chunk_0000.idx
lct/rank_0004_chunk_0000.bin
lct/rank_0004_chunk_0000.idx
merged.bin
merged.idx
rank_0000/_SUCCESS
rank_0000_checkpoint.pt
rank_0000_stats.json
rank_0001/_SUCCESS
rank_0001_checkpoint.pt
rank_0001_stats.json
rank_0002/_SUCCESS
rank_0002_checkpoint.pt
rank_0002_stats.json
rank_0003/_SUCCESS
rank_0003_checkpoint.pt
rank_0003_stats.json
rank_0004/_SUCCESS
rank_0004_checkpoint.pt
rank_0004_stats.json
rank_0005/_SUCCESS
... (+25 more)
```