#771

# dataset #771
path: /capstor/store/cscs/swissai/infra01/vision-datasets/tokenized/interleave/molmo_syn_multiimage
kind: parquet | status: active
samples: 1,895,870 (parquet footer) | size: 22.0 GB | files: 197

fields:
- document_id: int
- component_index: int
- kind: int
- token_offset: int
- token_length: int
- token_hash: text
- resize_height: int
- resize_width: int

tree (truncated):
```
rank_0000/_SUCCESS
rank_0000/components.000000.parquet
rank_0000/components.000001.parquet
rank_0000/components.000002.parquet
rank_0000/components.000003.parquet
rank_0000/tokens.000000.bin
rank_0000/tokens.000001.bin
rank_0000/tokens.000002.bin
rank_0000/tokens.000003.bin
rank_0000/worker_stats.json
rank_0000_checkpoint.pt
rank_0000_stats.json
rank_0001/_SUCCESS
rank_0001/components.000000.parquet
rank_0001/components.000001.parquet
rank_0001/components.000002.parquet
rank_0001/components.000003.parquet
rank_0001/tokens.000000.bin
rank_0001/tokens.000001.bin
rank_0001/tokens.000002.bin
rank_0001/tokens.000003.bin
rank_0001/worker_stats.json
rank_0001_checkpoint.pt
rank_0001_stats.json
rank_0002/_SUCCESS
... (+172 more)
```

samples

1

122

8

0

0

5767

57272c9c45193c84

912

1600

2

146

10

0

23068

5767

87feffc8ba4bd2c4

912

1600

3

147

1

1

46136

555

aaa5e28d17241953

0

0

4

147

3

1

48356

593

55914993f9cf0efe

0

0

5

147

5

1

50728

573

776e8c7496078da4

0

0

6

147

7

1

53020

614

34f6709656782e07

0

0

7

147

9

1

55476

556

a80650a17d665290

0

0

8

147

11

1

57700

609

965a1c413221fda2

0

0

9

147

13

1

60136

644

157c8ca4a2f387c6

0

0

10

147

15

1

62712

625

884afded5fbc48b6

0

0