| # | image_1 | image_2 | question | answer | objects_1 | objects_2 | num_objects_image_1 | num_objects_image_2 | question_template | answer_type | choices | num_choices | num_ground_truth_objects | real_or_synthetic | ground_truth_objects |
|---|
1
|
|
|
Which objects are present in both images? Select all choices that are true: A) teapot B) kitchenware C) basketball D) mouse E) shampoo F) hammer G) bowl H) cutting board I) football J) No objects are in common K) orb L) marker M) mallard (fake duck) N) dino O) calculator P) vase Q) cup. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
A, C, D, G, I, O, P, Q
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
8
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['teapot', 'kitchenware', 'basketball', 'mouse', 'shampoo', 'hammer', 'bowl', 'cutting board', 'football', 'No objects are in common', 'orb', 'marker', 'mallard (fake duck)', 'dino', 'calculator', 'vase', 'cup']
|
17
|
8
|
synthetic
|
teapot, basketball, mouse, bowl, football, calculator, vase, cup
|
2
|
|
|
Which objects are present in both images? Select all choices that are true: A) dino B) cup C) calculator D) vase E) orb F) marker G) football H) kitchenware I) hammer J) mallard (fake duck) K) cutting board L) bowl M) mouse N) shampoo O) basketball P) No objects are in common Q) teapot. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
B, C, D, G, L, M, O, Q
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
8
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['dino', 'cup', 'calculator', 'vase', 'orb', 'marker', 'football', 'kitchenware', 'hammer', 'mallard (fake duck)', 'cutting board', 'bowl', 'mouse', 'shampoo', 'basketball', 'No objects are in common', 'teapot']
|
17
|
8
|
synthetic
|
cup, calculator, vase, football, bowl, mouse, basketball, teapot
|
3
|
|
|
Which objects are present in both images? Select all choices that are true: A) kitchenware B) teapot C) cutting board D) football E) mouse F) cup G) hammer H) mallard (fake duck) I) dino J) basketball K) orb L) shampoo M) No objects are in common N) vase O) calculator P) bowl Q) marker. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
B, D, E, F, J, N, O, P
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
8
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['kitchenware', 'teapot', 'cutting board', 'football', 'mouse', 'cup', 'hammer', 'mallard (fake duck)', 'dino', 'basketball', 'orb', 'shampoo', 'No objects are in common', 'vase', 'calculator', 'bowl', 'marker']
|
17
|
8
|
synthetic
|
teapot, football, mouse, cup, basketball, vase, calculator, bowl
|
4
|
|
|
Which objects are present in both images? Select all choices that are true: A) cutting board B) kitchenware C) bowl D) dino E) marker F) orb G) mouse H) mallard (fake duck) I) shampoo J) cup K) basketball L) football M) No objects are in common N) vase O) hammer P) calculator Q) teapot. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
C, G, J, K, L, N, P, Q
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'mouse', 'orb', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
9
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['cutting board', 'kitchenware', 'bowl', 'dino', 'marker', 'orb', 'mouse', 'mallard (fake duck)', 'shampoo', 'cup', 'basketball', 'football', 'No objects are in common', 'vase', 'hammer', 'calculator', 'teapot']
|
17
|
8
|
synthetic
|
bowl, mouse, cup, basketball, football, vase, calculator, teapot
|
5
|
|
|
Which objects are present in both images? Select all choices that are true: A) bowl B) teapot C) orb D) hammer E) cup F) cutting board G) football H) calculator I) No objects are in common J) shampoo K) vase L) mallard (fake duck) M) kitchenware N) basketball O) dino P) mouse Q) marker. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
A, B, E, G, H, K, N, P
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'mouse', 'orb', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
9
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['bowl', 'teapot', 'orb', 'hammer', 'cup', 'cutting board', 'football', 'calculator', 'No objects are in common', 'shampoo', 'vase', 'mallard (fake duck)', 'kitchenware', 'basketball', 'dino', 'mouse', 'marker']
|
17
|
8
|
synthetic
|
bowl, teapot, cup, football, calculator, vase, basketball, mouse
|
6
|
|
|
Which objects are present in both images? Select all choices that are true: A) No objects are in common B) marker C) basketball D) mouse E) mallard (fake duck) F) cutting board G) hammer H) cup I) teapot J) calculator K) football L) orb M) kitchenware N) shampoo O) bowl P) vase Q) dino. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
C, D, H, I, J, K, O, P
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'mouse', 'orb', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
9
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['No objects are in common', 'marker', 'basketball', 'mouse', 'mallard (fake duck)', 'cutting board', 'hammer', 'cup', 'teapot', 'calculator', 'football', 'orb', 'kitchenware', 'shampoo', 'bowl', 'vase', 'dino']
|
17
|
8
|
synthetic
|
basketball, mouse, cup, teapot, calculator, football, bowl, vase
|
7
|
|
|
Which objects are present in both images? Select all choices that are true: A) mouse B) basketball C) calculator D) football E) hammer F) cutting board G) shampoo H) dino I) vase J) teapot K) No objects are in common L) kitchenware M) bowl N) marker O) mallard (fake duck) P) orb Q) cup. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
A, B, C, D, I, J, M, Q
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'mouse', 'orb', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
9
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['mouse', 'basketball', 'calculator', 'football', 'hammer', 'cutting board', 'shampoo', 'dino', 'vase', 'teapot', 'No objects are in common', 'kitchenware', 'bowl', 'marker', 'mallard (fake duck)', 'orb', 'cup']
|
17
|
8
|
synthetic
|
mouse, basketball, calculator, football, vase, teapot, bowl, cup
|
8
|
|
|
Which objects are present in both images? Select all choices that are true: A) dino B) cutting board C) orb D) bowl E) vase F) football G) basketball H) hammer I) shampoo J) mallard (fake duck) K) cup L) teapot M) marker N) calculator O) kitchenware P) mouse Q) No objects are in common. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
D, E, F, G, K, L, N, P
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'kitchenware', 'mouse', 'orb', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
10
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['dino', 'cutting board', 'orb', 'bowl', 'vase', 'football', 'basketball', 'hammer', 'shampoo', 'mallard (fake duck)', 'cup', 'teapot', 'marker', 'calculator', 'kitchenware', 'mouse', 'No objects are in common']
|
17
|
8
|
synthetic
|
bowl, vase, football, basketball, cup, teapot, calculator, mouse
|
9
|
|
|
Which objects are present in both images? Select all choices that are true: A) mallard (fake duck) B) bowl C) mouse D) basketball E) kitchenware F) marker G) cup H) calculator I) dino J) No objects are in common K) orb L) hammer M) shampoo N) cutting board O) teapot P) football Q) vase. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
B, C, D, G, H, O, P, Q
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'kitchenware', 'mouse', 'orb', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
10
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['mallard (fake duck)', 'bowl', 'mouse', 'basketball', 'kitchenware', 'marker', 'cup', 'calculator', 'dino', 'No objects are in common', 'orb', 'hammer', 'shampoo', 'cutting board', 'teapot', 'football', 'vase']
|
17
|
8
|
synthetic
|
bowl, mouse, basketball, cup, calculator, teapot, football, vase
|
10
|
|
|
Which objects are present in both images? Select all choices that are true: A) mouse B) kitchenware C) shampoo D) calculator E) orb F) vase G) football H) dino I) No objects are in common J) cutting board K) bowl L) teapot M) marker N) hammer O) basketball P) cup Q) mallard (fake duck). You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
A, D, F, G, K, L, O, P
|
['bowl', 'basketball', 'mouse', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
['bowl', 'basketball', 'kitchenware', 'mouse', 'orb', 'vase', 'cup', 'teapot', 'calculator', 'football']
|
8
|
10
|
Which objects are present in both images? Select all choices that are true: {}. You can think of your answer in any way (e.g. step-by-step) but for the last line of your response, respond only in this format 'Answer: <letter 1> <letter 2> <letter 3>', e.g. 'Answer: A, B, C'.
|
with-letters
|
['mouse', 'kitchenware', 'shampoo', 'calculator', 'orb', 'vase', 'football', 'dino', 'No objects are in common', 'cutting board', 'bowl', 'teapot', 'marker', 'hammer', 'basketball', 'cup', 'mallard (fake duck)']
|
17
|
8
|
synthetic
|
mouse, calculator, vase, football, bowl, teapot, basketball, cup
|