| # | question_id | image | question | answer | segmentation | bbox | iscrowd | file_name |
|---|
1
|
1313895
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"guy holding purp umbrella in corner near us",
"black shirt person holding umbrella",
"man in black shirt and jeans"
]
|
[
118.6500015258789,
472.1199951171875,
57.16999816894531,
472.1199951171875,
44.220001220703125,
467.80999755859375,
38.83000183105469,
461.3299865722656,
38.83000183105469,
437.6000061035156,
39.90999984741211,
419.2699890136719,
49.619998931884766,
399.8500061035156,
58.25,
375.0400085449219,
66.87999725341797,
359.94000244140625,
66.87999725341797,
351.30999755859375,
66.87999725341797,
350.2300109863281,
62.560001373291016,
350.2300109863281,
51.779998779296875,
362.1000061035156,
37.75,
376.1199951171875,
22.649999618530273,
381.510009765625,
17.260000228881836,
381.510009765625,
15.100000381469727,
379.3599853515625,
8.630000114440918,
370.7300109863281,
5.389999866485596,
363.17999267578125,
3.240000009536743,
340.5199890136719,
18.34000015258789,
340.5199890136719,
46.380001068115234,
316.7900085449219,
53.93000030517578,
307.0899963378906,
64.72000122070312,
291.989990234375,
65.80000305175781,
274.7300109863281,
64.72000122070312,
260.70001220703125,
72.2699966430664,
243.4499969482422,
76.58000183105469,
235.89999389648438,
81.9800033569336,
230.5,
83.05999755859375,
212.16000366210938,
73.3499984741211,
213.24000549316406,
69.02999877929688,
200.3000030517578,
61.47999954223633,
181.9600067138672,
61.47999954223633,
174.41000366210938,
70.11000061035156,
164.6999969482422,
83.05999755859375,
160.38999938964844,
97.08000183105469,
159.30999755859375,
110.0199966430664,
163.6300048828125,
115.41999816894531,
177.64999389648438,
115.41999816894531,
186.27999877929688,
116.48999786376953,
205.69000244140625,
118.6500015258789,
213.24000549316406,
132.6699981689453,
219.72000122070312,
138.07000732421875,
218.63999938964844,
151.00999450683594,
221.8699951171875,
153.1699981689453,
234.82000732421875,
159.63999938964844,
288.75,
159.63999938964844,
311.3999938964844,
157.47999572753906,
345.9200134277344,
158.55999755859375,
381.510009765625,
156.39999389648438,
396.6099853515625,
141.3000030517578,
421.4200134277344,
125.12000274658203,
435.45001220703125,
112.18000030517578,
451.6300048828125,
115.41999816894531,
461.3299865722656,
122.97000122070312,
467.80999755859375
]
|
[
3.240000009536743,
159.30999755859375,
156.39999389648438,
312.80999755859375
]
|
0
|
COCO_train2014_000000581282_10.jpg
|
2
|
2151630
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"guy in blue hat & jacket",
"man",
"man on bench"
]
|
[
468.9100036621094,
241.22000122070312,
480.45001220703125,
246.50999450683594,
500.1499938964844,
294.55999755859375,
480.45001220703125,
304.6499938964844,
471.79998779296875,
311.8500061035156,
457.8599853515625,
315.70001220703125,
462.6700134277344,
304.6499938964844,
472.760009765625,
309.92999267578125,
473.7200012207031,
304.1700134277344,
454.0199890136719,
295.0400085449219,
453.5400085449219,
299.3599853515625,
455.94000244140625,
304.6499938964844,
452.1000061035156,
317.1400146484375,
446.3299865722656,
320.5,
449.69000244140625,
323.8699951171875,
444.4100036621094,
337.32000732421875,
439.6000061035156,
334.44000244140625,
426.1499938964844,
341.1600036621094,
423.2699890136719,
351.7300109863281,
413.6600036621094,
378.1600036621094,
414.6199951171875,
392.5799865722656,
413.17999267578125,
394.0199890136719,
414.6199951171875,
401.2300109863281,
409.80999755859375,
404.1099853515625,
406.92999267578125,
403.1499938964844,
401.6400146484375,
408.42999267578125,
385.7900085449219,
406.989990234375,
386.75,
399.29998779296875,
393.0,
394.5,
398.760009765625,
381.0400085449219,
398.2799987792969,
334.9200134277344,
401.6400146484375,
320.9800109863281,
393.9599914550781,
294.55999755859375,
396.3599853515625,
273.4100036621094,
404.5299987792969,
247.47000122070312,
426.6300048828125,
234.00999450683594,
433.8399963378906,
221.52000427246094,
435.2799987792969,
213.8300018310547,
440.0799865722656,
208.07000732421875,
452.5799865722656,
208.07000732421875,
459.29998779296875,
213.8300018310547,
463.6300048828125,
224.39999389648438,
469.3900146484375,
238.82000732421875
]
|
[
385.7900085449219,
208.07000732421875,
123.97000122070312,
205.1699981689453
]
|
0
|
COCO_train2014_000000580668_5.jpg
|
3
|
428963
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"yellow boots",
"brown boots",
"yellow boots"
]
|
[
177.47999572753906,
397.8999938964844,
177.47999572753906,
397.8999938964844,
183.3800048828125,
397.8999938964844,
204.7100067138672,
399.7099914550781,
203.8000030517578,
394.2699890136719,
201.52999877929688,
386.1000061035156,
197.89999389648438,
376.57000732421875,
197.0,
370.6700134277344,
192.4600067138672,
356.6000061035156,
191.10000610351562,
349.3399963378906,
189.27999877929688,
341.1700134277344,
188.8300018310547,
338.0,
190.19000244140625,
335.2699890136719,
195.63999938964844,
333.0,
197.4499969482422,
333.0,
211.05999755859375,
333.0,
219.69000244140625,
333.0,
226.9499969482422,
331.6400146484375,
234.66000366210938,
329.3699951171875,
238.75,
329.3699951171875,
254.6300048828125,
329.3699951171875,
261.44000244140625,
325.2900085449219,
265.07000732421875,
311.6700134277344,
261.8900146484375,
281.2699890136719,
260.9800109863281,
275.3699951171875,
257.3500061035156,
268.1099853515625,
256.45001220703125,
252.22999572753906,
255.99000549316406,
244.9600067138672,
252.82000732421875,
239.97000122070312,
243.2899932861328,
231.8000030517578,
240.55999755859375,
231.35000610351562,
239.1999969482422,
224.5399932861328,
239.1999969482422,
218.63999938964844,
219.69000244140625,
207.3000030517578,
212.8800048828125,
208.66000366210938,
207.42999267578125,
211.83999633789062,
204.25999450683594,
224.08999633789062,
204.25999450683594,
227.27000427246094,
199.72000122070312,
231.8000030517578,
192.4600067138672,
235.88999938964844,
185.64999389648438,
241.3300018310547,
183.83999633789062,
244.50999450683594,
177.47999572753906,
246.77999877929688,
170.67999267578125,
247.22999572753906,
164.32000732421875,
253.58999633789062,
162.9600067138672,
262.6600036621094,
162.9600067138672,
268.55999755859375,
162.9600067138672,
279.0,
161.14999389648438,
285.3500061035156,
156.14999389648438,
290.79998779296875,
155.25,
297.6099853515625,
155.25,
298.05999755859375,
152.97999572753906,
306.67999267578125,
152.52000427246094,
308.5,
156.14999389648438,
312.5799865722656,
155.25,
318.0299987792969,
154.7899932861328,
324.8299865722656,
154.7899932861328,
329.3699951171875,
152.07000732421875,
340.260009765625,
151.6199951171875,
346.6199951171875,
148.44000244140625,
354.7900085449219,
143.89999389648438,
365.2200012207031,
136.19000244140625,
369.760009765625,
131.64999389648438,
372.4800109863281,
127.11000061035156,
374.29998779296875,
125.75,
378.8399963378906,
127.55999755859375,
380.6499938964844,
133.9199981689453,
381.1099853515625,
143.4499969482422,
382.9200134277344,
152.52000427246094,
383.3800048828125,
158.8800048828125,
383.3800048828125,
162.9600067138672,
383.3800048828125,
166.58999633789062,
378.8399963378906,
166.58999633789062,
372.0299987792969,
167.5,
365.67999267578125,
168.41000366210938,
358.8699951171875,
170.67999267578125,
354.7900085449219,
175.2100067138672,
361.5899963378906,
175.6699981689453,
367.95001220703125,
174.30999755859375,
378.3800048828125,
173.39999389648438,
381.55999755859375,
168.41000366210938,
386.54998779296875,
162.0500030517578,
390.17999267578125,
158.8800048828125,
391.0899963378906,
161.60000610351562,
395.6300048828125,
165.67999267578125,
395.6300048828125,
175.2100067138672,
396.989990234375,
175.2100067138672,
396.989990234375,
179.75,
397.44000244140625,
181.57000732421875,
397.8999938964844
]
|
[
125.75,
207.3000030517578,
139.32000732421875,
192.41000366210938
]
|
0
|
COCO_train2014_000000580668_2.jpg
|
4
|
356741
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"dark car",
"blue car in back of the man with hat"
]
|
[
317.0799865722656,
326.6300048828125,
315.1700134277344,
316.1199951171875,
329.489990234375,
296.07000732421875,
338.0899963378906,
285.55999755859375,
338.0899963378906,
272.19000244140625,
398.260009765625,
274.1000061035156,
394.44000244140625,
300.8399963378906,
406.8500061035156,
313.260009765625,
398.260009765625,
327.5799865722656,
320.8999938964844,
327.5799865722656
]
|
[
315.1700134277344,
166.17999267578125,
324.8299865722656,
226.35000610351562
]
|
0
|
COCO_train2014_000000580668_1.jpg
|
5
|
344471
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"white car",
"white car",
"The white car"
]
|
[
0.0,
358.75,
3.0799999237060547,
179.60000610351562,
4.980000019073486,
173.8800048828125,
13.5600004196167,
171.97999572753906,
18.31999969482422,
169.1199951171875,
54.529998779296875,
163.39999389648438,
74.54000091552734,
164.35000610351562,
90.73999786376953,
167.2100067138672,
117.43000030517578,
170.07000732421875,
140.3000030517578,
171.02999877929688,
166.02000427246094,
167.2100067138672,
190.8000030517578,
171.02999877929688,
198.4199981689453,
171.97999572753906,
205.08999633789062,
182.4600067138672,
211.75999450683594,
193.89999389648438,
212.72000122070312,
206.27999877929688,
212.72000122070312,
208.19000244140625,
206.0500030517578,
216.77000427246094,
194.61000061035156,
231.05999755859375,
178.41000366210938,
240.58999633789062,
168.8800048828125,
249.16000366210938,
156.5,
261.54998779296875,
156.5,
283.4700012207031,
154.58999633789062,
296.80999755859375,
150.77999877929688,
310.1499938964844,
150.77999877929688,
327.29998779296875,
159.35000610351562,
341.6000061035156,
159.35000610351562,
355.8900146484375,
154.58999633789062,
361.6099853515625,
145.05999755859375,
372.0899963378906,
132.6699981689453,
375.8999938964844,
128.86000061035156,
376.8500061035156,
126.95999908447266,
375.8999938964844,
127.91000366210938,
366.3699951171875,
128.86000061035156,
361.6099853515625,
128.86000061035156,
357.79998779296875,
121.23999786376953,
356.8399963378906,
113.61000061035156,
364.4700012207031,
90.73999786376953,
367.3299865722656,
69.77999877929688,
364.4700012207031,
45.959999084472656,
361.6099853515625,
24.989999771118164,
362.55999755859375,
4.03000020980835,
363.510009765625,
0.2199999988079071,
363.510009765625,
0.0,
361.6099853515625
]
|
[
0.0,
163.39999389648438,
212.72000122070312,
213.4499969482422
]
|
0
|
COCO_train2014_000000580668_0.jpg
|
6
|
1219171
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"man out of frame",
"blue shirted arm",
"man in blue shirt halfway on screen"
]
|
[
251.77000427246094,
302.510009765625,
229.75,
237.41000366210938,
213.47999572753906,
186.6699981689453,
178.05999755859375,
162.74000549316406,
150.3000030517578,
153.1699981689453,
150.3000030517578,
143.60000610351562,
126.36000061035156,
143.60000610351562,
117.75,
345.5899963378906,
154.1300048828125,
352.2900085449219,
196.25,
339.8399963378906,
197.1999969482422,
300.5899963378906,
217.30999755859375,
289.1099853515625,
236.4499969482422,
304.4200134277344
]
|
[
117.75,
143.60000610351562,
134.02000427246094,
208.69000244140625
]
|
0
|
COCO_train2014_000000577725_3.jpg
|
7
|
205480
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"man on TV",
"white guy on tv",
"man on cscreen"
]
|
[
245.07000732421875,
313.0400085449219,
240.27999877929688,
320.70001220703125,
239.3300018310547,
325.4800109863281,
252.72999572753906,
336.010009765625,
260.3900146484375,
341.760009765625,
269.0,
341.760009765625,
277.6199951171875,
341.760009765625,
291.9800109863281,
336.010009765625,
329.30999755859375,
315.9100036621094,
336.010009765625,
336.010009765625,
363.7799987792969,
336.010009765625,
360.8999938964844,
348.4599914550781,
393.45001220703125,
357.07000732421875,
408.7699890136719,
358.0299987792969,
433.6600036621094,
363.7799987792969,
461.4200134277344,
366.6499938964844,
502.5799865722656,
363.7799987792969,
503.5400085449219,
363.7799987792969,
501.6300048828125,
314.95001220703125,
494.92999267578125,
300.5899963378906,
497.79998779296875,
279.5299987792969,
497.79998779296875,
265.1700134277344,
463.3299865722656,
257.510009765625,
440.3599853515625,
245.07000732421875,
428.8699951171875,
238.3699951171875,
445.1499938964844,
231.6699981689453,
447.05999755859375,
197.1999969482422,
433.6600036621094,
183.8000030517578,
402.07000732421875,
173.27000427246094,
378.1300048828125,
169.44000244140625,
358.0299987792969,
204.86000061035156,
354.20001220703125,
220.17999267578125,
358.0299987792969,
227.83999633789062,
367.6000061035156,
244.11000061035156,
370.4800109863281,
244.11000061035156,
330.2699890136719,
249.86000061035156,
323.57000732421875,
258.4700012207031,
317.82000732421875,
269.0,
306.3399963378906,
278.5799865722656,
292.92999267578125,
291.9800109863281,
285.2799987792969,
298.67999267578125,
278.5799865722656,
303.4700012207031,
259.42999267578125,
307.2900085449219,
249.86000061035156,
312.0799865722656
]
|
[
239.3300018310547,
169.44000244140625,
264.2099914550781,
197.2100067138672
]
|
0
|
COCO_train2014_000000577725_1.jpg
|
8
|
476773
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"blue shirt",
"blue",
"blue shirt lady"
]
|
[
178.6999969482422,
472.8900146484375,
173.55999755859375,
436.94000244140625,
148.91000366210938,
350.6499938964844,
149.92999267578125,
313.6700134277344,
138.6300048828125,
243.80999755859375,
120.13999938964844,
262.30999755859375,
108.83999633789062,
248.9499969482422,
99.58999633789062,
216.0800018310547,
83.16000366210938,
195.52999877929688,
67.75,
184.22999572753906,
61.59000015258789,
164.7100067138672,
85.20999908447266,
164.7100067138672,
115.01000213623047,
181.14999389648438,
130.41000366210938,
177.0399932861328,
133.49000549316406,
152.3800048828125,
136.5800018310547,
114.37000274658203,
142.74000549316406,
85.61000061035156,
172.52999877929688,
77.38999938964844,
197.19000244140625,
85.61000061035156,
207.4600067138672,
116.43000030517578,
203.35000610351562,
154.44000244140625,
245.47000122070312,
173.9499969482422,
260.8800048828125,
235.58999633789062,
279.3699951171875,
311.6099853515625,
263.9599914550781,
299.2799987792969,
238.27000427246094,
251.0,
250.60000610351562,
309.55999755859375,
217.74000549316406,
410.2300109863281,
217.74000549316406,
446.17999267578125,
223.89999389648438,
480.0,
182.80999755859375,
480.0
]
|
[
61.59000015258789,
77.38999938964844,
217.77999877929688,
402.6099853515625
]
|
0
|
COCO_train2014_000000576322_5.jpg
|
9
|
2206523
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"black shirt",
"man in blackjacket holding skate board",
"man with skateboard"
]
|
[
382.5799865722656,
304.05999755859375,
384.6400146484375,
283.4200134277344,
389.79998779296875,
273.6199951171875,
392.8999938964844,
259.69000244140625,
386.19000244140625,
242.6699981689453,
385.1600036621094,
213.77999877929688,
382.05999755859375,
201.91000366210938,
356.2699890136719,
220.47999572753906,
335.1199951171875,
218.4199981689453,
326.8599853515625,
213.25999450683594,
321.19000244140625,
209.1300048828125,
318.0899963378906,
199.85000610351562,
322.2200012207031,
189.00999450683594,
323.7699890136719,
187.41000366210938,
335.1199951171875,
190.50999450683594,
338.2099914550781,
192.05999755859375,
341.82000732421875,
189.47999572753906,
362.4599914550781,
169.8699951171875,
378.9700012207031,
136.86000061035156,
411.9800109863281,
106.94000244140625,
421.7900085449219,
103.31999969482422,
430.55999755859375,
100.73999786376953,
427.9800109863281,
93.5199966430664,
424.8800048828125,
85.2699966430664,
428.489990234375,
62.56999969482422,
437.7799987792969,
50.189998626708984,
455.8299865722656,
44.0,
465.6400146484375,
50.70000076293945,
470.7900085449219,
62.56999969482422,
472.8599853515625,
74.94999694824219,
474.4100036621094,
85.2699966430664,
472.8599853515625,
97.12999725341797,
467.70001220703125,
107.44999694824219,
472.8599853515625,
110.02999877929688,
492.9800109863281,
126.54000091552734,
506.3900146484375,
138.9199981689453,
517.739990234375,
179.16000366210938,
517.739990234375,
223.52000427246094,
511.0299987792969,
269.95001220703125,
506.9100036621094,
269.95001220703125,
497.1000061035156,
262.7300109863281,
492.9800109863281,
263.25,
488.3299865722656,
269.95001220703125,
486.7900085449219,
286.4599914550781,
488.3299865722656,
309.67999267578125,
482.1400146484375,
330.8299865722656,
473.8900146484375,
360.2300109863281,
458.4100036621094,
416.9800109863281,
454.79998779296875,
430.9100036621094,
451.19000244140625,
449.4800109863281,
455.8299865722656,
464.44000244140625,
441.3900146484375,
474.239990234375,
419.2099914550781,
480.0,
399.0899963378906,
479.3999938964844,
413.5299987792969,
464.9599914550781,
415.5899963378906,
449.4800109863281,
407.3399963378906,
440.7099914550781,
394.9599914550781,
411.30999755859375,
383.6099853515625,
374.1600036621094,
375.8699951171875,
335.989990234375,
380.510009765625,
314.32000732421875
]
|
[
318.0899963378906,
44.0,
199.64999389648438,
436.0
]
|
0
|
COCO_train2014_000000576322_17.jpg
|
10
|
510855
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"woman white hair",
"old lady in white",
"old lady"
]
|
[
236.66000366210938,
250.44000244140625,
187.91000366210938,
240.1199951171875,
209.6999969482422,
212.58999633789062,
195.3699951171875,
205.7100067138672,
191.35000610351562,
182.1999969482422,
187.33999633789062,
169.00999450683594,
197.66000366210938,
156.97000122070312,
225.19000244140625,
159.8300018310547,
237.8000030517578,
174.1699981689453,
236.0800018310547,
203.4199981689453,
243.5399932861328,
220.0500030517578,
240.6699981689453,
244.13999938964844
]
|
[
171.27999877929688,
156.97000122070312,
72.26000213623047,
332.6099853515625
]
|
0
|
COCO_train2014_000000576286_4.jpg
|