| # | question_id | image | question | answer | segmentation | bbox | iscrowd | file_name |
|---|
1
|
491042
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"the man in yellow coat",
"Skiier in red pants."
]
|
[
386.1400146484375,
222.22000122070312,
397.9700012207031,
158.85000610351562,
436.8399963378906,
158.85000610351562,
422.4700012207031,
133.5,
406.4200134277344,
158.85000610351562,
382.760009765625,
143.63999938964844,
374.30999755859375,
140.25999450683594,
378.5299987792969,
137.72999572753906,
399.6600036621094,
130.1199951171875,
418.25,
110.69000244140625,
405.57000732421875,
87.02999877929688,
411.489990234375,
73.51000213623047,
423.32000732421875,
65.05999755859375,
443.6000061035156,
100.55000305175781,
462.17999267578125,
97.16999816894531,
464.7200012207031,
111.52999877929688,
477.3900146484375,
171.52000427246094,
481.6199951171875,
196.8699951171875,
509.5,
253.47999572753906,
510.3500061035156,
267.0,
479.0799865722656,
245.8800048828125,
468.94000244140625,
233.1999969482422,
446.1300048828125,
191.8000030517578,
419.94000244140625,
186.72999572753906,
419.94000244140625,
208.6999969482422,
420.7799987792969,
239.9600067138672
]
|
[
374.30999755859375,
65.05999755859375,
136.0399932861328,
201.94000244140625
]
|
0
|
COCO_train2014_000000380440_491042.jpg
|
2
|
398406
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"There is red colored truck in between the other trucks",
"A shiny red vintage pickup truck"
]
|
[
280.8800048828125,
306.05999755859375,
270.2200012207031,
307.0299987792969,
221.8000030517578,
288.6199951171875,
169.49000549316406,
267.32000732421875,
168.52999877929688,
279.9100036621094,
152.05999755859375,
299.2799987792969,
135.60000610351562,
291.5299987792969,
122.04000091552734,
277.9700012207031,
118.16000366210938,
249.8800048828125,
119.12999725341797,
239.22999572753906,
104.5999984741211,
236.32000732421875,
93.94999694824219,
218.88999938964844,
101.69999694824219,
143.33999633789062,
142.3800048828125,
151.08999633789062,
190.8000030517578,
149.16000366210938,
226.63999938964844,
153.02999877929688,
232.4499969482422,
154.0,
236.32000732421875,
100.7300033569336,
259.57000732421875,
87.16999816894531,
299.2799987792969,
89.11000061035156,
369.9800109863281,
83.29000091552734,
409.69000244140625,
88.13999938964844,
438.75,
108.4800033569336,
429.05999755859375,
115.26000213623047,
432.94000244140625,
156.89999389648438,
464.8999938964844,
161.75,
504.6099853515625,
170.4600067138672,
528.8200073242188,
185.9600067138672,
555.9400024414062,
214.0500030517578,
577.25,
225.6699981689453,
580.1599731445312,
246.00999450683594,
584.030029296875,
300.25,
594.6799926757812,
307.0299987792969,
598.5599975585938,
309.92999267578125,
494.9200134277344,
349.6400146484375,
427.1300048828125,
356.4200134277344,
376.760009765625,
355.45001220703125,
368.0400085449219,
373.8599853515625,
319.6199951171875,
359.3299865722656,
310.8999938964844,
351.5799865722656,
300.25,
307.0299987792969
]
|
[
93.94999694824219,
83.29000091552734,
504.6099853515625,
290.57000732421875
]
|
0
|
COCO_train2014_000000419645_398406.jpg
|
3
|
124383
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"A apple desktop computer",
"the white IMac computer that is also turned on"
]
|
[
349.82000732421875,
82.19000244140625,
486.1400146484375,
103.23999786376953,
471.1099853515625,
239.55999755859375,
338.79998779296875,
203.47999572753906
]
|
[
338.79998779296875,
82.19000244140625,
147.33999633789062,
157.3699951171875
]
|
0
|
COCO_train2014_000000478885_124383.jpg
|
4
|
192943
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"A girl wearing glasses and a pink shirt",
"an Asian girl with a pink shirt eating at the table"
]
|
[
45.20000076293945,
322.82000732421875,
57.040000915527344,
269.0,
75.33999633789062,
255.00999450683594,
99.01000213623047,
237.7899932861328,
102.23999786376953,
202.27999877929688,
115.16000366210938,
172.13999938964844,
144.22000122070312,
166.75999450683594,
160.36000061035156,
169.99000549316406,
184.0399932861328,
209.80999755859375,
192.64999389648438,
293.760009765625,
190.49000549316406,
315.2799987792969,
145.2899932861328,
345.4200134277344,
108.69999694824219,
346.489990234375,
106.55000305175781,
321.739990234375,
60.27000045776367,
326.0400085449219,
48.43000030517578,
326.0400085449219
]
|
[
45.20000076293945,
166.75999450683594,
147.4499969482422,
179.72999572753906
]
|
0
|
COCO_train2014_000000323240_192943.jpg
|
5
|
197196
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"WOMAN IN COVERALLS",
"a person wearing overalls"
]
|
[
519.0999755859375,
241.00999450683594,
525.9000244140625,
217.52999877929688,
526.52001953125,
209.49000549316406,
532.7000122070312,
199.61000061035156,
525.280029296875,
177.36000061035156,
526.52001953125,
145.22000122070312,
520.9600219726562,
140.27999877929688,
506.1199951171875,
158.82000732421875,
500.55999755859375,
172.4199981689453,
497.4700012207031,
169.3300018310547,
496.239990234375,
161.2899932861328,
512.9199829101562,
134.10000610351562,
512.9199829101562,
129.77999877929688,
528.989990234375,
110.0,
532.0800170898438,
100.7300033569336,
530.8400268554688,
90.83999633789062,
542.5800170898438,
82.80999755859375,
550.0,
87.75,
549.3800048828125,
103.81999969482422,
548.760009765625,
108.1500015258789,
564.8300170898438,
113.70999908447266,
568.5399780273438,
118.02999877929688,
570.3900146484375,
110.0,
570.3900146484375,
105.66999816894531,
577.1900024414062,
106.29000091552734,
579.0399780273438,
111.23999786376953,
579.0399780273438,
124.83000183105469,
578.4299926757812,
131.00999450683594,
572.25,
133.47999572753906,
561.739990234375,
134.10000610351562,
559.27001953125,
134.10000610351562,
559.27001953125,
166.85000610351562,
558.6500244140625,
184.77999877929688,
556.1799926757812,
188.47999572753906,
559.8900146484375,
207.02000427246094,
565.4500122070312,
229.27000427246094,
567.9199829101562,
236.07000732421875,
574.719970703125,
239.77999877929688,
570.3900146484375,
245.9600067138672,
566.0700073242188,
251.52000427246094,
556.1799926757812,
251.52000427246094,
556.7999877929688,
241.6300048828125,
554.3300170898438,
231.74000549316406,
546.2899780273438,
223.08999633789062,
540.1099853515625,
220.6199951171875,
532.7000122070312,
232.97999572753906,
536.4000244140625,
239.77999877929688,
535.1699829101562,
245.9600067138672,
519.719970703125,
241.6300048828125
]
|
[
496.239990234375,
82.80999755859375,
82.80000305175781,
168.7100067138672
]
|
0
|
COCO_train2014_000000041700_197196.jpg
|
6
|
443573
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"A man standing next to a young girl on a grassy hillside",
"A man in a black jacket."
]
|
[
401.54998779296875,
375.0,
401.54998779296875,
344.6700134277344,
399.8900146484375,
330.2099914550781,
390.42999267578125,
316.8699951171875,
384.8699951171875,
310.75,
380.42999267578125,
299.6300048828125,
377.0899963378906,
291.8500061035156,
379.8699951171875,
280.17999267578125,
379.8699951171875,
275.7300109863281,
376.5299987792969,
264.6099853515625,
375.9800109863281,
251.27000427246094,
378.20001220703125,
236.80999755859375,
387.6499938964844,
224.5800018310547,
389.8800048828125,
219.02000427246094,
386.5400085449219,
216.7899932861328,
389.8800048828125,
212.35000610351562,
394.3299865722656,
210.67999267578125,
397.6600036621094,
209.57000732421875,
398.7699890136719,
206.22999572753906,
401.0,
202.33999633789062,
404.8900146484375,
196.77999877929688,
410.45001220703125,
196.77999877929688,
420.4599914550781,
201.77999877929688,
423.7900085449219,
207.33999633789062,
421.57000732421875,
208.4600067138672,
421.010009765625,
209.00999450683594,
421.010009765625,
210.67999267578125,
421.010009765625,
212.89999389648438,
418.2300109863281,
216.24000549316406,
417.67999267578125,
217.91000366210938,
418.2300109863281,
220.1300048828125,
415.45001220703125,
223.47000122070312,
413.7799987792969,
226.25,
411.55999755859375,
229.02999877929688,
411.0,
232.36000061035156,
411.0,
237.9199981689453,
416.55999755859375,
259.6000061035156,
418.7900085449219,
262.3800048828125,
437.1400146484375,
274.05999755859375,
437.69000244140625,
281.2900085449219,
434.3599853515625,
281.2900085449219,
431.0199890136719,
281.8399963378906,
429.3500061035156,
284.239990234375,
423.239990234375,
281.2900085449219,
422.1199951171875,
281.8399963378906,
420.4599914550781,
284.6199951171875,
418.2300109863281,
291.8500061035156,
418.2300109863281,
301.29998779296875,
418.2300109863281,
307.4200134277344,
421.010009765625,
321.32000732421875,
423.7900085449219,
329.1000061035156,
424.8999938964844,
339.1099853515625,
426.0199890136719,
348.55999755859375,
427.1300048828125,
354.1199951171875,
430.4599914550781,
362.4599914550781,
432.1300048828125,
369.69000244140625,
430.4599914550781,
375.0,
404.3299865722656,
374.69000244140625
]
|
[
375.9800109863281,
196.77999877929688,
61.709999084472656,
178.22000122070312
]
|
0
|
COCO_train2014_000000274266_443573.jpg
|
7
|
594421
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"The adult giraffe.",
"A MOTHER GIRAFFE LICKICKING HER BABY."
]
|
[
73.22000122070312,
195.1999969482422,
119.5,
173.61000061035156,
142.1199951171875,
159.2100067138672,
157.0399932861328,
157.14999389648438,
204.33999633789062,
177.72000122070312,
239.30999755859375,
197.77000427246094,
260.3900146484375,
225.02999877929688,
275.29998779296875,
256.9100036621094,
281.989990234375,
262.04998779296875,
293.82000732421875,
259.4800109863281,
294.3299865722656,
263.5899963378906,
286.6199951171875,
272.8500061035156,
288.1600036621094,
277.4800109863281,
285.07000732421875,
284.6700134277344,
280.9599914550781,
289.29998779296875,
278.3900146484375,
311.4100036621094,
275.82000732421875,
313.9800109863281,
263.989990234375,
311.92999267578125,
263.4800109863281,
305.239990234375,
263.4800109863281,
294.44000244140625,
258.3399963378906,
278.5,
259.8800048828125,
266.67999267578125,
242.38999938964844,
240.97000122070312,
213.0800018310547,
215.25999450683594,
186.86000061035156,
203.94000244140625,
176.05999755859375,
208.05999755859375,
178.1199951171875,
217.8300018310547,
177.60000610351562,
225.5399932861328,
172.97999572753906,
236.85000610351562,
164.22999572753906,
256.3900146484375,
165.77999877929688,
292.3900146484375,
169.3800048828125,
319.1300048828125,
172.4600067138672,
339.510009765625,
165.77999877929688,
339.0,
154.97999572753906,
302.489990234375,
150.35000610351562,
273.17999267578125,
150.35000610351562,
251.5800018310547,
143.6699981689453,
267.010009765625,
142.1199951171875,
297.8599853515625,
142.1199951171875,
305.05999755859375,
136.97999572753906,
332.8299865722656,
136.97999572753906,
346.7099914550781,
128.75,
349.2799987792969,
131.3300018310547,
313.79998779296875,
127.7300033569336,
300.95001220703125,
126.69999694824219,
271.1199951171875,
128.75,
256.7200012207031,
115.9000015258789,
260.32000732421875,
95.33000183105469,
256.7200012207031,
89.16000366210938,
270.6099853515625,
82.98999786376953,
295.2900085449219,
82.4800033569336,
309.1700134277344,
81.95999908447266,
322.5400085449219,
82.98999786376953,
339.0,
74.76000213623047,
341.57000732421875,
73.22000122070312,
316.8900146484375,
70.12999725341797,
310.7200012207031,
67.05000305175781,
337.9700012207031,
67.55999755859375,
345.67999267578125,
61.90999984741211,
353.3999938964844,
56.7599983215332,
349.79998779296875,
61.90999984741211,
322.5400085449219,
64.4800033569336,
285.010009765625,
64.4800033569336,
275.75,
59.34000015258789,
269.5799865722656,
58.81999969482422,
287.05999755859375,
57.790000915527344,
308.6600036621094,
56.25,
322.0299987792969,
45.45000076293945,
318.94000244140625,
39.279998779296875,
301.9700012207031,
52.650001525878906,
273.17999267578125,
56.25,
264.95001220703125,
54.709999084472656,
247.47000122070312,
52.650001525878906,
227.92999267578125,
59.849998474121094,
233.07000732421875,
67.05000305175781,
234.61000061035156,
73.7300033569336,
238.2100067138672,
81.95999908447266,
235.1300048828125,
81.95999908447266,
228.9600067138672,
76.30000305175781,
222.27000427246094,
78.87999725341797,
220.2100067138672,
82.4800033569336,
218.6699981689453,
79.38999938964844,
209.92999267578125,
74.76000213623047,
203.25,
69.62000274658203,
196.55999755859375
]
|
[
39.279998779296875,
157.14999389648438,
255.0500030517578,
196.25
]
|
0
|
COCO_train2014_000000074060_594421.jpg
|
8
|
468642
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"A lady in blue t-shirt and white shorts sitting on a park bench.",
"A couple of friends are sitting on a bench and hanging out."
]
|
[
282.8800048828125,
337.4200134277344,
278.20001220703125,
334.94000244140625,
272.4100036621094,
331.6300048828125,
269.3800048828125,
326.1199951171875,
267.7300109863281,
320.8900146484375,
268.0,
298.8399963378906,
270.2099914550781,
283.69000244140625,
269.1000061035156,
274.5899963378906,
267.45001220703125,
270.4599914550781,
250.08999633789062,
267.9800109863281,
242.92999267578125,
266.3299865722656,
235.2100067138672,
259.989990234375,
228.32000732421875,
239.8699951171875,
227.22000122070312,
231.8800048828125,
222.80999755859375,
228.85000610351562,
213.1699981689453,
225.5399932861328,
218.67999267578125,
222.7899932861328,
219.77999877929688,
220.86000061035156,
221.16000366210938,
216.4499969482422,
223.36000061035156,
211.2100067138672,
220.61000061035156,
202.1199951171875,
218.39999389648438,
196.3300018310547,
210.9600067138672,
191.92999267578125,
199.94000244140625,
195.22999572753906,
193.8800048828125,
201.2899932861328,
191.6699981689453,
208.4600067138672,
195.80999755859375,
217.8300018310547,
197.4600067138672,
221.9600067138672,
198.83999633789062,
222.7899932861328,
199.11000061035156,
223.88999938964844,
190.02000427246094,
227.47000122070312,
183.9600067138672,
233.25999450683594,
182.85000610351562,
246.2100067138672,
186.7100067138672,
256.1300048828125,
190.85000610351562,
269.0799865722656,
193.8800048828125,
287.2699890136719,
197.4600067138672,
290.29998779296875,
210.1300048828125,
290.5799865722656,
218.39999389648438,
290.8500061035156,
228.60000610351562,
296.6400146484375,
228.8699951171875,
302.1499938964844,
234.3800048828125,
317.0299987792969,
241.82000732421875,
323.0899963378906,
248.16000366210938,
333.8399963378906,
253.6699981689453,
342.92999267578125,
257.25,
347.6199951171875,
261.6600036621094,
346.510009765625,
267.7300109863281,
344.0299987792969,
267.7300109863281,
340.45001220703125,
266.3500061035156,
338.25,
264.4200134277344,
335.2200012207031,
259.7300109863281,
329.42999267578125,
253.6699981689453,
323.3699951171875,
247.88999938964844,
311.5199890136719,
242.64999389648438,
300.2200012207031,
238.24000549316406,
288.6499938964844,
248.16000366210938,
288.9200134277344,
254.5,
287.82000732421875,
256.42999267578125,
288.6499938964844,
254.77000427246094,
296.9100036621094,
254.77000427246094,
307.3800048828125,
257.5299987792969,
318.4100036621094,
258.6300048828125,
323.3699951171875,
259.17999267578125,
327.7799987792969,
268.2799987792969,
338.25,
269.6499938964844,
341.2799987792969,
278.75,
341.8299865722656,
280.67999267578125,
339.6199951171875,
281.2300109863281,
338.79998779296875
]
|
[
182.85000610351562,
191.92999267578125,
100.02999877929688,
155.69000244140625
]
|
0
|
COCO_train2014_000000185558_468642.jpg
|
9
|
426270
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"A blonde woman in a white shirt and long black skirt.",
"There is one small girl wearing white top is touching the elephant"
]
|
[
85.05000305175781,
221.25999450683594,
122.5199966430664,
234.22999572753906,
135.5,
257.29998779296875,
128.2899932861328,
294.7699890136719,
123.95999908447266,
310.6300048828125,
123.95999908447266,
319.2799987792969,
129.72999572753906,
319.2799987792969,
147.02999877929688,
319.2799987792969,
171.52999877929688,
327.92999267578125,
229.19000244140625,
353.8699951171875,
229.19000244140625,
366.8500061035156,
216.22000122070312,
369.7300109863281,
200.36000061035156,
366.8500061035156,
177.3000030517578,
366.8500061035156,
149.91000366210938,
366.8500061035156,
141.25999450683594,
369.7300109863281,
172.97000122070312,
440.3599853515625,
174.41000366210938,
499.4599914550781,
171.52999877929688,
638.5599975585938,
59.099998474121094,
638.5599975585938,
50.45000076293945,
638.5599975585938,
56.220001220703125,
526.1300048828125,
61.97999954223633,
456.94000244140625,
64.86000061035156,
420.8999938964844,
49.0099983215332,
402.1600036621094,
40.36000061035156,
343.05999755859375,
41.79999923706055,
314.2300109863281,
43.2400016784668,
283.9599914550781,
44.68000030517578,
252.25,
59.099998474121094,
224.86000061035156,
82.16000366210938,
209.00999450683594,
96.58000183105469,
213.3300018310547
]
|
[
40.36000061035156,
209.00999450683594,
188.8300018310547,
429.54998779296875
]
|
0
|
COCO_train2014_000000566681_426270.jpg
|
10
|
399976
|
|
Please carefully observe the area circled in the image and come up with a caption for the area.
|
[
"The truck covered in the snow furthest to the right.",
"An old truck covered in snow except for the grill and door"
]
|
[
305.6499938964844,
373.3999938964844,
333.6300048828125,
299.1400146484375,
353.0,
284.07000732421875,
428.3399963378906,
265.7799987792969,
453.0899963378906,
237.7899932861328,
514.4400024414062,
224.8800048828125,
555.3400268554688,
225.9600067138672,
563.9500122070312,
215.19000244140625,
638.2100219726562,
213.0399932861328,
639.280029296875,
378.7799987792969,
588.7000122070312,
378.7799987792969,
585.469970703125,
386.30999755859375,
471.3900146484375,
387.3900146484375,
467.0899963378906,
401.3800048828125,
415.42999267578125,
409.989990234375,
401.42999267578125,
406.760009765625,
397.1300048828125,
392.7699890136719,
363.7699890136719,
403.5299987792969,
353.0,
411.07000732421875,
333.6300048828125,
406.760009765625,
328.25,
388.4700012207031,
308.8800048828125,
389.5400085449219
]
|
[
305.6499938964844,
213.0399932861328,
333.6300048828125,
198.02999877929688
]
|
0
|
COCO_train2014_000000410969_399976.jpg
|