#690

/capstor/store/cscs/swissai/infra01/vision-datasets/raw/sft/hf___allenai___pixmo-cap-qa

kind	parquet
status	active
samples	439,131
counted via	parquet footer
size	166.9 GB
files	26
first seen	2026-07-22 13:56
last seen	2026-07-22 13:56
registered	2026-07-22 13:56

# dataset #690
path: /capstor/store/cscs/swissai/infra01/vision-datasets/raw/sft/hf___allenai___pixmo-cap-qa
kind: parquet | status: active
samples: 439,131 (parquet footer) | size: 166.9 GB | files: 26

fields:
- image_url: text
- question: json
- answer: text
- messages: json

tree (truncated):
```
.cache/huggingface/.gitignore
.cache/huggingface/download/.gitattributes.metadata
.cache/huggingface/download/README.md.metadata
.cache/huggingface/download/data/train-00000-of-00001.parquet.metadata
.gitattributes
README.md
data/train-00000-of-00001.parquet
preprocessed/0000.parquet
preprocessed/0001.parquet
preprocessed/0002.parquet
preprocessed/0003.parquet
preprocessed/0004.parquet
preprocessed/0005.parquet
preprocessed/0006.parquet
preprocessed/0007.parquet
preprocessed/0008.parquet
preprocessed/0009.parquet
preprocessed/0010.parquet
preprocessed/0011.parquet
preprocessed/0012.parquet
preprocessed/0013.parquet
preprocessed/0014.parquet
preprocessed/0015.parquet
preprocessed/0016.parquet
preprocessed/0017.parquet
... (+1 more)
```

samples


[
  "Can you come up with a joke about this unconventional grilling setup using a toolbox?",
  "Sure! Here's a joke about the toolbox grill:\n\nWhy did the mechanic become a gourmet chef?\n\nBecause he realized his toolbox made the perfect \"well-oiled\" machine for grilling!\n\n(Ba dum tss!) \ud83d\ude04"
]
[
  "Sarah is on a kayaking trip. She brought 6 cans of her favorite soda, which have a distinctive black and green polka dot design. If Sarah has already consumed half of her sodas and there is one can visible in the cup holder, how many cans does Sarah have left unopened?",
  "Sarah has 2 cans of soda left unopened. We can see one can in the cup holder, which is described as \"a black can with green dots.\" Since Sarah brought 6 cans and has consumed half (3), there are 3 cans left. With one visible in the cup holder, that leaves 2 cans still unopened."
]
[
  "I have a caption for this image, but I think it might have some errors. Can you please correct any mistakes and rewrite it to be more accurate? Here's the original caption:",
  "The original caption has two main errors that need to be corrected. First, the currency denomination is not specified and may not be $10 bills. Second, the description of the second image being blurry is incorrect. Here's the corrected caption with a brief explanation:\n\nThe main changes are:\n1. Removed the specific denomination of the bills, as it's not clear from the description.\n2. Corrected the description of the second image, stating that it has more money but is not blurry.\n\nCorrected caption:\nA green tablecloth with a floral pattern. There are two bills on top of it in the first image, and more money in the second image which is clearer."
]
[
  "Is there a futuristic black car with electric blue lights in the image?",
  "Yes"
]
[
  "Are there white puffy clouds visible in the sky?",
  "Yes"
]
[
  "Is there a side mirror visible on the driver's side of the car?",
  "Yes"
]
[
  "Is there a traffic light hanging above the road in the image?",
  "No"
]
[
  "Is there a holographic display projecting from the car's dashboard?",
  "No"
]
[
  "Are there pedestrians walking on a sidewalk next to the road?",
  "No"
]
[
  "Imagine you're a student who just overheard this poll being discussed by teachers in the hallway. Write a short diary entry about your thoughts and concerns regarding this issue.",
  "Dear Diary,\n\nToday at school, I overheard something that really freaked me out. Some teachers were talking about a poll asking if they should be allowed to carry guns at school! I can't believe this is even a question. Part of me understands why people might think it could make us safer, but the idea of my math teacher packing heat is just bizarre.\n\nI keep imagining Mr. Johnson, who can barely work the projector, trying to handle a gun. What if there was an accident? Or what if a student somehow got hold of it? The whole thing seems so risky.\n\nI wish they'd focus on other ways to keep us safe, like better mental health support or stricter security at the entrances. The thought of guns in our classrooms just makes me feel more anxious, not safer.\n\nI hope this poll doesn't lead to anything. I want to feel safe at school, but not like this. It's hard enough to concentrate on algebra without wondering if there's a loaded weapon in the desk drawer.\n\nI think I'll talk to Mom and Dad about this tonight. Maybe they can help me understand why this is even being considered. For now, I just hope common sense prevails.\n\nUntil tomorrow,\n[Your Name]"
]

#	image_url	question	answer	messages
1	https://imgur.com/vY52gUr.png	`[USER]Can you come up with a joke about this unconventional grilling setup using a toolbox? [ASSISTANT]`	Sure! Here's a joke about the toolbox grill: Why did the mechanic become a gourmet chef? Because he realized his toolbox made the perfect "well-oiled" machine for grilling! (Ba dum tss!) 😄	`[ "Can you come up with a joke about this unconventional grilling setup using a toolbox?", "Sure! Here's a joke about the toolbox grill:\n\nWhy did the mechanic become a gourmet chef?\n\nBecause he realized his toolbox made the perfect \"well-oiled\" machine for grilling!\n\n(Ba dum tss!) \ud83d\ude04" ]`
2	https://i.redd.it/npxggvv64tb11.jpg	`[USER]Sarah is on a kayaking trip. She brought 6 cans of her favorite soda, which have a distinctive black and green polka dot design. If Sarah has already consumed half of her sodas and there is one can visible in the cup holder, how many cans does Sarah have left unopened? [ASSISTANT]`	Sarah has 2 cans of soda left unopened. We can see one can in the cup holder, which is described as "a black can with green dots." Since Sarah brought 6 cans and has consumed half (3), there are 3 cans left. With one visible in the cup holder, that leaves 2 cans still unopened.	[ "Sarah is on a kayaking trip. She brought 6 cans of her favorite soda, which have a distinctive black and green polka dot design. If Sarah has already consumed half of her sodas and there is one can visible in the cup holder, how many cans does Sarah have left unopened?", "Sarah has 2 cans of soda left unopened. We can see one can in the cup holder, which is described as \"a black can with green dots.\" Since Sarah brought 6 cans and has consumed half (3), there are 3 cans left. With one visible in the cup holder, that leaves 2 cans still unopened." ]
3	https://pixmo.s3.us-west-2.amazonaws.com/compare/something_something_v2/28633-seed1337-2HxW-480x427.jpg	`[USER]I have a caption for this image, but I think it might have some errors. Can you please correct any mistakes and rewrite it to be more accurate? Here's the original caption: A green tablecloth with a floral pattern. There are two $10 bills on top of it in the first image, and more money in the second image which is blurry. Please provide the corrected caption in the same format, and briefly explain the changes you made. [ASSISTANT]`	The original caption has two main errors that need to be corrected. First, the currency denomination is not specified and may not be $10 bills. Second, the description of the second image being blurry is incorrect. Here's the corrected caption with a brief explanation: The main changes are: 1. Removed the specific denomination of the bills, as it's not clear from the description. 2. Corrected the description of the second image, stating that it has more money but is not blurry. Corrected caption: A green tablecloth with a floral pattern. There are two bills on top of it in the first image, and more money in the second image which is clearer.	[ "I have a caption for this image, but I think it might have some errors. Can you please correct any mistakes and rewrite it to be more accurate? Here's the original caption:", "The original caption has two main errors that need to be corrected. First, the currency denomination is not specified and may not be $10 bills. Second, the description of the second image being blurry is incorrect. Here's the corrected caption with a brief explanation:\n\nThe main changes are:\n1. Removed the specific denomination of the bills, as it's not clear from the description.\n2. Corrected the description of the second image, stating that it has more money but is not blurry.\n\nCorrected caption:\nA green tablecloth with a floral pattern. There are two bills on top of it in the first image, and more money in the second image which is clearer." ]
4	https://fullycharged.show/wp-content/uploads/2019/05/Banner-blog-future-electric-car-design.jpg	`[USER]Is there a futuristic black car with electric blue lights in the image? [ASSISTANT]`	Yes	`[ "Is there a futuristic black car with electric blue lights in the image?", "Yes" ]`
5	https://fullycharged.show/wp-content/uploads/2019/05/Banner-blog-future-electric-car-design.jpg	`[USER]Are there white puffy clouds visible in the sky? [ASSISTANT]`	Yes	`[ "Are there white puffy clouds visible in the sky?", "Yes" ]`
6	https://fullycharged.show/wp-content/uploads/2019/05/Banner-blog-future-electric-car-design.jpg	`[USER]Is there a side mirror visible on the driver's side of the car? [ASSISTANT]`	Yes	`[ "Is there a side mirror visible on the driver's side of the car?", "Yes" ]`
7	https://fullycharged.show/wp-content/uploads/2019/05/Banner-blog-future-electric-car-design.jpg	`[USER]Is there a traffic light hanging above the road in the image? [ASSISTANT]`	No	`[ "Is there a traffic light hanging above the road in the image?", "No" ]`
8	https://fullycharged.show/wp-content/uploads/2019/05/Banner-blog-future-electric-car-design.jpg	`[USER]Is there a holographic display projecting from the car's dashboard? [ASSISTANT]`	No	`[ "Is there a holographic display projecting from the car's dashboard?", "No" ]`
9	https://fullycharged.show/wp-content/uploads/2019/05/Banner-blog-future-electric-car-design.jpg	`[USER]Are there pedestrians walking on a sidewalk next to the road? [ASSISTANT]`	No	`[ "Are there pedestrians walking on a sidewalk next to the road?", "No" ]`
10	https://i.redd.it/q40xkn9tk0z51.jpg	`[USER]Imagine you're a student who just overheard this poll being discussed by teachers in the hallway. Write a short diary entry about your thoughts and concerns regarding this issue. [ASSISTANT]`	Dear Diary, Today at school, I overheard something that really freaked me out. Some teachers were talking about a poll asking if they should be allowed to carry guns at school! I can't believe this is even a question. Part of me understands why people might think it could make us safer, but the idea of my math teacher packing heat is just bizarre. I keep imagining Mr. Johnson, who can barely work the projector, trying to handle a gun. What if there was an accident? Or what if a student somehow got hold of it? The whole thing seems so risky. I wish they'd focus on other ways to keep us safe, like better mental health support or stricter security at the entrances. The thought of guns in our classrooms just makes me feel more anxious, not safer. I hope this poll doesn't lead to anything. I want to feel safe at school, but not like this. It's hard enough to concentrate on algebra without wondering if there's a loaded weapon in the desk drawer. I think I'll talk to Mom and Dad about this tonight. Maybe they can help me understand why this is even being considered. For now, I just hope common sense prevails. Until tomorrow, [Your Name]	[ "Imagine you're a student who just overheard this poll being discussed by teachers in the hallway. Write a short diary entry about your thoughts and concerns regarding this issue.", "Dear Diary,\n\nToday at school, I overheard something that really freaked me out. Some teachers were talking about a poll asking if they should be allowed to carry guns at school! I can't believe this is even a question. Part of me understands why people might think it could make us safer, but the idea of my math teacher packing heat is just bizarre.\n\nI keep imagining Mr. Johnson, who can barely work the projector, trying to handle a gun. What if there was an accident? Or what if a student somehow got hold of it? The whole thing seems so risky.\n\nI wish they'd focus on other ways to keep us safe, like better mental health support or stricter security at the entrances. The thought of guns in our classrooms just makes me feel more anxious, not safer.\n\nI hope this poll doesn't lead to anything. I want to feel safe at school, but not like this. It's hard enough to concentrate on algebra without wondering if there's a loaded weapon in the desk drawer.\n\nI think I'll talk to Mom and Dad about this tonight. Maybe they can help me understand why this is even being considered. For now, I just hope common sense prevails.\n\nUntil tomorrow,\n[Your Name]" ]