PROVE Explorer
An outdoor daytime angled down medium shot front view of two chairs that are in the shape of a cupped human hand. Both of the chairs have the thumbs located to the right of them, and both have a square shaped base. The chair on the left is colored pink and the chair on the right is colored green. The chairs are placed on a cement ground floor that spans from left to right and is made up of large square cement tiles. The cement ground floor has been slightly weathered down with visible dark markings spread throughout its surface. There is a large brown colored rock wall behind the chairs that has a rigid surface.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'ground floor' in entity:
3 return scene_graph.get_attributes(entity).get('material', "")
4 return None
5
0 def execute_command(scene_graph):
1 return 'shaped like a cupped human hand'
2
An outdoor angled down view of several black trash bags placed side by side and stacked on top of each other, the trash bag towards the bottom right is placed on top of a wooden beam and several cylindrical cans, there is a pair of gray tennis shoes placed on top of that same bag. The rest of the trash bags are placed on a muddy dirt floor, to the left of the bags is a patch of tall green grass and roots, to the right of trash bags are two white pillars staked into a tiled platform.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'pair of gray tennis shoes' in entity:
3 in_relations = scene_graph.get_incoming_relations(entity)
4 for source, relation in in_relations.items():
5 if 'on top of' in relation.get('spatial', ''):
6 return
scene_graph.describe(scene_graph.generate_subgraph([source]))
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'trash bags' in entity:
3 return scene_graph.get_attributes(entity).get('state', '')
4 return None
5
A close-up view of a backpack. The backpack is covered by an image of stars. A black rectangular patch is sewn into the backpack on the right side of the image. On the patch is white text with thin red outlining that reads "trans" the bottom of the "s" extends to the left below the "n". To the left of the bottom of the "s" is text that reads "by JANSPORT" the "by" is written in small white text, the "JANSPORT" is written in larger red letters with white outlining. There is a bee on the left side of the image on the backpack.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'bee' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'backpack' in relations and 'left side of the image' in
relations:
5 return 'The bee is located on the left side of the image on
the backpack.'
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'text' in entity:
3 attrs = scene_graph.get_attributes(entity)
4 state = attrs.get('state', '')
5 color = attrs.get('color', '')
6 size = attrs.get('size', '')
7 if 'thin outlining' in state:
8 return ('The text on the patch has thin outlining, with
"trans" extending below the "n". '
9 'The "by" is small and white, while "JANSPORT" is
larger, red, with white outlining.')
10 return None
11
A front close up view of part of a white car. The rear driver side wheel and tire is in the middle. It has a silver rim. The inside edges of the rim are dirty and black. The rim has the "INFINITI" logo on it in the middle. The bumper is on the right. Light is reflecting off of it and over the wheel and part of the door on the left. The car is on pavement. There are dried scattered leaves around. A crack is visible in the cement on the left that runs under the front of the black tire. A shadow is on the cement under the car bumper.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'logo' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'rim' in relations:
5 return "on the rim in the middle"
6 return "No specific location found"
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'crack' in entity and 'visible' in
scene_graph.get_attributes(entity).get('state', ''):
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'tire' in relations and 'under' in
relations['tire']['spatial']:
5 return f"visible in the cement
{relations['tire']['spatial']} tire"
6 return "No prominent feature found"
7
A high-angle view of a moist outdoor area. The soil is covered in withered, dry grass and rows of dark brown and black dead leaves. The leaves are lined in a curved pattern that has subsided from the aftermath of a flood. There are two prominent curved lines created by the leaves that intersect the frame. On the right side, some of the dead leaves are congregated in a pile in between the curved lines.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'grass' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'lines' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 relations_out = scene_graph.get_outgoing_relations(entity)
5 if 'frame' in relations_out and 'intersect' in
relations_out['frame'].get('spatial', ''):
6 return attributes.get('shape', '')
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'outdoor area' in entity:
3 return scene_graph.get_attributes(entity).get('state', '')
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'leaves' in entity:
3 return scene_graph.get_attributes(entity).get('state', '')
4 return None
5
An outdoor daytime angled down medium close-up view of three wooden logs with brown bark that have been placed in a certain way forming a teepee. Within the teepee are many small wooden branches piled on top of each other that have a fire just starting to begin above them. The ground floor is completely covered in gray ash, and there is a fog of white smoke behind the fire, to the right of it.
0 def question_5(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'fire' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'branches' in relations:
5 return relations['branches'].get('spatial', '')
6 return None
7
0 def question_8(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'branches' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'each other' in relations and 'on top of' in relations['each
other'].get('spatial', ''):
5 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
6 return None
7
0 def question_9(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'ash' in entity:
3 relations = scene_graph.get_outgoing_relations('ground floor')
4 if not relations:
5 return scene_graph.get_attributes('ground
floor').get('state', '')
6 return None
7
0 def question_12(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'logs' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('state', '')
5 return None
6
A neon green sculpture of a gecko in a three-quarter view, the gecko has brightly colored circular patterns on its head. The gecko has a red and orange colored ring around its eye on the side and has bumps on its back, painted orange on the tips. It has its front legs arched up and over a green patch of turf. The sculpture is in a green turf, surrounded by stone, and bushes and trees are behind it with a blue sky partially visible in the tree's branches.
0 def locate_gecko_sculpture(scene_graph):
1 locations = []
2 for entity in scene_graph.get_entities():
3 if 'type' in scene_graph.get_attributes(entity) and
scene_graph.get_attributes(entity).get('type') == 'gecko':
4 relations = scene_graph.get_outgoing_relations(entity)
5 for place, details in relations.items():
6 if 'spatial' in details:
7 locations.append(details['spatial'] + ' ' + place)
8 return ', '.join(locations)
9
0 def describe_gecko_eye_ring(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "eye's ring" in entity:
3 return scene_graph.get_attributes(entity).get('color', 'unknown
color')
4 return 'unknown color'
5
0 def check_visibility_in_tree_branches(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'color' in scene_graph.get_attributes(entity) and 'blue' in
scene_graph.get_attributes(entity)['color']:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if "tree's branches" in relations and 'spatial' in
relations["tree's branches"] and 'partially visible in' in relations["tree's
branches"]['spatial']:
5 return entity
6 return 'nothing is partially visible'
7
A medium view of a bronze statue of Caesar. He's standing, looking in the left direction, with his left arm and hand pointing up and his pointer finger up as well. The statue is wearing gear with a cloth wrapped around his waist, held by his right arm. His right leg is positioned behind his body, and his right leg is tilting forward. A miniature bronze statue is hanging from his left leg, holding on with his left hand. It's standing on a bronze and dark gray marble platform. On the right side, there is a snack counter with multiple lined-up chips and beverages inside a fridge. The word "ESSENTIA" is written in black on a light gray banner. On the left, there are two exit doors with two signs above that say "EXIT" in bright red. Above the statue, there is a ceiling with a painting and four cream-colored small pillars.
0 def execute_command(scene_graph):
1 entity = 'statue'
2 relations = scene_graph.get_outgoing_relations(entity)
3 if relations and "statue's left hand" in relations:
4 return "Caesar's left arm is pointing up with his pointer finger
also up."
5 return None
6
0 def execute_command(scene_graph):
1 entity = 'platform'
2 attributes = scene_graph.get_attributes(entity)
3 material = attributes.get('material', '')
4 if material == 'dark gray marble,bronze':
5 return "The platform is made of dark gray marble and bronze."
6 return None
7
An angled view down of a pine tree that is lying on the grass. The top of it is pointed to the right. The top of the tree is missing branches and needles. It is not full. Dried leaves are on the ground on the grass in front of it. A square metal plate is in the ground near the bottom of the tree. Behind the tree are shrubs in the dirt going across. The leaves on it are green, and they are bright green behind the tree.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'plate' in entity:
3 return scene_graph.get_attributes(entity).get('shape', "")
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'plate' in entity:
3 outgoing_relations = scene_graph.get_outgoing_relations(entity)
4 description =
scene_graph.describe(scene_graph.generate_subgraph(['plate', 'ground']))
5 return description
6 return None
7
An outdoor, daytime, angled-down medium close-up three-quarter left side view of a young, cream-colored labradoodle wearing a transparent protective collar that is cone-shaped around its neck. The dogs fur is white and wavy, and has a thick pink tongue. The labradoodle is looking upward and slightly to its left. The labradoodle has a dark maroon nose and light green eyes. The dog is standing on a weathered down cement ground floor that has small chips and markings all throughout its surface. Behind the dog is a blue child's toy bicycle that is facing towards the left. There is a dark blue helmet hanging from the left handlebar. Behind the bike is a square wooden white support post. Further behind the post are some other toys in the shadows.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'tongue' in entity:
3 color = scene_graph.get_attributes(entity).get('color', "")
4 shape = scene_graph.get_attributes(entity).get('shape', "")
5 return f'The tongue is {shape} and {color}, suggesting it is
healthy and relaxed.'
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "bicycle" in entity:
3 description = scene_graph.get_attributes(entity).get('color',
"") + ' ' + scene_graph.get_attributes(entity).get('type', "") + ", "
4 state = scene_graph.get_attributes(entity).get('state', "") +
'.'
5 return description + state
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "ground floor" in entity:
3 material = scene_graph.get_attributes(entity).get('material',
"")
4 state = scene_graph.get_attributes(entity).get('state', "")
5 return f'The ground floor is {state} and made of {material}. '
6 return None
7