PROVE Explorer
An eye-level view of a tree growing out of a shallow stream of water in the middle of the image. There are rocks visible below the surface of the transparent water. There are trees on both sides of the stream, casting shadows over most of the water. The reflection of the tree growing in the middle of the stream is shining off of the water below it. In the bottom right corner of the image, a gray rock surface is visible. The sky at the top of the image is clear blue with no cloud coverage.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'sky' in entity:
3 sky_attributes = scene_graph.get_attributes(entity)
4 return f"The sky is {sky_attributes.get('color', '')} with
{sky_attributes.get('state', '')} coverage."
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'tree' in entity and 'grow' in
scene_graph.get_attributes(entity).get('state', ''):
3 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'rock surface' in entity:
3 surface_relations = scene_graph.get_outgoing_relations(entity)
4 if 'bottom right corner of the image' in surface_relations:
5 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
6 return None
7
A cream colored labradoodle standing on a wooden bench painted light brown, a red leash is attached to the dog's collar extending vertically from the bottom of the image. The dog's body is facing the left side of the image, and its head is facing forward toward the bottom of the image. The bench is placed on a pebble surface. To the left of the bench is a gray metal chain link border attached to a dark gray wooden post that extends to the top left corner of the image. Behind the barrier is another wooden object. There is a light brown wooden fence behind the bench with horizontal planks. There is a space between the barrier and the fence. There is a faint shadow being cast coming from the left side of the image, it covers most of the image and cuts off in the bottom right corner. The dog is casting a shadow on the bench going toward the bottom of the image.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "leash" in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if "dog's collar" in relations_out:
5 return 'leash'
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'labradoodle' in entity:
3 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'chain link border' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'bench' in relations_out and 'left of' in
relations_out['bench']['spatial']:
5 return 'chain link border'
6 return None
7
Eye-level view during the day of the side of a building that has a brown brick wall with a painting of a young woman, an eagle and a coyote on it. The woman has long flowing hair and she wears a broad-brimmed hat and an elaborate necklace. The head of a coyote is painted to the left of the woman, and above the coyote is painted a brown eagle spreading its wings. Bushes grow from the base of the wall, partly covering the bottom of the painting and spreading along the gravel on the ground. A pipe with stickers on it goes up the wall, just to the right of the painting. NANU is written at the top of the wall. A small portion of a green tree can be seen just to the top left of the building, with sky stretching toward the right.
0 def execute_command(scene_graph):
1 items_on_wall = []
2 for entity in scene_graph.get_entities():
3 outgoing_rels = scene_graph.get_outgoing_relations(entity)
4 if 'painting' in outgoing_rels and 'on' in
outgoing_rels['painting']['spatial']:
5 items_on_wall.append(entity)
6 return items_on_wall
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'pipe' in entity:
3 outgoing_rels = scene_graph.get_outgoing_relations(entity)
4 if 'painting' in outgoing_rels:
5 return outgoing_rels['painting']['spatial']
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'woman' in entity:
3 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'bushes' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('state', '')
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'NANU' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('text rendering', '')
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'wall' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('material', '')
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'eagle' in entity:
3 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
4 return None
5
An outdoor top-down view of lane two of a rubber track on a bright sunny day. The white spray-painted stencil font number, "2" sits between two vertical white lines. The three section of the number two have a light outline from overspray. The white paint has been worn, as pieces of the black rubber are visible throughout the number and the lines. Small white pieces of rubber are also visible scattered across the track.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'paint' in entity:
3 return scene_graph.get_attributes(entity).get('state', "")
4 return None
5
A large Didone Room number font "7" is seen below, painted on a sports track. The number has a wide, rounded bottom of the stem and a small line on the left edge of the horizontal line, which is also thick and rounded with a small upward tail on the right. The number is stenciled on and shows a white, faded chalk outline around it that has imperfections in small areas. A small gap between the top horizontal line and the stem of the number shows that a stencil was used. The track has a dark gray rubber particle surface. Small white flecks are seen in the dark gray of the rubber. There are two white lines, one on each side of the number. They both tilt inward at the top, showing the angle from which the number is seen. The right line tilts more than the left line. A natural light shines from the bottom edge of the image, showing the top edge just slightly darker.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 attributes = scene_graph.get_attributes(entity)
3 if 'font' in entity and 'Didone Room' in attributes.get('type', ''):
4 return attributes.get('type', None)
5 return None
6
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 attributes = scene_graph.get_attributes(entity)
3 if "number's horizontal line" in entity:
4 return attributes.get('shape', None)
5 return None
6
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 relations_out = scene_graph.get_outgoing_relations(entity)
3 if 'gap' in entity:
4 between_parts = [target for target in relations_out.keys() if
'between' in relations_out[target]['spatial']]
5 return f"There is a small gap between {',
'.join(between_parts)}."
6 return None
7
8
A black spaceship hanging from the ceiling, the spaceship appears to be viewed from a worm's eye view. Below the spaceship is a black disk with white lines and circles with dots design, the design has white light seeping through it and a circular base below with a red LED strip surrounding it. The ship also has a grey dome with long and thin poles that poke out in different directions, in the tips of the poles are bright red LED lights. the ship appears to be in a dark room with a white metal beam ceiling.
0 def execute_command(scene_graph):
1 spaceship_color = None
2 room_condition = None
3 scene_description = []
4 for entity in scene_graph.get_entities():
5 if 'spaceship' in entity and 'ceiling' in
scene_graph.get_outgoing_relations(entity):
6 spaceship_color =
scene_graph.get_attributes(entity).get('color', None)
7 if 'room' in entity:
8 room_condition =
scene_graph.get_attributes(entity).get('state', None)
9 ceiling_material =
scene_graph.get_attributes('ceiling').get('material', None)
10 ceiling_color =
scene_graph.get_attributes('ceiling').get('color', None)
11 if ceiling_material or ceiling_color:
12 scene_description.append(f"a {ceiling_color}
{ceiling_material} ceiling")
13 return f"The spaceship hanging from the ceiling is {spaceship_color},
and it appears to be in a {room_condition} room with {'
'.join(scene_description)}." if spaceship_color and room_condition else
"Couldn't determine the description."
14
0 def execute_command(scene_graph):
1 ceiling_material = None
2 ceiling_color = None
3 for entity in scene_graph.get_entities():
4 if 'ceiling' in entity:
5 ceiling_material =
scene_graph.get_attributes(entity).get('material', None)
6 ceiling_color = scene_graph.get_attributes(entity).get('color',
None)
7 return f"The ceiling is made up of {ceiling_color} {ceiling_material}
beams." if ceiling_material and ceiling_color else "Couldn't describe the
ceiling beam."
8
An outdoor wide angle shot of the shadowed dirt area with patches of grass on the underside of a multi-lane highway with rows of three round cement support columns. Large bushy trees fill a woodsy area in the background, shining under the bright sunlight. A cement round walkway is visible on the left with its curved raised about a foot around the columns on the left side. The middle column on the left side is covered in vines. A clear blue skies visible above the bridge.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'skies' in entity:
3 if 'blue' in scene_graph.get_attributes(entity).get('color',
''):
4 spatial_relations =
scene_graph.get_outgoing_relations(entity)
5 if 'bridge' in spatial_relations:
6 return "above the bridge"
7 return 'Location unavailable.'
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'walkway' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 if 'curved' in attributes.get('shape', ''):
5 return 'The walkway is curved, round, and raised about a
foot around the columns on the left side.'
6 return 'Interaction description unavailable.'
7
An overhead view of two gray sanderling birds walking on a gray damp sand surface. The bird nearest in view toward the right side of the image is facing the top left corner of the image. The bird walking ahead is facing the top right corner of the image. There are white seashells scattered throughout the entire image, most of the shells are piled up in the bottom right and left side of the image.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'seashells' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 locations = [place for place, details in relations.items() if
'in' in details['spatial']]
5 return f'Seashells are in: {", ".join(locations)}'
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'sanderling birds' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return 'No' if attributes.get('count', '0') == '==2' else 'Yes'
5 return None
6
0 def execute_command(scene_graph):
1 bird_positions = []
2 for entity in scene_graph.get_entities():
3 if 'bird' in entity:
4 state = scene_graph.get_attributes(entity).get('state', '')
5 if 'walk ahead' in state:
6 bird_positions.append('ahead')
7 else:
8 bird_positions.append('behind')
9 return 'ahead' if 'ahead' in bird_positions else 'behind'
10
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'sand surface' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return f"The surface is {attributes.get('color', '')} and
{attributes.get('state', '')}."
5 return None
6
An eye-level view of a group of multi-colored adirondack folding chairs arranged in a circle on top of a very small hill, the chairs are in the bottom right corner of the image. A dark shadow is covering the majority of the bottom of the image over the chairs. The chairs are either colored yellow, green, orange, or red. Beyond the small hill is a parking lot with multiple grass medians. The medians have trees growing in them creating a row of trees extending across the middle of the image. There is a gray sedan parked under one of the trees on the far left side of the image facing the left side of the image. Behind the car is a small gray sign on the ground with the "Google" logo on it. There is another gray sedan parked in the distance on the right side of the image visible behind the chairs facing the right side of the image. The sky taking up the top half of the image is clear blue, there is a small group of clouds that are barely visible directly above the trees on the right side of the image.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "sedan" in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if "right side of the image" in relations and "on" in
relations["right side of the image"].get("spatial", ""):
5 return "facing the right side of the image"
6 return ""
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "clouds" in entity:
3 attributes = scene_graph.get_attributes(entity)
4 relations = scene_graph.get_outgoing_relations(entity)
5 if "barely visible" in attributes.get("state", "") and "above"
in relations["trees"].get("spatial", ""):
6 return "barely visible directly above the trees on the
right"
7 return ""
8
A black Volvo XC90 is parked in a gray brick driveway oriented in a three-quarters position facing the bottom right corner of the image. To the right of the driveway is a bed of rocks with bushes and a tree growing out of it. To the right of the bed of rocks is a wooden fence and a blue house on the far right side of the image. On the other side of the road is a yellow house with a black car parked in the driveway. The tops of multiple trees in the background and the tree to the right of the black Volvo are going across the middle of the image, the limb of another tree is in the foreground in the top right corner of the image. The reflection of the trees and the sky is shining off of the hood of the car. The sky is almost completely covered by a large cumulonimbus cloud. The sun is shining on the top of the cloud in the middle and on the cloud's right side.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "car's hood" in scene_graph.get_outgoing_relations(entity):
3 return "The reflection of the trees and the sky is shining off
the car's hood."
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 attributes = scene_graph.get_attributes(entity)
3 if 'Volvo XC90' in entity:
4 return f"The Volvo XC90 is oriented {attributes.get('state',
'')}."
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'road' in scene_graph.get_outgoing_relations(entity):
3 return "On the other side of the road is a yellow house with a
black car parked in the driveway."
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'driveway' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return f"The driveway is made of {attributes.get('material',
'')}."
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'tree' in entity:
3 outgoing_relations = scene_graph.get_outgoing_relations(entity)
4 if 'rocks' in outgoing_relations:
5 return "The tree is growing on the bed of rocks."
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 attributes = scene_graph.get_attributes(entity)
3 if 'sky' in entity:
4 return f"The sky is {attributes.get('state', '')} by a large
cumulonimbus cloud."
5 return None
6