PROVE Explorer
An overhead aerial view of a landscape covered in green with hills throughout the image seen from the vantage point of an airplane. There is a group of cumulus clouds on the left side of the image casting a shadow over the land on the right side of the image. Extending vertically from the top of the image to the bottom of the image is a road with slight bends in it as it moves along in a general direction.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'cumulus clouds' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 for target_entity, relation_info in relations_out.items():
5 if 'left side of the image' in target_entity:
6 return target_entity
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'cumulus clouds' in entity:
3 return scene_graph.get_attributes(entity).get('state', '')
4 return None
5
A view of 3 different signs on a street corner of a T-shaped intersection. 2 signs are attached to a metal pole planted in an overgrown patch of grass with a silver fire extinguisher . At the top of the metal pole, there is black rectangular sign with a left facing white arrow. The black text within the arrow reads "ONE WAY". In the middle of the middle pole, there is a red,hexagon shaped sign with white upside down text “STOP”. There is a graffiti tag “PVT A” written next to “STOP” To the right of the metal pole, there is a power pole with a square blue sign with text “COHN”. Behind the wooden pole, there is a side view of houses with cars parked in front.
0 def get_graffiti_next_to_stop(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'STOP sign' in entity:
3 incoming_relations = scene_graph.get_incoming_relations(entity)
4 for source_entity, relations in incoming_relations.items():
5 if 'graffiti tag' in source_entity and 'next to' in
relations.get('spatial', ''):
6 return
scene_graph.get_attributes(source_entity).get('text rendering', "")
7 return None
8
0 def find_location_of_cohn(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'sign' in entity:
3 attrs = scene_graph.get_attributes(entity)
4 if 'COHN' in attrs.get('text rendering', ''):
5 outgoing_relations =
scene_graph.get_outgoing_relations(entity)
6 for target_entity, relation in outgoing_relations.items():
7 if 'pole' in target_entity:
8 return "sign code located on a square blue sign to
the right of the metal pole"
9 return None
10
0 def get_intersection_shape(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'intersection' in entity:
3 return scene_graph.get_attributes(entity).get('shape', "")
4 return None
5
0 def find_object_in_grass(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'fire extinguisher' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'grass' in relations and 'in' in
relations['grass']['spatial']:
5 return scene_graph.get_attributes(entity).get('color', "") +
" fire extinguisher"
6 return None
7
An outdoor angled down view of several black trash bags placed side by side and stacked on top of each other, the trash bag towards the bottom right is placed on top of a wooden beam and several cylindrical cans, there is a pair of gray tennis shoes placed on top of that same bag. The rest of the trash bags are placed on a muddy dirt floor, to the left of the bags is a patch of tall green grass and roots, to the right of trash bags are two white pillars staked into a tiled platform.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'pair of gray tennis shoes' in entity:
3 in_relations = scene_graph.get_incoming_relations(entity)
4 for source, relation in in_relations.items():
5 if 'on top of' in relation.get('spatial', ''):
6 return
scene_graph.describe(scene_graph.generate_subgraph([source]))
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'trash bags' in entity:
3 return scene_graph.get_attributes(entity).get('state', '')
4 return None
5
An outdoor view of a sculpture of an ant colored purple and pink, the ant is wearing blue high heels and is holding a long silver microphone to its mouth. The ant is sitting on a sculpture of a yellow hard shell taco with veggies inside of it. The taco is placed over a path of green turf, the taco is sitting on two parallel red colored rectangular shaped slabs with each side of the taco on one of the slabs. To the right of the ant sculpture is a line of tall green bushes planted side by side. Behind the ant sculpture is a tall black fence, behind the fence are many tall green trees.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'ant' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'taco' in relations_out and 'on' in
relations_out['taco']['spatial']:
5 taco_attrs = scene_graph.get_attributes('taco\'s shell')
6 return f"a sculpture of a {taco_attrs['color']}
{taco_attrs['state']} shell taco"
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'ant sculpture' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'bushes' in relations_out and 'to the right of' in
relations_out['bushes']['spatial']:
5 bushes_attrs = scene_graph.get_attributes('bushes')
6 return f"a line of {bushes_attrs['shape']}
{bushes_attrs['color']} bushes"
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'taco' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'path' in relations_out and 'over' in
relations_out['path']['spatial']:
5 path_attrs = scene_graph.get_attributes('turf')
6 return f"a path of {path_attrs['color']} turf"
7 return None
8
An indoor side view of a bed in the center of a dim lit room, the bed has white mattress covers and white sheets, the bed also has a dark colored frame and headboard. There are two dark colored night stands on both sides of the bed, each with an identical lamp that has a large arm and a cubed shaped shader, the lamp to the left of the bed is on while the right one is off. About four feet in front of the bed is a TV console that has TV placed on top of it along with a rectangular shaped mirror.
0 def execute_command(scene_graph):
1 lamp_shader_attributes = scene_graph.get_attributes("lamps' shader")
2
3 return lamp_shader_attributes.get('shape', 'unknown')
4
0 def execute_command(scene_graph):
1 night_stands_attributes = scene_graph.get_attributes('night stands')
2
3 if 'count' in night_stands_attributes and 'color' in
night_stands_attributes:
4 return f"There are {night_stands_attributes['count']}
{night_stands_attributes.get('color')} night stands on both sides of the
bed."
5
6 return None
7
Large dark gray clouds are looming low over the top of a highway full of cars. A concrete median is in the middle of the highway. Trees are on each side of the highway, with streetlight posts beside them. A yellow sign with an arrow on it pointing upwards is on the right side of the highway. Large power lines towers are in on the left side of the highway. A large metal structure with signs on it is over the highway, with cars passing underneath it. The image is taken through a dirty glass window of a car on the highway.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'clouds' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 if 'dark gray' in attributes.get('color', ''):
5 return 'dark gray'
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'glass window' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('state', '')
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'median' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 attributes = scene_graph.get_attributes(entity)
5 if 'highway' in relations and 'in the middle of' in
relations['highway'].get('spatial', ''):
6 return f"The concrete median is in the middle of the
highway."
7 return None
8
0 def execute_command(scene_graph):
1 left_side_structures = []
2 both_sides_structures = []
3 for entity in scene_graph.get_entities():
4 relations = scene_graph.get_outgoing_relations(entity)
5 if 'highway' in relations:
6 spatial_relation = relations['highway'].get('spatial', '')
7 if 'on each side of' in spatial_relation:
8 both_sides_structures.append(entity)
9 elif 'on the left side of' in spatial_relation:
10 left_side_structures.append(entity)
11 return {
12 "both_sides": both_sides_structures,
13 "left_side": left_side_structures
14 }
15
An angled top view of a cement square that is sitting on green turf that is painted like dice. The dots are lime green, and the background is light purple. The paint is worn, and there is gray cement showing through in spots. The top shows six worn dots, with parts of the cement weathered away. The front face shows five dots. The light purple paint on top has faded and now looks blue. The sun is shining on top of it. There is a shadow on the ground to the left of it.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'green turf' in entity:
3 return scene_graph.get_attributes(entity).get('texture', "")
4 return None
An ancient Greek-style statue is seen from below. The statue is made of a pale gray stone. The statue shows a woman on the left with an unidentifiable group of objects on her lap while holding a torch in her right hand. She partially stands and kneels with a man crouching to the right. The woman is pulling a cloth over the man's shoulders with her left hand as he reaches for something below him. The woman wears a toga style dress and has a large, unidentifiable object behind her in the shape of flowing cloth on the right. The man is undressed. Another unidentifiable object is seen on the bottom left, as if she is stepping on it. There is a window in the background on the left with eccentric framing that shows a man's face above it. Another building with windows is seen reflected in the glass of this window. Two large concrete pillars are seen directly behind the statue, above the borders of an unseen object. There is an overcast shade of sunlight in the scene.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'building' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'window' in relations_out and 'reflected in' in
relations_out['window']['spatial']:
5 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
6 return None
7
An outdoor close up view of a black cricket on the ground facing toward the right side of the view with its hind legs slightly angled toward the bottom left of the view. The view is filled with green colored grass, small amounts of soil, and numerous amounts of dried grass. Shadows are visible in the top left of the view under green colored grass, light also shines off of the abdomen and head of the cricket. To the right of the cricket is a small patch of soil beneath the nearby grass.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'light' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if "cricket's head" in relations and "cricket's abdomen" in
relations:
5 description = "Light shines off the cricket's abdomen and
head."
6 return description
7 return None
8
An outdoor medium-close-up view of a white rhododendron plant that is sprouting from a plant that is made up of large green leaves that grow in all directions and slightly down as well. Along the leaves, there are small white specks that are spread throughout. Also surrounding the white flower are branches that run horizontally and vertically. Underneath the plant, there are dried brown leaves all throughout the floor. It is daytime, as the plant can be seen clearly.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 attributes = scene_graph.get_attributes(entity)
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'rhododendron plant' in entity and 'sprout' in
attributes.get('state', ''):
5 for target_entity in relations:
6 if 'plant' in target_entity:
7 return scene_graph.get_attributes(entity).get('color',
''), entity
8 return None
9
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 attributes = scene_graph.get_attributes(entity)
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'branches' in entity and 'flower' in relations:
5 return attributes.get('state', ''), entity
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 attributes = scene_graph.get_attributes(entity)
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'specks' in entity:
5 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
6 return None
7