PROVE Explorer
A high-angle wide view of a mountain range seen from the vantage point of an airplane. A river is extending from the bottom left side of the image toward the right side of the image. There are smaller mountains near the bottom right side of the image in front of the river. Behind the river are much taller mountains. There is a large mountain in the distance near the top right side of the image. The sky is visible extending across the very top of the image. There is a layer of gray fog over the mountains, the fog around the taller mountain in the distance is thicker.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'mountain range' in entity:
3 return scene_graph.get_attributes(entity).get('state', '')
4 return None
An indoor close-up front view of a grey tabby cat wearing a collar with a silver ring, inside a gray wooden cage with white steel rods and five strings on each side. The cage is placed on a brown hardwood floor, where the light and shadows of the cat and cage are reflected. Behind the cage is a white door with a cream-colored wall and white floorboard to its side.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'cat' in entity and 'grey' in
scene_graph.get_attributes(entity).get('color', ''):
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'cage' in relations and 'inside' in
relations['cage']['spatial']:
5 return "inside a grey wooden cage"
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'floor' in entity:
3 attrs = scene_graph.get_attributes(entity)
4 if 'brown' in attrs.get('color', '') and 'hardwood' in
attrs.get('material', ''):
5 return 'The floor beneath the cage is ' + attrs['color'] + '
and made of ' + attrs['material']
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'rods' in entity:
3 attrs = scene_graph.get_attributes(entity)
4 return 'The rods on the cage are made of ' + attrs['material'] +
' and are ' + attrs['color'] + ' in color'
5 return None
6
A view of a gray concrete block that is sitting on a multicolored rock ground. White cement is visible in between the different rocks. The cement block is in the middle and has two open squares in the middle of it. Behind it, the ground is covered in small stones on the left and right. On the right, there are some patches of dried grass and green weeds. Two black cables are on the ground, going across. Behind the cables is another gray concrete block. Part of one is visible on the left. A gray piece of concrete is in between them in the dirt and stones.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'cement' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'rocks' in relations and 'in between' in
relations['rocks'].get('spatial', ''):
5 return scene_graph.get_attributes(entity).get('color', '') +
' cement'
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'cables' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'ground' in relations and 'on' in
relations['ground'].get('spatial', ''):
5 return ' and '.join([
6 scene_graph.describe(scene_graph.generate_subgraph([sub
_entity]))
7 for sub_entity in ['stones', 'concrete']
8 ]) + ' over which black cables go across'
9 return None
10
Side-view image of a black Hot Wheels Bone Shaker monster truck on a concrete floor. The truck is from a landing position after a jump with its back wheels off the ground. The truck has a black body panel with an orange under cage and decals of a black and white skull and orange/yellow flames, and black tires with orange inner rims. Behind the truck is a wall of baby-blue tarp with a black and white checkered line, in between two posters of the Hot Wheels logo, partially obscured by the top frame.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'tires' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 if 'truck' in scene_graph.get_outgoing_relations(entity):
5 colors = attributes.get('color', '')
6 return colors.replace(',', ' and ')
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'posters' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'line' in relations and 'tarp' in relations:
5 return scene_graph.get_attributes(entity).get('type', '') +
' are between the line and the tarp.'
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'wall' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 for target, rel in relations.items():
5 if target == 'tarp' and 'spatial' in rel:
6 description =
scene_graph.get_attributes(target).get('color', '') + ' tarp'
7 line_attr = scene_graph.get_attributes('line')
8 if 'line' in relations:
9 description += ' with a ' + line_attr.get('color',
'') + ' line'
10 return description
11 return None
12
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'back wheels' in entity:
3 state = scene_graph.get_attributes(entity).get('state', '')
4 if 'truck' in scene_graph.get_outgoing_relations(entity):
5 return "The truck is {} and its back wheels are
{}".format(scene_graph.get_attributes('truck').get('state', ''), state)
6 return None
7
An outdoor medium close-up front view of home with a gazebo type entrance, the gazebo is completely covered with vertical vines that have green leaves attached to them. The gazebo has a pointed roof and is made up of dark colored shingles, along with the house's roof. The house walls are also partially covered in hanging vines that have green leaves attached to them. The ground floor towards the bottom consists of small green plants and dried up leaves scattered throughout the surface. Above the home and behind it, are several tall trees with green leaves attached to their branches. The bright white sky can be seen above the trees and in between their branches.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'vines' in entity:
3 outgoing_relations = scene_graph.get_outgoing_relations(entity)
4 if 'gazebo' in outgoing_relations and 'attached to' in
outgoing_relations['gazebo'].get('spatial', ''):
5 return scene_graph.get_attributes(entity).get('orientation',
'')
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'sky' in entity:
3 spatial_relations = scene_graph.get_outgoing_relations(entity)
4 if 'trees' in spatial_relations and 'above' in
spatial_relations['trees'].get('spatial', ''):
5 return scene_graph.get_attributes(entity).get('color', '')
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "gazebo's roof" in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('shape', '')
5 return None
6
Large dark gray clouds are looming low over the top of a highway full of cars. A concrete median is in the middle of the highway. Trees are on each side of the highway, with streetlight posts beside them. A yellow sign with an arrow on it pointing upwards is on the right side of the highway. Large power lines towers are in on the left side of the highway. A large metal structure with signs on it is over the highway, with cars passing underneath it. The image is taken through a dirty glass window of a car on the highway.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'clouds' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 if 'dark gray' in attributes.get('color', ''):
5 return 'dark gray'
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'glass window' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('state', '')
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'median' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 attributes = scene_graph.get_attributes(entity)
5 if 'highway' in relations and 'in the middle of' in
relations['highway'].get('spatial', ''):
6 return f"The concrete median is in the middle of the
highway."
7 return None
8
0 def execute_command(scene_graph):
1 left_side_structures = []
2 both_sides_structures = []
3 for entity in scene_graph.get_entities():
4 relations = scene_graph.get_outgoing_relations(entity)
5 if 'highway' in relations:
6 spatial_relation = relations['highway'].get('spatial', '')
7 if 'on each side of' in spatial_relation:
8 both_sides_structures.append(entity)
9 elif 'on the left side of' in spatial_relation:
10 left_side_structures.append(entity)
11 return {
12 "both_sides": both_sides_structures,
13 "left_side": left_side_structures
14 }
15
An indoor side view of a bed in the center of a dim lit room, the bed has white mattress covers and white sheets, the bed also has a dark colored frame and headboard. There are two dark colored night stands on both sides of the bed, each with an identical lamp that has a large arm and a cubed shaped shader, the lamp to the left of the bed is on while the right one is off. About four feet in front of the bed is a TV console that has TV placed on top of it along with a rectangular shaped mirror.
0 def execute_command(scene_graph):
1 lamp_shader_attributes = scene_graph.get_attributes("lamps' shader")
2
3 return lamp_shader_attributes.get('shape', 'unknown')
4
0 def execute_command(scene_graph):
1 night_stands_attributes = scene_graph.get_attributes('night stands')
2
3 if 'count' in night_stands_attributes and 'color' in
night_stands_attributes:
4 return f"There are {night_stands_attributes['count']}
{night_stands_attributes.get('color')} night stands on both sides of the
bed."
5
6 return None
7
A close up shot of the back of a statue of a man facing a chain link fence. The statue has orange hair and a cap made of leaves on its head. The statue is wearing a lime green jersey with 2 white strips on its arm sleeves and one white stripe on the upper part of the jersey. "LOST BOY / 01" is written in large white text. The statue has a belt composed of an alternating triangle pattern of blue and light blue. White and orange flowers are visible through the fence. Trees and a white house are to the left of the statue. The sky is bright with large white clouds.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "statue" in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if "fence" in relations and "face" in
relations["fence"].get("spatial", ""):
5 statue_hair = scene_graph.get_outgoing_relations(entity +
"'s hair")
6 if "statue" in statue_hair:
7 return scene_graph.get_attributes(entity + "'s
hair").get("color", "")
8 return None
9
10
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "word" in entity:
3 return scene_graph.get_attributes(entity).get("text rendering",
"")
4 return None
5
6
0 def execute_command(scene_graph):
1 objects_found = []
2 for entity in scene_graph.get_entities():
3 if "house" in entity or "trees" in entity:
4 relations = scene_graph.get_outgoing_relations(entity)
5 if "statue" in relations and "left of" in
relations["statue"].get("spatial", ""):
6 description =
scene_graph.describe(scene_graph.generate_subgraph([entity]))
7 objects_found.append(description)
8 return " and ".join(objects_found) if objects_found else None
9
10
A medium-close-up view of brown and black print sunglasses with black lenses sitting on a light brown wooden table. Behind it is a light gray block laid sideways. A sketch of a girl, drawn four times, each facing a different direction. She has short hair with goggles on her head, and she's wearing a knit sweater with flowers on it and cargo pants with a choker. She has a hook for a right hand. Beside the sketch is a color wheel palette with different shades of blue, green, light blue, yellow, brown, and pink. A light gray wall is behind the items.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'color wheel palette' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'sketch' in relations and 'beside' in
relations['sketch']['spatial']:
5 colors = scene_graph.get_attributes(entity).get('color',
'').replace(',', ', ')
6 return f"Beside the sketch of the girl is a color wheel
palette with different shades of {colors}."
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'wall' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 if 'items' in relations and 'behind' in
relations['items']['spatial']:
5 return "The wall is behind the items."
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "sunglasses' lenses" in entity:
3 return f"The lenses of the sunglasses are
{scene_graph.get_attributes(entity).get('color', '')}."
4 return None
5
0 def execute_command(scene_graph):
1 return "The girl has goggles on her head."
2
A view of black seats in a movie theater. They are in rows and have numbers at each table on them. The wall is red, and there is a light on the left wall that is shaped like a film reel. There is a projector window on the back wall over the seats. Black speakers are attached to the back wall. There is a blue light shining out on the wall, casting a film reel shaped shadow. Steps are visible on the right of the rows of chairs.
0 def execute_query(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'projector window' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'seats' in relations_out and 'over' in
relations_out['seats']['spatial']:
5 return 'over the seats'
6 return None
7
0 def execute_query(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'steps' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'rows of chairs' in relations_out and 'on the right of' in
relations_out['rows of chairs']['spatial']:
5 return 'steps'
6 return None
7
0 def execute_query(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'seats' in entity:
3 color = scene_graph.get_attributes(entity).get('color', '')
4 if color:
5 return color
6 else:
7 return "No color is specified."
8 return None
9