PROVE Explorer
A chess board is seen from a close angle with all the pieces in a starting position. The chess board is all metal, dark metallic silver and black. The board itself has a triple-layer design, with each lower layer slightly larger, creating a step design around the board. The pieces themselves are made of small vehicle pieces. Most of the pieces have some sort of gear on them, and two pieces of each color have a spark plug. The side that is usually white is seen from the lower left to the bottom at an angle and is dark silver besides the white of the spark plugs. The black side is on the opposite side, towards the upper right corner, and is completely black. The board sits on a beige and cream tile floor with consistent indoor lighting.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'side' in entity and 'dark silver' in
scene_graph.get_attributes(entity).get('color', ""):
3 relations = scene_graph.get_outgoing_relations(entity)
4 return ', '.join([f"{rel['spatial']} {loc}" for loc, rel in
relations.items()])
5 return None
6
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'floor' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('texture', "")
5 return None
6
A close up shot of an uncolored pencil sketch of the Gundam RX-76, brandishing its beam rifle in its right hand and holding its shield in its left hand. The sketch is placed in a square section of a wooden shelf with a red background. A reglinleif spider mech model kit is on top of a small black box to the left of the gundam drawing. A small figure of Saber from Fate/Grand Order is positioned sitting with its feet hanging off the edge of the shelf in front of the gundam drawing. "LIGHT NOVELS" is written in white letters on a blue box. The wall behind the box is green.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 attributes = scene_graph.get_attributes(entity)
3 if 'Saber' in attributes.get('type', '') and 'sit' in
attributes.get('state', ''):
4 relations_out = scene_graph.get_outgoing_relations(entity)
5 if 'shelf' in relations_out and 'on' in
relations_out['shelf']['spatial']:
6 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'reglinleif spider mech model kit' in entity:
3 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'sketch' in entity:
3 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'word' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return attributes.get('text rendering', '')
5 return None
6
A medium view of a "WELCOME" sign that is written vertically. The "O" is replaced with the state of Texas and its flag, while the "E" is covered by a gray cylindrical container that has a black label that reads "SPOONS" in white. On the right side of the spoon's container is a knife's container, while on the left is a fork's container. Each container is the same as the spoon one, but they have the black sign marked respectively towards what they are. The containers are sitting on top of a small wooden table. Behind the sign, there is a wall that is made up of dark brown wooden planks that run vertically but at an angle to the left. A bright white light shines brightly onto the containers and sign.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'O' in entity:
3 incoming_relations = scene_graph.get_incoming_relations(entity)
4 for source_entity in incoming_relations:
5 if 'replace' in
incoming_relations[source_entity]['spatial']:
6 return
scene_graph.describe(scene_graph.generate_subgraph([source_entity]))
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'E' in entity:
3 incoming_relations = scene_graph.get_incoming_relations(entity)
4 for source_entity in incoming_relations:
5 if 'cover' in incoming_relations[source_entity]['spatial']:
6 return
scene_graph.get_attributes(source_entity).get('color', '')
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'planks' in entity:
3 return scene_graph.get_attributes(entity).get('material', '')
4 return None
5
A cream colored Labradoodle is sitting on top of a cushion with a multicolored kente pattern. The dog has its tongue out and is looking at the camera. The dog has light brown floppy ears. A cream colored dog toy is laying on the cushion beside the dog. The cushion is laying on a brown hard wood floor. A Bicycle wheel is behind the dog and next to a metal object. A gray and white colored wall is beside the dog and the cushion and has a shadow of the dog on it. Light is shining onto the dog, cushion, and floor.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'cushion' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 if 'multicolored' in attributes.get('pattern', ''):
5 return attributes.get('pattern', '')
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "dog's ears" in entity:
3 return scene_graph.get_attributes(entity).get('state', '')
4 return None
5
An outdoors top-down view of an orange toy basketball, a yellow toy volleyball, and a water football floating in that order from left to right on the surface of a pool within inches of each other in a U-shaped arch. The volleyball is the smallest, with thin indention lines creating the panels of the ball. The orange basketball medium is textured with small dots. The football has an oval-shaped logo with black text upside down that reads, "COOP" on its left side facing the volleyball. The still light blue pool water reflects the overhanging treetops and the light blue sky above. Daytime.
0 def smallest_ball_description(scene_graph):
1 entities = scene_graph.get_entities()
2 for entity in entities:
3 if 'volleyball' in entity:
4 attributes = scene_graph.get_attributes(entity)
5 if attributes.get('size') == 'smallest':
6 indentations = scene_graph.get_attributes("volleyball's
indention lines")
7 return f"The {entity} is {attributes['size']} with features
of {indentations.get('shape', 'Unknown features')}."
8 return None
9
0 def direction_of_floating_objects(scene_graph):
1 volleyball_relations = scene_graph.get_outgoing_relations('volleyball')
2 basketball_relations = scene_graph.get_outgoing_relations('basketball')
3 direction = None
4 if 'football' in volleyball_relations:
5 direction = volleyball_relations['football'].get('spatial')
6 if 'volleyball' in basketball_relations:
7 direction = basketball_relations['volleyball'].get('spatial')
8 return direction
9
An angled view down of a pine tree that is lying on the grass. The top of it is pointed to the right. The top of the tree is missing branches and needles. It is not full. Dried leaves are on the ground on the grass in front of it. A square metal plate is in the ground near the bottom of the tree. Behind the tree are shrubs in the dirt going across. The leaves on it are green, and they are bright green behind the tree.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'plate' in entity:
3 return scene_graph.get_attributes(entity).get('shape', "")
4 return None
5
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'plate' in entity:
3 outgoing_relations = scene_graph.get_outgoing_relations(entity)
4 description =
scene_graph.describe(scene_graph.generate_subgraph(['plate', 'ground']))
5 return description
6 return None
7
An overhead view looking down at brick tiles in the ground. Pieces of dirt and leaves are in between the cracks of the tile. Grass stains are on some of the tiles as well. The color of the tiles are maroon and gray and are running vertically and horizontally on the ground. Black letters are in the middle of the image on a horizontal maroon tile that reads "BASS".
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'tiles' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 return f"{attributes.get('color', '')}, {attributes.get('state',
'')}"
5 return None
6
A side night view of a Japan, Germany, Finland, Slovenia, France, Ireland flag lined up beside each other. A metal flag staff is holding the flags up by a pulley system. All flags are raised at full staff. A parking lot full of cars that is partially cut off from the left side of the image is to the left of the flags. One of the cars has its headlights on and is face toward the flags. Streetlight posts with lights on are behind the parking lot. Three small trees are around the parking lot. A metal structure is in the background. A tent is in the background as well, next to a building with purple lighting coming from the inside of it. More trees are to the right of the building. Stands of a stadium are to the right of the image and partially cut off by the camera. A red fence is at the bottom right of the image. A semicircle made up of two blue neon glowing strips is in the dark sky.
0 def execute_command(scene_graph):
1 # Iterate through entities
2 for entity in scene_graph.get_entities():
3 # If entity is a flag and matches the type 'Ireland'
4 if 'flag_6' in entity:
5 return scene_graph.get_attributes(entity).get('type', '')
6 return None
7
0 def execute_command(scene_graph):
1 semicircle_desc = None
2 for entity in scene_graph.get_entities():
3 if 'semicircle' in entity:
4 for attr in scene_graph.get_attributes(entity).get('shape',
'').split(', '):
5 if 'strips' in attr:
6 semicircle_desc = attr
7 return scene_graph.get_attributes('strips').get('color', '')
8 return semicircle_desc
9
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'flag staff' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'flags' in relations_out and 'hold up' in
relations_out['flags'].get('spatial', ''):
5 return '{} flag
staff'.format(scene_graph.get_attributes(entity).get('material', ''))
6 return None
7
An outdoor nighttime slightly angled up close-up front view of a plastic orange pumpkin that has a cutout rigid smile, and triangle shaped eyes and nose. There is a red light within the pumpkin that is shining on its inner surface giving the pumpkin a dramatic look. The pumpkin is placed on top of dark gray metal post, and the area surrounding the pumpkin is pitch black.
0 def execute_command(scene_graph):
1 triangle_count = 0
2 for entity in scene_graph.get_entities():
3 attributes = scene_graph.get_attributes(entity)
4 if 'triangle' in attributes.get('shape', ''):
5 triangle_count += 1
6 return f'The pumpkin has {triangle_count} triangle-shaped features: two
eyes and one nose.' if triangle_count > 0 else None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'pumpkin' in entity:
3 pumpkin_material =
scene_graph.get_attributes(entity).get('material', '')
4 relations_to = scene_graph.get_outgoing_relations(entity)
5 if 'post' in relations_to and 'on top of' in
relations_to['post'].get('spatial', ''):
6 return (f'The pumpkin is made of {pumpkin_material} and is
placed on top of the dark gray metal post.')
7 return None
8
A close up view of a blue lit indoor fountain. The fountain is a semicircle and is a pedestal bird bath shape. The fountain is up against an arched up small square and slanted tile wall. Over it is a plaque with a sculpted lion's head with a scrolling design beneath and to each side. Water cascades out of the bowl evenly and forms a semicircle that is highlighted in light blue, in the pool below. A raised walkway is behind the fountain. The walkway has an iron fence railing that has exes for each section between the posts. The top of the fountain wall obscures most of the railing sections. Behind the walkway in the top left corner are three dressed and spot-lighted mannequins in a storefront window. To their right on the wall is a small backlit swordfish model facing to the left. The overall color of the frame is a rich blue hue. The wall in the background goes from a lavender glow over the storefront window and wall, to a golden lit tan, to violet on the right.
0 def execute_command(scene_graph):
1 fountain_attr = {}
2 for entity in scene_graph.get_entities():
3 if 'fountain' in entity:
4 fountain_attr = scene_graph.get_attributes(entity)
5 break
6 return "The fountain is {}. It is also noted for being {}.".format(
7 ', '.join(f"{key} {value}" for key, value in
fountain_attr.items()),
8 ', '.join(f"{key}" for key, value in fountain_attr.items() if key
== 'state')
9 )
10
0 def execute_command(scene_graph):
1 above_desc = "A plaque "
2 for entity in scene_graph.get_entities():
3 if 'plaque' in entity:
4 relations_out = scene_graph.get_outgoing_relations(entity)
5 if "lion's head" in relations_out:
6 above_desc += "with a sculpted lion's head"
7 if 'over' in relations_out["lion's head"].get('spatial',
'').split(','):
8 above_desc += " is situated above the fountain."
9 break
10 return above_desc
11