PROVE Explorer
A close-up view of a brown horse. The horse has a thick white blaze running along its face, and next to its face is a rusted-out fence that has thick and thin poles running vertically and horizontally. The top of the head is filled with blonde hair that runs along the horse's neck. Along the backside of the horse, the stomach and rib cage stand out. The feet of the horse are white, and they are standing on a dirt pathway. Behind the horse, there is a grass field that has shade and sunlight. On the other side of the grass field, there is a tree line that is filled with dark green leaves.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "horse" in entity:
3 outgoing_relations = scene_graph.get_outgoing_relations(entity)
4 if 'dirt pathway' in outgoing_relations and
outgoing_relations['dirt pathway']['spatial'] == 'on':
5 if 'grass field' in outgoing_relations and
outgoing_relations['grass field']['spatial'] == 'in front of':
6 face_relations =
scene_graph.get_outgoing_relations("horse's face")
7 if 'fence' in face_relations and
face_relations['fence']['spatial'] == 'next to':
8 return "The horse is on a dirt pathway, in front of
a grass field and next to a rusted-out fence."
9 return None
10
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "top of the head" in entity:
3 hair_relations = scene_graph.get_incoming_relations("top of the
head")
4 if 'hair' in hair_relations and
hair_relations['hair']['spatial'] == 'fill':
5 hair_attributes = scene_graph.get_attributes('hair')
6 if hair_attributes.get('color') == 'blonde':
7 horse_neck_relations =
scene_graph.get_outgoing_relations('hair')
8 if "horse's neck" in horse_neck_relations and
horse_neck_relations["horse's neck"]['spatial'] == 'run along':
9 return "The top of the horse's head is filled with
blonde hair that runs along the horse's neck."
10 return None
11
A medium-close-up view of a layered cake that is brown. The cake is made up of two layers, the top portion of the cake is covered in white cream, while the second portion of the cake is also covered in white cream. The portion also has a small decorative piece located at its center. The cake is sitting on a cardboard cutout that is shaped like a circle. The cake is sitting on a gray plate that is circular and has white trimming. Underneath the plate, there is a white cake stand that has brown trimming. Underneath the stand is a brown mat that is made of lines that run vertically and horizontally. On the left side of the mat, there is a metal holder. The cake is placed inside a fridge.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'mat' in entity:
3 relationships_to = scene_graph.get_outgoing_relations(entity)
4 if 'stand' in relationships_to and 'underneath' in
relationships_to['stand']['spatial']:
5 return entity
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'cake stand' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 relations_out = scene_graph.get_outgoing_relations(entity)
5 if 'plate' in relations_out and 'underneath' in
relations_out['plate']['spatial']:
6 return attributes.get('color', "")
7 return None
8
An outdoor angled down view of a portion of a field that is covered with tall white spring star flowers that are rooted into a ground floor made up of moist dark colored soil and also consists of small green plants. Behind the field covered in white flowers is another field that is made up of only dark colored soil.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'field_2' in entity:
3 incoming_relations = scene_graph.get_incoming_relations(entity)
4 for source_entity in incoming_relations:
5 if 'field_1' in source_entity and 'in front of' in
incoming_relations[source_entity]['spatial']:
6 return source_entity
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'plants' in entity:
3 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
4 return None
5
A monster truck is in the air and jumping over a line of red crushed cars. The truck has a color scheme of red and blue. The word "BIG FOOT" is written on the side of the truck in big white letters. The grille of the truck is silver. An orange truck with black stripes is in the background behind the truck red and blue truck. The word "Hot Wheels" is inside a flame logo on the blue wall. The "H" is partially covered by the truck's shark fin design. An orange van is partially cut off from the right of the image next to a crushed blue car. An audience of people are in the background in the stands watching the trucks.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'truck' in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 for relation, details in relations.items():
5 if "red and blue" in
scene_graph.get_attributes(relation).get('color', "") and 'behind' in
details.get('spatial', ""):
6 return scene_graph.get_attributes(entity).get('color',
"")
7 return None
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if "H" in entity:
3 relations = scene_graph.get_outgoing_relations(entity)
4 for relation, details in relations.items():
5 if "shark fin design" in relation and "partially covered by"
in details.get('spatial', ""):
6 return 'The "H" is partially covered by the truck’s
shark fin design.'
7 return None
A front view of a stone sculpture of a Trojan warrior with a Trojan helmet, shield on his left hand with dirt on it, and a metal spear. The sculpture is on top of a rock with a bigger rock behind it. The rocks are in a fountain of water. Some parts of the water are bubbling and raising from the surface as if it is a mini geyser on the left and right of the sculpture. Light is shining from beneath the water surface. The wing of another sculpture is seen to the left of the Trojan warrior. Another white sculpture is in the background behind the Trojan warrior on a bigger rock formation. A stone pillar is to the right of the Trojan Warrior. Two tops of stone formations are next to each other in the background. Shadows are being cast on the stones. A clear blue nighttime sky is above the sculptures.
0 def execute_command(scene_graph):
1 location = None
2 for entity in scene_graph.get_entities():
3 if 'stone pillar' in entity:
4 outgoing = scene_graph.get_outgoing_relations(entity)
5 if 'Trojan Warrior' in outgoing:
6 location = outgoing['Trojan Warrior'].get('spatial', '')
7 return f"The stone pillar is {location} the Trojan Warrior." if location
else None
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'water' in entity:
3 state = scene_graph.get_attributes(entity).get('state', '')
4 return f"The water is {state} in the fountain."
5 return "No water condition information found."
An eye level side view of a white delivery truck parked on a gray concrete road facing towards the left, the truck is parked on top of painted white lines positioned diagonally and evenly spaced. There is a painting on the side of the the truck of a brown rooster facing towards the right, the rooster is holding a sliver megaphone to its mouth, to the right of the rooster is a donkey pulling a wooden wagon with a man on it, the donkey it facing towards the right. There are red painted letters above the person on the wooden wagon, the letters read, "FARMERS / MARKET". Behind the rooster and donkey are tall painted green mountains and a blue sky full of white puffy cumulus clouds.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'letters' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 text_rendering = attributes.get('text rendering', None)
5 if text_rendering:
6 return text_rendering.strip('"')
7 return None
8
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'letters' in entity:
3 attributes = scene_graph.get_attributes(entity)
4 color = attributes.get('color', None)
5 texture = attributes.get('texture', None)
6 return f"Color: {color}, Texture: {texture}"
7 return None
8
An outdoor top-down view of lane two of a rubber track on a bright sunny day. The white spray-painted stencil font number, "2" sits between two vertical white lines. The three section of the number two have a light outline from overspray. The white paint has been worn, as pieces of the black rubber are visible throughout the number and the lines. Small white pieces of rubber are also visible scattered across the track.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'paint' in entity:
3 return scene_graph.get_attributes(entity).get('state', "")
4 return None
5
A row of five semi truck cabs parked in a semi truck parking lot facing forward pointing slightly to the left. The cabs are white, there are two cabs that are black at the bottom on the right, a cab with a brown bottom to the left, and a cab with an orange bottom to the far left. There is another cab that is only partially in view on the far left side of the image. There is a small black metal bar gate going across the image in front of the semi truck cabs. There is a green strip of grass the gate is placed on, there is a sidewalk going across the grass. At the very bottom of the image a gray cement road is visible. There is a tall light post with a round cement base behind the gate going vertically up the middle of the image. There are two utility wires extending to the top left corner of the image, the top wire has a yellow tube at its base. The sky is almost completely covered in clouds. There is a white building visible behind the semi truck cabs on the right side of the image.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'grass' in entity:
3 relations_in = scene_graph.get_incoming_relations(entity)
4 if 'gate' in relations_in and 'on' in
relations_in['gate']['spatial']:
5 return scene_graph.get_attributes(entity).get('color', '')
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'cab' in entity and 'partially in view' in
scene_graph.get_attributes(entity).get('state', ''):
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'left side of the image' in relations_out and 'on' in
relations_out['left side of the image']['spatial']:
5 return 'on the left side of the image'
6 return None
7
Two small, perfectly round stone structures are laid in a brown soil scattered with gravel. The stone structures are pale gray, with medium gray mottle variations throughout. They are smooth, with no roughness visible. They lay side by side horizontally. The soil below is dry and dust-like in a pale brown shade. The gravel ranges in size from large pebbles to tiny chipped pieces. The gravel has been pushed towards the stones on the left side, with no visible hand or footprints seen in the close-up view. The overcast day gives light while creating soft, small shadows below the stone spheres.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'soil' in entity:
3 return scene_graph.get_attributes(entity).get('texture', '')
4 return None
5
A medium view of a bed with white sheets and wrinkles and two white fluffy pillows. Below is a black leather bench with silver balls all over it. A back long headboard with two vertical lines is standing against a tan wall. On the top left wall there is a black framed, picture hanging up. A light brown marble night stand is next to the bed with a lit florescent silver lamp with a white top and a phone next to it. The reflection of the lamp is seen on the wall. The bottom right corner has a view of a dark gray carpet with black lines.
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'headboard' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'wall' in relations_out and 'against' in
relations_out['wall']['spatial']:
5 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'picture' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'wall' in relations_out and 'on' in
relations_out['wall']['spatial']:
5 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
6 return None
7
0 def execute_command(scene_graph):
1 for entity in scene_graph.get_entities():
2 if 'sheets' in entity:
3 relations_out = scene_graph.get_outgoing_relations(entity)
4 if 'bed' in relations_out and 'on' in
relations_out['bed']['spatial']:
5 return
scene_graph.describe(scene_graph.generate_subgraph([entity]))
6 return None
7