Instructions

You can use this demo to predict situations for images of your choice. Start by clicking on the example images. The demo provides the nearest neighbors in the imSitu training set and a list of predicted situations and associated probability. The demo has a 2 second time limit, so please do not try to very large images because they will take the server too long to download. The demo is an implemenation of the Compositional Conditional Random Field, pre-trained using semantic data augmention on 5 million web images, found here.

Click on images to try these examples

Recognize Situations

Paste a url

Upload a file

Results


Query

Similar in imSitu train set

Predicted situations

falling
agent source goal place
person horse land outdoors
0.58372
whipping
agent item tool place
jockey horse whip outdoors
0.10375
rearing
agent place
horse grass
0.07997
stumbling
agent destination place
jockey land outdoors
0.07119
competing
agent competition place
jockey horse race outdoors
0.02464
racing
agent place
horse racetrack
0.01415
yanking
agent yanked yankedpart place
person horse leash outdoors
0.01174
leaping
agent source obstacle destination place
horse land hurdle land outdoors
0.00799
pawing
agent paweditem agentpart place
horse land hoof outdoors
0.00579
dragging
agent item tool contact place
horse man hand rope outside
0.00575