Instructions

You can use this demo to predict situations for images of your choice. Start by clicking on the example images. The demo provides the nearest neighbors in the imSitu training set and a list of predicted situations and associated probability. The demo has a 2 second time limit, so please do not try to very large images because they will take the server too long to download. The demo is an implemenation of the Compositional Conditional Random Field, pre-trained using semantic data augmention on 5 million web images, found here.

Click on images to try these examples

Recognize Situations

Paste a url

Upload a file

Results


Query

Similar in imSitu train set

Predicted situations

carrying
agent item agentpart place
man baby arm outdoors
0.16050
embracing
agent coagent place
man male child outdoors
0.11375
encouraging
agent reciever place
man male child outdoors
0.08411
hugging
agent hugged agentpart place
male child male child arm outdoors
0.08271
clinging
agent clungto place
male child leg outdoors
0.06109
tickling
agent tickled object place
man male child hand outside
0.05808
patting
agent item tool place
man baby hand outdoors
0.03677
bothering
agent victim action
male child male child touch
0.03357
lifting
agent item start end place
man baby land air outdoors
0.02508
imitating
agent model place
male child father outdoors
0.01662