MPII Cooking Composite Activities

This site hosts the MPII (Max Planck Institute for Informatics) Cooking Composite Activities dataset as well the corresponding publications [1],[2] and code.

Please contact us if you have questions

Download

License

The data is only to be used for scientific purposes and must not be republished other than by the Max Planck Institute for Informatics. The scientific use includes processing the data and showing it in publications and presentations. When using it please cite [1].

Activity Recognition dataset

• README
• Raw data
  • videos as avis (27 GB)
• Video features
  • dense trajectory bag-of-word integral hist (45 GB)
• Attribute groundtruth as Matlab structure (see README)
  • attribute Groundtruth-1-0 (42 MB)
• script data
  • dish id - script id - name (txt file)
  • preprocessed scripts (zip of xml files, 928 KB)
  • aligned scripts (zip of csv files, 200 KB)

See also our cooking activities dataset, which is a subset of this dataset, note that attribute annotations are, although similar, not identical to the ones used in the MPII cooking activities dataset.

Please contact Marcus Rohrbach if you have any questions or interested in other data not published.

We highly recommend a download manager which allows to continue interrupted downloads, under Linux you could try wget.

Supplemental material video

• video showing our system

Acknowledgements

The authors would like to thank the annotators for the effort they put into this project, among others:
Amirhossein Baradaranshahroudi, Florin Haque, Seyed Mehdi Khodadad Hosseini, Dragana Majstorovic, and Banafsheh Sadry

Hardware

The dataset was recorded with a camera system from 4D View Solutions.

Help & Contact

If you need any help or have any suggestions feel free to contact Marcus Rohrbach.
We are looking forward to hear from your success of using the dataset.

Feel free to subsribe to our mailing list to get updates (cookingactivities-join@lists.mpi-inf.mpg.de).

Related datasets of our group

• MPII Cooking Activities (a subset focusing on detecting fine-grained activities)
• Saarbrücken Corpus of Textually Annotated Cooking Scenes (short: TACoS) textual descriptions for MPII Cooking Composite Activities
• MPII Multi-Kinect Dataset: Multi-view kinect object classification, recorded in the same kitchen