> HOME > Data List > OSX Cooking Video Dataset (COM Kitchens)

OSX Cooking Video Dataset (COM Kitchens)

The dataset has been deposited by OMRON SINIC X Corporation (OSX) in accordance with the requirements set by NII for provision to researchers.

update: 2024-09-26

Outline of the Data

The dataset was collected and annotated through joint research between OMRON SINIC X Corporation and Cookpad Inc. It comprises 177 videos filmed in 76 household kitchens, featuring dishes from 157 distinct recipes.

Additionally, 116 of these videos (approximately 32 hours, from 56 households, covering 113 recipes) are annotated using Visual Action Graphs with English translations of the recipes.
(NOTE: These data correspond to the training and validation sets described in the paper below. The dataset from IDR does not include the test set.)

The video data is available in MP4 format, and annotations are provided in JSON format, with a total size (compressed file) of approximately 260GB.

For more details, please refer to the arXiv paper.

And for detailed annotation information, please refer to the dataset's benchmarking task GitHub repository.

Update Information

  • Overseas distribution began. (2024/09/26)

User Qualification

  • The use of the dataset is strictly limited to academic research. Please note that the dissemination of research outcomes on the web by users outside the context of academic presentations is not permitted.
    • For example, it is acceptable to appropriately cite figures from papers and presentation slides that are publicly available through academic conferences/journals. However, it is prohibited to upload results that are not publicly disclosed as an academic publication to your own web pages or social media for publicity purposes. For more details, please refer to Article 11 of the Terms of Use.
  • Eligible users include universities and incorporated entities such as independent administrative agencies to which academic research institutions belong.
  • The unit of provision is a research laboratory (or a group equivalent to a laboratory in the case of entities other than universities).

Data Provision

The data will be provided by downloading from the IDR's Web server.

Application

To apply for this dataset, follow the steps below. You must agree to the terms and conditions specified.

  1. Fill out the application form with required details, such as institution name, principal investigator, and intended use (all fields are mandatory).

    Note: Submitted information will be provided to OMRON SINIC X Corporation and Cookpad Inc. and will be used to review the application, to identify the user, to contact the user regarding the dataset and to request usage reports, as well as to use for usage statistics and for various announcement from the IDR office.

  2. Review the "OSX Cooking Video Dataset (COM Kitchens)" Terms of Use and the Terms of IDR Dataset Service, then click the "Submit" button.
  3. An email will be sent to the "Representative's Email Address." Follow the instructions in the email to complete the application process.
  4. Then, the application will go through the review process (please note that this may take a week or two). You may be requested to make corrections, if necessary. Please note that as the result of the review, your application may not be approved.
  5. Once your application is approved, the access information to the dataset will be sent to the "Representative's Email Address."

(All fields are mandatory.)

Postal Address

Name of University or Research Institution

Name of Laboratory or Section

Representative's Name

*Please enter the name of the person in charge of the laboratory or section mentioned above, or the person responsible for managing the dataset (an individual equivalent to a full-time employee). (Students are not eligible)

Representative's Job Title

Representative's Email Address

*Please enter the individual email address issued by the affiliated institution. After providing the dataset, the user will be registered to the users's mailing list.

Purpose of Use
(256 chars max)

Example: "Participation in the XXX competition using this dataset," "Research on cooking video search techniques," "Research on cooking video captioning," "Research on understanding Hand-Object Interaction," etc.

Terms of Use

I agree to the following terms:
Submit Application

Please check your input carefully and press the button below.

*A confirmation email will be sent to the "Representative's Email Address."
Please check the contents of the email and click the link of "Confirm Application" within 24 hours.

Usage Report, etc.

  • Please submit a report on publications at conferences and in journals every year in response to a request from the IDR office.
  • For more information, please refer to the User Guide Page.

Contact (IDR Office)

IDR Office, National Institute of Informatics

Email
idr [at] nii.ac.jp
Address
2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo 101-8430, JAPAN

(Please use email for communicating with us if not otherwise specified.)

Page for Users (For Data Users)

Information for users of the "OSX Cooking Video Dataset" is provided here. → Page for Users