Recording method, recording device, and program

Patent metadata

Field	Value
Publication number	US-2024428557-A1
Application number	US-202418823126-A
Country	US
Kind code	A1
Filing date	Sep 3, 2024
Priority date	Mar 30, 2022
Publication date	Dec 26, 2024
Grant date	—

Abstract

There are provided a recording method, a recording device, and a program for efficiently recording accessory information in a frame of moving image data.
There is provided a recording method of recording accessory information in a frame of moving image data including a plurality of frames, the recording method including: a recognition step of recognizing a subject in the frame for each of the frames; a search step of searching for the accessory information that is able to be recorded for the recognized subject among pieces of the accessory information; and a recording step of recording the accessory information in the frame based on a result of the search step, in which, in a case where the number of the frames included in the moving image data is set as a first number and the number of the frames in which the search step is executed is set as a second number, the second number is smaller than the first number.

First claim

What is claimed is:

1 . A recording method of recording accessory information in a frame of moving image data including a plurality of frames, the recording method comprising:
a recognition step of recognizing a subject in the frame for each of the frames; a search step of searching for the accessory information that is able to be recorded for the recognized subject among pieces of the accessory information; and a recording step of recording the accessory information in the frame based on a result of the search step, wherein, in a case where the number of the frames included in the moving image data is set as a first number and the number of the frames in which the search step is executed is set as a second number, the second number is smaller than the first number, and the search step is not executed for the frame in which a shake of a subject or an angle of view is detected.

2 . The recording method according to claim 1 , further comprising:
a first determination step of determining a similarity between a result of the recognition step executed for a first frame among the plurality of frames and a result of the recognition step executed for a second frame different from the first frame among the plurality of frames, wherein, in a case where the similarity determined in the first determination step satisfies a first restriction condition related to an execution of the search step, the execution of the search step for the first frame is restricted.

3 . The recording method according to claim 2 ,
wherein, in a case where a plurality of subjects are recognized in the recognition step for the first frame and the second frame, in the first determination step, priorities are set for the plurality of subjects, and the similarity is determined based on the priorities of the plurality of subjects.

4 . The recording method according to claim 1 ,
wherein, in a case where the number of frames in which the accessory information is recorded in the recording step is set as a third number, the third number is smaller than the second number.

5 . The recording method according to claim 4 , further comprising:
a second determination step of determining a similarity between a result of the search step executed for a first frame among the plurality of frames and a result of the search step executed for a second frame different from the first frame among the plurality of frames, wherein, in a case where the similarity determined in the second determination step satisfies a second restriction condition related to an execution of the recording step, the execution of the recording step for the first frame is restricted.

6 . The recording method according to claim 5 ,
wherein, in the search step for the first frame and the second frame, in a case where the accessory information that is able to be recorded is searched for a plurality of subjects, in the second determination step, priorities are set to the plurality of subjects, and the similarity is determined based on the priorities of the plurality of subjects.

7 . The recording method according to claim 1 , further comprising:
a receiving step of receiving an input of a user that is related to a recording instruction of the accessory information, wherein the recording step is executed to record the accessory information in an input frame corresponding to the input of the user, among the plurality of frames.

8 . The recording method according to claim 7 ,
wherein, in the recording step for the input frame, information related to the recording instruction is recorded as the accessory information.

9 . The recording method according to claim 8 ,
wherein the recording step is executed to record the accessory information in the input frame and a complementation frame before or after the input frame, among the plurality of frames.

10 . The recording method according to claim 1 ,
wherein the accessory information is stored in a data file different from the moving image data.

11 . A recording device that records accessory information in a frame of moving image data including a plurality of frames, the recording device comprising:
a processor, wherein the processor is configured to execute:
recognition processing of recognizing a subject in the frame for each of the frames;
search processing of searching for the accessory information that is able to be recorded for the recognized subject among pieces of the accessory information; and
recording processing of recording the accessory information in the frame based on a result of the search processing,
wherein, in a case where the number of the frames included in the moving image data is set as a first number and the number of the frames in which the search processing is executed is set as a second number, the second number is smaller than the first number.

12 . A program causing a computer to execute each of the recognition step, the search step, and the recording step included in the recording method according to claim 1 .

Assignees

• Fujifilm Corp

Inventors

• Yamaji Kei
• Kobayashi Toshiki
• Kobayashi Masaru

Classifications

• G06V2201/07

  Target detection · CPC title

• G06V10/761 Primary

  Proximity, similarity or dissimilarity measures · CPC title

• G06T1/00

  General purpose image data processing · CPC title

• H04N5/92

  Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback · CPC title

• G06F16/783

  using metadata automatically derived from the content · CPC title