Apparatus and method for recognizing object using correlation between object and content-related information

Patent metadata

Field	Value
Publication number	US-9412049-B2
Application number	US-201514589203-A
Country	US
Kind code	B2
Filing date	Jan 5, 2015
Priority date	Jan 21, 2014
Publication date	Aug 9, 2016
Grant date	Aug 9, 2016

Abstract

An apparatus and method for recognizing an object using correlation information about an object and content-related information which is generated based on the content-related information. The apparatus includes a data classifier, a data analyzer, a correlation manager, and an object identifier.

First claim

What is claimed is:

1. An apparatus for recognizing an object present in multimedia content, which includes image or audio data, internal related-data, and internal metadata, using correlation information between the object and multimedia content-related information, the apparatus comprising:
a data classifier configured to receive the multimedia content from a multimedia content providing apparatus and separate the multimedia content into the internal related-data, the internal metadata, and the image data;
a data analyzer configured to request and receive external content information, analyze the separated internal related-data, internal metadata, and image data and the received external content information, and generate image analysis data to be used to search for and extract, from the multimedia content, information about a correlation between an object included in the multimedia content and multimedia content-related information, wherein the multimedia content-related information is information on recognition of the object and includes the internal related-data and the internal metadata;
a correlation manager configured to store information about a correlation between the object and the multimedia content-related information and generate the correlation information about the object and the multimedia content-related information by matching the generated image analysis data with the stored information about a correlation between the object and the multimedia content-related information; and
an object identifier configured to receive the image data and the generated correlation information and identify a particular object in the image data.

2. The apparatus of claim 1 , wherein the data analyzer comprises:
a related-data analyzer configured to analyze and process the received internal related-data to generate the image analysis data to be matched with the information about a correlation between the object and the multimedia content-related information, and
a metadata analyzer configured to request and receive external content information, and analyze and process the received internal metadata and the external content information to generate the image analysis data to be matched with the information about a correlation between the object and the multimedia content-related information.

3. The apparatus of claim 2 , wherein the metadata analyzer transmits external related-data included in the received external content information to the related-data analyzer to request data analysis.

4. The apparatus of claim 1 , wherein the correlation manager comprises:
a correlation computer configured to store the information about a correlation between the object and the multimedia content-related information and generate the correlation information about the object and the multimedia content-related information by matching the received image analysis data with the information about a correlation between the object and the multimedia content-related information, wherein the generated correlation information is a reference for recognizing the object present in the multimedia content, and
a correlation utilizer configured to change the generated correlation information into an applicable type and format according to object classification and an object recognition technique used by the object identifier.

5. A computer implemented method of recognizing an object present in multimedia content, which includes image or audio data, internal related-data, and internal metadata, using correlation information between the object and multimedia content-related information, the method comprising:
receiving, by a data classifier loaded on at least one hardware processor, the multimedia content including the object and separating the multimedia content into the internal related-data, the internal metadata, and the image data according to properties;
receiving, by a data analyzer loaded on the at least one hardware processor, the separated internal related-data, internal metadata, and image data and generating image analysis data by analyzing and processing the received internal related-data, internal metadata, and image data, wherein the image analysis data is to be matched with information about a correlation between the object and related information, wherein the multimedia content-related information is information on recognition of the object and includes the internal related-data and the internal metadata;
generating, by a correlation manager loaded on the at least one hardware processor, correlation information about the object and the multimedia content-related information by matching the generated image analysis data and the information about a correlation between the object and multimedia content-related information, wherein the correlation information is a reference for recognizing the object present in the multimedia content; and
identifying, by an object identifier loaded on the at least one hardware processor, the object present in the multimedia content using the generated correlation information.

6. The method of claim 5 , wherein the generating of the image analysis data comprises:
requesting the external content information, receiving the requested external content information, and generating the image analysis data to be matched with the information about a correlation between the object and the multimedia content-related information by analyzing and processing external metadata included in the received external content information and the received internal related-data,
in response to a determination that an additional analysis is required for the external related-data included in the received external content information, transmitting the external related-data to request data analysis, and
generating the image analysis data to be matched with the information about a correlation between the object and the multimedia content-related information by analyzing and processing the received internal related-data and the external related-data.

7. The method of claim 5 , wherein the generating of the correlation information comprises:
generating the correlation information about the object and the multimedia content-related information by matching the received image analysis data with the information about a correlation between the object and multimedia content-related information, wherein the correlation information is a reference for recognizing the object present in the multimedia content, and
changing the generated correlation information into an applicable type and format according to object classification and an object recognition technique for recognizing the object in the multimedia content.

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Park So Yung
• Kim Hwa Suk
• Sim Jae Cheol
• Yu Cho Rong
• Cho Kee Seong

Classifications

• F16B37/16 Primary

  Wing-nuts (F16B37/14 takes precedence) · CPC title

• F16B39/282

  Locking by means of special shape of work-engaging surfaces, e.g. notched or toothed nuts · CPC title

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G06F18/24155

  Bayesian classification · CPC title

• G06F16/5854 Primary

  using shape and object relationship · CPC title