Method and device for recognizing content

Patent metadata

Field	Value
Publication number	US-11012739-B2
Application number	US-201716084030-A
Country	US
Kind code	B2
Filing date	Mar 14, 2017
Priority date	Mar 16, 2016
Publication date	May 18, 2021
Grant date	May 18, 2021

Abstract

Provided is a method, performed by a device, of recognizing content, the method including selecting a template to be used for recognizing content displayed on the device when a type of a content service that provides the content to the device is determined; capturing a screen of the device when a control signal is received by the device; determining whether the captured screen corresponds to a gateway page; determining whether the captured screen corresponds to the selected template when the captured screen corresponds to the gateway page; and generating a template corresponding to the content service, based on the captured screen, when the captured screen does not correspond to the selected template.

First claim

The invention claimed is:

1. A method, performed by a device, of recognizing content, the method comprising:
selecting a template used for recognizing content displayed by the device, based on a type of a content service that provides the content to the device;
capturing at least a first screen of displayed content and a second screen of displayed content, based on the device receiving a control signal;
comparing the captured first screen to the captured second screen to determine whether the captured first screen corresponds to a gateway page comprising content recognition information; and
based on determining that the captured first screen corresponds to the gateway page:
determining whether the captured first screen corresponds to the selected template;
extracting content recognition information from the captured first screen using the selected template, based on determining that the captured first screen corresponds to the selected template; and
generating a template corresponding to the content service, based on a layout of components included in the captured first screen, based on determining that the captured first screen does not correspond to the selected template.

2. The method of claim 1 , wherein the generating of the template comprises:
recognizing the layout of the components included in the captured first screen,
wherein the generated template comprises default components corresponding to the components, based on the recognized layout.

3. The method of claim 1 , wherein the generating of the template comprises:
recognizing a text region included in the captured first screen,
wherein the generated template comprises information about a position and arrangement of the recognized text region.

4. The method of claim 1 , further comprising:
determining the type of the content service that provides the content to the device,
wherein the selecting of the template comprises:
based on a template corresponding to the type of the content service not being stored in the device, selecting, as the template used for recognizing content, a predetermined template.

5. The method of claim 1 , further comprising:
detecting a text region from the captured first screen by using the generated template; and
recognizing displayed content, based on text detected from the detected text region.

6. The method of claim 5 , further comprising:
detecting content recognition information from the detected text by comparing the detected text and at least one text included in a meaning recognition model.

7. The method of claim 6 , further comprising:
updating the generated template based on a display position of the content recognition information.

8. A device comprising:
a display;
an input device; and
a processor configured to:
select a template used for recognizing content displayed on the display, based on a type of the content service that provides the content to the device;
control to capture at least a first screen of displayed content and a second screen of displayed content, based on a control signal corresponding to an input to the input device;
compare the captured first screen to the captured second screen to determine whether the captured first screen corresponds to a gateway page comprising content recognition information; and
based on determining that the captured first screen corresponds to the gateway page:
determine whether the captured first screen corresponds to the selected template;

extracting content recognition information from the captured first screen using the selected template, based on determining that the captured first screen corresponds to the selected template; and
generate a template corresponding to the content service based on a layout of components included in the captured first screen, based on determining that the captured first screen does not correspond to the selected template.

9. The device of claim 8 , wherein the processor is further configured to recognize the layout of the components included in the captured first screen,
wherein the generated template comprises default components corresponding to the components, based on the recognized layout.

10. The device of claim 8 , wherein the processor is further configured to recognize a text region included in the captured first screen,
wherein the generated template comprises information about a position and arrangement of the recognized text region.

11. The device of claim 8 , wherein the processor is further configured to:
determine the type of the content service that provides the content to the device; and
based on a template corresponding to the type of the content service not being stored in the device, select, as the template used for recognizing content, a predetermined template.

12. The device of claim 8 , wherein the processor is further configured to:
detect a text region from the captured first screen by using the generated templates; and
recognize displayed content, based on text detected from the detected text region.

13. The device of claim 12 , wherein the processor is further configured to detect content recognition information from the detected text by comparing the detected text and at least one text included in a meaning recognition model.

14. The device of claim 13 , wherein the processor is further configured to update the generated template based on a display position of the content recognition information.

15. A non-transitory computer-readable recording medium on which a program for recognizing content is recorded, the program, when executed by a processor of an electronic device, causing the processor to control the electronic device to perform operations comprising:
selecting a template used for recognizing content displayed by the device, based on a type of a content service that provides the content to the device;
capturing at least a first screen of displayed content and a second screen of displayed content, based on the device receiving a control signal;
comparing the captured first screen to the captured second screen to determine whether the captured first screen corresponds to a gateway page comprising content recognition information; and
based on determining that the captured first screen corresponds to the gateway page:
determining whether the captured first screen corresponds to the selected template;
extracting content recognition information from the captured first screen using the selected template, based on determining that the captured first screen corresponds to the selected template; and
generating a template corresponding to the content service, based on a layout of components included in the captured first screen, based on determining that the captured first screen does not correspond to the selected template.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Chang Tae-Kwon
• Kim Sang-Ha
• Kim Sung-Jin
• Kim Il-Koo
• Park Sung-Kweon
• Park Young-O
• Jang Won-Young

Classifications

• G06Q30/0251 Primary

  Targeted advertisements · CPC title

• G06V10/24

  Aligning, centring, orientation detection or correction of the image · CPC title

• H04N21/44008 Primary

  involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04N21/4316

  for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window · CPC title

• H04N21/4314

  for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid · CPC title