Electronic device and content recognition information acquisition therefor

Patent metadata

Field	Value
Publication number	US-11575962-B2
Application number	US-201917053289-A
Country	US
Kind code	B2
Filing date	Mar 21, 2019
Priority date	May 21, 2018
Publication date	Feb 7, 2023
Grant date	Feb 7, 2023

Abstract

Disclosed are a method for recognizing an image by an electronic device and a configuration of the electronic device for same. The method for recognizing an image by an electronic device of the present disclosure comprises the steps of: capturing an image of content; acquiring, form a server, content recognition information matching a recognized text by recognizing the text from a text area, if the text area is identified in the captured image, and acquiring, from the server, content recognition information matching an extracted fingerprint by extracting the fingerprint from the captured image, if the text area is not identified in the captured image; and storing at least one of the content recognition information matching the acquired text and the content recognition information matching the fingerprint.

First claim

What is claimed is:

1. An electronic device, comprising:
a communicator capable of communicating with a server;
a memory configured to store instructions; and
at least one processor electrically coupled with the communicator and the memory,
wherein the memory is configured to, based on executing the electronic device, store instructions set to cause the at least one processor to:
capture an image of a content;
identify whether a character area is included in the captured image;
based on identifying that the character area is included in the captured image, identify a character included in the character area, transmit information regarding the identified character to a first server, and receive content recognition information matching the identified character from the first server through the communicator;
based on identifying that the character area is not included in the captured image, extract a finger print from the captured image, transmit information regarding the extracted finger print to a second server, and receive content recognition information matching the extracted finger print from the second server through the communicator; and
store at least one from among the content recognition information matching the identified character and the content recognition information matching the finger print in the memory.

2. The electronic device of claim 1 , wherein the memory is configured to, based on the electronic device being executed, store instructions set to cause the processor to, based on the captured image not being a finger print recognition target, receive content recognition information matching the identified character from the first server through the communicator.

3. The electronic device of claim 2 , wherein the memory is configured to, based on the electronic device being executed, store instructions set to cause the processor to, transmit the identified character to the first server, and based on the captured image not being identified as the finger print recognition target based on the transmitted character, receive content recognition information matching the identified character from the first server through the communicator.

4. The electronic device of claim 1 , wherein the memory is configured to, based on the electronic device being executed, store instructions set to cause the processor to, transmit the stored content recognition information to an external analysis server that analyzes a viewing log of a user through the communicator.

5. The electronic device of claim 1 , wherein each of the content recognition information matching the identified character and the content recognition information matching the extracted finger print comprises a metadata related to the captured image, a storing address of the metadata, or an identifier of the metadata.

6. The electronic device of claim 1 , wherein the memory is configured to, based on the electronic device being executed, store instructions set to cause the processor to, identify a type of the content, and based on the identified type of the content, extract a finger print from the captured image and receive content recognition information matching the extracted finger print from the second server through the communicator regardless of whether the character area is identified.

7. A method of obtaining content recognition information, comprising:
capturing an image of a content;
identifying whether a character area is included in the captured image;
based on identifying that a character area is included in the captured image, identifying a character included in the character area, transmitting information regarding the identified character to a first server and receiving content recognition information matching the identified character from the first server;
based on identifying that the character area is not included in the captured image, extracting a finger print from the captured image, transmitting information regarding the extracted finger print to a second server and receiving content recognition information matching the extracted finger print from the second server; and
storing at least one from among the content recognition information matching the identified character and the content recognition information matching the finger print.

8. The method of claim 7 , wherein the receiving of content recognition information matching the identified character from the first server comprises,
based on the captured image not being a finger print recognition target, receiving content recognition information matching the identified character from the first server.

9. The method of claim 8 , wherein based on the captured image not being a finger print recognition target, receiving content recognition information matching the identified character from the first server, comprises:
transmitting the identified character to the first server; and
based on the captured image not being identified as the finger print recognition target based on the transmitted character, receiving content recognition information matching the identified character from the first server.

10. The method of claim 7 , wherein the method further comprises:
transmitting the stored content recognition information to an external analysis server that analyzes a viewing log of a user.

11. The method of claim 7 , wherein the first server which provides content recognition information matching the identified character is a character matching server comprised in the server, and
wherein the second server which provides content recognition information matching the extracted finger print is a finger print matching server comprised in the server.

12. The method of claim 7 , wherein the content recognition information comprises a metadata related to the captured image, a storing address of the metadata, or an identifier of the metadata.

13. The method of claim 7 , further comprising:
based on a character area being identified in the captured image, transmitting the identified character to a character matching server; and
based on a character area not being identified in the captured image, transmitting the extracted finger print to a finger print matching server.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Choi Hyunsoo
• Kim Minsoo
• Kim Sungjin
• Kim Younguk
• Kim Ilkoo
• Kim Hyunhan
• Choi Jiwoong

Classifications

• H04H60/37

  for identifying segments of broadcast information, e.g. scenes or extracting programme ID · CPC title

• H04N21/4622

  Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859) · CPC title

• H04N21/6582

  Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38) · CPC title

• H04N21/47815

  Electronic shopping (payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12) · CPC title

• H04N21/4722 Primary

  for requesting additional data associated with the content · CPC title