On Device Image Keyword Identification and Content Overlay

Patent metadata

Field	Value
Publication number	US-2016019239-A1
Application number	US-201414332995-A
Country	US
Kind code	A1
Filing date	Jul 16, 2014
Priority date	Jul 16, 2014
Publication date	Jan 21, 2016
Grant date	—

Abstract

An example of a method of keyword identification and content overlay is described. A mobile device identifies a keyword within a file containing one or more images. The identified keyword is compared to a collection of pre-stored keywords. If the identified keyword matches one of the pre-stored keywords, content corresponding to the matched pre-stored keyword is overlaid onto the image and the image with the overlaid content is displayed. A user of the mobile device can select the overlaid content to retrieve additional information related to the identified keyword.

First claim

What is claimed is:

1 . A mobile device, comprising:
a communication interface system, including at least one wireless communication transceiver; an image capture sensor; a user interface; a processor coupled to the communication interface system; a memory; and a content overlay manager program stored in the memory, wherein execution of the content overlay manager program by the processor configures the mobile device to perform functions, including functions to:
obtain a file containing one or more images;
process the file to identify a keyword within the file;
upon identifying the keyword within the file:
determine whether the identified keyword within the file matches a pre-stored keyword in a keyword match database; and
upon determining the identified keyword matches the pre-stored keyword in the keyword match database, overlay content associated with the pre-stored keyword onto a respective image of the one or more images, the overlay location corresponding to the location of the identified keyword within the file; and

present, via the user interface and to a user of the mobile device, the respective image with the overlaid content.

2 . The mobile device of claim 1 , wherein the function to obtain the file comprises at least one of:
capture the one or more images via the image capture sensor; retrieve the file from the memory; or receive the file via the communication interface system.

3 . The mobile device of claim 1 , wherein:
the file contains a photograph; and the function to process the file to identify the keyword comprises functions to:
identify, based on one or more of text recognition, optical character recognition and pattern recognition, the keyword within the photograph;
determine an x,y coordinate location of the keyword within the photograph; and
insert the x,y coordinate location of the keyword into metadata associated with the photograph.

4 . The mobile device of claim 1 , wherein:
the file contains a video; and the function to process the file to identify the keyword comprises functions to:
identify, based on one or both of text recognition and speech recognition, the keyword within the video;
determine a timestamp of the keyword within the video; and
insert the timestamp of the keyword into metadata associated with the video.

5 . The mobile device of claim 1 , further including functions to:
receive, via the wireless transceiver and from a mobile wireless communication network, the keyword match database, the keyword match database including the content associated with the pre-stored keyword; and store the keyword match database in the memory.

6 . The mobile device of claim 5 , wherein the function to determine whether the identified keyword within the file matches the pre-stored keyword in the keyword match database comprises functions to:
compare the identified keyword with the pre-stored keyword in the keyword match database; and determine the identified keyword matches the pre-stored keyword when the identified keyword and the pre-stored keyword are at least substantially identical.

7 . The mobile device of claim 5 , further including a function to subsequently receive, via the wireless transceiver and from the mobile wireless communication network, a periodic update to the keyword match database.

8 . The mobile device of claim 1 , wherein the function to determine whether the identified keyword within the file matches the pre-stored keyword in the keyword match database comprises functions to:
send the identified keyword via the wireless transceiver to a keyword match database server; and receive, via the wireless transceiver and from the keyword match database server, the content associated with the pre-stored keyword when the keyword match database server determines the identified keyword and the pre-stored keyword are substantially identical.

9 . The mobile device of claim 1 , wherein the function to present the respective image with the overlaid content comprises functions to:
prompt, via the user interface, the user to accept or deny the overlaid content; and store the respective image with the overlaid content into the file in the memory only upon user acceptance of the overlaid content.

10 . The mobile device of claim 1 , wherein the overlaid content represents a uniform resource locator and further including functions to:
upon selection of the uniform resource locator by the user via the user interface, initiate execution of an appropriate application on the mobile device to access the uniform resource locator; access, via the appropriate application, the uniform resource locator; and present, via the user interface, content obtained as a result of accessing the uniform resource locator.

11 . A method, comprising steps of:
obtaining, by a mobile device, a file containing one or more images; processing, by the mobile device, the file to identify a keyword within the file; upon identifying the keyword within the file:
determining, by the mobile device, whether the identified keyword within the file matches a pre-stored keyword in a keyword match database; and
upon determining the identified keyword matches the pre-stored keyword in the keyword match database, processing a respective image of the one or more images to overlay content associated with the pre-stored keyword onto the respective image, the overlay location corresponding to the location of the identified keyword within the file; and
presenting, to a user via a user interface of the mobile device, the respective processed image with the overlaid content.

12 . The method of claim 11 , wherein the step of obtaining the file comprises at least one of:
capturing the one or more images via an image capture sensor of the mobile device; retrieving the file from a memory of the mobile device; or receiving the file via a communication interface system of the mobile device.

13 . The method of claim 11 , wherein the step of processing the file to identify the keyword within the file further comprises the steps of:
identifying, via one or more of text recognition, optical character recognition, pattern recognition and sound recognition, the keyword within the file, the file containing one of a photograph or a video; determining a location of the keyword within the file, the location being one of an x,y coordinate location of the keyword within the photograph or a timestamp location of the keyword within the video; and inserting the x,y coordinate location into metadata associated with the photograph or the timestamp location into metadata associated with the video.

14 . The method of claim 11 , further comprising steps of:
receiving, by the mobile device and from a mobile wireless communication network, the keyword match database, the keyword match database including the content associated with the pre-stored keyword; and storing the keyword match database in the memory.

15 . The method of claim 14 , wherein the step of determining whether the identified keyword within the file matches the pre-stored keyword in the keyword match database further comprises steps of:
comparing the identified keyword with the pre-stored keyword in the keyword match database; and determining the identified keyword matches the pre-stored keyword when the identified keyword and the pre-stored keyword are at least substantially identical.

16 . The method of claim 14 , further comprising a step of subsequently receiving, by the mobile device and from the mobile wireless communication network, a periodic update to the k

Assignees

• Verizon Patent & Licensing Inc

Inventors

• Bastaldo-Tsampalis Brigitte
• Zhang Ning
• Li Yuk Lun

Classifications

• G06V10/7788

  the supervisor being a human, e.g. interactive learning with a human teacher · CPC title

• G06F18/41

  Interactive pattern learning with a human teacher · CPC title

• G06V30/10

  Character recognition · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06F17/30256 Primary

  Physics · mapped topic