System and method for recognition of items in media data and delivery of information related thereto

Patent metadata

Field	Value
Publication number	US-9344774-B2
Application number	US-201514848755-A
Country	US
Kind code	B2
Filing date	Sep 9, 2015
Priority date	Jan 18, 2011
Publication date	May 17, 2016
Grant date	May 17, 2016

Abstract

The system and method disclosed herein relate to the establishment of both the location and identity of individual items in pictures or videos. Once the one or more items in the picture/video are identified and matched to images in a reference database, the locations of the items are established and additional information relating to the items is accessed. Collectively, the position data and additional data is merged in the electronic pictures or videos and then provided to a user as a merged data stream. Additional functionality related to those identified items can occur when those identified locations are “pointed to”, “clicked” or otherwise selected (e.g., purchase an item, request information, select another video stream, play a game, share the item, rate, “Like”, and the like).

First claim

What is claimed is:

1. A system for recognizing individual items in images contained in video source content and delivering related information, the system comprising:
at least one electronic database storing a plurality of digital images and information related to each of the plurality of digital images;
at least one processor communicatively coupled to the at least one electronic database, the at least one processor configured to:
(1) scan at least one of the images contained in the video source content and dynamically compare individual elements in the at least one image with the plurality of digital images stored in the at least one electronic database to identify at least one individual item in the at least one image that matches at least one of the plurality of digital images stored in the at least one electronic database, and
(2) access the information stored in the at least one electronic database that is related to the at least one digital image that matches the identified at least one individual item; and

a server configured to transmit the information related to the at least one digital image to a display device that receives the video source content as a separate data stream from the information and renders the information accessible in conjunction with the at least one image of the video source content being displayed on the display device.

2. The system of claim 1 , wherein the at least one processor is further configured to generate coordinate position data indicating a position of the identified at least one individual item in the at least one image contained in the video source content.

3. The system of claim 2 , wherein the server is further configured to transmit the coordinate position data with the information related to the at least one digital image to the display device that displays the at least one image with at least one electronic indicator, which is based on the coordinate position data, for the identified at least one individual item such that the identified at least one individual item is selectable to access the information.

4. The system of claim 2 , wherein the at least one processor comprises:
a first processor configured to scan the at least one image contained in the video source content and identify the at least one individual item in the at least one image that matches one of the plurality of digital images stored in the at least one electronic database,
a second processor configured to access the information stored in the at least one electronic database that is related to the at least one digital image that matches the identified at least one individual item, and
a third processor configured to generate coordinate position data indicating a position of the identified at least one individual item in the video source content.

5. The system of claim 3 , wherein the processor is further configured to update the coordinate position data indicating the position of the identified at least one individual item.

6. The system of claim 1 , wherein the images are part of a video feed.

7. The system of claim 1 , wherein the images are part of at least one picture.

8. The system of claim 1 , wherein the at least one electronic database comprises a first electronic database storing the plurality of digital images and a second electronic database storing the information related to each of the plurality of digital images.

9. The system of claim 1 , wherein the processor is further configured to initiate an electronic shopping interaction in response to a user's access of the information related to the at least one digital image.

10. The system of claim 1 , wherein the display device displays the information related to the identified at least one individual item in response to a user's access of such information using the display device.

11. The system of claim 1 , wherein the display device is at least one of a computer, a smartphone, a tablet, a PDA, a television, a viewing device with a set-top box type processor, a Blu-ray player, and a video game console.

12. The system of claim 1 , wherein the information related to the at least one digital image is configured to be access by at least one of the display device or a user of the display device.

13. The system of claim 1 , wherein the processor is further configured to scan the at least one image contained in the video source content and identify a plurality of individual items in the at least one image that matches a plurality of respective digital images stored in the at least one electronic database.

14. A method for recognizing individual items in images contained in video source content and delivering related information, the method comprising:
scanning at least one of the images contained in the video source content from the content source;
dynamically comparing individual elements in the at least one image with a plurality of digital images stored in at least one electronic database to identify at least one individual item in the at least one image that matches at least one of the plurality of digital images stored in the at least one electronic database;
accessing information stored in the at least one electronic database that is related to the at least one digital image that matches the identified at least one individual item; and
transmitting the information related to the at least one digital image to a display device that receives the video source content as a separate data stream from the information and renders the information accessible in conjunction with the at least one image of the video source content being displayed on the display device.

15. The method of claim 14 , further comprising generating coordinate position data indicating a position of the identified at least one individual item in the at least one image contained in the video source content.

16. The method of claim 15 , further comprising transmitting the coordinate position data with the information related to the at least one digital image to the display device that displays the at least one image with at least one electronic indicator, which is based on the coordinate position data, for the identified at least one individual item such that the identified at least one individual item is selectable to access the information.

17. The method of claim 16 , further comprising updating the coordinate position data indicating the position of the identified at least one individual item.

18. The method of claim 14 , further comprising initiating an electronic shopping interaction in response to a user's access of the information related to the at least one digital image.

19. The method of claim 14 , further comprising displaying on the display device the information related to the identified at least one individual item in response to a user's access of such information using the display device.

20. The method of claim 14 , further comprising accessing the information related to the at least one digital image that by at least one of the display device or a user of the display device.

21. The method of claim 14 , further comprising scanning the at least one image contained in the video source content and identifying a plurality of individual items in the at least one image that matches a plurality of respective digital images stored in the at least one electronic database.

22. A method for recognizing individual items in images contained in video source content and delivering related information, the method comprising:
transmi

Assignees

• Hsni Llc

Inventors

• Mcdevitt John

Classifications

• H04N21/8133 Primary

  specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme · CPC title

• H04N21/8126

  involving additional data, e.g. news, sports, stocks, weather forecasts · CPC title

• H04N21/47815

  Electronic shopping (payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12) · CPC title

• G06F16/70

  of video data · CPC title

• H04N21/23614

  Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28) · CPC title