Object information derived from object images

Patent metadata

Field	Value
Publication number	US-9360945-B2
Application number	US-201414569766-A
Country	US
Kind code	B2
Filing date	Dec 14, 2014
Priority date	Nov 6, 2000
Publication date	Jun 7, 2016
Grant date	Jun 7, 2016

Abstract

Search terms are derived automatically from images captured by a camera equipped cell phone, PDA, or other image capturing device, submitted to a search engine to obtain information of interest, and at least a portion of the resulting information is transmitted back locally to, or nearby, the device that captured the image.

First claim

What is claimed is:

1. A method of enabling an interaction with on-screen video content, comprising:
obtaining, via a mobile device, image data associated with on-screen video content;
deriving a search term from the image data;
recognizing at least a portion of the on-screen video content as including a representation of a target object via a query of a data set indexing a collection of data associated with known target objects using the search term;
obtaining, via an address, content information corresponding to the target object; and
enabling, via a second mobile device, an interaction associated with the content information based on at least one of the address and the content information.

2. The method of claim 1 , wherein the second mobile device comprises the first mobile device.

3. The method of claim 1 , wherein the on-screen video content includes a representation of an object comprising a tag.

4. The method of claim 3 , wherein the tag comprises at least one of a code, an image, a pattern, a logo and a sign.

5. The method of claim 4 , wherein the tag is time varying.

6. The method of claim 1 , wherein the on-screen video content lacks a representation of a tag.

7. The method of claim 1 , wherein the target object comprises television programming.

8. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a changing of a channel of a television.

9. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a purchase associated with the target object.

10. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a streaming of a sample of a video related to the on-screen video content.

11. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling the second mobile device to display showtimes related to the on-screen video content.

12. The method of claim 11 , wherein enabling the interaction associated with the content information comprises enabling a purchase of a ticket related to the showtimes.

13. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling the second mobile device to make a telephone call related to the on-screen video content.

14. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a real time interaction with the on-screen video content.

15. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a purchase associated with the target object at a reduced price.

16. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling a vote registration related to the on-screen content.

17. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling an indication of an action.

18. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining a television listing corresponding to the target object.

19. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining a telephone number relating to the target object.

20. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining audio content relating to the target object.

21. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining text content relating to the target object.

22. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining video content relating to the target object.

23. The method of claim 1 , wherein enabling the interaction associated with the content information comprises enabling obtaining graphics content relating to the target object.

24. The method of claim 1 , wherein the on-screen video content comprises television programming.

25. The method of claim 1 , wherein the on-screen video content comprises an advertisement.

26. The method of claim 1 , wherein the on-screen video content represents a promotion.

27. The method of claim 1 , wherein the on-screen video content is associated with a game.

28. The method of claim 1 , wherein the on-screen video content comprises symbolic content.

29. The method of claim 1 , further comprising obtaining at least one of a position, a location and an orientation related to the on-screen video content.

30. The method of claim 1 , further comprising obtaining a time of capture of the on-screen video content.

31. The method of claim 1 , further comprising obtaining non-visual information, and wherein deriving the search term further comprises deriving the search term from at least a portion of the non-visual information.

32. The method of claim 31 , wherein the non-visual information comprises audio.

33. The method of claim 1 , wherein the search term comprises a portion of the image data.

34. An on-screen content interaction system comprising:
a device interface configured to receive a digital representation of on-screen video content from a mobile device; and
a processing platform communicatively coupled with the device interface and configured to:
obtain the digital representation via the device interface;
derive a search term from the digital representation;
recognize at least a portion of the on-screen video content as the target object via a query of a data set indexing a collection of data associated with known target objects using the search term;
obtain, via an address, content information corresponding to the target object; and
enable, via a second device, an interaction associated with the content information based on at least one of the address and the content information.

35. The system of claim 34 , wherein the on-screen video content comprises television programming.

36. The system of claim 34 , wherein the target object comprises television programming.

37. The system of claim 34 , wherein the interaction comprises a changing of a channel of a television.

38. The system of claim 34 , wherein the interaction comprises a streaming of a sample of a video related to the target object.

39. The system of claim 34 , wherein the interaction comprises a purchase related to the target object.

40. The system of claim 34 , wherein the interaction comprises an indication of an action.

41. The system of claim 34 , wherein the content information comprises a television listing corresponding to the target object.

42. The system of claim 34 , wherein the content information comprises text content relating to the target object.

43. A portable imaging device, comprising:
a sensor configured to acquire a digital representation of on-screen video content; and
a computing platform coupled

Assignees

• Nant Holdings Ip Llc
• Nant Holdings Ip Llc

Inventors

• Boncyk Wayne C
• Cohen Ronald H

Classifications

• G06F2218/08

  Feature extraction · CPC title

• G06F18/25

  Fusion techniques · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• G06T7/00

  Image analysis · CPC title

• G06Q30/0625

  by formulating product or service queries, e.g. using keywords or predefined options · CPC title