System and method for determining the position of an object displaying media content

Patent metadata

Field	Value
Publication number	US-10013623-B2
Application number	US-201213538134-A
Country	US
Kind code	B2
Filing date	Jun 29, 2012
Priority date	Jun 29, 2012
Publication date	Jul 3, 2018
Grant date	Jul 3, 2018

Abstract

A system and method are provided for enabling a primary device to track a secondary device. The method comprises determining a frequency at which a marker is being displayed with media content on the secondary device; capturing images using the primary device at the frequency at which the marker is being displayed; and providing an output on the primary device while the marker is being displayed.

First claim

The invention claimed is:

1. A method, in an environment constituted by a primary device and a secondary device, for the primary device to track the secondary device in the environment and for the primary device to display an augmented reality object associated with the secondary device, the method comprising:
capturing, with an imaging device of the primary device, images of the environment including at least the secondary device displaying media content including an unobtrusive marker, the unobtrusive marker being displayed by the secondary device periodically in a frame, in a stream of frames of the media content, at a frequency that is less than a frame rate of the media content such that the unobtrusive marker is displayed undetectable to an unaided eye while being detectable by the primary device with the imaging device of the primary device;
scanning, with the primary device for displaying an augmented reality object on a display of the primary device, the captured images of the environment containing the secondary device displaying the media content, to detect an occurrence of the unobtrusive marker in the media content and to determine the frequency that the unobtrusive marker is displayed in the media content, and without scanning to detect in the scanned captured images an occurrence of a recognizable object in the media content detectable to an unaided eye;
determining, with the primary device, from the scanned captured images that the unobtrusive marker is being displayed in the media content at the frequency;
tracking, by the primary device, a location of the secondary device in the captured images of the environment based on determination that the unobtrusive marker is being displayed in the media content at the frequency; and
providing, in response to the determination, an output on the primary device based on detecting in the captured images the unobtrusive marker in the media content displayed by the secondary device being tracked by the primary device, the output comprising display, on the display of the primary device, of the captured images of the environment including at least one augmented reality object overlaying the media content displayed by the secondary device.

2. The method of claim 1 , the media content comprising a video, the unobtrusive marker being displayed in at least one frame of the video.

3. The method of claim 1 , the at least one augmented reality object being personalized to a user of the primary device.

4. The method of claim 1 , further comprising the primary device:
determining, based on one or more images of the environment captured with the imaging device of the primary device, that the unobtrusive marker is no longer being displayed in the media content at the frequency;
detecting, within one or more images of the environment being captured with the imaging device, a second unobtrusive marker integral to different media content being displayed by another secondary device, the second unobtrusive marker displayed periodically in a frame, in a stream of frames of the displayed different media content, at a second frequency that is less than a frame rate of the different media content such that the second unobtrusive marker is displayed undetectable to an unaided eye while being detectable by the primary device with an imaging device of the primary device;
scanning, with the primary device, the one or more captured images of the environment containing the another secondary device displaying the different media content, to detect occurrence of the second unobtrusive marker in the different media content and to determine a second frequency that the second unobtrusive marker is displayed in the different media content, and without scanning to detect in the scanned captured images an occurrence of a recognizable object in the different media content detectable to an unaided eye;
determining, with the primary device, from the one or more scanned captured images that the second unobtrusive marker is being displayed in the different media content at the second frequency;
tracking, by the primary device, a location of the another secondary device in the captured images of the environment based on the determining that the second unobtrusive marker is being displayed in the different media content at the second frequency; and
providing, in response to the determining that the second unobtrusive marker is being displayed at the second frequency, another output on the primary device based on detecting within the one or more captured images the second unobtrusive marker integral to the different media content being displayed by the another secondary device, the another output comprising display, on the display of the primary device, of the captured images of the environment including a second augmented reality object overlaying the different media content displayed by the another secondary device.

5. The method of claim 1 , wherein the media content being displayed on the secondary device is previously known to the primary device.

6. The method of claim 1 , further comprising the primary device:
identifying information in the media content being displayed; and
requesting data from an external source to determine a timing of display frequency of the unobtrusive marker in the media content.

7. The method of claim 5 , wherein the media content including the at least one recognizable object comprising the unobtrusive marker being displayed by the secondary device is being provided to the secondary device by the primary device.

8. The method of claim 1 , further comprising the primary device applying analytics to confirm that the at least one recognizable object has been detected.

9. The method of claim 4 , wherein the detected second unobtrusive marker integral to the different media content is different than the unobtrusive marker in the media content, and wherein the providing the another output comprises:
displaying on the display of the primary device another augmented reality object overlaying a representation of the media content displayed by the another secondary device and captured by the imaging device of the primary device, the displayed another augmented reality object being
customized to the different media content displayed by the another secondary device, and
different than the displayed augmented reality object overlaying a representation of the media content displayed by the secondary device and captured by the imaging device of the primary device.

10. The method of claim 1 , wherein the providing an output comprises:
providing a first output on the primary device while periodically detecting in the captured images the at least one recognizable object comprising the unobtrusive marker in the media content displayed by the secondary device.

11. The method of claim 10 , wherein the output on the primary device comprises the first output and a second output, different from the first output, and the providing an output further comprising:
providing the second output on the primary device in response to the primary device no longer periodically detecting in the captured images the at least one recognizable object comprising the unobtrusive marker in the media content displayed by the secondary device.

12. The method of claim 1 , wherein the providing the output comprises:
displaying the augmented reality object in a location and orientation such that the augmented reality object accurately and unobstructively overlays the media content displayed by the secondary device while the tracked location of the secondary device displaying the media content moves in the displayed captured images.

13. A primary electr

Assignees

• Walker David Ryan
• Fyke Steven Henry
• Blackberry Ltd

Inventors

• Walker David Ryan
• Fyke Steven Henry

Classifications

• G06F3/147 Primary

  using display panels · CPC title

• G06V10/245

  by locating a pattern; Special marks for positioning · CPC title

• G09G2340/12

  Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels · CPC title

• G06K9/3216 Primary

  Physics · mapped topic

• G09G2340/0464

  Positioning · CPC title