Supplemental video content on a mobile device

Patent metadata

Field	Value
Publication number	US-9814977-B2
Application number	US-83565710-A
Country	US
Kind code	B2
Filing date	Jul 13, 2010
Priority date	Jul 13, 2010
Publication date	Nov 14, 2017
Grant date	Nov 14, 2017

Abstract

Methods, systems, devices, and software are described for providing supplemental content for display on a mobile device. In one embodiment, a system includes a video display that displays video content. A mobile device with an integrated display may track the video display, with a video camera or other methods, and identify the video content in the tracked video display. The mobile device may access supplemental content related to the identified video content, and display the accessed supplemental content on the integrated display.

First claim

What is claimed is:

1. A system for augmented video, the system comprising:
a video source configured to:
provide video content to a video display, the video content including video segments and a time variable marker anchored to a portion of the video content, wherein the time variable marker comprises a presented pattern in the video content, wherein:
the presented pattern changes over time,
a presented change to the presented pattern corresponds to a time code, identifies the video content, identifies a progression of the video content based on the time code, and does not identify supplemental content, and
the progression indicates a temporal position of a video segment relative to another video segment within the video content; and

a mobile device with an integrated display, the mobile device configured to:
track the video content on the video display using the time variable marker as an anchor;
determine the temporal position of the video segment from the presented change to the presented pattern of the time variable marker;
access, based on the video content and the temporal position, the supplemental content that corresponds to the video segment; and
display the supplemental content on the integrated display, wherein the display of the supplemental content is time synchronized with the display of the video segment based on the presented change to the presented pattern of the time variable marker.

2. The system of claim 1 , wherein the mobile device further comprises an integrated video camera configured to capture the video content for display with the supplemental content on the integrated display.

3. The system of claim 2 , wherein the mobile device identifies the video content by capturing the time variable marker using the integrated video camera.

4. The system of claim 1 , wherein the supplemental content comprises content requested by a user with the mobile device.

5. The system of claim 1 , wherein the video source comprises a video game console, the video content is a video game, and the supplemental content comprises first player-specific information for the video game for a user of the mobile device.

6. The system of claim 5 , further comprising a second mobile device with an integrated display, the second mobile device configured to:
identify the video content displayed on the video display;
track the video content on the video display using the time variable marker as an anchor;
determine a game status of the video game based on the time variable marker;
access second player-specific information for the video game for a user of the second mobile device based on the game status, the second player-specific information different from the first information; and
display the second player-specific information on the integrated display of the second mobile device.

7. The system of claim 1 , wherein the mobile device is configured to track the video display by identifying a position and orientation of the video content relative to the mobile device.

8. The system of claim 1 , further comprising:
a supplemental content datastore, remote from the video display and mobile device and in communication with the mobile device, configured to store the supplemental content, wherein the mobile device accesses the supplemental content from the supplemental content datastore.

9. The system of claim 1 , wherein the mobile device is remote from the video display, and wherein the supplemental content is accessed based on a view angle between the mobile device and the video display.

10. The system of claim 1 , wherein the mobile device and a second mobile device are remote from the video display, wherein a view angle between the mobile device and the video display identifies a user profile associated with a user of the mobile device, wherein a second view angle between the mobile device and the video display identifies a second user profile associated with a second user of the second mobile device, wherein the supplemental content is accessed based on the user profile being identified according to the view angle, and wherein the supplemental content is different from second supplemental content that is accessed based on the second user profile.

11. The system of claim 1 , wherein the mobile device has a stored low-resolution version of the video content, and wherein the display of the supplemental content is time synchronized with the display of the video content by at least performing image matching based on a hash of the stored low-resolution version of the video content.

12. The system of claim 1 , wherein the time variable marker is presented at a frequency not perceptible to the human eye, and wherein the time variable marker is identified based on an application of a Fourier transform to the video segment.

13. The system of claim 1 , wherein the time variable marker further comprises an audio marker, and wherein the temporal position is identified based on the audio marker.

14. A computer-implemented method for augmented video on a mobile device, the method comprising:
identifying video content displayed on a video display, wherein the video content comprises video segments and a time variable marker anchored to a portion of the video content, wherein the time variable marker comprises a presented pattern in the video content, wherein:
the presented pattern changes over time,
a presented change to the presented pattern corresponds to a time code identifies the video content, identifies a progression of the video content based on the time code, and does not identify supplemental content, and
the progression indicates a temporal position of a video segment relative to another video segment within the video content;

identifying the temporal position in the identified video content using the time variable marker;
tracking the video content on the video display using the time variable marker as an anchor;
accessing the supplemental content based on the video content and the temporal position, the supplemental content corresponding to the video segment; and
displaying the supplemental content on the mobile device, wherein the display of the supplemental content is time synchronized with the display of the video segment based on the presented change to the presented pattern of the time variable marker.

15. The computer-implemented method of claim 14 , further comprising:
displaying the video content on the mobile device;
scaling and positioning the supplemental content on the mobile device to avoid overlaying the video content, wherein the supplemental content includes at least one of text, animations, graphic enhancements, advertisements, hyperlinks, and other information.

16. The method of claim 14 , wherein the video content is available from a content source and is presented on a display according to a display rate, wherein the mobile device is configured to identify at time intervals the presented change to the presented pattern of the time variable marker on the display, wherein the time intervals are known to the mobile device and correspond to predefined time intervals that are different from the display rate and that the content source uses to update the time variable marker in the video presentation on the display.

17. A computer-implemented method for augmented video, the method comprising:
identifying video game content displayed on a video display, wherein the video game content comprises video game segments and a time variable marker anchored to a portion of the video game content, wherein the time variable marker comprises a presented pa

Assignees

• Stafford Jeffrey R
• Zhu Yunpeng
• Osman Steven
• Sony Interactive Entertainment Inc

Inventors

• Stafford Jeffrey R
• Zhu Yunpeng
• Osman Steven

Classifications

• A63F13/00 Primary

  Video games, i.e. games using an electronically generated display having two or more dimensions · CPC title

• A63F2300/403

  Connection between platform and handheld device · CPC title

• A63F2300/1093

  using visible light · CPC title

• H04N21/4122

  additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423) · CPC title

• A63F13/213

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title