Interactive binocular video display

Patent metadata

Field	Value
Publication number	US-9591349-B2
Application number	US-201414581548-A
Country	US
Kind code	B2
Filing date	Dec 23, 2014
Priority date	Dec 23, 2014
Publication date	Mar 7, 2017
Grant date	Mar 7, 2017

Abstract

Various systems and methods for providing a repositionable video display on a mobile device, to emulate the effect of user-controlled binoculars, are described herein. In one example, one or more high resolution video sources (such as UltraHD video cameras) obtain video that is wirelessly broadcasted to mobile devices. The mobile device processes the broadcast based on the approximate location of the spectator's mobile device, relative to a scene within the field of view of the mobile device. The location of the mobile device may be derived from a combination of network monitoring, camera inputs, object recognition, and the like. Accordingly, the spectator can obtain a virtual magnification of a scene from an external video source displayed on the spectator's mobile device.

First claim

What is claimed is:

1. A mobile computing device to provide a virtual binocular display, the mobile computing device comprising:
a wireless networking transceiver to receive a selected stream of video data from a video streaming server via a wireless network;
a processor to process video content from the stream of the video data, wherein the selected stream of video data is selected based on a location of the mobile computing device in a viewing area located in proximity to a scene captured in the video data;
a display processor to output a select enhanced portion of the video content on a display screen of the mobile computing device, the select enhanced portion determined based on an orientation of the mobile computing device relative to the scene captured in the video data; and
a camera to capture a digital image of the scene;
wherein operations performed by the processor to process the video content from the stream of the video data include operations to:
perform image recognition of at least one object in the digital image of the scene; and
identify the select enhanced portion of the video content based on a location of the at least one object in the select enhanced portion of the high-definition video.

2. The mobile computing device of claim 1 , wherein the processor operates to generate a graphical user interface, the graphical user interface to receive user commands to effect control of the output of the select enhanced portion of the video content on the display screen, wherein the select enhanced portion of the video content provides a zoomed and panned portion of the video content from the stream of the video data.

3. The mobile computing device of claim 1 , wherein the processor operates to change the select enhanced portion of the video content on the display screen based on at least one motion input detected by the mobile computing device.

4. The mobile computing device of claim 1 , wherein the wireless networking transceiver operates to receive the stream of the video data via operation of the wireless network according to an IEEE 802.11 wireless network protocol, wherein the selected stream of the video data is selected based on a location of the mobile computing device relative to at least one access point of the wireless network located within the viewing area, and wherein an identification of the location of the mobile computing device relative to the access point of the wireless network is communicated to the video streaming server to indicate the location of the mobile computing device.

5. The mobile computing device of claim 1 , wherein the at least one object includes at least one indicator, and wherein the processor operates to correlate the at least one indicator detected in the digital image of the scene to the orientation of the mobile computing device relative to the scene captured in the video data, based on the location of the at least one object in the select enhanced portion of the high-definition video.

6. The mobile computing device of claim 5 , wherein the processor operates to correlate the digital image of at least the portion of the scene including the at least one indicator to the select enhanced portion of the video content.

7. The mobile computing device of claim 6 , wherein the processor operates to compare and match the digital image of at least the portion of the scene captured by the camera with an image of the scene captured in the video data, to determine the orientation of the mobile computing device relative to the scene.

8. A method of displaying streaming video at a mobile device, the method comprising operations executing with hardware components at the mobile device, the operations including:
capturing, with the mobile device, a digital image of a scene;
performing an image recognition of at least one object in the digital image of the scene;
accessing a selected high-definition video stream at the mobile device, the high-definition video stream providing high-definition video of the scene captured in a direction of view away from the mobile device and towards an area of interest of the scene;
determining an orientation of the mobile device relative to the area of interest, based on the at least one object;
selecting a particular zoomed portion of the high-definition video based on determining the orientation of the mobile device relative to the area of interest, the particular zoomed portion of the high-definition video providing a reduced area within the high-definition video; and
displaying the particular zoomed portion of the high-definition video of the scene on the mobile device.

9. The method of claim 8 , further comprising:
panning the high-definition video of the scene to the particular zoomed portion of the high-definition video, the panning performed using the orientation of the mobile device relative to the area of interest; and
zooming the high-definition video of the scene to the particular zoomed portion of the high-definition video, the zooming performed using the orientation of the mobile device relative to the area of interest.

10. The method of claim 8 , further comprising:
providing location information of the mobile device to a remote server, the location information indicating a location of the mobile device in an observation area adjacent to the scene; and
receiving the high-definition video stream from one of a plurality of high-definition video streams, the high-definition video stream selected by the remote server based the location information of the mobile device.

11. The method of claim 8 , wherein the at least one object is a marker, and the method further comprising:
detecting, with the mobile device, the marker in the digital image of the scene; and
wherein the particular zoomed portion of the high-definition video is further selected based on a position of the marker detected by the mobile device within the high-definition video of the scene.

12. The method of claim 11 , wherein correlating the orientation of the mobile device to the particular zoomed portion of the high-definition video includes matching the marker in the digital image of the scene to a marker in an image of the high-definition video of the scene, to simulate a perspective of the scene from the mobile device in the selecting of the particular zoomed portion of the high-definition video.

13. The method of claim 12 , wherein the marker is provided by at least one infrared light positioned in the scene.

14. The method of claim 12 , wherein the marker is a machine-readable object positioned in the scene, the machine-readable object providing an identifier associated with a location relative to the scene.

15. The method of claim 8 , further comprising:
displaying an information overlay on the particular zoomed portion of the high-definition video, the information overlay providing information about at least one real-world item portrayed in the particular zoomed portion of the high-definition video.

16. The method of claim 8 , further comprising:
processing at least one user input received in connection with a graphical user interface output with the mobile device, the at least one user input used to:
select the high-definition video stream from among a plurality of high-definition video streams;
perform panning of the high-definition video of the scene to another area of interest of the scene;
or perform zooming of the high-definition video of the scene to generate a zoomed display of another portion of the area of interest of the scene.

17. At least one machine-readable storage medium including instruct

Assignees

• Intel Corp

Inventors

• Assayag Michel
• Taite Shahar
• Wasserblat Moshe
• Rider Tomer
• Pereg Oren
• Sivak Alexander

Classifications

• H04N21/25841 Primary

  involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; arrangements for identifying locations of receiving stations in broadcast systems H04H60/51; location of the user terminal in data switching networks H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00) · CPC title

• H04N21/41407

  embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57) · CPC title

• H04N21/6582

  Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38) · CPC title

• H04N21/4312 Primary

  involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations · CPC title

• H04N21/6181

  involving transmission via a mobile phone network (arrangements for providing broadcast or conference services to substation in data switching networks in combination with wireless systems H04L12/189; wireless uplink channel access H04W74/004) · CPC title