System and method for integrating an electronic pointing device into digital image data

Patent metadata

Field	Value
Publication number	US-9294556-B2
Application number	US-201514712269-A
Country	US
Kind code	B2
Filing date	May 14, 2015
Priority date	Jun 22, 2010
Publication date	Mar 22, 2016
Grant date	Mar 22, 2016

Abstract

A method and system is provided for creating a new video stream having an electronic pointer rendered therein. The disclosed system includes a receiver that continuously receives position data from a wireless pointing device; a calibration unit that calculates positions for the electronic pointer relative to a viewing device based on the position data received from the wireless pointing device; a processor that renders the electronic pointer in an original video feed received from a video source to create the new video stream as a single data stream, such that the electronic pointer is positioned at locations in the new video stream that correspond to the calculated positions for the electronic pointer; and a server that transmits the new video stream to the wireless pointing device to be rendered on a screen of the wireless pointing device.

First claim

What is claimed is:

1. A system for creating a new video stream having an electronic pointer rendered therein, the system comprising:
a receiver configured to continuously receive position data from a wireless pointing device;
at least one processor configured to:
calculate positions for the electronic pointer relative to a viewing device based on the position data received from the wireless pointing device;
render the electronic pointer in an original video feed received from a video source to create the new video stream as a single data stream, such that the electronic pointer is positioned at locations in the new video stream that correspond to the calculated positions for the electronic pointer; and
at least one server configured to transmit the new video stream to the wireless pointing device to be rendered on a screen of the wireless pointing device.

2. The system of claim 1 , wherein the at least one server is further configured to transmit feedback data to the wireless pointing device, in which the feedback data is generated in response to the position data.

3. The system of claim 2 , wherein the feedback data transmitted by the at least one server to the wireless pointing device indicates that the current position for the electronic pointer relative to the viewing device is beyond a screen boundary of the viewing device.

4. The system of claim 1 , further comprising a feedback loop configured to adjust the locations of the electronic pointer in the new video stream based on the position data received from the wireless pointing device.

5. The system of claim 1 , wherein the position data is determined by a user's input on a touch screen of the wireless pointing device.

6. The system of claim 1 , wherein the position data is measured by at least one of an accelerometer, a gyroscope, a magnetometer, an optical sensor, and an inertial tracker.

7. A method for creating a new video stream having an electronic pointer rendered therein, the method comprising:
repeatedly receiving, by a receiver, position data from a wireless pointing device;
calculating, by at least one processor, positions for the electronic pointer relative to a viewing device based on the position data received from the wireless pointing device;
generating, by the at least one processor, the electronic pointer based on the calculated positions for the electronic pointer relative to the viewing device;
creating, by the at least one processor, the new video stream by rendering the electronic pointer in an original video feed received from a video source to create the new video stream as a single data stream, the new video stream having the electronic pointer positioned at locations in the new video stream that corresponds to the calculated positions for the electronic pointer; and
transmitting, by at least one server, the new video stream to the wireless pointing device to be displayed on a screen of the wireless pointing device.

8. The method of claim 7 , further comprising transmitting, by the at least one server, feedback data in response to the position data received from the wireless pointing device.

9. The method of claim 7 , wherein the feedback data indicates that the current position for the electronic pointer relative to the viewing device is beyond a screen boundary of the viewing device.

10. The method of claim 7 , further comprising adjusting, by the at least one processor, the locations of the electronic pointer in the new video stream in response to the position data continuously received from the wireless pointing device.

11. A method for providing data content to a wireless pointing device, the method comprising:
repeatedly receiving, by a receiver, position data from a wireless pointing device;
calculating, by at least one processor, positions for an electronic pointer relative to a viewing device to be rendered in a video feed from a video source based on the position data received from the wireless pointing device;
creating, by the at least one processor, a new video stream by rendering the electronic pointer in the video feed, such that the electronic pointer is positioned at a location in the new video stream feed that corresponds to the calculated current position of the electronic pointer based on the position data received from the wireless pointing device;
receiving, by the receiver, an input selection from the wireless pointing device;
upon receiving the input selection, identifying, by the at least one processor, a current location in the video feed that corresponds to the calculated current position for the electronic pointer;
identifying, by the at least one processor, content in the video feed positioned at the current location;
accessing, by the at least one processor, additional content related to the content identified at the identified current location in the video feed; and
transmitting, by at least one server, the additional data content to the wireless pointing device to be displayed on a screen of the wireless pointing device.

12. The method of claim 11 , further comprising transmitting, by the at least one server, the new video stream to at least one of the viewing device and the wireless pointing device to be displayed thereon.

13. The method of claim 11 , wherein the position data received from the wireless pointing device indicates a physical position of the wireless pointing device relative to the viewing device.

14. The method of claim 11 , wherein the position data received from the wireless pointing device is determined by a user's input on a touch screen of the wireless pointing device.

15. The method of claim 11 , further comprising:
generating, by the at least one processor, feedback data in response to the position data; and
transmitting, by the at least one server, the feedback data to the wireless pointing device.

16. The method of claim 15 , wherein the feedback data transmitted to the wireless pointing device indicates that the current position for the electronic pointer relative to the viewing device is beyond a screen boundary of the viewing device.

17. The method of claim 11 , wherein the additional data content is at least one of a software application to purchase an item related to the identified content in the video feed, a video stream related to the identified content in the video feed, and an electronic game related to the identified content in the video feed.

18. A system for providing data content to a wireless pointing device, the system comprising:
a receiver configured to continuously receive position data from the wireless pointing device;
at least one processor configured to:
calculate positions for an electronic pointer relative to a viewing device to be rendered in a video feed from a video source based on the position data received from the wireless pointing device, and
create a new video stream by rendering the electronic pointer in the video feed, such that the electronic pointer is positioned at a location in the new video stream that corresponds to the calculated current position of the electronic pointer based on the position data;

at least one server configured to transmit the new video stream to at least one of the viewing device and the wireless pointing device to be displayed thereon,
wherein the receiver is further configured to receive an input selection from the wireless pointing device, and, upon receiving the input selection, the at least one processor is further configured to: (i) identify a current location in the video feed that corresponds to the calculated current positio

Assignees

• Hsni Llc
• Hsni Llc

Inventors

• Mcdevitt John
• Bunner Sean

Classifications

• G06F3/038 Primary

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• H04N21/42204

  User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205) · CPC title

• H04L67/10 Primary

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title

• H04N5/4403

  Electricity · mapped topic

• H04N21/4725

  using interactive regions of the image, e.g. hot spots {(details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94)} · CPC title