System and method for integrating an electronic pointing device into digital image data

Patent metadata

Field	Value
Publication number	US-9948701-B2
Application number	US-201615040021-A
Country	US
Kind code	B2
Filing date	Feb 10, 2016
Priority date	Jun 22, 2010
Publication date	Apr 17, 2018
Grant date	Apr 17, 2018

Abstract

A method and system is provided for creating an integrated video stream based on relative location and movement of a wireless pointing device. The system includes a receiver for continuously receiving position data from a wireless pointing device and a processor for calculating an initial position and orientation of the wireless pointing device based on the position data received from the wireless pointing device, accessing additional data from a secondary source based on input data received from the wireless pointing device, and creating the integrated video stream based on an original video stream, the initial position and orientation of the wireless pointing device and the additional data accessed from the secondary source. The system further includes a server for transmitting the integrated video stream to the wireless pointing device to be rendered on a screen thereof.

First claim

What is claimed is:

1. A system for creating a video stream based on a physical location and movement of a wireless pointing device, the system comprising:
a receiver configured to continuously receive physical position data generated by at least one position and movement sensor of a wireless pointing device;
at least one processor configured to:
calculate a position and orientation of the wireless pointing device based on the physical position data received from the position and movement sensor of the wireless pointing device,
access additional data from a secondary source based on input data received from the wireless pointing device, and
based on an initial at least one of the position and orientation of the wireless pointing device and a subsequent change in the at least one of the position and orientation of the wireless pointing device, create and dynamically update a combined new video content stream by modifying an original video stream such that at least a portion of the original video stream is dynamically integrated with at least a portion of the additional data accessed from the secondary source; and

at least one server configured to transmit the combined new video stream to the wireless pointing device to be rendered on a screen thereof.

2. The system of claim 1 , wherein the at least one server is further configured to transmit feedback data to the wireless pointing device, in which the feedback data is generated in response to the physical position data.

3. The system of claim 1 , further comprising a feedback loop between the receiver and the wireless pointing device and wherein the processor is further configured to adjust the combined new video stream based on further changes in at least one of the position and orientation of the wireless pointing device.

4. The system of claim 1 , wherein the physical position data is determined by a user's input on a touch screen of the wireless pointing device.

5. The system of claim 1 , wherein the position and movement sensor of the wireless pointing device is at least one of an accelerometer, a gyroscope, a magnetometer, an optical sensor, and an inertial tracker.

6. A method for creating a video stream based on a physical location and movement of a wireless pointing device, the method comprising:
continuously receiving physical position data generated by at least one position and movement sensor of a wireless pointing device;
calculating, by at least one processor, a position and orientation of the wireless pointing device based on the position data received from the wireless pointing device;
accessing, by the at least one processor, additional data from a secondary source based on input data received from the wireless pointing device;
based on an initial at least one of the position and orientation of the wireless pointing device and a subsequent change in the at least one of the position and orientation of the wireless pointing device, creating and dynamically updating, by the at least one processor, a combined new video content stream by modifying an original video stream such that at least a portion of the original video stream is dynamically integrated with at least a portion of the additional data accessed from the secondary processing system; and
transmitting, by at least one server, the combined new video stream to the wireless pointing device to be rendered on a screen thereof.

7. The method of claim 6 , further comprising transmitting, by the at least one server, feedback data to the wireless pointing device, in which the feedback data is generated in response to the physical position data.

8. The method of claim 6 , further comprising adjusting, using a feedback loop between the at least one processor and the wireless pointing device, the combined new video stream based on further changes in at least one of the position and orientation of the wireless pointing device.

9. The method of claim 6 , further comprising determining, by the at least one processor, the physical position data by a user's input on a touch screen of the wireless pointing device.

10. The method of claim 6 , wherein the at least one position and movement sensor is at least one of an accelerometer, a gyroscope, a magnetometer, an optical sensor, and an inertial tracker.

Assignees

• Hsni Llc

Inventors

• Mcdevitt John

Classifications

• H04N5/4403

  Electricity · mapped topic

• H04L65/60

  Network streaming of media packets · CPC title

• H04N21/4725

  using interactive regions of the image, e.g. hot spots {(details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94)} · CPC title

• G06Q30/0601

  Electronic shopping [e-shopping] · CPC title

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title