System and method for integrating an electronic pointing device into digital image data

Patent metadata

Field	Value
Publication number	US-12301651-B2
Application number	US-201916390111-A
Country	US
Kind code	B2
Filing date	Apr 22, 2019
Priority date	Jun 22, 2010
Publication date	May 13, 2025
Grant date	May 13, 2025

Abstract

A method and system is provided for creating an integrated video stream based on relative location and movement of a wireless pointing device. The system includes a receiver for continuously receiving position data from a wireless pointing device and a processor for calculating an initial position and orientation of the wireless pointing device based on the position data received from the wireless pointing device, accessing additional data from a secondary source based on input data received from the wireless pointing device, and creating the integrated video stream based on an original video stream, the initial position and orientation of the wireless pointing device and the additional data accessed from the secondary source. The system further includes a server for transmitting the integrated video stream to the wireless pointing device to be rendered on a screen thereof.

First claim

What is claimed is:

1. A method comprising:
determining, based on a first content stream bound for a display device at a premises, image data associated with the first content stream;
receiving, from a user device at the premises, orientation data;
determining, based on the orientation data, position data associated with a position indicator;
generating, by a processing system remote to the premises, based on the first content stream and the position data associated with the position indicator, a second content stream comprising the position indicator; and
sending, by the processing system, to the display device, the second content stream.

2. The method of claim 1 , wherein the first content stream and the second content stream comprise an internet protocol data stream.

3. The method of claim 1 , wherein the orientation data is configured to indicate an orientation of the user device relative to the display device and wherein the position data is configured to indicate a position on the display device relative to other image data output on the display device.

4. The method of claim 1 , wherein the image data comprises pixel data.

5. The method of claim 1 , wherein the second content stream comprises second image data associated with the position data, wherein the second image data is configured to cause output of the position indicator.

6. The method of claim 1 , further comprising causing output of the second content stream, wherein causing output of the second content stream comprises rendering image data on the display device.

7. The method of claim 1 , further comprising:
receiving, from the user device, updated orientation data associated with the user device; and
generating, based on the updated orientation data, an updated second content stream, wherein the updated second content stream comprises an updated position indicator.

8. The method of claim 1 , further comprising sending, to the processing system remote to the premises, the orientation data.

9. One or more non-transitory computer-readable media storing processor-executable instructions thereon that, when executed by a processor, cause the processor to:
receive, from a content source, a first content stream bound for a display device at a premises;
determine, based on the first content stream, image data associated with the first content stream;
receive, from a user device at the premises, orientation data;
determine, based on the orientation data, position data associated with the a position indicator;
generate, by a processing system remote to the premises, based on the first content stream and the position data, a second content stream; and
send, by the processing system, to the display device, the second content stream.

10. The computer-readable media of claim 9 , wherein the first content stream and the second content stream comprise an internet protocol data stream.

11. The computer-readable media of claim 9 , wherein the orientation data is configured to indicate an orientation of the user device relative to the display device and wherein the position data is configured to indicate a position on the display device relative to other image data output on the display device.

12. The computer-readable media of claim 9 , wherein the image data comprises pixel data.

13. The computer-readable media of claim 9 , wherein the second content stream comprises second image data associated with the position data, wherein the second image data is configured to cause output of the position indicator.

14. The computer-readable media of claim 9 , wherein the processor-executable instructions, when executed by at least one processor, further cause the at least one processor to cause output of the second content stream, wherein causing output of the second content stream comprises rendering image data on the display device.

15. The computer-readable media of claim 9 , wherein the processor-executable instructions, when executed by at least one processor, further cause the at least one processor to:
receive, from the user device, updated orientation data associated with the user device; and
generate, based on the updated orientation data, an updated second content stream, wherein the updated second content stream comprises an updated position indicator.

16. The one or more non-transitory computer-readable media of claim 9 , wherein the processor-executable instructions, when executed by the processor, further cause the processor to sending, to the processing system remote to the premises, the orientation data.

17. A system comprising:
a computing device configured to:
receive, from a content source, a first content stream bound for a display device at a premises;
determine, based on the first content stream, image data associated with the first content stream;
receive, from a user device, orientation data;
determine, based on the orientation data, position data associated with a position indicator;
generate, by a processing system remote to the premises, based on the first content stream and the position data, a second content stream;
send, by the processing system, to the display device, the second content stream; and

the display device configured to:
output the second content stream.

18. The system of claim 17 , wherein the first content stream and the second content stream comprise an internet protocol data stream, and wherein the image data comprises pixel data.

19. The system of claim 17 , wherein the orientation data is configured to indicate an orientation of the user device relative to the display device and wherein the position data is configured to indicate a position on the display device relative to other image data output on the display device.

20. The system of claim 17 , wherein the second content stream comprises second image data associated with the position data, wherein the second image data is configured to cause output of the position indicator.

21. The system of claim 17 , wherein the computing device is further configured to cause output of the second content stream, wherein causing output of the second content stream comprises rendering image data on the display device.

22. The system of claim 17 , wherein the computing device is further configured to:
receive, from the user device, updated orientation data associated with the user device; and
generate, based on the updated orientation data, an updated second content stream, wherein the updated second content stream comprises an updated position indicator.

23. The system of claim 17 , wherein the computing device is further configured to send, to the processing system remote to the premises, the orientation data.

Assignees

• Hsni Llc

Inventors

• Mcdevitt John
• Bunner Sean

Classifications

• H04L65/60

  Network streaming of media packets · CPC title

• G06Q30/0601

  Electronic shopping [e-shopping] · CPC title

• H04N21/42204

  User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205) · CPC title

• H04N21/41265

  having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204) · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title