Augmented reality remote control

Patent metadata

Field	Value
Publication number	US-2016165170-A1
Application number	US-201414559513-A
Country	US
Kind code	A1
Filing date	Dec 3, 2014
Priority date	Dec 3, 2014
Publication date	Jun 9, 2016
Grant date	—

Abstract

An Augmented Reality (AR) device, places manual controls and virtual displays onto a surface of a controllable electronic device (CED) or next to the CED as viewed through the AR device allowing the user to manipulate the controls and view feedback via the virtual displays associated with the controllable device. The AR device overlays an image on a surface of the CED with virtual control objects and virtual feedback image(s) are displayed on a surface of the CED or adjacent to the CED. The user views the control objects and virtual displays on the surface and/or area adjacent to the CED. These control objects are manipulated via voice, hand, head, and eye gestures recognized by the AR device and will be able to see real time feedback displayed on the virtual displays.

First claim

What is claimed is:

1 . A remote controlling system, comprising:
a first device, having a camera, said camera obtaining imaging information about a target device to be controlled, and having a viewable display that shows a view indicative of controls for said target device to be controlled, said first device having a processor, running a program which automatically recognizes at least one aspect of said target device to be controlled based on said imaging information, and using said aspect to create said view on said viewable display, and accepts commands associated with selection of different positions on said viewable display, to produce outputs that control said target device.

2 . The system as in claim 1 , wherein said program recognizes an image of said target device in said imaging information.

3 . The system as in claim 1 , wherein said program recognizes at least one marking in said imaging information.

4 . The system as in claim 1 , wherein said program recognizes a readable code in in said imaging information.

5 . The system as in claim 1 , wherein said program recognizes an image of a remote control for said target device in said imaging information.

6 . The system as in claim 5 , wherein said viewable display displays controls for controlling the target device, where the remote control has controls for controlling the target device, and where the controls on the viewable display are different than the controls on the remote control.

7 . The system as in claim 6 , wherein the controls on the viewable display occupy a larger percentage of the viewable display than the controls on the remote control itself.

8 . The system as in claim 1 , wherein the program queries the target device to obtain information about controlling the target device to produce said outputs that control said target device.

9 . The system as in claim 1 , wherein the program queries a database to obtain information about controlling the target device to produce said outputs that control said target device.

10 . The system as in claim 1 , wherein said first device produces a wireless output that controls the target device.

11 . The system as in claim 1 , wherein the first device accepts gestures from a user to control the target device.

12 . The system as in claim 5 , wherein the viewable display displays controls for targeting or commanding the target device that are different than controls on the remote control.

13 . The system as in claim 1 , further comprising the first device downloading at least one program used for controlling the target device.

14 . The system as in claim 1 , further comprising an additional computing device, communicating with said first device.

15 . A remote controlling system, comprising:
a first device, accessing a database to determine a list of different target devices to be controlled within an area and producing a viewable display showing said target devices, and accepting a selection of a target device among said list of target devices to be controlled, and responsive to accepting said selection of said target device, producing outputs indicative of controlling said target device; said first device having a viewable display that produces an display indicative of controls for said target device to be controlled and responsive to selection of said controls, said first device producing outputs to control said target device.

16 . The system as in claim 15 , wherein said viewable display displays controls for controlling the target device that are controls from a remote control, where the controls on the viewable display occupy a larger percentage of the viewable display than the controls on the remote control itself.

17 . The system as in claim 15 , wherein the first device queries the target device to obtain information about controlling the target device to produce said outputs that control said target device.

18 . The system as in claim 15 , wherein the first device queries a database to obtain information about controlling the target device to produce said outputs that control said target device.

19 . The system as in claim 15 , wherein said first device produces a wireless output that controls the target device.

20 . The system as in claim 15 , wherein the first device accepts gestures from a user to control the target device.

21 . The system as in claim 15 , wherein the first device downloads at least one program used for controlling the target device.

22 . A method of remote control of a target device, comprising:
in a first device, obtaining imaging information about a target device to be controlled; automatically recognizing at least one aspect of said target device to be controlled based on said imaging information; based on said at least one aspect, creating a display of multiple controls for the target device; accepting commands associated with selection of controls among said multiple controls; producing outputs that control said target device, based on said selection.

23 . The method as in claim 22 , wherein said recognizing comprises recognizing an image of said target device in said imaging information.

24 . The method as in claim 22 , wherein said recognizing comprises recognizing at least one marking in said imaging information.

25 . The method as in claim 22 , wherein said recognizing comprises recognizing a readable code in in said imaging information.

26 . The method as in claim 22 , wherein said recognizing comprises recognizing an image of a remote control for said target device in said imaging information.

27 . The method as in claim 26 , wherein said display displays controls for controlling the target device, where the remote control has controls for controlling the target device, and where the controls on the display are different than the controls on the remote control.

28 . The method as in claim 27 , wherein the controls on the display occupy a larger percentage of the display than the controls on the remote control itself.

29 . The method as in claim 22 , further comprising querying the target device to obtain information about controlling the target device to produce said outputs that control said target device.

30 . The method as in claim 22 , wherein the first device accepts gestures from a user to control the target device.

Assignees

• Vizio Inc
• Vizio Inc

Inventors

• Mcrae Matthew Blake

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04N5/4403 Primary

  Electricity · mapped topic

• H04N21/42204 Primary

  User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205) · CPC title

• H04M1/72415

  for remote control of appliances · CPC title

• H04N21/42222

  Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device · CPC title