Wearable electronic glasses that detect movement of a real object copies movement of a virtual object

Patent metadata

Field	Value
Publication number	US-9256072-B2
Application number	US-201314044091-A
Country	US
Kind code	B2
Filing date	Oct 2, 2013
Priority date	Oct 2, 2013
Publication date	Feb 9, 2016
Grant date	Feb 9, 2016

Abstract

A method detects a real object with a wearable electronic device and displays a virtual image of the real object with the real object on a display of the wearable electronic device. The wearable electronic device displays movement of the virtual image of the real object to show a task to be completed and detects a completion of the task.

First claim

What is claimed is:

1. A method, comprising:
detecting, with wearable electronic glasses, a real object that is seen through a lens of the wearable electronic glasses;
displaying, on a display of the wearable electronic glasses, a virtual image of the real object next to the real object;
reducing a size of the virtual image of the real object, on the display of the wearable electronic glasses, when the wearable electronic glasses move to have a field of view that causes an available space to a left or to a right of the real object to be insufficient to display a full-size virtual image of the real object next to the real object;
displaying, on the display of the wearable electronic glasses and while the virtual image of the real object is next to the real object, movement of the virtual image of the real object to show a task to be completed on the real object;
detecting, with the wearable electronic glasses and while the virtual image of the real object is next to the real object, completion of the task on the real object to determine whether the movement of the real object emulates the movement of the virtual image of the real object;
displaying, on the wearable electronic glasses, an indication that the task was correctly completed on the real object when the wearable electronic glasses detect that the movement of the real object emulated the movement of the virtual image of the real object; and
displaying, on the wearable electronic glasses, an indication that the task was not correctly completed on the real object when the wearable electronic glasses detect that the movement of the real object did not emulate the movement of the virtual image of the real object.

2. The method of claim 1 further comprising:
maintaining a consistent distance between the real object and the virtual image of the real object being displayed on the display while the wearable electronic glasses move and change a location of where the real object exists in a field of view of the wearable electronic glasses.

3. The method of claim 1 further comprising:
switching the virtual image of the real object from being located on one side of the real object to being located on an opposite side of the real object when the wearable electronic glasses move to have a field of view that obstructs a view of the virtual image of the real object on the one side.

4. The method of claim 1 further comprising:
translating text of a first language that is located on a surface of the real object into a second language; and
displaying the text in the second language on a surface of the virtual image of the real object such that the virtual image of the real object emulates an appearance of the real object but has the text being displayed in the second language.

5. The method of claim 1 further comprising:
displaying, on a display of a handheld portable electronic device, controls that provide a wearer of the wearable electronic glasses with instructions regarding which direction to move and how fast to move in the direction; and
displaying, on the display of the wearable electronic glasses, the controls that provide the wearer of the wearable electronic glasses with the instructions regarding which direction to move and how fast to move in the direction.

6. The method of claim 1 further comprising:
displaying, on a display of other wearable electronic glasses that are remote from the wearable electronic glasses, video of the real object;
detecting, at the other wearable electronic glasses, movements of a hand of a wearer of the other wearable electronic glasses toward the real object; and
displaying, on the display of the wearable electronic glasses, a virtual hand that emulates the movements of the hand toward the real object.

7. The method of claim 1 further comprising:
displaying the virtual image of the real object superimposed over the real object; and
moving, while the virtual image of the real object is superimposed over the real object, a portion of the virtual image of the real object to show the task to be completed on the real object.

8. Wearable electronic glasses, comprising:
a display;
a memory that stores instructions;
a position sensor; and
a processor in communication with the display, with the position sensor, and with the memory, to execute the instructions to:
detect a real object that is visible through the wearable electronic glasses;
display, on the display and concurrently with the real object, a virtual object that emulates the real object;
reduce, on the display, a size of the virtual object when the wearable electronic glasses move to have a field of view that causes an available space to a left or to a right of the real object to be insufficient to display a full-size virtual object next to the real object;
display, on the display and while the virtual object is concurrently displayed with the real object, movement of the virtual object that shows an action to be performed on the real object;
detect, with the position sensor and while the virtual object is concurrently displayed with the real object, movement of the real object to determine whether the movement of the real object copies the movement of the virtual object;
display, on the display, an indication that the action was correctly completed on the real object when the position sensor of the wearable electronic glasses detects that the movement of the real object copied the movement of the virtual object; and
display, on the display, an indication that the action was not correctly completed on the real object when the position sensor of the wearable electronic glasses detects that the movement of the real object did not copy the movement of the virtual object.

9. The wearable electronic glasses of claim 8 , wherein the processor further executes the instructions to:
track movement of eyes of a wearer of the wearable electronic glasses; and
activate the virtual content to display on the display of the wearable electronic glasses when the eyes of the wearer focus on the real object.

10. The wearable electronic glasses of claim 8 , wherein the processor further executes the instructions to:
receive, from a remote pair of wearable electronic glasses, images of the virtual object that instruct a wearer of the wearable electronic glasses the action to be performed on the real object.

11. The wearable electronic glasses of claim 8 , wherein the processor further executes the instructions to:
display, on the display, the virtual object adjacent to one side of the real object in a field of view of the wearable electronic glasses;
detect movement of the wearable electronic glasses in which the virtual object is no longer within the field of view of the wearable electronic glasses; and
move, in response to the virtual object no longer being within the field of view, the virtual object to an opposite side of the real object such that the virtual object is within the field of view of the wearable electronic glasses.

12. The wearable electronic glasses of claim 8 , wherein the processor further executes the instructions to:
maintain a constant distance between the virtual object being displayed on the display and the real object in a field of view of a wearer of the wearable electronic glasses while the wearable electronic glasses and the field of view moves and changes.

13. The wearable electronic glasses of claim 8 , wherein the processor further executes the instructions to:
receive, from a remote handheld portable electronic device, instructions; and
display, on the display and to a wearer of the wearable electronic glasses, the instructions that simultaneously inst

Assignees

• Lyren Philip Scott

Inventors

• Lyren Philip Scott

Classifications

• G06F3/012

  Head tracking input arrangements · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B27/017 Primary

  Head mounted · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title