Augmenting reality via antenna and interaction profile

Patent metadata

Field	Value
Publication number	US-10578880-B2
Application number	US-201615188633-A
Country	US
Kind code	B2
Filing date	Jun 21, 2016
Priority date	Jun 21, 2016
Publication date	Mar 3, 2020
Grant date	Mar 3, 2020

Abstract

With a device comprising a directional antenna, obtain an interaction profile for an augmentable object and augment a sensory experience of the augmentable object according to the interaction profile.

First claim

What is claimed is:

1. An apparatus for augmenting reality, comprising:
a sensory output device, a computer processor, a memory, and an antenna;
an augmentable object detection module coupled to the computer processor, wherein the augmentable object detection module is arranged to use the antenna to detect an augmentable object based on a received wireless signal from the augmentable object;
a sensory augmentation module coupled to the computer processor, wherein the sensory augmentation module is arranged to use the received wireless signal to obtain an interaction profile associated with the augmentable object, and determine a sensory output based on the interaction profile and an area point cloud;
an optical head-mounted display coupled with the antenna, wherein the antenna is a narrow beam width directional antenna with a high gain for reception of the wireless signal in a receive area, and the receive area is equivalent to and aligned with a field of view of a wearer of the optical head-mounted display;
a photogrammetry module coupled to the computer processor, wherein the photogrammetry module is arranged to receive a set of images comprising the receive area, measure a motion field based on the set of images, and determine the area point cloud based on the motion field; and
wherein the sensory output comprises a video, wherein the interaction profile comprises a point cloud of the augmentable object and a graphical user interface of the augmentable object, and wherein the sensory augmentation module is further arranged to:
determine a relative orientation between the area point cloud and the point cloud of the augmentable object,
determine an image according to the graphical user interface and the orientation, and
output the image in the video.

2. The apparatus according to claim 1 , wherein the graphical user interface comprises at least one of a digital object, an anchor point in the point cloud of the augmentable object, or a user input for controlling the augmentable object, wherein the digital object comprises the sensory output associated with a component of the augmentable object, and wherein the component of the augmentable object is defined in terms of the anchor point, wherein the user input may be received relative to the component of the augmentable object, and wherein the user input may control the sensory output.

3. The apparatus according to claim 1 , wherein the wireless signal comprises at least one of an identifier of the augmentable object, a network path to obtain the interaction profile, or an orientation token, wherein the interaction profile comprises at least one of a digital object associated with the augmentable object, a user interface for controlling the augmentable object according to a user input, or a configuration parameter of the digital object, wherein the digital object is associated with the sensory output, and wherein the sensory augmentation module is to receive the user input and determine the sensory output according to the user input, the graphical user interface, and the digital object.

4. A computer implemented method for augmenting reality, the method comprising:
detecting a wireless signal of an augmentable object with an antenna of a computer device coupled with an optical head-mounted display, wherein the antenna is a narrow beam width directional antenna with a high gain for the wireless signal in a receive area, and the receive area is equivalent to and aligned with a field of view of a wearer of the optical head-mounted display;
obtaining, by the computer device, an interaction profile associated with the augmentable object based on the wireless signal wherein the interaction profile comprises a point cloud of the augmentable object and a graphical user interface of the augmentable object;
determining, by the computing device, a point cloud of an area comprising the receive area by receiving a set of images comprising the receive area, measuring a motion field based on the set of images, and determining the point cloud of the area based on the motion field;
determining a relative orientation between the point cloud of the area and the point cloud of the augmentable object, determining an image according to the graphical user interface and the orientation; and
determining, by the computer device, a sensory output based on the interaction profile and the point cloud of the area, and wherein the sensory output comprises a video.

5. The method according to claim 4 , wherein the graphical user interface comprises at least one of a digital object, an anchor point in the point cloud of the augmentable object, or a user input for controlling the augmentable object, wherein the digital object comprises the sensory output associated with a component of the augmentable object, and wherein the component of the augmentable object is defined in terms of the anchor point, wherein the user input may be received relative to the component of the augmentable object, and wherein the user input may control the sensory output.

6. The method according to claim 4 , wherein the wireless signal comprises at least one of an identifier of the augmentable object, a network path to obtain the interaction profile, or an orientation token, wherein the interaction profile comprises at least one of a digital object associated with the augmentable object, a user interface for controlling the augmentable object according to a user input, or a configuration parameter of the digital object, wherein the digital object is associated with the sensory output, and further comprising receiving the user input and determining the sensory output according to the user input, the graphical user interface, and the digital object.

7. An computer apparatus for augmenting reality, comprising:
means to detect a wireless signal of an augmentable object with an antenna of the computer apparatus, wherein the antenna is coupled with an optical head-mounted display and is a narrow beam width directional antenna with a high gain for the wireless signal in a receive area, and wherein the receive area is equivalent to and aligned with a field of view of a wearer of the optical head-mounted display;
means to receive a set of images comprising the receive area, measure a motion field based on the set of images, and determine a point cloud of an area comprising the receive area based on the motion field;
means to obtain an interaction profile associated with the augmentable object using the wireless signal, wherein the interaction profile comprises a point cloud of the augmentable object and a graphical user interface of the augmentable object;
means to determine a relative orientation between the point cloud of the area and the point cloud of the augmentable object;
means to determine an image according to the graphical user interface and the orientation;
means to determine a sensory output based on the interaction profile and the point cloud of an area; and
means to output the sensory output, wherein the sensory output comprises a video.

8. The apparatus according to claim 7 , wherein the graphical user interface comprises at least one of a digital object, an anchor point in the point cloud of the augmentable object, or a user input for controlling the augmentable object, wherein the digital object comprises the sensory output associated with a component of the augmentable object, and wherein the component of the augmentable object is defined in terms of the anchor point, and further comprising means to receive the user input relative to the component of the augmentable object, and means to control the sensory output via the user input.

9. The apparatus according to claim 7 , wherein the wireless signal comprises at least one of an

Assignees

• Intel Corp

Inventors

• Rider Tomer
• Ferens Ron
• Moran Amit

Classifications

• G09G2340/125

  wherein one of the images is motion video · CPC title

• G09G2380/04

  Electronic labels · CPC title

• G09G2370/16

  Use of wireless transmission of display information · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G06F3/147 Primary

  using display panels · CPC title