Systems and methods for utilizing anchor graphs in mixed reality environments

Patent metadata

Field	Value
Publication number	US-2018053315-A1
Application number	US-201715786266-A
Country	US
Kind code	A1
Filing date	Oct 17, 2017
Priority date	May 31, 2016
Publication date	Feb 22, 2018
Grant date	—

Abstract

Mixed-reality systems are provided for using anchor graphs within a mixed-reality environment. These systems utilize anchor vertexes that comprise at least one first key frame, a first mixed-reality element, and at least one first transform connecting the at least one first key frame to the first mixed-reality element. Anchor edges comprising transformations connect the anchor vertexes.

First claim

What is claimed is:

1 . A computer system comprising:
one or more processors; and one or more computer-readable hardware storage media having stored thereon computer-executable instructions, the computer-executable instructions being executable by the one or more processors to generate an anchor graph for a mixed-reality environment by causing the computer system to:
identify an anchor vertex that includes a mixed-reality element, the mixed-reality element being linked by the anchor vertex to a key frame;
identify a second anchor vertex that includes a second mixed-reality element, the second mixed-reality element being linked by the second anchor vertex to a second key frame; and
generate the anchor graph using information corresponding to the anchor vertex, the second anchor vertex, and a link between the anchor vertex and the second anchor vertex.

2 . The computer system of claim 1 , wherein the mixed-reality element is linked to the key frame by a transform, the transform defining a relationship between (1) a location and viewing direction associated with the key frame and (2) a location and pose associated with the mixed-reality element.

3 . The computer system of claim 1 , wherein the anchor graph is transmitted to a second computer system that is identified as being worn by a user who is physically proximate to a location associated with the key frame.

4 . The computer system of claim 1 , wherein the key frame comprises image data and geolocation data, the image data being captured by a camera of the computer system as a user who is wearing the computer system traverses a path, and wherein the geolocation data corresponds to a plurality of locations that are sampled from the user's traversed path, whereby the key frame includes location information corresponding to the user's traversed path.

5 . The computer system of claim 1 , wherein the mixed-reality element is a pre-made hologram.

6 . The computer system of claim 5 , wherein the pre-made hologram is viewable only when the computer system is oriented in a particular pose and situated at a particular location.

7 . The computer system of claim 1 , wherein a size of the anchor vertex is configurable.

8 . The computer system of claim 1 , wherein the anchor graph corresponds to a traversal path of a user who is wearing the computer system, and wherein execution of the computer-executable instructions further causes the computer system to:
receive a previously generated anchor graph, the previously generated anchor graph corresponding to a different path that was traversed previously by a different user who was wearing a different computer system, wherein a location of the path is determined to be sufficiently proximate to a location of the different path such that the key frame is included in both the anchor graph and the previously generated anchor graph; and update the anchor graph to include additional anchor vertexes that are included in the previously generated anchor graph.

9 . The computer system of claim 1 , wherein the anchor graph includes a third anchor vertex, the third anchor vertex including a third mixed-reality element that is linked, in the third anchor vertex, to a third key frame, and wherein the anchor graph further includes an established link between the third anchor vertex and the second anchor vertex.

10 . The computer system of claim 9 , wherein, after identifying (1) the link between the anchor vertex and the second anchor vertex and (2) the established link between the third anchor vertex and the second anchor vertex, a third link is generated, the third link linking the anchor vertex to the third anchor vertex.

11 . The computer system of claim 1 , wherein the link between the anchor vertex and the second anchor vertex is structured so as to define a path of the user, the path originating at a location associated with the anchor vertex and ending at a location associated with the second anchor vertex.

12 . The computer system of claim 1 , wherein the anchor vertex further includes geographic location associated with the key frame, the geographic location being generated by one or more of (1) a global positioning sensor included as a part of the computer system, (2) an extrapolated mapping of a traversal path of a user wearing the computer system, or (3) location information entered by the user.

13 . The computer system of claim 1 , wherein the anchor vertex and the second anchor vertex are stored in an index of anchor vertexes.

14 . The computer system of claim 1 , wherein execution of the computer-executable instructions further causes the computer system to:
upon an occurrence of a triggering event, receive an additional anchor vertex from a remote server, the additional anchor vertex being added to the anchor graph.

15 . The computer system of claim 14 , wherein the triggering event occurs when a location of the computer system is determined to be sufficiently proximate to a location associated with the additional anchor vertex.

16 . A method for generating an anchor graph for a mixed-reality environment, the method being implemented by one or more processors of a computer system, the method comprising:
identifying an anchor vertex that includes a mixed-reality element, the mixed-reality element being linked by the anchor vertex to a key frame; identifying a second anchor vertex that includes a second mixed-reality element, the second mixed-reality element being linked by the second anchor vertex to a second key frame; and generating the anchor graph using information corresponding to the anchor vertex, the second anchor vertex, and a link between the anchor vertex and the second anchor vertex.

17 . The method of claim 16 , wherein the link between the anchor vertex and the second anchor vertex is an anchor edge, the anchor edge comprising a rotational matrix that represents a physical rotation between the anchor vertex and the second anchor vertex.

18 . The method of claim 17 , wherein the anchor edge further includes a translational matrix that represents a translation between the anchor vertex and the second anchor vertex.

19 . The method of claim 16 , wherein the method further includes:
upon determining that a location of the computer system is determined to be sufficiently proximate to a location associated with a different anchor vertex, receive the different anchor vertex from a remote server, the different anchor vertex being added to the anchor graph.

20 . One or more hardware storage devices having stored thereon computer-executable instructions, the computer-executable instructions being executable by one or more processors of a computer system to cause the computer system to:
identify an anchor vertex that includes a mixed-reality element, the mixed-reality element being linked by the anchor vertex to a key frame; identify a second anchor vertex that includes a second mixed-reality element, the second mixed-reality element being linked by the second anchor vertex to a second key frame; and generate the anchor graph using information corresponding to the anchor vertex, the second anchor vertex, and a link between the anchor vertex and the second anchor vertex.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Ard Tracy K
• Takacs Gabriel
• Gedye David M
• Fletcher James
• Ashman Matthew Sammis

Classifications

• G06T11/26

  Drawing of charts or graphs · CPC title

• H04W4/023

  using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds · CPC title

• G06T2215/16

  Using real world measurements to influence rendering · CPC title

• A63F13/65

  automatically by game devices or servers from real world data, e.g. measurement in live racing competition · CPC title

• A63F13/213 Primary

  comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) · CPC title