Systems and methods for rendering a virtual content object in an augmented reality environment

Patent metadata

Field	Value
Publication number	US-12296264-B2
Application number	US-202318359357-A
Country	US
Kind code	B2
Filing date	Jul 26, 2023
Priority date	Oct 27, 2017
Publication date	May 13, 2025
Grant date	May 13, 2025

Abstract

Systems and methods for rendering of a virtual content object in an augmented reality environment based on a physical marker are discussed herein. Virtual content objects may be rendered by a display device in an augmented reality environment based on the field of view seen through the display device and a position of a marker (and one or more linkage points associated with the marker) in the real world. When rendered in the augmented reality environment, the virtual content objects may be visualized from any angle, from the exterior or interior of the object, and manipulated in response to user input. Virtual content objects and/or user visualizations of virtual content objects may be shared with other users (local and/or remote), enabling multiple users to potentially build, modify, and/or interact with a virtual content object simultaneously and/or cooperatively.

First claim

What is claimed is:

1. A system configured to convey virtual content in an augmented reality environment, via a presentation device, by causing superimposition of images of the virtual content over physical objects and/or physical surroundings visible within a field of view of a user as if the images of the virtual content were present in a real world, wherein the augmented reality environment includes (i) the physical objects and/or the physical surroundings visible within the field of view of the user and (ii) the images of the virtual content presented in conjunction with the physical objects and/or the physical surroundings, the system comprising:
electronic storage that stores information related to virtual surfaces that are applied to physical surfaces in the augmented reality environment visible within the field of view of the user; and
one or more processors configured by machine-readable instructions to:
generate a user interface that enables the user to provide user input related to the physical objects visible within the field of view of the user;
obtain, via the user interface, the user input, wherein the user input specifies (i) sets of linkage points on the physical surfaces of some of the physical objects within the field of view of the user upon which the virtual surfaces are to be applied to, and (ii) surface definitions that define the virtual surfaces;
store the sets of linkage points and the surface definitions to the electronic storage;
receive, via the user interface, selections of one of the physical surfaces visible within the field of view of the user and one of the surface definitions from the electronic storage;
generate, based on the selections, an image of a virtual surface for the selected physical surface to be presented in the augmented reality environment; and
cause the image to be presented in the augmented reality environment via the presentation device so that the virtual surface is covering the selected physical surface in accordance with the set of linkage points for the selected physical surface.

2. The system of claim 1 , wherein the electronic storage stores templates, wherein individual ones of the templates include one of the sets of linkage points and one of the surface definitions.

3. The system of claim 1 , wherein the surface definitions include values to virtual surface parameters.

4. The system of claim 3 , wherein the virtual surface parameters include one or more color, texture, shape, uploaded images, transparency, font, and/or font size.

5. The system of claim 3 , wherein the one or more processors are further configured to:
obtain supplemental user input from the user indicating a request to modify the virtual surface presented in the augmented reality environment;
obtain values of the virtual surface parameter defining a modified version of the virtual surface presented in the augmented reality environment based on the supplemental user input; and
facilitate presentation of the modified version of the virtual surface via the presentation device of the user and/or presentation devices of other users.

6. A method, implemented using one or more processors, for conveying virtual content in an augmented reality environment, via a presentation device, by causing superimposition of images of the virtual content over physical objects and/or physical surroundings visible within a field of view of a user as if the images of the virtual content were present in a real world, wherein the augmented reality environment includes (i) the physical objects and/or the physical surroundings visible within the field of view of the user and (ii) the images of the virtual content presented in conjunction with the physical objects and/or the physical surroundings, the method comprising:
generating a user interface that enables the user to provide user input related to the physical objects visible within the field of view of the user;
obtaining, via the user interface and using the one or more processors, the user input, wherein the user input specifies (i) sets of linkage points on physical surfaces of some of the physical objects in the augmented reality environment visible within the field of view of the user upon which virtual surfaces are to be applied to, and (ii) surface definitions that define the virtual surfaces;
storing the sets of linkage points and the surface definitions to electronic storage;
receiving, via the user interface, selections of one of the physical surfaces visible within the field of view of the user and one of the surface definitions from the electronic storage;
generating, using the one or more processors, an image of a virtual surface for the selected physical surface to be presented in the augmented reality environment based on the selections; and
causing, using the one or more processors, the image to be presented in the augmented reality environment via the presentation device so that the virtual surface is covering the selected physical surface in accordance with the set of linkage points for the selected physical surface.

7. The method of claim 6 , wherein the electronic storage, wherein the electronic storage stores templates, wherein individual ones of the templates include one of the sets of linkage points and one of the surface definitions.

8. The method of claim 6 , wherein the surface definitions include values to virtual surface parameters.

9. The method of claim 8 , wherein the virtual surface parameters include one or more color, texture, shape, uploaded images, transparency, font, and/or font size.

10. The method of claim 8 , further comprising:
obtaining, using the one or more processors, supplemental user input from the user indicating a request to modify the virtual surface presented in the augmented reality environment;
obtaining, using the one or more processors, values of the virtual surface parameter defining a modified version of the virtual surface presented in the augmented reality environment based on the supplemental user input; and
facilitating, using the one or more processors, presentation of the modified version of the virtual surface via the presentation device of the user and/or presentation devices of other users.

Assignees

• Hariton Nicholas T

Inventors

• Hariton Nicholas T

Classifications

• H04L67/131

  Protocols for games, networked simulations or virtual reality · CPC title

• G09G2320/0261

  in the context of movement of objects on the screen or movement of the observer relative to the screen · CPC title

• G06F3/147

  using display panels · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• A63F2003/00996

  Board games available as video games · CPC title