Augmented reality system

Patent metadata

Field	Value
Publication number	US-12283009-B2
Application number	US-202318378899-A
Country	US
Kind code	B2
Filing date	Oct 11, 2023
Priority date	May 5, 2015
Publication date	Apr 22, 2025
Grant date	Apr 22, 2025

Abstract

An example augmented reality system includes: obtaining information about an instance of a device; recognizing the instance of the device based on the information; selecting a digital twin for the instance of the device, with the digital twin being unique to the instance of the device; and generating augmented reality content based on the digital twin and an actual graphic of the instance of the device.

First claim

What is claimed is:

1. A method performed by one or more processing devices, the method comprising:
obtaining a digital graphic of a device;
reconfiguring the digital graphic of the device by incorporating one or more augmented reality (AR) components into the digital graphic to produce a digital graphic of a reconfigured device;
generating a digital twin for the reconfigured device, the digital twin being unique to the reconfigured device, where the digital twin is generated based on a digital twin for the device and one or more digital twins for one or more of the AR components, respectively;
simulating operation of the reconfigured device using the digital twin for the reconfigured device; and
generating an output for display showing the operation of the reconfigured device.

2. The method of claim 1 , wherein reconfiguring the digital graphic of the device comprises at least one of: adjusting a position of a component of the device in the digital graphic of the device, changing a geometry of the device in the digital graphic of the device, or changing a kinematic characteristic of the device in the digital graphic of the device.

3. The method of claim 1 , further comprising:
receiving specified conditions associated with a simulation of operation of the reconfigured device;
wherein simulating operation of the reconfigured device is performed for the specified conditions.

4. The method of claim 1 , further comprising:
receiving information for one or more stimuli;
wherein simulating operation of the reconfigured device is performed in a presence of the one or more stimuli.

5. The method of claim 4 , further comprising:
recording a response of the reconfigured device to the one or more stimuli in the digital twin for the reconfigured device.

6. The method of claim 4 , further comprising:
reporting, in real-time, a response of the reconfigured device to the one or more stimuli.

7. The method of claim 1 , further comprising:
storing information about manipulations performed to reconfigure the digital graphic of the device; and
reporting the manipulations to a third-party system configured to generate a blueprint or model for building the reconfigured device.

8. One or more non-transitory machine-readable storage media storing instructions that are executable by one or more processing devices to perform operations comprising:
obtaining a digital graphic of a device;
reconfiguring the digital graphic of the device by incorporating one or more augmented reality (AR) components into the digital graphic to produce a digital graphic of a reconfigured device;
generating a digital twin for the reconfigured device, the digital twin being unique to the reconfigured device, where the digital twin is generated based on a digital twin for the device and one or more digital twins for one or more of the AR components, respectively;
simulating operation of the reconfigured device using the digital twin for the reconfigured device; and
generating an output for display showing the operation of the reconfigured device.

9. The one or more non-transitory machine-readable storage media of claim 8 , wherein reconfiguring the digital graphic of the device comprises at least one of:
adjusting a position of a component of the device in the digital graphic of the device, changing a geometry of the device in the digital graphic of the device, or changing a kinematic characteristic of the device in the digital graphic of the device.

10. The one or more non-transitory machine-readable storage media of claim 8 , wherein the operations comprise:
receiving specified conditions associated with a simulation of operation of the reconfigured device;
wherein simulating operation of the reconfigured device is performed for the specified conditions.

11. The one or more non-transitory machine-readable storage media of claim 8 , wherein the operations comprise:
receiving information for one or more stimuli;
wherein simulating operation of the reconfigured device is performed in a presence of the one or more stimuli.

12. The one or more non-transitory machine-readable storage media of claim 11 , wherein the operations comprise:
recording a response of the reconfigured device to the one or more stimuli in the digital twin for the reconfigured device.

13. The one or more non-transitory machine-readable storage media of claim 11 , wherein the operations comprise:
reporting, in real-time, a response of the reconfigured device to the one or more stimuli.

14. The one or more non-transitory machine-readable storage media of claim 8 , wherein the operations comprise:
storing information about manipulations performed to reconfigure the digital graphic of the device; and
reporting the manipulations to a third-party system configured to generate a blueprint or model for building the reconfigured device.

15. A system comprising:
one or more non-transitory machine-readable storage media storing instructions that are executable; and
one or more processing devices to execute the instructions to perform operations comprising:
obtaining a digital graphic of a device;
reconfiguring the digital graphic of the device by incorporating one or more augmented reality (AR) components into the digital graphic to produce a digital graphic of a reconfigured device;
generating a digital twin for the reconfigured device, the digital twin being unique to the reconfigured device, where the digital twin is generated based on a digital twin for the device and one or more digital twins for one or more of the AR components, respectively;
simulating operation of the reconfigured device using the digital twin for the reconfigured device; and
generating an output for display showing the operation of the reconfigured device.

16. The system of claim 15 , wherein reconfiguring the digital graphic of the device comprises at least one of: adjusting a position of a component of the device in the digital graphic of the device, changing a geometry of the device in the digital graphic of the device, or changing a kinematic characteristic of the device in the digital graphic of the device.

17. The system of claim 15 , wherein the operations comprise:
receiving specified conditions associated with a simulation of operation of the reconfigured device;
wherein simulating operation of the reconfigured device is performed for the specified conditions.

18. The system of claim 15 , wherein the operations comprise:
receiving information for one or more stimuli;
wherein simulating operation of the reconfigured device is performed in a presence of the one or more stimuli.

19. The system of claim 18 , wherein the operations comprise:
recording a response of the reconfigured device to the one or more stimuli in the digital twin for the reconfigured device.

20. The system of claim 18 , wherein the operations comprise:
reporting, in real-time, a response of the reconfigured device to the one or more stimuli.

Assignees

• Ptc Inc

Inventors

• Parfenov Vladimir
• Jordan Kevin Elliott
• Dertien Steven Thomas
• Baum Moshe Jacob
• Gosselin Andre
• Prideaux-Ghee Stephen
• Heppelman James E

Classifications

• G06T17/00

  Three-dimensional [3D] modelling for computer graphics · CPC title

• G06T15/20

  Perspective computation · CPC title

• G06T13/00

  Animation · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title