Augmented reality device

Patent metadata

Field	Value
Publication number	US-10878241-B2
Application number	US-201916368074-A
Country	US
Kind code	B2
Filing date	Mar 28, 2019
Priority date	Mar 29, 2018
Publication date	Dec 29, 2020
Grant date	Dec 29, 2020

Abstract

An augmented reality device includes a processing unit adapted to process data, and a display unit with a field of view, which is adapted to display a control, control components and first connections between the control components as an extended real image, The control receives sensor data from at least one sensor and transmits actuator signals to at least one actuator of an industrial plant. The processing unit processes from the data a model of the industrial plant with the control, the sensor, the actuator and second connections as plant components, and processes position data of the plant components into the model. The position data of the display unit can be transmitted to the processing unit as GPS data by means of satellites or local position data by means of local sensors, and the processing unit processes the position data of the display unit into the model.

First claim

The invention claimed is:

1. An augmented reality device comprising:
a processing unit adapted to process data, and
a display unit with a field of view, which is adapted to display a control, control components and first connections between the control components as an extended real image, wherein the control receives sensor data from at least one sensor and transmits actuator signals to at least one actuator of an industrial plant,
wherein the processing unit processes from the data a model of the industrial plant with the control, the sensor, the actuator and second connections as plant components, and processes position data of the plant components into the model,
characterized in that position data of the display unit are transmitted to the processing unit as GPS data by means of satellites or local position data by means of local sensors, and the processing unit processes the position data of the display unit into the model,
wherein the display unit is designed to represent the industrial plant with the plant components and their second connections as a function of the position and the field of view of the display unit in the model as the extended real image, so that the display unit is moved accurately by an user within the industrial plant.

2. Augmented reality device according to claim 1 , characterized in that the data comprise CAD data of the industrial plant.

3. Augmented reality device according to claim 1 , characterized in that the second connections can be displayed as colored lines in the model on the display unit.

4. Augmented reality device according to claim 1 , characterized in that the display unit is designed to display wired, wireless or both wired and wireless second connections which represent data connections, power supply connections or both data connections and power supply connections between the system components.

5. Augmented reality device according to claim 4 , characterized in that the data connections, power supply connections or both data connections and power supply connections are represented differently.

6. Augmented reality device according to claim 1 , characterized in that the display unit is designed to make invisible plant components recognizable to the user by means of a marker, at least one direction indicator or both marker and at least one direction indicator in the direction of the invisible plant components.

7. Augmented reality device according to claim 6 , characterized in that the direction display can be displayed in the form of an arrow on the display unit.

8. Augmented reality device according to claim 6 , characterized in that the direction display is visible in the display unit until the system component has become visible to the user.

9. Augmented reality device according to claim 1 , characterized in that a selection means is provided for selectively selecting an installation component of the industrial installation, so that only the selected installation component and its respective second connections are displayed highlighted to the user.

10. Augmented reality device according to claim 9 , characterized in that the selected plant component, its respective second connections and the other plant components connected to the selected plant component are flashing, displayed in color, or both flashing and displayed in color and the non-selected plant components and plant components being not connected to the selected plant component can be are displayed transparently or hidden.

11. Augmented reality device according to claim 5 , characterized in that the data connections, power supply connections or both data connections and power supply connections are represented as solid, dashed or similarly shaped lines.

12. Augmented reality device according to claim 7 , characterized in that the direction display is visible in the display unit until the system component has become visible to the user.

13. An augmented reality device comprising:
a processing unit adapted to process data, and
a display unit with a field of view, which is adapted to display a control, control components and first connections between the control components as an extended real image, wherein the control receives sensor data from at least one sensor and transmits actuator signals to at least one actuator of an industrial plant,
wherein the processing unit processes from the data a model of the industrial plant with the control, the sensor, the actuator and second connections as plant components, and processes position data of the plant components into the model,
characterized in that:
position data of the display unit are transmitted to the processing unit as GPS data by means of satellites or local position data by means of local sensors,
the processing unit processes the position data of the display unit into the model, and
the display unit is designed to make invisible plant components recognizable to the user by means of a marker, at least one direction indicator or both marker and at least one direction indicator in the direction of the invisible plant components,
wherein the display unit is designed to represent the industrial plant with the plant components and their second connections as a function of the position and the field of view of the display unit in the model as the extended real image.

14. Augmented reality device according to claim 13 , characterized in that the direction display can be displayed in the form of an arrow on the display unit.

15. Augmented reality device according to claim 14 , characterized in that the direction display is visible in the display unit until the system component has become visible to the user.

16. Augmented reality device according to claim 13 , characterized in that the direction display is visible in the display unit until the system component has become visible to the user.

17. An augmented reality device comprising:
a processing unit adapted to process data, and
a display unit with a field of view, which is adapted to display a control, control components and first connections between the control components as an extended real image, wherein the control receives sensor data from at least one sensor and transmits actuator signals to at least one actuator of an industrial plant,
wherein the processing unit processes from the data a model of the industrial plant with the control, the sensor, the actuator and second connections as plant components, and processes position data of the plant components into the model,
characterized in that position data of the display unit are transmitted to the processing unit as GPS data by means of satellites or local position data by means of local sensors, the processing unit processes the position data of the display unit into the model, and a selection means is provided for selectively selecting an installation component of the industrial installation, so that only the selected installation component and its respective second connections are displayed highlighted to the user,
wherein the display unit is designed to represent the industrial plant with the plant components and their second connections as a function of the position and the field of view of the display unit in the model as the extended real image.

18. Augmented reality device according to claim 17 , characterized in that the selected plant component, its respective second connections and the other plant components connected to the selected plant component are flashing, displayed in color or both flashing and displayed in color and the non-selected plant components and plant com

Assignees

• Sick Ag

Inventors

• Schwer Felix
• Haberstroh Frank

Classifications

• G05B19/4183 Primary

  characterised by data acquisition, e.g. workpiece identification · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06T11/23

  using straight lines or curves · CPC title

• G06F30/367

  Design verification, e.g. using simulation, simulation program with integrated circuit emphasis [SPICE], direct methods or relaxation methods · CPC title

• G06V2201/06

  Recognition of objects for industrial automation · CPC title