Augmented Reality System

Patent metadata

Field	Value
Publication number	US-2019299412-A1
Application number	US-201916281462-A
Country	US
Kind code	A1
Filing date	Feb 21, 2019
Priority date	Mar 29, 2018
Publication date	Oct 3, 2019
Grant date	—

Abstract

An augmented reality device for overlapping an augmented reality with a real environment is provided to enable a high degree of freedom of movement of a person in an operation. The device includes a detection unit which detects the real environment and provides it as environmental data. At least one monitoring unit and at least one working unit are arranged in the environment. A communication unit receives safety data from the monitoring unit and process data from the working unit. A control unit processes the environmental data, the safety data and the process data. A current working area of the monitoring unit and a current position (aP) of the working unit are creatable as a current mapping of the real environment on the basis of the environmental and safety data. A future working area of the monitoring unit and a future position (zP) of the working unit are creatable.

First claim

1 . Augmented reality system for overlapping an augmented reality with a real environment, comprising
a detection unit which detects the real environment and provides it as environmental data, at least one monitoring unit and at least one working unit being arranged in the environment, a communication unit receiving safety data from the monitoring unit and process data from the working unit, a control unit which processes the environmental data, the safety data and the process data, wherein a current working area of the monitoring unit and a current position of the working unit are creatable on the basis of the environmental and safety data as a current mapping of the real environment, and wherein a future working area of the monitoring unit and a future position of the working unit are creatable as a virtual mapping on the basis of the safety and process data at a preferably selectable future point in time, and a display unit that displays the current mapping and the virtual mapping to a user in relation to each other, wherein an image of the user is displayed in the overlapping current and virtual mapping at a current point in time of creation of the current mapping.

2 . Augmented reality system according to claim 1 , wherein the augmented reality system comprises a pair of glasses, a helmet display or an electronic communication device, in particular a smartphone or a touchpad.

3 . Augmented reality system according to claim 1 , wherein the detection unit comprises a camera, in particular a camera detecting a room depth, and/or wide-angle camera.

4 . Augmented reality system according to claim 1 , wherein the monitoring unit comprises a monitoring camera, in particular a monitoring camera detecting a room depth, a scanner, a light grid or a light barrier.

5 . Augmented reality system according to claim 1 , wherein the working unit comprises a robot, a driverless transport system or a processing machine.

6 . Augmented reality system according to claim 1 , wherein the future point in time lies in several seconds in the future after the current working area of the monitoring unit has moved into a future position of the working area of the monitoring unit, if the working area of the monitoring unit is changeable with a movement of the working unit.

7 . Augmented reality system according to claim 6 , wherein the current position of the working unit has moved into the future position of the working unit after the seconds on the basis of the process data.

8 . Augmented reality system according to claim 1 , wherein the future working area of the monitoring unit and the future position of the working unit are calculable by the control unit or transmitted from the monitoring unit and the control of the working unit to the control unit of the augmented reality system.

9 . Augmented reality system according to claim 1 , wherein the future working area of the monitoring unit represents a visual direction of the monitoring unit.

10 . Augmented reality system according to claim 1 , wherein an avoidance direction or an avoidance route for the user is calculable and displayable in order to avoid a collision with the future position of the working unit.

11 . Augmented reality system according to claim 10 , wherein the avoidance direction indicates a position or the avoidance route leads to a position, which lies outside the working area of the monitoring unit and/or the future position of the working unit.

12 . Augmented reality system according to claim 1 , wherein the safety data of the monitoring unit comprises geometric data of the working area and the process data of the working unit comprises transaction data of the working unit.

13 . Augmented reality device according to claim 1 , wherein the working area of the monitoring unit is subdivided into a protective area and a monitoring area, wherein a detection of an impermissible object within the protective area triggers a safety reaction of the monitoring unit and the monitoring area represents an entire visible area of the monitoring unit.

14 . Augmented reality system according to claim 1 , wherein a transition of the working unit from the current position to the future position on the basis of the process data is displayable as a visual sequence of the process data on the display unit.

Assignees

• Sick Ag

Inventors

• Schwer Felix
• Haberstroh Frank

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G05B19/0423

  Input/output · CPC title

• G06F2203/012

  Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment · CPC title

• G08B21/02

  Alarms for ensuring the safety of persons · CPC title

• G05B2219/39451

  Augmented reality for robot programming · CPC title