Method for operating virtual reality glasses in a vehicle and virtual reality system with virtual reality glasses and a vehicle

Patent metadata

Field	Value
Publication number	US-12429693-B2
Application number	US-202418659166-A
Country	US
Kind code	B2
Filing date	May 9, 2024
Priority date	Sep 11, 2019
Publication date	Sep 30, 2025
Grant date	Sep 30, 2025

Abstract

A method of operating virtual reality glasses in a vehicle, in which a risk of motion sickness for a wearer of the virtual reality glasses is reduced with the aid of the method. A virtual reality system (IO) includes the virtual reality glasses and the vehicle. According to the method, a vehicle movement of the vehicle is evaluated in such a way that ultimately, after the image data describing the virtual surroundings have been split into a background image dataset and a foreground image dataset, a lateral offset for a position of an object in the foreground in comparison with the background is determined, so that virtual surroundings which are processed in this way can be determined and displayed. Alternatively, the virtual surroundings can be enlarged in accordance with the vehicle movement, and processed virtual surroundings can be determined by a movement of the enlarged virtual surroundings along a movement trajectory, and displayed.

First claim

The invention claimed is:

1. A method of operating virtual reality glasses in a vehicle, in which a virtual surrounding described by image data is displayed by the virtual reality glasses, the method performed by a control device of the virtual reality glasses comprising:
receiving movement data describing a movement of the vehicle acquired by an acquisition device of the vehicle;
splitting the image data describing the virtual surrounding into a background image dataset that characterizes a background of the virtual surrounding, and at least one foreground image dataset that characterizes at least one object positioned in a foreground of the virtual surrounding, by applying an image processing criterion to the image data describing the virtual surrounding;
evaluating the movement data to determine a lateral offset between a position of the at least one object positioned in the foreground of the virtual surrounding and the background;
determining processed image data describing a processed virtual surrounding in which the at least one object in the foreground is shifted relative to the background according to the determined lateral offset;
enlarging the at least one object positioned in the foreground of the virtual surrounding by a magnification factor, so that relative to the processed virtual surrounding the enlarged at least one object is shifted relative to the background; and
displaying the processed virtual surrounding described by the processed image data on the virtual reality glasses.

2. The method as claimed in claim 1 , wherein, when an image gap arises in the processed virtual surrounding due to a displacement of the at least one object in the foreground according to the determined lateral offset, the image gap in the processed virtual surrounding is closed with a virtual image fill content by applying an image gap fill criterion to the processed image data.

3. The method as claimed in claim 2 ,
further comprising evaluating the movement data to determine a rotation angle of the at least one object positioned in the foreground of the virtual surrounding relative to the background, and
wherein the processed image data is determined to describe the processed virtual surrounding, in which the at least one object in the foreground is shifted relative to the background according to the determined lateral offset and rotated according to the determined rotation angle.

4. The method as claimed in claim 1 , wherein the determined lateral offset and a steering angle of the vehicle, included in the movement data, are correlated non-linearly.

5. The method as claimed in claim 1 , wherein, when an image gap arises in the processed virtual surrounding due to a displacement of the at least one object in the foreground according to the determined lateral offset, the image gap in the processed virtual surrounding is closed with a virtual image fill content by applying an image gap fill criterion to the processed image data.

6. The method as claimed in claim 1 ,
further comprising evaluating the movement data is evaluated to determine a rotation angle of the at least one object positioned in the foreground of the virtual surrounding relative to the background, and
wherein the processed image data is determined to describe the processed virtual surrounding, in which the at least one object in the foreground is shifted relative to the background according to the determined lateral offset and rotated according to the determined rotation angle.

7. A method of operating virtual reality glasses in a vehicle, in which a virtual surrounding described by image data is displayed by the virtual reality glasses, the method performed by a control device of the virtual reality glasses comprising:
receiving movement data describing a movement of the vehicle acquired by an acquisition device of the vehicle;
splitting the image data describing the virtual surrounding into a background image dataset that characterizes a background of the virtual surrounding, and at least one foreground image dataset that characterizes at least one object positioned in a foreground of the virtual surrounding, by applying an image processing criterion to the image data describing the virtual surrounding;
evaluating the movement data to determine a lateral offset between a position of the at least one object positioned in the foreground of the virtual surrounding and the background;
determining processed image data describing a processed virtual surrounding in which the at least one object in the foreground is shifted relative to the background according to the determined lateral offset; and
displaying the processed virtual surrounding described by the processed image data on the virtual reality glasses, wherein, when an image gap arises in the processed virtual surrounding due to a displacement of the at least one object in the foreground according to the determined lateral offset, the image gap in the processed virtual surrounding is closed with a virtual image fill content by applying an image gap fill criterion to the processed image data.

8. The method as claimed in claim 7 ,
further comprising evaluating the movement data is evaluated to determine a rotation angle of the at least one object positioned in the foreground of the virtual surrounding relative to the background, and
wherein the processed image data is determined to describe the processed virtual surrounding, in which the at least one object in the foreground is shifted relative to the background according to the determined lateral offset and rotated according to the determined rotation angle.

9. The method as claimed in claim 7 , wherein the determined lateral offset and a steering angle of the vehicle, included in the movement data, are correlated non-linearly.

10. A method of operating virtual reality glasses in a vehicle, in which a virtual surrounding described by image data is displayed by the virtual reality glasses, the method performed by a control device of the virtual reality glasses comprising:
receiving movement data describing a movement of the vehicle acquired by an acquisition device of the vehicle;
splitting the image data describing the virtual surrounding into a background image dataset that characterizes a background of the virtual surrounding, and at least one foreground image dataset that characterizes at least one object positioned in a foreground of the virtual surrounding, by applying an image processing criterion to the image data describing the virtual surrounding;
evaluating the movement data to determine a lateral offset between a position of the at least one object positioned in the foreground of the virtual surrounding and the background;
determining processed image data describing a processed virtual surrounding in which the at least one object in the foreground is shifted relative to the background according to the determined lateral offset;
evaluating the movement data to determine a rotation angle of the at least one object positioned in the foreground of the virtual surrounding relative to the background,
wherein the processed image data is determined to describe the processed virtual surrounding, in which the at least one object in the foreground is shifted relative to the background according to the determined lateral offset and rotated according to the determined rotation angle; and
displaying the processed virtual surrounding described by the processed image data on the virtual reality glasses.

11. The method as claimed in claim 10 , wherein, when an image gap arises in the processed virtual surrounding due to a displacement of the at least one object in the foreground according to the determined lateral offset, th

Assignees

• Audi Ag

Inventors

• Moll Tobias
• Bouaziz Tahar

Classifications

• B60K35/00

  Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles · CPC title

• B60K35/22

  Display screens · CPC title

• B60K35/80

  Arrangements for controlling instruments · CPC title

• B60K35/213

  Virtual instruments · CPC title

• B60K2360/31

  Virtual images · CPC title