Method and system for presenting a shared virtual environment to users residing in different vehicles, and server unit, user device, and vehicle

Patent metadata

Field	Value
Publication number	US-12450845-B2
Application number	US-202118549863-A
Country	US
Kind code	B2
Filing date	Mar 11, 2021
Priority date	Mar 11, 2021
Publication date	Oct 21, 2025
Grant date	Oct 21, 2025

Abstract

The disclosure relates to a method for presenting a shared virtual environment to users residing in different vehicles while driving in a real-world environment. In at least one of the vehicles, an interactive user device of that vehicle receives definition data from the user residing in that vehicle, wherein the definition data describe a new virtual event for the virtual environment, and a position sensor of the vehicle generates position data of the vehicle while the user generates the definition data, wherein the position data describe a current position of the vehicle in the real-world environment. A server device receives the definition data and the corresponding position data and generates corresponding event data of a new virtual event, wherein based on the position data a trigger region is defined that defines where in the real-world environment the virtual event shall be triggered for the users in their respective vehicle.

First claim

The invention claimed is:

1. A method for presenting a shared virtual environment to users residing in different vehicles while the respective vehicle driving in a real-world environment, the method comprising:
receiving, by a respective interactive first user device of a first vehicle, definition data from a user in the first vehicle, or generating the definition data based on a current driving situation of the vehicle, wherein the definition data describe a new virtual event for the virtual environment;
generating, by a position sensor of the first vehicle, position data of the first vehicle while the user generates the definition data, wherein the position data describe a current position of the first vehicle in the real-world environment;
receiving, by a server device, the definition data and the position data from the first vehicle;
generating, by the server device, event data of the new virtual event, wherein based on the position data a trigger region is defined that defines where in the real-world environment the new virtual event shall be triggered;
receiving, by the server device, request data from a second user device a second vehicle, wherein the request data indicate that the second vehicle approaches or enters or is positioned in the trigger region;
sending, by the server device, the event data of the new virtual event to the first user device of the first vehicle; and
displaying, in the first vehicle, the corresponding virtual event as a part of the virtual environment.

2. The method according to claim 1 , further comprising:
while the first user device of the vehicles receives the definition data of the new virtual event, receiving, by the first user device, condition data, wherein the condition data describe a current environmental condition or a current state of the vehicle;
receiving, by the server device, the condition data;
generating, by the server device, at least one trigger condition for the new virtual event, wherein the new virtual event is displayed to the user in the first vehicle if the first vehicle fulfills the at least one trigger condition.

3. The method according to claim 2 , wherein the at least one trigger condition comprises:
a driving speed of the first vehicle has a value that lies within a predefined interval,
a traffic light in the real-world environment has a predefined state,
traffic is in a predefined state,
a weather in the real-world environment
a specific heading of the first vehicle, or
a driving destination as signaled by a navigation system.

4. The method according to claim 1 , further comprising:
generating, by the server device, map data from the event data of stored virtual events;
providing, by the server device, the map data to the first vehicle and the second vehicle, wherein the map data describe respective trigger regions of the stored virtual events;
monitoring, by the second user device, a current position of the second vehicle; and
generating, by the second user device, the request data if the current position of the second vehicle indicates that the second vehicle approaches or enters or is positioned in the trigger region according to the map data.

5. The method according to claim 1 , wherein the definition data describe at least one of the following virtual events:
a message that is displayed in the virtual environment,
a camera image of the real-world environment,
a screenshot of the virtual environment,
an image of the user who defines the definition data,
a video stream,
a drawing,
an audio message,
a haptic signal, or
a link to a media file of a song.

6. The method according to claim 1 , wherein the definition data describe an interactive virtual event where at least two users interact in real-time via the first user device and the second user device.

7. The method according to claim 1 , wherein the definition data also comprise a geometric position that is set by the user, wherein the geometric position describes a geometric offset of the new virtual event with regard to the current position of the first vehicle or an absolute position of the new virtual event in the real-world environment and
wherein the first user device that is displaying the virtual event projects the new virtual event to a corresponding geometric position in the virtual environment.

8. The method according to claim 1 , wherein the user in the first vehicle is registered in at least one user group and at least one virtual event is associated with the at least one user group and the server device provides event data of the at least one virtual event only to the second user device if a user in the second vehicle is also registered in a same user group with which the at least one virtual event is associated.

9. The method according to claim 1 , wherein, while the new virtual event is displayed to the user in the first vehicle, an interaction of the user with the new virtual event is monitored and the interaction is described by interaction data that are provided to the server device, and the server device adapts the event data of the new virtual event, wherein the adapted event data describe a result of the interaction.

10. The method according to claim 1 , wherein by the first user device the new virtual event:
is displayed in a common virtual environment background that is super-imposed over the real-world environment as a virtual reality, VR, or
is projected into the user's view on the real-world environment as augmented reality, AR.

11. A system comprising:
a server device which, in operation, receives, stores, and sends out event data; and
a first user device of a first vehicle, wherein the first user device, in operation, displays virtual events to a user in the first vehicle and receives definition data of new virtual events from the user,
wherein:
the first user device of the first vehicle, in operation, receives definition data from a user residing in the first vehicle, or generates the definition data based on a current driving situation of the vehicle,
the definition data describe a new virtual event for a virtual environment,
a position sensor of the first vehicle generates position data of the first vehicle while the user generates the definition data,
the position data describe a current position of the first vehicle in a real-world environment,
the server device, in operation, receives the definition data and the position data from the first vehicle,
the server device, in operation, generates event data of the new virtual event,
the server device, in operation, defines, based on the position data, a trigger region that defines where in the real-world environment the new virtual event shall be triggered,
the server device, in operation, receives request data from a second user device of a second vehicle,
the request data indicate that the second vehicle approaches or enters or is positioned in the trigger region,
the server device, in operation, sends the event data of the new virtual event to the first user device of the first vehicle, and
the first user device, in operation, displays the corresponding virtual event as a part of the virtual environment.

12. The system according to claim 11 , wherein the server device comprises a processor that, in operation, stores event data describing at least one virtual event of a virtual environment, wherein the virtual event is associated with a respective real-world trigger region in a real-world environment, and
if, from the first user device of the first vehicle, respective request data are received that indicate that the first vehicle approaches or enters or is positioned in the trigger region of one of the virtual

Assignees

• Cariad Se

Inventors

• Pfaller Daniel
• Weigand Christoph

Classifications

• H04W4/021

  Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences · CPC title

• G06T2219/024

  Multi-user, collaborative environment · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B27/017

  Head mounted · CPC title