Enabling vehicle display interaction and personalization

Patent metadata

Field	Value
Publication number	US-12548484-B2
Application number	US-202418637976-A
Country	US
Kind code	B2
Filing date	Apr 17, 2024
Priority date	Apr 17, 2024
Publication date	Feb 10, 2026
Grant date	Feb 10, 2026

Abstract

A system for enabling vehicle display and interaction includes a vehicle display server in communication with a plurality of sensors and adapted to track head and eye position and movement of users within the vehicle, detect locations of users within the vehicle and when users change seating positions, detect when a user enters and exits the vehicle, detect and interpret facial and gesture inputs from users, capture images of users, and receive audio inputs from users within the vehicle, haptic feedback devices adapted to provide haptic feedback to users, and a user display system for viewing and interaction by users, the vehicle display server adapted to identify an identity of a user seated within the vehicle, select user specific content to be displayed for the user on the user display system, and automatically display the user specific content on the user display system for viewing by the user.

First claim

What is claimed is:

1 . A system for enabling vehicle display and interaction, comprising:
a vehicle display server positioned within a vehicle and in communication with:
a plurality of sensors positioned within the vehicle and adapted to:
track head and eye position and movement of users seated within a plurality of seating positions within the vehicle;
detect locations of users within the vehicle and when users change seating positions within the vehicle;
detect when a user enters and exits the vehicle;
detect and interpret facial and gesture inputs from users within the vehicle;
capture images of users within the vehicle;
receive audio inputs from users within the vehicle;

haptic feedback devices positioned within the vehicle and adapted to provide haptic feedback to users seated within the vehicle; and
a user display system positioned within the vehicle for viewing and interaction by users seated within the plurality of seating positions within the vehicle;
the vehicle display server adapted to:
identify, using the plurality of sensors positioned within the vehicle, computer vision algorithms and stored data, an identity of a user seated at a one of the plurality of seating positions within the vehicle;
select, using the identity of the user seated at the one of the plurality of seating positions within the vehicle, user specific content to be displayed for the user on the user display system; and
automatically display the user specific content on the user display system for viewing by the user seated within the one of the plurality of seating positions within the vehicle; and
when a user seated at a first seating position within the vehicle moves to a second seating position within the vehicle, the vehicle display server is adapted to:
detect, with the plurality of sensors positioned within the vehicle, when the user leaves the first seating position within the vehicle;
pause user specific content that is currently being displayed on the user display system for the first seating position;
detect, with the plurality of sensors positioned within the vehicle, when the user sits at the second seating position within the vehicle; and
resume displaying the user specific content on the user display system for the second seating position.

2 . The system of claim 1 , wherein the plurality of sensors includes an occupant monitoring camera for each one of the plurality of seating positions.

3 . The system of claim 2 , wherein the user display system comprises one of: a plurality of individual display screens adapted to display information and receive input from a user, one individual display screen associated with each of the plurality of seating positions within the vehicle; or a single display system comprising: at least one display for projecting an image; a plurality of reflectors, each reflector associated with a one of the plurality of seating positions within the vehicle and adapted to reflect a projected image to the associated one of the plurality of seating positions, such that a user seated at the associated one of the plurality of seating positions within the vehicle perceives the image floating at a central location within the vehicle; and a transparent cylindrical touch screen display positioned between the plurality of seating positions within the vehicle and the plurality of reflectors and adapted to display user specific content for users at each of the plurality of seating positions within the vehicle and receive input from each of the users at each of the plurality of seating positions within the vehicle.

4 . The system of claim 3 wherein, the vehicle display server is adapted to: identify, using the plurality of sensors positioned within the vehicle, when a user that is viewing the user display system looks away from the user display system; pause user specific content that is being displayed on the user display system; identify, using the plurality of sensors positioned within the vehicle, when the user returns to looking at the user display system; and
resume displaying the user specific content on the user display system.

5 . The system of claim 4 , further including a cloud-based host server in communication, via a wireless communication network, with the vehicle display server within the vehicle, the cloud-based host server further in communication with at least one remote vehicle, the remote vehicle having a vehicle display server in communication with the cloud-based host server, a plurality of sensors, haptic feedback devices, a plurality of seating positions and a user display system substantially identical to the correspon ding features of the vehicle.

6 . The system of claim 5 , wherein when a user seated within the vehicle exits the vehicle and moves to a one of the at least one remote vehicle, the vehicle display server within the vehicle is adapted to: detect, with the plurality of sensors positioned within the vehicle, when the user leaves the vehicle; and pause user specific content that is currently being displayed on the user display system within the vehicle; and the vehicle display server within the one of the at least one remote vehicle is adapted to: detect, with the plurality of sensors positioned within the one of the at least one remote vehicle, when the user enters the one of the at least one remote vehicle; identify, using the plurality of sensors positioned within the one of the at least one remote vehicle, computer vision algorithms and stored data, an identity of the user; obtain, via communication with the host server, information related to the user specific content that the user was viewing in the vehicle prior to exiting the vehicle; and automatically resume displaying the user specific content on the user display system within the one of the at least one remote vehicle into which the user entered.

7 . The system of claim 6 , wherein the host server is adapted to coordinate the vehicle display server and the user display system positioned within the vehicle and being viewed by a first user with a vehicle display server and user display system positioned within a one of the at least one remote vehicle and being viewed by a second user and facilitate communication and interaction between the first user and the second user.

8 . The system of claim 7 , wherein the host server is in communication with a personal device of a user, and further wherein: when the user is viewing user specific content on the user display system within the vehicle and the user exits the vehicle, the host server is adapted to: detect, with the plurality of sensors positioned within the vehicle via communication with the vehicle display server within the vehicle, when the user leaves the vehicle; automatically pause the user specific content that is currently being displayed on the user display system within the vehicle; and automatically resume displaying the user specific content on the personal device of the user; and when the user is viewing user specific content on the personal device and the user enters the vehicle, the host server is adapted to: detect, with the plurality of sensors positioned within the vehicle via communication with the vehicle display server within the vehicle, when the user enters the vehicle; automatically prompt the user with the option to selectively: pause the user specific content that is currently being displayed on the personal device; and resume displaying the user specific content on the user display system within the vehicle.

9 . The system of claim 3 , wherein for the user display system comprising a single display system, the plurality of reflectors comprises a plurality of transparent beam splitters, one transparent beam splitter individually assoc

Assignees

• Gm Global Tech Operations Llc

Inventors

• Sharma Manoj Kumar
• Grimm Donald K
• Szczerba Joseph F
• Philipp Tzvi
• Seder Thomas A

Classifications

• G06V20/597

  Recognising the driver's state or behaviour, e.g. attention or drowsiness · CPC title

• G09G2380/10

  Automotive applications · CPC title

• G09G2370/20

  Details of the management of multiple sources of image data · CPC title

• G09G2340/0464

  Positioning · CPC title

• G06T2207/30201

  Face · CPC title