Coupling of user interfaces

Patent metadata

Field	Value
Publication number	US-12373087-B2
Application number	US-202017594709-A
Country	US
Kind code	B2
Filing date	Jun 5, 2020
Priority date	Jul 5, 2019
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

A method and system couples a first user interface with a second user interface. The first user interface is implemented in the form of a mobile terminal or one or more back-end components. The second user interface is implemented in the form of a control device of a vehicle. The method includes the steps of: registering one or more elements of the first user interface; determining one or more display elements based on first heuristics and the one or more elements, wherein the one or more display elements are configured to reproduce at least one portion of the one or more elements; and displaying the one or more display elements on the second user interface. The system has the control device and/or the one or more back-end components, wherein the control device and/or the one or more back-end components are configured to carry out the method.

First claim

What is claimed is:

1. A method for coupling a first user interface to a second user interface, wherein the first user interface is implemented by way of a mobile terminal or by way of one or more back-end components and the second user interface is implemented by way of a control device of a vehicle, the method comprising:
registering one or more elements of the first user interface;
determining one or more display elements based on first heuristics and the one or more elements, wherein the one or more display elements are configured to depict at least some of the one or more elements;
displaying the one or more display elements on the second user interface;
registering one or more inputs of a user of the vehicle;
determining an input image of the one or more inputs based on second heuristics;
transmitting the input image to the first user interface;
repeatedly at regular intervals, continuously, or when required:
registering one or more behavior parameters, which characterize a behavior of the user of the vehicle, by directly monitoring the user of the vehicle via an optical sensor; and
determining one or more attention parameters, which characterize a degree of attention of the user of the vehicle relating to the operation of the vehicle, based on the behavior parameters; and

adjusting the first and/or second heuristics based on the determined one or more attention parameters,
wherein the first heuristics comprise personal capabilities of the user of the vehicle,
wherein the first heuristics further comprise relevance-based heuristics for transferring the one or more elements to the one or more display elements,
wherein the relevance-based heuristics correlate a relevance of at least one of the one or more elements with one or more display parameters of the depiction,
wherein the relevance-based heuristics take into account a current relevance of the one or more elements for the user of the vehicle,
wherein the current relevance of an element of the one or more elements is determined based on whether the element is usable by the user of the vehicle for a purpose related to the operation of the vehicle, and
wherein a first element of the one or more elements that is relevant only to mobile use of the mobile terminal is prevented from being displayed on the one or more display elements according to the relevance-based heuristics.

2. The method according to claim 1 , wherein the first heuristics further comprise:
dynamics-based heuristics for transferring the one or more elements to one or more display elements,
wherein the dynamics-based heuristics correlate display dynamics of at least one of the one or more elements with one or more display parameters of the depiction, and
wherein the dynamics-based heuristics take into account a current driving state of the vehicle.

3. The method according to claim 1 , wherein the first heuristics further comprise:
parameter-based heuristics for transferring one or more parameters of the first user interface to one or more parameters of the second user interface, and
wherein the parameter-based heuristics take into account generic depiction rules of the display of the one or more elements on the second user interface.

4. The method according to claim 1 , wherein the second heuristics further comprise:
input-modal heuristics for depicting the one or more inputs of the user on input modalities of the first user interface.

5. The method according to claim 1 , wherein
the steps of registering one or more inputs, of determining the input image, and of transmitting the input image to the first user interface are carried out in real time.

6. The method according to claim 1 , wherein
the steps of registering the one or more elements, of determining one or more display elements and of displaying the one or more display elements on the second user interface are carried out in real time.

7. A system for providing one or more users of a vehicle with information, the system comprising:
a control device; and/or
one or more back-end components; wherein
the control device and/or the one or more back-end components are configured to couple a first user interface to a second user interface, wherein the first user interface is implemented by way of a mobile terminal or by way of the one or more back-end components and the second user interface is implemented by way of the control device of a vehicle, wherein the coupling operates to:
register one or more elements of the first user interface;
determine one or more display elements based on first heuristics and the one or more elements, wherein the one or more display elements are configured to depict at least some of the one or more elements;
display the one or more display elements on the second user interface;
register one or more inputs of a user of the vehicle;
determine an input image of the one or more inputs based on second heuristics;
transmit the input image to the first user interface;
repeatedly at regular intervals, continuously, or when required:
register one or more behavior parameters, which characterize a behavior of the user of the vehicle, by directly monitoring the user of the vehicle via an optical sensor; and
determine one or more attention parameters, which characterize a degree of attention of the user of the vehicle relating to the operation of the vehicle, based on the behavior parameters; and

adjust the first and/or second heuristics based on the determined one or more attention parameters,
wherein the first heuristics comprise personal capabilities of the user of the vehicle,
wherein the first heuristics further comprise relevance-based heuristics for transferring the one or more elements to the one or more display elements,
wherein the relevance-based heuristics correlate a relevance of at least one of the one or more elements with one or more display parameters of the depiction,
wherein the relevance-based heuristics take into account a current relevance of the one or more elements for the user of the vehicle,
wherein the current relevance of an element of the one or more elements is determined based on whether the element is usable by the user of the vehicle for a purpose related to the operation of the vehicle, and
wherein a first element of the one or more elements that is relevant only to mobile use of the mobile terminal is prevented from being displayed on the one or more display elements according to the relevance-based heuristics.

8. A vehicle, comprising:
a control device, wherein
the control device is configured to couple a first user interface to a second user interface, wherein the first user interface is implemented by way of a mobile terminal or by way of one or more back-end components and the second user interface is implemented by way of the control device,
the control device operating to:
register one or more elements of the first user interface;
determine one or more display elements based on first heuristics and the one or more elements, wherein the one or more display elements are configured to depict at least some of the one or more elements;
display the one or more display elements on the second user interface;
register one or more inputs of a user of the vehicle;
determine an input image of the one or more inputs based on second heuristics;
transmit the input image to the first user interface;
repeatedly at regular intervals, continuously, or when required:
register one or more behavior parameters, which characterize a behavior of the user of the vehicle, by directly monitoring the user of the vehicle via an optical sensor; and
determine one or more attention parameters, which characterize a degree of attention of the user of the vehicle relating to the oper

Assignees

• Bayerische Motoren Werke Ag

Inventors

• Strassberger Markus

Classifications

• B60K35/00

  Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles · CPC title

• B60K35/265

  Voice · CPC title

• B60K35/25

  using haptic output · CPC title

• B60K35/10

  Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor · CPC title

• B60K35/60

  Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10) · CPC title