Automotive touchscreen with simulated texture for the visually impaired

Patent metadata

Field	Value
Publication number	US-11625145-B2
Application number	US-202016800164-A
Country	US
Kind code	B2
Filing date	Feb 25, 2020
Priority date	Apr 28, 2014
Publication date	Apr 11, 2023
Grant date	Apr 11, 2023

Abstract

Electrostatic friction textures on a touchscreen panel are used to create the sensation of block icons in a contextual menu adapted to an automotive environment. In particular, a center stack touchscreen friction display in a passenger vehicle provides one set of touch controls and HMI data to the driver while simultaneously providing either the same control options and HMI or a completely different set of information and menu structure to the passenger in invisible texture form. The invisible texture is in the form of block icons, and coincidence between a finger of a passenger and a block icon results in an audio announcement of the block icon to guide a visually impaired passenger through the contextual menu.

First claim

What is claimed is:

1. A control system for a vehicle with a driver seat, a passenger seat, and a plurality of vehicle accessories having controllable functions, comprising:
a touchscreen display for displaying a graphical HMI and detecting at least one contact point on the display established manually by touching by a finger of an occupant of one of the seats;
a haptic texture system having an electrode disposed across the touchscreen display and first and second signal generators generating first and second oscillating signals coupled to the driver and passenger seats, respectively, to produce a respective potential difference between the finger and the electrode resulting in a corresponding perceived texture as the finger slides over the touchscreen display, wherein the first and second oscillating signals are varied in response to movement of the contact point with respect to at least one contextual menu;
an audio reproduction system adapted to reproduce audio messages; and
a control circuit determining which of the oscillating signals is associated with a detected touch of a finger to identify a corresponding seat, wherein the control circuit has a passenger mode when the identified seat is the passenger seat, wherein the passenger mode comprises 1) providing a texture pattern for an invisible menu page of the contextual menu comprising a plurality of block icons corresponding to the controllable functions wherein the invisible menu page differs from the graphical HMI displayed by the touchscreen display, 2) comparing the contact point of the finger with respective locations of the block icons, 3) when the contact point coincides with one of the block icons then initiating an audio message identifying the coincident block icon, 4) detecting whether a selection gesture is produced by the contacting finger, and 5) if the selection gesture is detected then initiating an action corresponding to the coincident block icon.

2. The system of claim 1 wherein the passenger mode is independent of the graphical HMI.

3. The system of claim 1 wherein the action is comprised of adjusting one of the controllable functions of the vehicle accessories.

4. The system of claim 1 wherein the action is comprised of providing an updated texture pattern for respective block icons according to a submenu page.

5. The system of claim 1 wherein the control circuit is adapted to detect a selection gesture comprised of a double tap of the finger on the coincident block icon.

6. The system of claim 1 wherein the control circuit is adapted to detect a selection gesture comprised of a swipe of the finger in a predetermined direction.

7. The system of claim 1 further comprising:
a pressure-sensitive screen disposed across the touchscreen display for providing a pressure signal responsive to a pressure of a touch of the finger;
wherein the control circuit is adapted to detect a selection gesture is comprised of a predetermined increase of the pressure signal in response to the finger on the coincident block icon.

8. The system of claim 1 wherein the audio reproduction system is comprised of a speech generation system for generating the audio messages as predetermined text messages.

9. The system of claim 1 wherein the audio reproduction system is adapted to steer the audio messages to an occupant of the passenger seat.

10. The system of claim 1 wherein the control circuit further 1) compares the contact point of the finger with respective locations on the graphical HMI displayed by the touchscreen display when the oscillating signals associated with a detected touch of a finger correspond to the driver seat, and 2) initiating respective audio messages for the driver identifying the respective locations according to the comparison.

11. A method for touchscreen control of controllable features of accessories within an automotive vehicle using a touchscreen control which includes a touchscreen display for displaying a graphical HMI and detecting at least one contact point on the display established manually by touching by a finger of an occupant of one of a driver seat or a passenger seat, a haptic texture system having an electrode disposed across the touchscreen display and first and second signal generators generating first and second oscillating signals coupled to the driver and passenger seats, respectively, to produce a respective potential difference between the finger and the electrode resulting in a corresponding perceived texture as the finger slides over the touchscreen display, an audio reproduction system adapted to reproduce audio messages, and a control circuit coupled to the touchscreen display, haptic texture system, and audio reproduction system, wherein the first and second oscillating signals are varied in response to movement of the contact point with respect to at least one contextual menu, and wherein the method comprises the steps of:
monitoring finger contact on the touchscreen display;
driving the signal generators;
determining which of the oscillating signals is associated with a detected touch of a finger to identify a corresponding seat, wherein the control circuit has a passenger mode when the identified seat is the passenger seat, and wherein the passenger mode includes:
providing a texture pattern for an invisible menu page of the contextual menu comprising a plurality of block icons corresponding to the controllable features, wherein the invisible menu page differs from the graphical HMI displayed by the touchscreen display;
comparing the contact point of the finger with respective locations of the block icons;
when the contact point coincides with one of the block icons then initiating an audio message identifying the coincident block icon;
detecting whether a selection gesture is produced by the contacting finger; and
if the selection gesture is detected then initiating an action corresponding to the coincident block icon.

12. The method of claim 11 wherein the action is comprised of adjusting one of the controllable features.

13. The method of claim 11 wherein the action is comprised of providing an updated texture pattern for respective block icons according to a submenu page.

14. The method of claim 11 wherein the selection gesture comprised of a double tap of the finger on the coincident block icon.

15. The method of claim 11 wherein the selection gesture comprised of a swipe of the finger in a predetermined direction.

16. The method of claim 11 wherein the touchscreen control further includes a pressure-sensitive screen disposed across the touchscreen display for providing a pressure signal responsive to a pressure of a touch of the finger, and wherein the selection gesture is comprised of a predetermined increase of the pressure signal in response to the finger on the coincident block icon.

17. The method of claim 11 wherein the audio messages are comprised of predetermined text messages from a speech generation system.

18. The method of claim 11 wherein the step of initiating an audio message includes steering the audio messages to an occupant of the passenger seat.

19. The method of claim 11 further comprising the steps of:
comparing the contact point of the finger with respective locations on the graphical HMI displayed by the touchscreen display when the oscillating signals associated with a detected touch of a finger correspond to the driver seat; and
initiating respective audio messages for the driver identifying the respective locations according to the comparison.

Assignees

• Ford Global Tech Llc

Inventors

• Van Wiemeersch John R
• Hanson Ryan E

Classifications

• B60K35/22

  Display screens · CPC title

• B60K35/60 Primary

  Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10) · CPC title

• B60K35/10

  Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor · CPC title

• G06F3/03547

  Touch pads, in which fingers can move on a surface · CPC title

• G06F3/0482 Primary

  Interaction with lists of selectable items, e.g. menus · CPC title