Systems and methods for mitigating user input errors on touchscreen displays due to perturbances of mobile platforms

Patent metadata

Field	Value
Publication number	US-2025028410-A1
Application number	US-202318353531-A
Country	US
Kind code	A1
Filing date	Jul 17, 2023
Priority date	Jul 17, 2023
Publication date	Jan 23, 2025
Grant date	—

Abstract

Systems and methods are provided for mitigating user input errors due to perturbances of mobile platforms. The systems may include, one or more sensors configured to sense measurable conditions internal or external to a mobile platform, and a controller in operable communication with the sensors and with a touchscreen display. The controller may be configured to, by one or more processors: receive sensor data from the sensors, process the sensor data to detect and characterize a perturbance, receive user input data indicative of user input performed by a user via the touchscreen display, process the user input data to determine whether the user input is likely to be invalid due to the perturbance, and initiate a corrective action in response to a determination that the user input is likely to be invalid due to the perturbance.

First claim

What is claimed is:

1 . A method, comprising:
receiving, by one or more processors, sensor data from a sensor system of a mobile platform; processing, by the one or more processors, the sensor data to detect and characterize a perturbance of the mobile platform; receiving, by the one or more processors, user input data indicative of user input provided by a user via a touchscreen display in communication with the mobile platform; analyzing, by the one or more processors, the perturbance and the user input to determine whether the user input is likely to be invalid due to the perturbance of the mobile platform; and initiating, by the one or more processors, a corrective action in response to a determination that the user input is likely to be invalid due to the perturbance, wherein the corrective action includes at least one of confirming the user input, invalidating the user input, or modifying the user input.

2 . The method of claim 1 , wherein performing the corrective action includes generating, by the one or more processors, a visual prompt on the touchscreen display that requests confirmation of the user input.

3 . The method of claim 1 , wherein performing the corrective action includes modifying, by the one or more processors, the user input based on the perturbance and programed criteria.

4 . The method of claim 3 , wherein modifying the user input is based on, at least in part, a magnitude of the perturbance, a frequency of the perturbance, a timing of the perturbance relative to the user input, an orientation of the touchscreen display, and/or a direction of the perturbance.

5 . The method of claim 3 , wherein modifying the user input includes:
processing, by the one or more processors, the user input data to determine an actual location of contact on the touchscreen display; determining, by the one or more processors, an intended location of contact on the touchscreen display based on the perturbance; and adjusting, by the one or more processors, the user input from the actual location of contact to the intended location of contact.

6 . The method of claim 3 , wherein the programed criteria is configured to consider a reach distance between a physical location of the touchscreen display and the user.

7 . The method of claim 1 , further comprising:
processing, by the one or more processors, the user input data to determine that the user input includes a first type of operation or command; determining, by the one or more processors, that the user intended a second type of operation or command based on the perturbance; and changing, by the one or more processors, the user input from the first type of operation or command to the second type of operation or command.

8 . The method of claim 1 , further comprising processing, by the one or more processors, the user input data to determine that the user input includes a swipe operation or command or a double-tap operation or command;
determining, by the one or more processors, that the user intended a single-tap operation or command based on the perturbance; and changing, by the one or more processors, the user input from the swipe operation or command or the double-tap operation or command to the single-tap operation or command.

9 . The method of claim 1 , further comprising:
determining, by the one or more processors, that the user input includes a first dragging operation wherein the user performed a sliding contact across the touchscreen display; receiving, by the one or more processors, additional user input data subsequent to receiving the user input data that is indicative of a second dragging operation; determining, by the one or more processors, that an unintended interruption occurred between receiving the user input data and receiving the additional user input data based on the perturbance; and combining, by the one or more processors, the user input data and the additional user input data to generate a continuous, uninterrupted dragging operation.

10 . A system, comprising:
one or more sensors of a mobile platform configured to sense measurable conditions internal or external to the mobile platform; and a controller in operable communication with the one or more sensors and with a touchscreen display having a graphic user interface that includes selectable icons, the controller configured to, by one or more processors: receive sensor data from the one or more sensors; process the sensor data to detect and characterize a perturbance of the mobile platform; receive user input data indicative of user input provided by a user via the touchscreen display; analyze the perturbance and the user input to determine whether the user input is likely to be invalid due to the perturbance of the mobile platform; and initiate a corrective action in response to a determination that the user input is likely to be invalid due to the perturbance, wherein the corrective action includes at least one of confirming the user input, invalidating the user input, or modifying the user input.

11 . The system of claim 10 , wherein the controller is configured to, by the one or more processors, generate a visual prompt on the touchscreen display that requests confirmation of the user input.

12 . The system of claim 10 , wherein the controller is configured, by the one or more processors, to modify the user input based on the perturbance and programed criteria.

13 . The system of claim 12 , wherein the controller is configured to, by the one or more processors, modify the user input based on, at least in part, a magnitude of the perturbance, a frequency of the perturbance, a timing of the perturbance relative to the user input, an orientation of the touchscreen display, and/or a direction of the perturbance.

14 . The system of claim 12 , wherein the controller is configured to, by the one or more processors, modify the user input by:
processing the user input data to determine an actual location of contact on the touchscreen display; determining an intended location of contact on the touchscreen display based on the perturbance; and adjusting the user input from the actual location of contact to the intended location of contact.

15 . The system of claim 12 , wherein the programed criteria is configured to consider a reach distance between a physical location of the touchscreen display relative and the user.

16 . The system of claim 10 , wherein the controller is configured to, by the one or more processors:
determine that the user input includes a first type of operation or command; determine that the user intended a second type of operation or command based on the perturbance; and change the user input from the first type of operation or command to the second type of operation or command.

17 . The system of claim 10 , wherein the controller is configured to, by the one or more processors:
determine that the user input includes a swipe operation or command or a double-tap operation or command; determine that the user intended a single-tap operation or command based on the perturbance; and change the user input from the swipe operation or command or the double-tap operation or command to the single-tap operation or command.

18 . The system of claim 10 , wherein the controller is configured to, by the one or more processors:
process the user input data to determine that the user input includes a first dragging operation or command wherein the user performed a sliding contact across the touchscreen display; receive additional user input data s

Assignees

• Honeywell Int Inc

Inventors

• Finseth Tor
• De Mers Robert
• Lubold Nichola

Classifications

• G06F3/0418 Primary

  for error correction or compensation, e.g. based on parallax, calibration or alignment · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• G06F3/04186 Primary

  Touch location disambiguation · CPC title

• B60K2360/48

  Sensors · CPC title