Predictive input system for touch and touchless displays

Patent metadata

Field	Value
Publication number	US-9753579-B2
Application number	US-201414391411-A
Country	US
Kind code	B2
Filing date	Feb 4, 2014
Priority date	Feb 4, 2014
Publication date	Sep 5, 2017
Grant date	Sep 5, 2017

Abstract

A device comprising a display, a predictive input system coupled to the display and configured to store zone data indicating zones of the display, wherein each zone constitutes a portion of a display area; store predictive parameter data, wherein each zone is assigned a subset of predictive parameter data, wherein each subset indicates at least one of a look-ahead prediction value that indicates a time period corresponding to how far in the future a predictive user input pertains, an indication of a particular prediction algorithm, or at least one value used by the particular prediction algorithm, and wherein at least two zones of the display have different values for the subsets of predictive parameter data; receive input data via the display; determine the zone in which the input data is received; and generate prediction data based on the input data, the zone data, and the subset of predictive parameter data.

First claim

What is claimed is:

1. A device comprising:
a display, wherein the display is configured to operate in at least one of a touch mode or a touchless mode;
a predictive input system communicatively coupled to the display, wherein the predictive input system comprises:
a memory, wherein the memory stores instructions; and
a processor, wherein the processor executes the instructions to:
store zone data indicating zones of the display, wherein each zone constitutes a portion of a display area of the display;
store predictive parameter data, wherein each zone of the zone data is assigned a subset of the predictive parameter data, wherein each subset of the predictive parameter data indicates at least one of a look-ahead prediction value that indicates a time period corresponding to how far in the future a predictive user input pertains, an indication of a particular prediction algorithm, or at least one value used by the particular prediction algorithm, and wherein at least two zones of the display have different values for the subsets of predictive parameter data;
receive, via the display, input data representing an actual user's input;
determine the zone in which the input data is received;
generate prediction data based on the input data, the zone data associated with the determined zone, and the subset of predictive parameter data associated with the determined zone, the prediction data being a prediction of future user input that extends the actual user's input on the display along a predicted line of input that extends beyond the actual user's input; and
output the prediction data.

2. The device of claim 1 , wherein the zone data is generated based on a predictive input accuracy signature of an entire display area of the display, wherein the predictive input accuracy signature indicates an accuracy for calculating predictive data based on different noise levels associated with respective portions of the display area, wherein the display uses a capacitive-based sensing technology, and wherein the display displays the prediction data.

3. The device of claim 1 , wherein the display includes a single-point input device or a multi-point input device, and wherein the user device comprises a mobile communication device having telephone and data communication capabilities.

4. The device of claim 1 , wherein the at least one value includes an interpolated value, and wherein a number of zones is two or three, and a shape of each zone is different.

5. The device of claim 1 , wherein the at least one value pertains to a sensitivity to noise, and wherein a shape and a size of each zone is unlike a size and shape of the user's input stemming from the user's finger or an instrument used by the user.

6. A method comprising:
storing, by a user device that includes a display, zone data indicating zones of the display, wherein each zone constitutes a portion of a display area of the display, and the display is at least one of a touch display or a touchless display;
storing, by the user device, predictive parameter data, wherein each zone of the zone data is assigned a subset of the predictive parameter data, wherein each subset of the predictive parameter data indicates at least one of a look-ahead prediction value that indicates a time period corresponding to how far in the future a predictive user input pertains, an indication of a particular prediction algorithm, or at least one value used by the particular prediction algorithm, and wherein at least two zones of the display have different values for the subsets of the predictive parameter data;
receiving, by the user device, input data representing an actual user's input;
determining, by the user device, the zone in which the input data is received;
generating, by the user device, prediction data based on the input data, the zone data associated with the determined zone, and the subset of predictive parameter data associated with the determined zone, the prediction data being a prediction of future user input that extends the actual user's input on the display along a predicted line of input that extends beyond the actual user's input; and
outputting, by the user device, the prediction data.

7. The method of claim 6 , wherein a shape and a size of each zone is unlike a shape and size of the user's input stemming from the user's finger or an instrument used by the user.

8. A device comprising:
a display, wherein the display is configured to operate in at least one of a touch mode or a touchless mode;
a predictive input system communicatively coupled to the display, wherein the predictive input system comprises:
a memory, wherein the memory stores instructions; and
a processor, wherein the processor executes the instructions to:
receive, via the display, input data representing an actual user's input;
convert the input data into event data;
generate prediction data representing a prediction of future user input that extends the actual user's input on the display along a predicted line of input that extends beyond the actual user's input, the prediction data based on the event data, a prediction algorithm, and a predictive step value, wherein the predictive step value indicates a time period corresponding to how far in the future the prediction of user input is made, and wherein the predictive step value is gradually increased based on an interpolation between predicted positions over a pre-determined number of events;
perform overshoot compensation to the prediction data;
perform de-entanglement between events based on a sign of a direction between real events associated with the user's input compared to a sign of direction between predicted events;
perform post-smoothing; and
output the prediction data.

9. The device of claim 8 , wherein the processor further executes the instructions to: perform pre-smoothing of the event data using a smoothing algorithm, wherein an event data window having an event data window size corresponding to half of the event data is used to designate a portion of the event data to be pre-smoothed, and wherein the event data window is continuously moved as new event data is received.

10. The device of claim 8 , wherein, when performing overshoot compensation, the processor further executes the instructions to: determine an acceleration between events; calculate a first value based on the acceleration; and
determine whether the prediction step value is to be increased, be decreased, or remain as is based on the first value.

11. The device of claim 10 , wherein, when performing overshoot compensation, the processor further executes the instructions to: determine a speed between the events; calculate a second value based on the speed; and determine whether the prediction step value is to be increased, be decreased, or remain as is based on the first value and the second value.

12. The device of claim 8 , wherein the predicted events include a previous predicted event P(t−1) and a current predicted event P(t), and wherein, when performing de-entanglement, the processor further executes the instructions to:
maintain a value of the previous predicted event P(t−1) for the current predicted event P(t) if the sign of direction between the real events differ from the sign of direction between the predicted events.

13. A method comprising:
receiving, by a user device that includes a display, input data representing an actual user's input, wherein the display is at least one of a touch display or a touchless display;
converting, by the user device, the input data into event data;
generating, by the user device, prediction data representing a prediction of future user input

Assignees

• Sony Mobile Communications Inc
• Sony Corp

Inventors

• Johansson Magnus Ola
• Moliner Olivier Thierry Nicolas
• Midholt Magnus
• Hunt Alexander Leonard
• Skorokhodov Sergii

Classifications

• G06F3/044

  by capacitive means · CPC title

• G06F2203/04101

  2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup · CPC title

• G06F2203/04108

  Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction · CPC title

• H04M1/72583

  Electricity · mapped topic

• G06F3/0418 Primary

  for error correction or compensation, e.g. based on parallax, calibration or alignment · CPC title