Sensor based interface adjustment

Patent metadata

Field	Value
Publication number	US-10485056-B2
Application number	US-201514881297-A
Country	US
Kind code	B2
Filing date	Oct 13, 2015
Priority date	Oct 13, 2015
Publication date	Nov 19, 2019
Grant date	Nov 19, 2019

Abstract

A method includes sensing a hand position on a mobile device via sensors on the mobile device, providing information identifying the sensed hand position to a processor of the mobile device, identifying a position of a user interface on a touch screen display of the mobile device responsive to the information identifying the sensed hand position using the processor of the mobile device, and adjusting a user interface display position on the mobile device to the identified position using the processor of the mobile device.

First claim

The invention claimed is:

1. A method comprising:
sensing a hand position of a user on a mobile device via a sensor array comprising a multiplicity of sensors on a housing of the mobile device,
providing information identifying the sensed hand position to a processor of the mobile device;
identifying a position of a user interface on a touch screen display of the mobile device responsive to the information identifying the sensed hand position using the processor of the mobile device;
adjusting a user interface display position on the mobile device to the identified position using the processor of the mobile device;
tracking historic holding patterns for the user of the mobile device;
applying weights to emphasize more recent holding pattern information;
wherein adjusting the user interface display position on the mobile device responsive to the sensed hand position includes adjusting the user interface display position based on the weighted historic holding patterns prior to a user holding the device, wherein tracking historic holding patterns comprises:
periodically storing information identifying the sensed hand position;
generating a holding pattern heat map identifying frequency of occurrence of each sensed hand position, wherein a separate holding pattern heat map is generated for each application executing on the mobile device;

tracking historic attempted selections of user interface elements on the touch screen;
generating a touch screen interaction heat map for one of the user interface elements; and
shifting a position of the one of the user interface elements on the touch screen responsive to the touch screen interaction heat map.

2. The method of claim 1 further comprising displaying a portion of a block of text in a text reading mode, wherein sensing a hand position comprises sensing the mobile device is being held on one side of the mobile device by one hand, and wherein adjusting the user interface display position comprises moving existing user interface page up and page down buttons to the one side of the mobile device to enable navigation up or down through the block of text.

3. The method of claim 2 wherein the user interface page up and page down buttons are moved proximate the hand holding the side of the mobile device.

4. The method of claim 1 further comprising displaying a portion of a block of text in a text reading mode, wherein sensing a hand position comprises sensing the mobile device is being held on both sides of the mobile device by two hands, and wherein adjusting the user interface display position comprises moving user interface page up and page down buttons to both sides of the touch screen proximate where the hands are holding the mobile device to enable navigation up or down through the block of text.

5. The method of claim 1 wherein sensing a hand position comprises sensing the mobile device is being held on one side of the mobile device by only one hand and wherein adjusting the user interface display position comprises moving a user interface proximate the position of the hand on the one side of the mobile device to facilitate use of the user interface without moving the hand.

6. The method of claim 1 and further comprising:
sensing a position of a finger above the touchscreen display;
providing information identifying the sensed finger position to the processor of the mobile device; and
wherein identifying a position of a user interface is further responsive to the information identifying the sensed finger position.

7. The method of claim 6 wherein sensing a position of a finger above the touchscreen is performed by magnetic field disruption detection.

8. The method of claim 6 wherein sensing a position of a finger above the touchscreen is performed by processing images provided by a plurality of cameras of the mobile device, the plurality of cameras including a first camera above the touch screen display and a second camera below the touch screen display.

9. The method of claim 1 and further comprising reducing an active touch zone of the user interface responsive to adjusting a user interface display position.

10. A mobile computing device comprising:
a processor;
a sensor array supported by the mobile computing device, the sensor array positioned to sense hand positions on a housing of the mobile computing device and user selections of interface elements on a touchscreen on the mobile computing device by a user using the device; and
a memory device coupled to the processor and having instructions stored thereon executable by the processor to:
receive information identifying the sensed hand positions from the sensor array;
identify an adjusted position of a selectable user interface display on a touch screen display of the mobile device responsive to the information identifying the sensed hand positions; and
move a user interface display position for the selectable user interface display on the mobile device to the identified adjusted position;
tracking historic holding patterns for the user of the mobile device;
applying weights to emphasize more recent holding pattern information;
wherein adjusting the user interface display position on the mobile device responsive to the sensed hand position includes adjusting the user interface display position based on the weighted historic holding patterns prior to a user holding the device, wherein tracking historic holding patterns comprises:
periodically storing information identifying the sensed hand position;
generating a holding pattern heat map identifying frequency of occurrence of each sensed hand position;

tracking historic attempted selections of user interface elements on the touch screen;
generating a touch screen interaction heat map for one of the user interface elements; and
shifting a position of the one of the user interface elements on the touch screen responsive to the touch screen interaction heat map.

Assignees

• Lenovo Singapore Pte Ltd

Inventors

• Schantz Daniel Jordan
• Conzola Vincent Charles
• Luttrell Wesley Abram
• Osborne Christopher Miles

Classifications

• G09G2340/14

  Solving problems related to the presentation of information to be displayed · CPC title

• G06F1/1684

  Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 · CPC title

• G06F1/1686

  the I/O peripheral being an integrated camera · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• H04W88/02 Primary

  Terminal devices · CPC title