Software defined icon interactions with multiple and expandable layers

Patent metadata

Field	Value
Publication number	US-11334237-B2
Application number	US-201816164423-A
Country	US
Kind code	B2
Filing date	Oct 18, 2018
Priority date	Jun 30, 2016
Publication date	May 17, 2022
Grant date	May 17, 2022

Abstract

A method of controlling an electronic device is provided, comprising receiving a selection contact within a first icon region of a first icon displayed on a pressure-sensing display screen of the electronic device, displaying on the pressure-sensing display screen a second set of icons related to the first icon, detecting that the selection contact uninterruptedly moves to a second icon of the second set of icons and selects the second icon, displaying on the pressure-sensing display screen a third set of icons related to the second icon, detecting that the selection contact uninterruptedly moves to a third icon of the third set of icons and selects the third icon, and initiating an application or function associated with the third icon.

First claim

What is claimed is:

1. A method of controlling an electronic device, comprising:
the electronic device receiving a depth measured by a depth-sensing display screen of the electronic device, the depth-sensing display screen detecting the depth of an object in proximity to the depth-sensing display screen without the object physically contacting the depth-sensing display screen;
the electronic device detecting a selection action within a first icon region of a first icon or a first set of icons displayed on the depth-sensing display screen and the selection action therefore selecting the first icon, the detecting comprising determining that the depth of the object to the depth-sensing display screen is less than a predefined first depth threshold, and the electronic device generating a selection indication on the depth-sensing display screen;
the electronic device displaying a second set of icons on the depth-sensing display screen and changing the first icon to visually indicate a first icon non-active state, the second set of icons being related to the first icon;
the electronic device detecting that the selection action uninterruptedly moves to a second icon of the second set of icons and detecting that the selection action therefore selects the second icon, the selection action comprising determining that the depth of the object over the second icon is less than a predefined second depth threshold and the object lingering over the second icon for more than a predefined linger threshold;
the electronic device displaying a third set of icons on the depth-sensing display screen and changing the second set of icons to visually indicate a second icon set non-active state, the third set of icons being related to the second icon;
the electronic device detecting that the selection action uninterruptedly moves to a third icon of the third set of icons and the selection action therefore selecting the third icon, the selection action comprising determining a depth of the object over the third icon is less than a predefined third depth threshold and determining the object lingering over the third icon for more than the predefined linger threshold;
the electronic device initiating an application or function associated with the third icon; and
the electronic device detecting when the depth of the object has increased to greater than the predefined third depth threshold, removing the third set of icons from the depth-sensing display, and changing the second set of icons to a second icon set active state.

2. The method of claim 1 , with detecting that the selection action selects the second icon comprising moving the selection action within a predetermined second icon area of the second icon.

3. The method of claim 1 , further comprising the electronic device restoring an original appearance of selected and unselected icons of the second set of icons when determining the selection action exceeds the predetermined second depth threshold.

4. The method of claim 3 , wherein the detecting that the selection action selects the third icon comprises moving the selection action within a predetermined third icon area of the third icon.

5. The method of claim 3 , wherein the detecting that the selection action selects the first icon comprises moving the selection action within a predetermined first icon area of the first icon.

6. The method of claim 1 , with the application or function being associated with the third icon and the second set of icons.

7. The method of claim 1 , further comprising the electronic device restoring an original appearance of selected and unselected icons of the first set of icons after detecting the selection action exceeds the predetermined first depth threshold.

8. The method of claim 1 , further comprising the electronic device restoring an original appearance of selected and unselected icons of the third set of icons after detecting the selection action exceeds the predetermined third depth threshold.

9. The method of claim 1 , with the application or function being associated with the first icon, the second icon, and the third icon.

10. An electronic device, comprising:
a depth-sensing display screen detecting a depth of an object in proximity to the depth-sensing display screen without the object physically contacting the depth-sensing display screen;
a processor coupled to the depth-sensing display screen, the processor configured to:
detect a selection action within a first icon region of a first icon or a first set of icons displayed on the depth-sensing display screen and select the first icon, the detecting comprising detecting that the depth of the object to the depth-sensing display screen is less than a predefined first depth threshold, and generate a selection indication on the depth-sensing display screen;
display a second set of icons on the depth-sensing display screen and change the first icon to visually indicate a first icon non-active state, the second set of icons being related to the first icon;
detect that the selection action uninterruptedly moves to a second icon of the second set of icons and detect that the selection action therefore selects the second icon, the selection action comprising determining that the depth of the object over the second icon is less than a predefined second depth threshold and the object lingering over the second icon for more than a predefined linger threshold;
display a third set of icons on the depth-sensing display screen and change the second set of icons to visually indicate a second icon set non-active state, the third set of icons being related to the second icon;
detect that the selection action uninterruptedly moves to a third icon of the third set of icons and the selection action therefore selects the third icon, the selection action comprising determining a depth of the object over the third icon is less than a predefined third depth threshold and determining the object lingering over the third icon for more than the predefined linger threshold;
initiate an application or function associated with the third icon; and
detect when the depth of the object has increased to greater than the predefined third depth threshold, remove the third set of icons from the depth-sensing display and change the second set of icons to a second icon set active state.

11. The electronic device of claim 10 , with detecting that the selection action selects the second icon comprising moving the selection action within a predetermined second icon area of the second icon.

12. The electronic device of claim 11 , with the processor further configured to:
detect that the selection action selects the third icon comprising moving the selection action within a predetermined area of the third icon.

13. The electronic device of claim 10 , wherein the processor is further configured to restore an original appearance of unselected icons of the second set of icons when determining the selection action exceeds the predetermined second depth threshold.

14. The electronic device of claim 13 , wherein the detecting that the selection action selects the first icon comprises moving the selection action within a predetermined first icon area of the first icon.

15. The electronic device of claim 10 , with the application or function being associated with the third icon and the second set of icons.

16. The electronic device of claim 10 , further comprising the electronic device restoring an original appearance of selected and unselected icons of the first set of icons after detecting the selection action exceeds the predetermined first depth threshold.

Assignees

• Futurewei Technologies Inc

Inventors

• Lin Zongfang
• Yazdani Reza
• Tian Chen
• Davison Lawrence
• Hu Ziang

Classifications

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F2203/04105

  Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position · CPC title

• H04M1/72403

  with means for local support of applications that increase the functionality · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title