Dynamic adjustment of user interface

Patent metadata

Field	Value
Publication number	US-11099637-B2
Application number	US-201916549082-A
Country	US
Kind code	B2
Filing date	Aug 23, 2019
Priority date	Nov 12, 2012
Publication date	Aug 24, 2021
Grant date	Aug 24, 2021

Abstract

Embodiments related to dynamically adjusting a user interface based upon depth information are disclosed. For example, one disclosed embodiment provides a method including receiving depth information of a physical space from a depth camera, locating a user within the physical space from the depth information, determining a distance between the user and a display device from the depth information, and adjusting one or more features of a user interface displayed on the display device based on the distance.

First claim

The invention claimed is:

1. A method for adjusting a user interface display, comprising:
receiving depth information of a physical space from a depth camera;
locating a user within the physical space from the depth information;
determining from the depth information that a distance between the user and a display device has decreased; and
scaling an input zone to a reduced size based on the distance between the user and the display device having decreased, the input zone being a defined region of the physical space imaged for determining input control gestures performed by the user and comprising a cross-sectional area less than a field of view of the depth camera.

2. The method of claim 1 , further comprising adjusting one or more features of a user interface displayed on the display device based at least on the distance having decreased.

3. The method of claim 2 , wherein adjusting the one or more features of the user interface comprises adjusting a number of features of the user interface displayed on the display device.

4. The method of claim 3 , wherein the number of features of the user interface displayed on the display device is increased based upon the distance between the user and the display device having decreased.

5. The method of claim 2 , wherein adjusting the one or more features of the user interface displayed on the display device based on the distance having decreased further comprises displaying the user interface with a first number of features when the distance is less than a threshold distance, and displaying the user interface with a second number of features when the distance is greater than the threshold distance.

6. The method of claim 5 , wherein the threshold distance is a first threshold distance, and further comprising continuing to display the user interface with the second number of features until the distance is below a second threshold distance, lower than the first threshold distance, and wherein once the distance is below the second threshold distance, displaying the user interface with the first number of features.

7. The method of claim 1 , further comprising determining that the distance between the user and the display device has increased, and increasing a scale of the input zone based on the distance having increased.

8. The method of claim 7 , further comprising receiving input from the user via gestures and/or voice commands after determining that the distance between the user and the display device has increased.

9. On a computing device, a method for adjusting a user interface display, comprising:
receiving depth information of a physical space from a depth camera;
locating a user within the physical space from the depth information;
determining a distance between the user and a display device from the depth information;
when the user is a first distance from the display device, scaling an input zone to a first, smaller size, the input zone being a defined region of the physical space imaged for determining input control gestures performed by the user and; and when the user is a second, greater distance from the display device, scaling the input zone to a second, larger size.

10. The method of claim 9 , further comprising, if the user is at the first distance, displaying a user interface on the display device with a first number of features and/or with features having a first size, and as the user moves from the first distance to the second distance, changing the user interface to display a second number of features that is different than the first number of features and/or to display features having a second size that is different than the first size.

11. The method of claim 10 , wherein the first number of features is greater than the second number of features, and the first size is smaller than the second size.

12. The method of claim 9 , further comprising, adjusting one or more features displayed by the display device upon detecting that the user moved across a threshold distance.

13. The method of claim 12 , wherein the threshold distance is a first threshold distance, and further comprising, as the user moves from the second distance toward the first distance and past the first threshold distance, maintaining the input zone of the user at the second size until a second threshold distance is crossed, and scaling the input zone of the user to the first size upon crossing the second threshold distance.

14. The method of claim 9 , further comprising when the user is the first distance from the display device, receiving input from the user via touch input on the display device.

15. The method of claim 9 , further comprising when the user is the second distance from the display device, receiving input from the user via gestures and/or voice commands.

16. A computing device, comprising:
a logic subsystem; and
a storage subsystem holding instructions executable by the logic subsystem to:
receive depth information of a physical space from a depth camera;
locate a user within the physical space from the depth information;
determine from the depth information that a distance between the user and a display device has increased;
scaling an input zone to an increased size based on the distance between the user and the display device having increased, the input zone being a defined region of the physical space imaged for determining input control gestures performed by the user and comprising a cross-sectional area less than a field of view of the depth camera.

17. The computing device of claim 16 , wherein the instructions are executable to increase a scale of the input zone of the user based on a size of the user determined from the depth information.

18. The computing device of claim 16 , wherein the instructions are further executable to determine that the distance between the user and the display device has decreased, and decrease a scale of the input zone based on the distance having decreased.

19. The computing device of claim 16 , wherein the instructions are further executable to adjust one or more features displayed by the display device upon detecting that the user moved across a threshold distance.

20. The computing device of claim 19 , wherein the instructions are executable to adjust the one or more features by adjusting a size and/or number of the one or more features displayed on the display device.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Schwesinger Mark
• Murillo Oscar
• Yang Emily
• Bailey Richard
• Kapur Jay

Classifications

• A63F2300/308

  Details of the user interface · CPC title

• A63F2300/1087

  comprising photodetecting means, e.g. a camera · CPC title

• A63F13/21

  characterised by their sensors, purposes or types · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title