Volumetric multi-selection interface for selecting multiple objects in 3D space

Patent metadata

Field	Value
Publication number	US-10649616-B2
Application number	US-201816028239-A
Country	US
Kind code	B2
Filing date	Jul 5, 2018
Priority date	Jul 6, 2017
Publication date	May 12, 2020
Grant date	May 12, 2020

Abstract

Systems and methods for a volumetric multi-selection interface for selecting multiple entities in three-dimensional (3D) space are provided. An example method includes generating a selection region within a three-dimensional space and receiving a selection path user input to define a selection path. The method also includes defining a selection volume based on the selection region and the selection path and selecting entities within the 3D space based on the selection volume. In some implementations, an alter selection region user input is received while the selection path is being defined. The size or shape of the selection region may be altered in response thereto.

First claim

What is claimed is:

1. A computer-implemented method comprising:
generating a selection region defined as a two-dimensional (2D) plane within a three-dimensional (3D) space;
receiving a selection path user input to define a selection path;
moving the selection region along the selection path to define a selection volume; and
selecting entities within the 3D space based on the selection volume.

2. The computer-implemented method of claim 1 , wherein the receiving the selection path user input includes:
receiving a sequence of positional user inputs; and
mapping the positional user inputs to a sequence of 3D coordinates in the 3D space.

3. The computer-implemented method of claim 2 , wherein the receiving a sequence of positional user inputs includes detecting a sequence of contact points on a touchscreen.

4. The computer-implemented method of claim 2 , wherein the receiving a sequence of positional user inputs includes detecting positional changes of a hand-held device using an inertial motion unit.

5. The computer-implemented method of claim 2 , wherein the receiving a sequence of positional user inputs includes detecting positional changes of a hand-held device using a visual positioning system.

6. The computer-implemented method of claim 2 , wherein the receiving a sequence of positional user inputs includes:
capturing images of a body part; and
determining a sequence of positional changes of the body part based on the captured images.

7. The computer-implemented method of claim 1 , further comprising altering the selection region while receiving the selection path user input.

8. The computer-implemented method of claim 7 , wherein the altering the selection region includes:
receiving an alter selection region user input; and
responsive to receiving the alter selection region user input, altering the selection region.

9. The computer-implemented method of claim 8 , wherein the altering the selection region includes altering a shape of the selection region.

10. A computing device comprising:
at least one processor; and
memory storing instructions that, when executed by the at least one processor, cause the computing device to:
generate a selection polygon within a 3D space;
receive a selection path user input to define a selection path;
move the selection polygon along the selection path to define a selection volume that increases in volume with the movement of the selection polygon along the selection path; and
select entities within the 3D space based on the selection volume.

11. The computing device of claim 10 , wherein the instructions that cause the computing device to move the selection polygon along the selection path include instructions that cause the computing device to: orient the selection polygon based on the selection path.

12. The computing device of claim 11 , wherein the selection polygon is a planar polygon and the instructions that cause the computing device to orient the selection polygon include instructions that cause the computing device to orient the selection polygon so that a normal direction to the selection polygon is parallel with a direction of the selection path.

13. The computing device of claim 10 , wherein the 3D space is a virtual reality environment.

14. The computing device of claim 10 , wherein the 3D space is an augmented reality environment in which a computer-generated entity is overlaid on a view of physical environment surrounding a user.

15. A computer-implemented method comprising:
generating a selection polygon within a 3D space, the selection polygon having a first shape;
receiving a first selection path user input to define a first portion of a selection path;
receiving an alter selection polygon user input;
responsive to receiving the alter selection polygon user input, altering the selection polygon, the altered selection polygon having a second shape different than the first shape;
receiving a second selection path user input to define a second portion of the selection path;
defining a selection volume based on the selection polygon and the selection path; and
selecting entities within the 3D space based on the selection volume.

16. The computer-implemented method of claim 15 , wherein altering the shape of the selection polygon includes:
generating a contextual shape suggestion based on the selection path; and
applying the contextual shape suggestion to alter the shape of the selection polygon.

17. The computer-implemented method of claim 16 , where in the generating the contextual shape suggestion includes:
identifying a portion of the 3D space based on a current direction and position of the selection path;
identifying entities in the portion of the 3D space; and
using the identified entities to generate a contextual shape suggestion.

18. The computer-implemented method of claim 15 , wherein the altering the selection polygon includes altering a size of the selection polygon.

19. The computer-implemented method of claim 15 , wherein the selecting entities within the 3D space based on the selection volume includes:
identifying entities in the 3D space that at least partially intersect the selection volume.

20. The computer-implemented method of claim 15 , wherein the selecting entities within the 3D space based on the selection volume includes:
estimating a user precision factor;
determining a selection radius based on the user precision factor; and
selecting entities within the selection radius of the selection volume.

Assignees

• Google Llc

Inventors

• Moore Evan
• Ross Christopher
• Macgillivray Ian

Classifications

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/04815 Primary

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title