User-defined virtual interaction space and manipulation of virtual cameras with vectors

Patent metadata

Field	Value
Publication number	US-12405674-B2
Application number	US-202418827206-A
Country	US
Kind code	B2
Filing date	Sep 6, 2024
Priority date	Dec 16, 2013
Publication date	Sep 2, 2025
Grant date	Sep 2, 2025

Abstract

The technology disclosed relates to creating user-defined interaction spaces and modalities in a three dimensional (3D) sensor space in response to control gestures. It also relates to controlling virtual cameras in the 3D sensor space using control gestures and manipulating controls of the virtual cameras through the control gestures. In particular, it relates to defining one or more spatial attributes of the interaction spaces and modalities in response to one or more gesture parameters of the control gesture. It also particularly relates to defining one or more visual parameters of a virtual camera in response to one or more gesture parameters of the control gesture.

First claim

What is claimed is:

1. A method of manipulating virtual objects in a three-dimensional (3D) sensor space, the method including:
receiving a control gesture that makes swirling motions in a 3D sensor space;
obtaining a virtual vector field using the control gesture received, wherein the virtual vector field is a vortex;
receiving a subsequent control gesture; and
providing for display, the vortex manipulated as a virtual object within the 3D sensor space by interaction of the virtual vector field compounded with the subsequent control gesture.

2. The method of claim 1 , further comprising:
obtaining a size determined for the vortex from the control gesture.

3. The method of claim 2 , wherein one or more virtual objects are (i) brought closer to a center of the vortex, or (ii) pushed away from the center of the vortex, in proportion to interactions obtained from the virtual vector field compounded with object vectors defined on respective virtual objects, based on their respective magnitudes, the method further comprising:
determining based on at least one of (i) the size of the vortex and (ii) a number of virtual objects, a type of gestural effort required to manipulate the vortex as a virtual object.

4. The method of claim 3 , wherein gestural effort is one or more of a flick of a finger, a push of a few fingers, a full handed cup movement.

5. The method of claim 3 , further comprising:
defining the one or more virtual objects in response to one or more subsequent control gestures received.

6. The method of claim 5 , further comprising:
obtaining from the one or more virtual objects, a set of virtual objects determined to be within the vortex based upon the size of the vortex; and
providing for display, members of the set of virtual objects moving in unison responsive to the control gesture.

7. The method of claim 5 , further comprising obtaining an appropriate velocity of motion for the virtual objects determined from a compounding of the size of the vortex and at least one of (i) curling of fingers of a hand and (ii) degrees of freedom between fingers of curled fingers of a hand.

8. The method of claim 1 , further comprising the virtual vector field increasing in strength responsive to continued circling of a control gesture.

9. The method of claim 1 , further comprising obtaining a repulsive vortex in which virtual objects move further apart from one another.

10. A non-transitory computer-readable recording medium having instructions recorded thereon for manipulating virtual objects in a three-dimensional (3D) sensor space, which, when executed on a processor, implement:
receiving a control gesture that makes swirling motions in a 3D sensor space;
obtaining a virtual vector field using the control gesture received, wherein the virtual vector field is a vortex;
receiving a subsequent control gesture; and
providing for display, the vortex manipulated as a virtual object within the 3D sensor space by interaction of the virtual vector field compounded with the subsequent control gesture.

11. The non-transitory computer-readable recording medium of claim 10 , further comprising instructions implementing:
obtaining a size determined for the vortex from the control gesture.

12. The non-transitory computer-readable recording medium of claim 11 , wherein one or more virtual objects are (i) brought closer to a center of the vortex, or (ii) pushed away from the center of the vortex, in proportion to interactions obtained from the virtual vector field compounded with object vectors defined on respective virtual objects, based on their respective magnitudes; and further comprising instructions implementing:
determining based on at least one of (i) the size of the vortex and (ii) a number of virtual objects, a type of gestural effort required to manipulate the vortex as a virtual object.

13. The non-transitory computer-readable recording medium of claim 12 , wherein gestural effort is one or more of a flick of a finger, a push of a few fingers, a full handed cup movement.

14. The non-transitory computer-readable recording medium of claim 11 , further comprising instructions implementing:
defining the one or more virtual objects in response to one or more subsequent control gestures received.

15. The non-transitory computer-readable recording medium of claim 14 , further comprising instructions implementing:
obtaining from the one or more virtual objects, a set of virtual objects determined to be within the vortex based upon the size of the vortex; and
providing for display, members of the set of virtual objects moving in unison responsive to the control gesture.

16. The non-transitory computer-readable recording medium of claim 14 , further comprising instructions implementing: obtaining an appropriate velocity of motion for the virtual objects determined from a compounding of the size of the vortex and at least one of (i) curling of fingers of a hand and (ii) degrees of freedom between fingers of curled fingers of a hand.

17. The non-transitory computer-readable recording medium of claim 10 , further comprising the virtual vector field increasing in strength responsive to continued circling of a control gesture.

18. The non-transitory computer-readable recording medium of claim 10 , further comprising instructions implementing: obtaining a repulsive vortex in which virtual objects move further apart from one another.

19. A smart phone having an interface that manipulates virtual objects in a three-dimensional (3D) sensor space, the smart phone comprising:
a hardware controller storing instructions that, when executed, implement actions including:
receiving a control gesture that makes swirling motions in a 3D sensor space, as viewed by a camera having a particular vantage point;
obtaining a virtual vector field using the control gesture received, wherein the virtual vector field is a vortex;
receiving a subsequent control gesture; and
providing for display, the vortex manipulated as a virtual object within the sensor space by interaction of the virtual vector field compounded with the subsequent control gesture.

20. The smart phone of claim 19 , wherein one or more virtual objects are (i) brought closer to a center of the vortex, or (ii) pushed away from the center of the vortex, in proportion to interactions obtained from the virtual vector field compounded with object vectors defined on respective virtual objects, based on their respective magnitudes; and wherein the actions further include:
determining based on at least one of (i) a size of the vortex and (ii) a number of virtual objects, a type of gestural effort required to manipulate the vortex as a virtual object.

Assignees

• Ultrahaptics Ip Two Ltd

Inventors

• Cohen Isaac
• Sills Maxwell
• Durdik Paul

Classifications

• G06T15/20

  Perspective computation · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title