User-defined virtual interaction space and manipulation of virtual configuration

Patent metadata

Field	Value
Publication number	US-11995245-B2
Application number	US-202318099779-A
Country	US
Kind code	B2
Filing date	Jan 20, 2023
Priority date	Dec 16, 2013
Publication date	May 28, 2024
Grant date	May 28, 2024

Abstract

The technology disclosed relates to creating user-defined interaction spaces and modalities in a three dimensional (3D) sensor space in response to control gestures. It also relates to controlling virtual cameras in the 3D sensor space using control gestures and manipulating controls of the virtual cameras through the control gestures. In particular, it relates to defining one or more spatial attributes of the interaction spaces and modalities in response to one or more gesture parameters of the control gesture. It also particularly relates to defining one or more visual parameters of a virtual camera in response to one or more gesture parameters of the control gesture.

First claim

The invention claimed is:

1. A computer implemented method of manipulating a virtual camera in a three-dimensional (3D) sensor space, the method including:
receiving a definition defining parameters of a virtual camera;
obtaining a first control gesture of a control object that defines a starting point (x 0 , y 0 , z 0 ) in a three-dimensional (3D) sensor space for the virtual camera;
obtaining a second control gesture made by the control object that defines a continuous contour through time in the three-dimensional (3D) sensor space;
obtaining a third control gesture made by the control object that defines a finishing point (x 1 , y 1 , z 1 ) of the virtual camera in the three-dimensional (3D) sensor space;
obtaining a continuous contour between the starting point and the finishing point; and
providing the continuous contour to a further process that manipulates the virtual camera.

2. The method of claim 1 , further including determining a focal length of the virtual camera responsive to distance of a finger of a hand comprising the control object from the continuous contour.

3. The method of claim 2 , further including defining a field of view and orientation of the virtual camera responsive to a detected orientation of the finger.

4. The method of claim 1 , further including mapping the continuous contour to a straight line and moving the virtual camera along the straight line.

5. The method of claim 1 , further including defining a plurality of points on the continuous contour to construct a Bezier curve responsive to respective sizes and directions of the points.

6. The method of claim 1 , wherein the continuous contour is a complex curve including changes in each one of three dimensions.

7. The method of claim 1 , wherein the parameters include: a focal length.

8. The method of claim 1 , wherein the parameters include: an orientation.

9. The method of claim 1 , wherein the parameters include: a field of view.

10. The method of claim 1 , wherein the first control gesture and the second control gesture are separate instances of a same gesture.

11. The method of claim 1 , wherein defining a starting point includes the first control gesture encompassing the starting point (x 0 , y 0 , z 0 ).

12. The method of claim 11 , wherein the first control gesture encompassing the starting point (x 0 , y 0 , z 0 ) includes the starting point located within a region of space bounded by the first control gesture.

13. The method of claim 12 , wherein the first control gesture is circular and encompassing the starting point (x 0 , y 0 , z 0 ) includes the starting point located within the region of space bounded by the first control gesture.

14. The method of claim 11 , wherein the first control gesture encompassing the starting point (x 0 , y 0 , z 0 ) includes the starting point located tangent to a point on a path described by the first control gesture.

15. The method of claim 14 , wherein the first control gesture is circular and encompassing the starting point (x 0 , y 0 , z 0 ) includes the starting point located tangent to a point on a circular path described by the first control gesture.

16. The method of claim 1 , wherein defining a finishing point includes the third control gesture encompassing the starting point (x 1 , y 1 , z 1 ).

17. The method of claim 1 , wherein moving the virtual camera along the continuous contour between the starting point and the finishing point includes the camera moving freely along a two-dimensional object in a three-dimensional space.

18. The method of claim 1 , wherein no other gestures are required to define the starting point, finishing point and the continuous contour between the starting point and the finishing point.

19. A non-transitory computer readable medium storing instructions for manipulating a virtual camera in a three-dimensional (3D) sensor space, which instructions when executed by one or more processors perform actions including:
receiving a definition defining parameters of a virtual camera;
obtaining a first control gesture of a control object that defines a starting point in a three-dimensional (3D) sensor space for the virtual camera;
obtaining a second control gesture made by the control object that defines a continuous contour through the three-dimensional (3D) sensor space;
obtaining a third control gesture made by the control object that defines a finishing point (x 1 , y 1 , z 1 ) of the virtual camera in the three-dimensional (3D) sensor space;
obtaining a continuous contour between the starting point and the finishing point; and
providing the continuous contour to a further process that manipulates the virtual camera.

20. A system, including:
a stereoscopic image sensor for sensing movement of a control object including at least one human hand moving in a three-dimensional (3D) sensor space;
one or more processors; and
a memory storing instructions configured for:
receiving a definition defining parameters of a virtual camera in a three-dimensional (3D) sensor space;
obtaining a first control gesture of a control object that defines a starting point (x 0 , y 0 , z 0 ) for the virtual camera;
obtaining a second control gesture made by the control object that defines a continuous contour through time in the three-dimensional (3D) sensor space;
obtaining a third control gesture made by the control object that defines a finishing point (x 1 , y 1 , z 1 ) of the virtual camera in the three-dimensional (3D) sensor space;
obtaining a continuous contour between the starting point and the finishing point; and
providing the continuous contour to a further process that manipulates the virtual camera.

Assignees

• Ultrahaptics Ip Two Ltd

Inventors

• Cohen Isaac
• Sills Maxwell

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title