Motion mapping for continuous gestures using user-centric coordinate system

Patent metadata

Field	Value
Publication number	US-12510973-B2
Application number	US-202318472724-A
Country	US
Kind code	B2
Filing date	Sep 22, 2023
Priority date	Sep 23, 2022
Publication date	Dec 30, 2025
Grant date	Dec 30, 2025

Abstract

A movement of a user input component is presented in accordance with a mapping of a user input motion from a user-centric spherical coordinate system to a 2D plane. An input motion by a user is detected. An origin for the input motion is identified in a user-centric spherical coordinate system. An arc length for the input motion is determined based on the identified origin. The input motion is mapped from the user-centric spherical coordinate system to a 2D plane of a user input component, and a movement of the user input component is presented on the 2D plane in accordance with the mapping.

First claim

The invention claimed is:

1 . A method for determining an input motion by a user comprising:
in response to detecting an input motion, determining an origin location for the input motion in a user-centric spherical coordinate system with respect to a gesture centroid, wherein the origin location is determined along a vector originating at a shoulder of the user based on a first distance between the gesture centroid and the shoulder of the user; determining, based on the origin location, an arc length for the input motion; mapping the input motion to a 2D plane of a user input component based on the arc length; and presenting a movement of a user input component on the 2D plane in accordance with the mapping.

2 . The method of claim 1 , wherein determining the origin location comprises:
determining a joint location for a set of joints along an arm of the user, wherein the origin location is further determined based on the joint location.

3 . The method of claim 2 , wherein the origin location is determined along a gravity vector originating at a shoulder location for the user.

4 . The method of claim 2 , further comprising:
determining a change in position of the gesture centroid attributable to each of the set of joints of the arm of the user; and mapping the input motion to the 2D plane in accordance with the change in position of the gesture centroid attributable to each of the set of joints of the arm.

5 . The method of claim 1 further comprising:
determining a wrist location for a wrist of the user, wherein the origin location is determined based on the determined wrist location.

6 . The method of claim 5 , wherein the origin location is based on the determined wrist location and the gesture centroid.

7 . The method of claim 5 , further comprising:
determining a movement characteristic of the wrist and a movement characteristic of the gesture centroid, wherein the origin location is further determined based on the movement characteristic of the wrist and the movement characteristic of the gesture centroid.

8 . The method of claim 7 , further comprising:
mapping the input motion using a sensitivity level determined based on the movement characteristic of the gesture centroid.

9 . A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
determine, in response to detection of an input motion, an origin location for the input motion in a user-centric spherical coordinate system with respect to a gesture centroid, wherein the origin location is determined along a vector originating at a shoulder of a user based on a first distance between the gesture centroid and the shoulder of the user; determine, based on the origin location, an arc length for the input motion; map the input motion to a 2D plane of a user input component based on the arc length; and present a movement of a user input component on the 2D plane in accordance with the mapping.

10 . The non-transitory computer readable medium of claim 9 , wherein the computer readable code to determine the origin location comprises computer readable code to:
determine a joint location for a set of joints along an arm of the user, wherein the origin location is further determined based on the joint location.

11 . The non-transitory computer readable medium of claim 10 , wherein the origin location is determined along a gravity vector originating at a shoulder location for the user.

12 . The non-transitory computer readable medium of claim 10 , further comprising computer readable code to:
determine a change in position of the gesture centroid attributable to each of the set of joints of the arm of the user; and map the input motion to the 2D plane in accordance with the change in position of the gesture centroid attributable to each of the set of joints of the arm.

13 . The non-transitory computer readable medium of claim 9 , further comprising computer readable code to:
determine a wrist location for a wrist of the user, wherein the origin location is determined based on the determined wrist location.

14 . The non-transitory computer readable medium of claim 13 , further comprising computer readable code to:
determine a movement characteristic of the wrist and a movement characteristic of the gesture centroid, wherein the origin location is further determined based on the movement characteristic of the wrist and the movement characteristic of the gesture centroid.

15 . The non-transitory computer readable medium of claim 14 , further comprising computer readable code to:
map the input motion using a sensitivity level determined based on the movement characteristic of the gesture centroid.

16 . A system comprising:
one or more processors; and one or more computer readable media comprising computer readable code executable by the one or more processors to:
determine, in response to detection of an input motion, an origin location for the input motion in a user-centric spherical coordinate system with respect to a gesture centroid,
wherein the origin location is determined along a vector originating at a shoulder of the user based on a first distance between the gesture centroid and the shoulder of the user;
determine, based on the origin location, an arc length for the input motion;
map the input motion to a 2D plane of a user input component based on the arc length; and
present a movement of a user input component on the 2D plane in accordance with the mapping.

17 . The system of claim 16 , wherein the computer readable code to determine the origin location comprises computer readable code to:
determine a joint location for a set of joints along an arm of the user, wherein the origin location is further determined based on the joint location.

18 . The system of claim 17 , wherein the origin location is determined along a gravity vector originating at a shoulder location for the user.

19 . The system of claim 16 , further comprising computer readable code to:
determine a wrist location for the user, wherein the origin location is determined based on the determined wrist location.

Assignees

• Apple Inc

Inventors

• Chawda Vinay
• Lortie Chase B
• Brewer Daniel J
• Shutzberg Julian K
• Gum Leah M
• Tang Yirong
• Wing Alexander T

Classifications

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title