Suppression of hand gestures upon detection of peripheral events on a peripheral device

Patent metadata

Field	Value
Publication number	US-12481369-B2
Application number	US-202318472818-A
Country	US
Kind code	B2
Filing date	Sep 22, 2023
Priority date	Sep 23, 2022
Publication date	Nov 25, 2025
Grant date	Nov 25, 2025

Abstract

Suppressing a hand gesture upon detecting peripheral events on a peripheral device includes determining a first hand pose for a first hand a second hand pose for a second hand in response to a detected peripheral device peripheral event, determining, based on the first hand pose and the second hand pose, at least one hand of the first hand and the second hand in a peripheral use mode, detecting an input gesture from a hand of the at least one hand determined to be in the peripheral use mode, and rejecting the input gesture by a user input pipeline in accordance with the determination that the hand is in the peripheral use mode. The presence of a peripheral device is confirmed by activating a computer vision system in response to determining that a peripheral use condition is satisfied.

First claim

The invention claimed is:

1 . A method comprising:
obtaining, from image sensor data, hand tracking data for a first hand in accordance with an indication of a peripheral event at a peripheral device; detecting an input gesture for the first hand based on characteristics of the hand tracking data, wherein the input gesture corresponds to an input action; determining that characteristics of the hand tracking data for the first hand satisfy a peripheral use criterion based on a palm position of the first hand and a physical characteristic of a scene in which the first hand is located indicating that the hand is positioned proximate to a peripheral device; and rejecting the input gesture by a user input pipeline in accordance with the determination that the peripheral use criterion is satisfied.

2 . The method of claim 1 , wherein the peripheral event is associated with the first hand, the method further comprising:
determining that a relationship between the input gesture and the peripheral event satisfy a cancellation threshold, wherein the input gesture is processed by the user input pipeline to disregard a user input action associated with the input gesture.

3 . The method of claim 1 , wherein the input gesture is rejected based on a finger pose of the first hand.

4 . The method of claim 3 , further comprising:
obtaining sensor data capturing the first hand; and applying the sensor data to a hand classifier trained to predict a peripheral use mode classification based on sensor data comprising the first hand.

5 . The method of claim 1 , further comprising:
detecting a hand movement of the first hand; determining whether the hand movement satisfies a cancellation threshold; and in accordance with a determination that the hand movement satisfies the cancellation threshold, determining that the first hand is in a gesture input mode, wherein input gestures by the first hand detected during the gesture input mode are processed by the user input pipeline.

6 . The method of claim 1 , further comprising:
determining a second hand pose for the first hand; determining, based on the second hand pose, that the first hand is in a peripheral use mode; detecting a second input gesture from the first hand determined to be in the peripheral use mode; and in accordance with a determination that the second input gesture is allowable during the peripheral use mode, processing a user input action associated with the second input gesture.

7 . A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
obtain, from image sensor data, hand tracking data for a first hand in accordance with an indication of a peripheral event at a peripheral device; detect an input gesture for the first hand based on characteristics of the hand tracking data, wherein the input gesture corresponds to an input action; determine that characteristics of the hand tracking data for the first hand satisfy a peripheral use criterion based on a palm position of the first hand and a physical characteristic of a scene in which the first hand is located indicating that the hand is positioned proximate to a peripheral device; and reject the input gesture by a user input pipeline in accordance with the determination that the peripheral use criterion is satisfied.

8 . The non-transitory computer readable medium of claim 7 , wherein the peripheral event is associated with the first hand, and further comprising computer readable code to:
determine that a relationship between the input gesture and the peripheral event satisfy a cancellation threshold, wherein the input gesture is processed by the user input pipeline to disregard a user input action associated with the input gesture.

9 . The non-transitory computer readable medium of claim 7 , wherein the input gesture is rejected based on a finger pose of the first hand.

10 . The non-transitory computer readable medium of claim 9 , further comprising:
obtaining sensor data capturing the first hand; and applying the sensor data to a hand classifier trained to predict a peripheral use mode classification based on sensor data comprising the first hand.

11 . The non-transitory computer readable medium of claim 7 , further comprising computer readable code to:
detect a hand movement of the first hand; determine whether the hand movement satisfies a cancellation threshold; and in accordance with a determination that the hand movement satisfies the cancellation threshold, determine that the first hand is in a gesture input mode, wherein input gestures by the first hand detected during the gesture input mode are processed by the user input pipeline.

12 . The non-transitory computer readable medium of claim 7 , further comprising computer readable code to:
determine a second hand pose for the first hand; determine, based on the second hand pose, that the first hand is in a peripheral use mode; detect a second input gesture from the first hand determined to be in the peripheral use mode; and in accordance with a determination that the second input gesture is allowable during the peripheral use mode, process a user input action associated with the second input gesture.

13 . A system comprising:
one or more processors; and one or more computer readable media comprising computer readable code executable by the one or more processors to:
obtain, from image sensor data, hand tracking data for a first hand in accordance with an indication of a peripheral event at a peripheral device;
detect an input gesture for the first hand based on characteristics of the hand tracking data, wherein the input gesture corresponds to an input action;
determine that characteristics of the hand tracking data for the first hand satisfy a peripheral use criterion based on a palm position of the first hand and a physical characteristic of a scene in which the first hand is located indicating that the hand is positioned proximate to a peripheral device; and
reject the input gesture by a user input pipeline in accordance with the determination that the peripheral use criterion is satisfied.

14 . The system of claim 13 , wherein the peripheral event is associated with the first hand, and further comprising computer readable code to:
determine that a relationship between the input gesture and the peripheral event satisfy a cancellation threshold, wherein the input gesture is processed by the user input pipeline to disregard a user input action associated with the input gesture.

15 . The system of claim 13 , wherein the input gesture is rejected based on a finger pose of the first hand.

16 . The system of claim 15 , further comprising:
obtaining sensor data capturing the first hand; and
applying the sensor data to a hand classifier trained to predict a peripheral use mode classification based on sensor data comprising the first hand.

17 . The system of claim 13 , further comprising computer readable code to:
detect a hand movement of the first hand; determine whether the hand movement satisfies a cancellation threshold; and in accordance with a determination that the hand movement satisfies the cancellation threshold, determine that the first hand is in a gesture input mode, wherein input gestures by the first hand detected during the gesture input mode are processed by the user input pipeline.

Assignees

• Apple Inc

Inventors

• Brewer Daniel J
• Asoka Kumar Shenoi Ashwin Kumar
• Qiu Tian
• Gum Leah M
• Meyer David J
• Shutzberg Julian K
• Tang Yirong

Classifications

• G06V40/28 Primary

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06V40/113

  Recognition of static hand signs · CPC title

• G06V40/11

  Hand-related biometrics; Hand pose recognition · CPC title