Electronic device for recognizing gesture and method for operating the same

Patent metadata

Field	Value
Publication number	US-11899845-B2
Application number	US-202117428438-A
Country	US
Kind code	B2
Filing date	Aug 3, 2021
Priority date	Aug 4, 2020
Publication date	Feb 13, 2024
Grant date	Feb 13, 2024

Abstract

An electronic device is provided. The electronic device includes at least one sensor and at least one processor configured to identify a gesture identification request from a first application being executed by the at least one processor, in response to the identification of the gesture identification request, identify a gesture using at least one sensing data from at least one first sensor module activated, among the at least one sensor, based on a gesture application, provide the identified gesture to the first application, and perform at least one operation corresponding to the identified gesture based on the first application. Other various embodiments are possible as well.

First claim

The invention claimed is:

1. An electronic device, comprising:
at least one sensor; and
at least one processor configured to:
identify a gesture identification request from a first application being executed by the at least one processor;
in response to the identification of the gesture identification request, identify a gesture using at least one sensing data from at least one first sensor module activated, among the at least one sensor, based on a gesture application;
provide the identified gesture to the first application; and
perform at least one operation corresponding to the identified gesture based on the first application,

wherein, to identify the gesture using the at least one sensing data from the at least one activated first sensor module, the at least one processor is further configured to:
generate at least one summation data corresponding to the at least one sensing data based on the at least one sensing data for a designated length of section,
identify a section of the at least one sensing data as a segmentation section, based on the at least one summation data meeting a designated condition, and
perform gesture recognition on the segmentation section,

wherein the at least one processor is further configured to identify that the at least one summation data meets the designated condition based on a ratio of first comparison summation data, among the at least one summation data, to reference summation data, exceeding a designated threshold.

2. The electronic device of claim 1 , wherein the at least one processor is further configured to:
identify at least one first gesture of a target based on the gesture identification request, and
activate the at least one first sensor module corresponding to the at least one first gesture.

3. The electronic device of claim 1 , wherein, to generate the at least one summation data corresponding to the at least one sensing data, the at least one processor is configured to generate the at least one summation data corresponding to each of the at least one sensing data by calculating a sum of a designated number of previous sensing data for each of the at least one sensing data.

4. The electronic device of claim 1 , wherein the at least one processor is further configured to, in response to second comparison summation data, among the at least one summation data, being larger than summation data immediately before the second comparison summation data, set the second comparison summation data as the reference summation data and start to monitor whether the ratio of the first comparison summation data to the reference summation data exceeds the designated threshold.

5. The electronic device of claim 4 , wherein the at least one processor is further configured to monitor whether third comparison summation data, among the at least one summation data, is larger than summation data immediately before the third comparison summation data in response to the designated threshold by the ratio being not detected within a designated threshold time after starting to monitor whether the ratio of the first comparison summation data to the reference summation data exceeds the designated threshold.

6. The electronic device of claim 1 , wherein, to identify the segmentation section, the at least one processor is further configured to identify a section, from first sensing data corresponding to the first comparison summation data to second sensing data corresponding to an end point after a designated length of time, as the segmentation section.

7. The electronic device of claim 1 , wherein the at least one processor is configured to, as part of identifying the segmentation section, reset an end point of the identified segmentation section based on whether at least part of the summation data is reduced at the end point of the identified segmentation section.

8. The electronic device of claim 1 , wherein, to identify the segmentation section, the at least one processor is further configured to identify a section, from first sensing data corresponding to the first comparison summation data to second sensing data corresponding to fourth summation data, as the segmentation section, when a ratio of the fourth summation data to the reference summation data is less than a second threshold.

9. The electronic device of claim 1 , wherein, to identify the segmentation section, the at least one processor is further configured to:
identify the segmentation section in response to identifying that both a first type of summation data corresponding to a first type of sensing data meets the designated condition and a second type of summation data corresponding to a second type of sensing data meets the designated condition, or
identify the segmentation section in response to identifying that either the first type of summation data meets the designated condition or the second type of summation data meets the designated condition.

10. The electronic device of claim 1 , wherein, to identify the segmentation section, the at least one processor is further configured to:
identify a first segmentation section and a second segmentation section after the first segmentation section; and
determine whether to include a portion of the first segmentation section in the second segmentation section.

11. The electronic device of claim 1 , wherein the at least one processor is further configured to, as part of performing the at least one operation corresponding to the identified gesture, perform the at least one operation based on detection of a trigger for performing the at least one operation.

12. The electronic device of claim 1 , wherein the at least one processor is further configured to:
receive a signal from the at least one sensor, and
perform pre-processing on the signal received from the at least one sensor before identifying the gesture identification request.

13. The electronic device of claim 12 , wherein the pre-processing includes at least one of detrending or up-sampling.

14. The electronic device of claim 12 ,
wherein the at least one sensor includes a plurality of sensors, and
wherein pre-processing is performed on each signal received from the plurality of sensors.

15. An electronic device, comprising:
at least one sensor; and
at least one processor configured to:
identify a gesture identification request from a first application being executed by the at least one processor,
in response to the identification of the gesture identification request, identify a gesture using at least one sensing data from at least one first sensor module activated, among the at least one sensor, based on a gesture application,
provide the identified gesture to the first application, and
perform at least one operation corresponding to the identified gesture based on the first application,

wherein, to identify the gesture using the at least one sensing data from the at least one activated first sensor module, the at least one processor is further configured to:
generate at least one summation data corresponding to the at least one sensing data based on the at least one sensing data for a designated length of section,
identify a section of the at least one sensing data as a segmentation section, based on the at least one summation data meeting a designated condition,
determine whether to perform gesture recognition on the segmentation section based on different at least one sensing data obtained from the at least one sensor, and
perform the gesture recognition on the segmentation section.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Chung Wonsuk
• Cho Yongsang
• Yoo Byungwook
• Park Sungjin
• Lim Chaiman

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/03

  Arrangements for converting the position or the displacement of a member into a coded form · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F18/00

  Pattern recognition · CPC title

• G04G21/00

  Input or output devices integrated in time-pieces · CPC title