Information processing apparatus and information processing method

Patent metadata

Field	Value
Publication number	US-11886643-B2
Application number	US-201917294486-A
Country	US
Kind code	B2
Filing date	Oct 28, 2019
Priority date	Nov 26, 2018
Publication date	Jan 30, 2024
Grant date	Jan 30, 2024

Abstract

Provided is an information processing apparatus that includes a relative velocity calculation unit that calculates, on the basis of data obtained by sensing of an operation body in chronological order, a relative velocity of a second point on the operation body with respect to a first point on the operation body, and a gesture recognition unit that recognizes a gesture of the operation body on the basis of the relative velocity.

First claim

The invention claimed is:

1. An information processing apparatus, comprising:
an optical sensor configured to sense an operation body in chronological order to obtain data;
a relative velocity calculation unit configured to:
determine, based on the obtained data, a position of each of:
a first point on the operation body, and
a second point on the operation body;

determine an absolute velocity of each of the first point and the second point based on a change of the determined position of each of the first point and the second point; and
calculate, based on the determined absolute velocity of each of the first point and the second point, a relative velocity of the second point on the operation body with respect to the first point on the operation body; and a gesture recognition unit configured to:
recognize a touch with the first point on an object as a first gesture in a case where the relative velocity exceeds a threshold value; and
recognize a touch with the second point on the object as a second gesture in a case where the relative velocity is lower than the threshold value.

2. The information processing apparatus according to claim 1 , further comprising a command determination unit configured to determine a command corresponding to the first gesture.

3. The information processing apparatus according to claim 1 , wherein the data is one of two-dimensional data or three-dimensional data.

4. The information processing apparatus according to claim 1 , further comprising a mode selection unit configured to select a mode, wherein the relative velocity calculation unit is further configured to calculate the relative velocity based on the mode.

5. The information processing apparatus according to claim 1 , wherein
the first point is a specific point on a palm, and
the second point is a fingertip.

6. The information processing apparatus according to claim 5 , wherein the gesture recognition unit is further configured to recognize a touch with the fingertip on the object as the first gesture in the case where the relative velocity exceeds the threshold value.

7. The information processing apparatus according to claim 6 , wherein the touch with the fingertip corresponds to a command to output a sound corresponding to the object or a command to select the object.

8. The information processing apparatus according to claim 7 , wherein the gesture recognition unit is further configured to recognize a touch with the palm on the object as the second gesture in the case where the relative velocity is lower than the threshold value.

9. The information processing apparatus according to claim 8 , wherein the touch with the palm corresponds to a command to move the object.

10. The information processing apparatus according to claim 1 , wherein
the first point is on a wrist or an elbow, and
the second point is on a palm.

11. The information processing apparatus according to claim 10 , wherein the gesture recognition unit is further configured to:
recognize, as the first gesture, a gesture of waving a hand with the wrist as a fulcrum, wherein the gesture of waving the hand with the wrist as the fulcrum is recognized as the first gesture in the case where the relative velocity exceeds the threshold value; and
recognize, as the second gesture, a gesture of waving the hand with the elbow or a shoulder as the fulcrum, wherein the gesture of waving the hand with the elbow or the shoulder as the fulcrum is recognized as the second gesture in the case where the relative velocity is lower than the threshold value.

12. The information processing apparatus according to claim 11 , wherein
the gesture of waving the hand with the wrist as the fulcrum corresponds to a command to stroke the object, and
the gesture of waving the hand with the elbow or the shoulder as the fulcrum corresponds to a command to move the object.

13. The information processing apparatus according to claim 1 , wherein
the first point is a finger joint point, and
the second point is a fingertip.

14. The information processing apparatus according to claim 13 , wherein the gesture recognition unit is further configured to:
recognize, as the first gesture, a gesture to move the fingertip with a finger base as a fulcrum, wherein the gesture to move the fingertip with the finger base as the fulcrum is recognized as the first gesture in the case where the relative velocity exceeds the threshold value; and
recognize, as the second gesture, a gesture to move the fingertip with the finger joint point as the fulcrum, wherein the gesture to move the fingertip with the finger joint point as the fulcrum is recognized as the second gesture in the case where the relative velocity is lower than the threshold value.

15. The information processing apparatus according to claim 14 , wherein
the gesture to move the fingertip with the finger base as the fulcrum corresponds to a command to select the object, and
the gesture to move the fingertip with the finger joint point as the fulcrum corresponds to a command to move the object.

16. The information processing apparatus according to claim 1 , wherein
the first point is on a shoulder, and
the second point is on a fist.

17. The information processing apparatus according to claim 16 , wherein the gesture recognition unit is further configured to:
recognize a first type of punch as the first gesture in the case where the relative velocity exceeds the threshold value; and
recognize a second type of punch as the second gesture in the case where the relative velocity is lower than the threshold value.

18. An information processing method, comprising:
sensing an operation body in chronological order to obtain data;
optically determining, based on the obtained data, a position of each of:
a first point on the operation body, and
a second point on the operation body;

determining an absolute velocity of each of the first point and the second point based on a change of the determined position of each of the first point and the second point;
calculating, based on the determined absolute velocity of each of the first point and the second point, a relative velocity of the second point on the operation body with respect to the first point on the operation body;
recognizing a touch with the first point on an object as a first gesture in a case where the relative velocity exceeds a threshold value; and
recognizing a touch with the second point on the object as a second gesture in a case where the relative velocity is lower than the threshold value.

19. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a processor, cause the processor to execute operations, the operations comprising:
optically sensing an operation body in chronological order to obtain data;
determining, based on the obtained data, a position of each of:
a first point on the operation body, and
a second point on the operation body;

determining an absolute velocity of each of the first point and the second point based on a change of the determined position of each of the first point and the second point;
calculating, based on the determined absolute velocity of each of the first point and the second point, a relative velocity of the second point on the operation body with respect to the first point on the operation body;
recognizing a touch with the first point on an object as a first gesture in a case where the relative velocity exceeds a threshold value; and
recognizing a touch wit

Assignees

• Sony Group Corp

Inventors

• Irie Atsushi
• Gotoh Kenji
• Sato Yugo
• Otsuka Junji
• Ikeda Tetsuo
• Tomonaga Seishi
• Fujinawa Eisuke

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06V40/28 Primary

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• A63F13/428

  involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes · CPC title