Information processing apparatus, information processing system, and information processing method

Patent metadata

Field	Value
Publication number	US-11144130-B2
Application number	US-202016818483-A
Country	US
Kind code	B2
Filing date	Mar 13, 2020
Priority date	May 18, 2016
Publication date	Oct 12, 2021
Grant date	Oct 12, 2021

Abstract

There is provided an information processing apparatus including: a process execution unit configured to execute a process relating to a user's gesture recognized on a basis of information from a sensor. The process execution unit determines, during a period after the gesture has been recognized, whether or not there is an input of operation information based on a user's operation, and the process execution unit refrains from executing the process relating to the recognized gesture when there is an input of the operation information during the period.

First claim

What is claimed is:

1. An information processing apparatus comprising:
processing circuitry configured to
execute an application;
identify a process to be executed in the application based on a user's gesture recognized on a basis of information from a sensor;
determine whether or not a specified period of time for receiving a user's cancellation operation is provided on the basis of information relating to the application acquired from the application;
in a case that the period is determined to be provided, determine, during the period after the gesture has been completed and recognized, whether or not there is an input of particular operation information based on the user's cancellation operation, wherein the particular operation information is at least one of a user gesture, a voice input, or a button selection; and
refrain from executing the process relating to the recognized gesture when there is an input of the cancellation operation during the period.

2. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to:
dynamically set a length of the period to a first length in a case that the application is an application program of a first type; and
dynamically set the length of the period to a second length, which is different from the first length, in a case that the application is an application program of a second type, wherein the first type of application program is different than the second type of application program.

3. The information processing apparatus according to claim 1 , wherein
the processing circuitry is configured to dynamically set a length of the period.

4. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to
execute a process relating to the gesture in the application; and
set the length of the period on a basis of information relating to the application acquired from the application.

5. The information processing apparatus according to claim 4 , wherein
the processing circuitry is configured to set the period in accordance with a state of the application.

6. The information processing apparatus according to claim 4 , wherein
the processing circuitry is configured to set the period in accordance with a type of notification of the application.

7. The information processing apparatus according to claim 1 , wherein
the sensor is an acceleration sensor or a gyro sensor, and
the processing circuitry is configured to set the period in accordance with a magnitude of acceleration or angular velocity acquired from the sensor.

8. The information processing apparatus according to claim 1 ; wherein the processing circuitry is configured to:
recognize a second gesture; and
generate the operation information on a basis of the recognized second gesture.

9. The information processing apparatus according to claim 8 , wherein
the sensor is an acceleration sensor or a gyro sensor, and
the processing circuitry is configured to
recognize a third gesture; and
generate the operation information during the period when the circuitry detects acceleration or angular velocity which is equal to or higher than a predetermined value based on an output of the acceleration sensor or the gyro sensor.

10. The information processing apparatus according to claim 1 , wherein
the sensor is activated on a basis of a notification from the application being executed by the processing circuitry.

11. The information processing apparatus according to claim 10 , wherein a mode of a sensor to be activated is selected in accordance with a notification from the application or a type of the application.

12. The information processing apparatus according to claim 10 , wherein the sensor includes a plurality of sensors, and
a sensor to be activated is selected in accordance with a notification from the application or a type of the application.

13. The information processing apparatus according to claim 1 , wherein
the sensor is an acceleration sensor or a gyro sensor, and
the processing circuitry is configured to
recognize a first gesture when acceleration or angular velocity which is smaller than a predetermined value is detected; and
recognize a second gesture when acceleration or angular velocity which is larger than the predetermined value is detected.

14. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to:
recognize a first gesture when a same gesture is recognized a smaller number of times than a predetermined number of times; and
recognize a second gesture when a same gesture is recognized a larger number of times than the predetermined number of times.

15. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to:
recognize the gesture on a basis of machine learning and-on a basis of a predetermined rule.

16. The information processing apparatus according to claim 1 , wherein the particular operation is a non-gesture operation performed by the user.

17. The information processing apparatus according to claim 1 , wherein the particular operation is a voice command uttered by the user.

18. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to:
receive the voice input as a voice command tittered by the user during the period after the gesture has been recognized;
determine whether the voice command corresponds to a command to cancel the process to be executed in the application; and
cancel the process to be executed by the application in a case that the voice command corresponds to a command to cancel the process to be executed in the application.

19. An information processing system comprising:
processing circuitry configured to
execute an application;
identify a process to be executed in the application based on a user's gesture recognized on a basis of information from a sensor;
determine whether or not a specified period of time for receiving a user's cancellation operation is provided on the basis of information relating to the application acquired from the application;
in a case that the period is determined to be provided, determine, during the period after the gesture has been completed and recognized, whether or not there is an input of particular operation information based on the user's cancellation operation, wherein the particular operation information is at least one of a user gesture, a voice input, or a button selection; and
refrain from executing the process relating to the recognized gesture when there is an input of the cancellation operation during the period.

20. An information processing method comprising:
executing an application;
identifying a process to be executed in the application based on a user's gesture recognized on a basis of information from a sensor;
determining whether or not a specified period of time for receiving a user's cancellation operation is provided on the basis of information relating to the application acquired from the application;
in a case that the period is determined to be provided, determining, during the period after the gesture has been completed and recognized, whether or not there is an input of particular operation information based on the user's cancellation operation, wherein the particular operation information is at least one of a user gesture, a voice input, or a button selection, and
refraining from executing the process relati

Assignees

• Sony Corp

Inventors

• Aoyama Ryu
• Mizukami Tomoo
• Hirose Yoji
• Takahashi Kei
• Yamano Ikuo

Classifications

• G06F18/214

  Generating training patterns; Bootstrap methods, e.g. bagging or boosting · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title