Information processing apparatus, information processing system, and information processing method

Patent metadata

Field	Value
Publication number	US-10635152-B2
Application number	US-201715584330-A
Country	US
Kind code	B2
Filing date	May 2, 2017
Priority date	May 18, 2016
Publication date	Apr 28, 2020
Grant date	Apr 28, 2020

Abstract

There is provided an information processing apparatus including: a process execution unit configured to execute processes relating to voice operations recognized by a voice operation recognition unit configured to recognize the voice operations on a basis of information from a voice receiving unit and gesture operations recognized by a gesture recognition unit configured to recognize user's gestures recognized on a basis of information from a sensor. The voice operation recognition unit enters a voice operation waiting state in parallel with a gesture waiting state of the gesture recognition unit.

First claim

What is claimed is:

1. An information processing apparatus comprising:
processing circuitry configured to
transition to a voice operation waiting state and a gesture operation waiting state in parallel in response to receiving a message,
determine whether a gesture is recognized,
in response to a determination that the gesture is recognized, temporarily store the recognized gesture, and
in response to receiving one or more of a voice operation and a gesture operation, execute processes relating to voice operations or gesture operations based on which of the operations are performed and which of the performed operations is performed earlier.

2. The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to
executes an application, and
enter the voice operation waiting state based on a notification from the application being executed.

3. The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to
execute a process relating to a voice operation in preference to a gesture operation.

4. The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to
recognize a user's operation, and
enter an operation-unit-operation waiting state in parallel with the gesture operation waiting state and the voice operation waiting state.

5. The information processing apparatus according to claim 4 , wherein the processing circuitry is further configured to
execute a process relating to an operation-unit operation in preference to the voice operation.

6. The information processing apparatus according to claim 4 , wherein
weighting is performed on each of the voice operation, the gesture operation, and the operation-unit operation, and
the processing circuitry is further configured to determine a process to be executed preferentially in consideration of the weighting.

7. The information processing apparatus according to claim 4 , wherein the processing circuitry is further configured to
execute a process combining at least two of a gesture operation, a voice operation, and an operation-unit operation.

8. The information processing apparatus according to claim 2 , wherein
a mode of a sensor to be activated is selected in accordance with a notification from the application or a type of the application.

9. The information processing apparatus according to claim 2 , wherein
the sensor includes a plurality of sensors, and
a sensor to be activated is selected in accordance with a notification from the application or a type of the application.

10. The information processing apparatus according to claim 1 , wherein
the sensor is an acceleration sensor or a gyro sensor, and
the processing circuitry is further configured to recognize a first gesture when acceleration or angular velocity which is smaller than a predetermined value is detected, and recognizes a second gesture when acceleration or angular velocity which is larger than the predetermined value is detected.

11. The information processing apparatus according to claim 1 , wherein
the processing circuitry is further configured to recognize a first gesture when a same gesture is recognized a smaller number of times than a predetermined number of times, and recognizes a second gesture when a same gesture is recognized a larger number of times than the predetermined number of times.

12. The information processing apparatus according to claim 1 , wherein the processing circuitry is further configured to
recognize the gesture based on machine learning, and
recognize the gesture based on a predetermined rule, and
recognize the gesture when the gesture is recognized based on the machine learning and the predetermined rule.

13. An information processing system comprising:
processing circuitry configured to
transition to a voice operation waiting state and a gesture operation waiting state in parallel in response to receiving a message,
determine whether a gesture is recognized,
in response to a determination that the gesture is recognized, temporarily store the recognized gesture, and
in response to receiving one or more of a voice operation and a gesture operation, execute processes relating to voice operations or gesture operations based on which of the operations are performed and which of the performed operations is performed earlier.

14. An information processing method comprising:
transitioning to a voice operation waiting state and a gesture operation waiting state in parallel in response to receiving a message,
determining whether a gesture is recognized,
in response to a determination that the gesture is recognized, temporarily storing the recognized gesture, and
in response to receiving one or more of a voice operation and a gesture operation, executing processes relating to voice operations or gesture operations based on which of the operations are performed and which of the performed operations is performed earlier.

Assignees

• Sony Mobile Communications Inc
• Sony Corp

Inventors

• Aoyama Ryu
• Mizukami Tomoo
• Hirose Yoji
• Takahashi Kei
• Yamano Ikuo

Classifications

• G06F1/3206 Primary

  Monitoring of events, devices or parameters that trigger a change in power modality · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F1/1605

  Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F1/3234

  Power saving characterised by the action undertaken · CPC title