Information processing apparatus, information processing method, and computer readable medium

Patent metadata

Field	Value
Publication number	US-9268524-B2
Application number	US-201213545615-A
Country	US
Kind code	B2
Filing date	Jul 10, 2012
Priority date	Jul 22, 2011
Publication date	Feb 23, 2016
Grant date	Feb 23, 2016

Abstract

An apparatus includes an input unit, a microphone, a control unit, and a voice recognition unit. The input unit is configured to receive a first type input and a second type input. The microphone is configured to receive an input sound signal. The control unit is configured to control a display to display feedback according to a type of input. The voice recognition unit is configured to perform recognition processing on the input sound signal.

First claim

What is claimed is:

1. An apparatus comprising:
a tilt sensor configured to determine a tilt angle of the apparatus, and
circuitry configured to:
receive a first type input and a second type input;
receive an input sound signal;
control a display to display feedback according to a type of input;
perform recognition processing on the input sound signal;
control the display to display the feedback based on the first type input being a touch input and the second type input being a tilting input from a user;
change an input mode from a first mode to a second mode based on the second type input being the tilt angle detected by the tilt sensor; and
change the input mode from the second mode to a third mode based on the first type input, wherein

the second mode and the third mode are each a different state of a voice input mode associated with a third type input,
the second mode is one where the voice input mode is in a state of being prepared,
the third mode is one where the voice input mode is in a state of readiness,
the feedback based on the first type input being the touch input is feedback corresponding to the third mode, and
the feedback based on the second type input being the tilting input from the user is feedback corresponding to the second mode.

2. The apparatus according to claim 1 , wherein the circuitry is configured to perform recognition processing on the input sound signal as the third type input after the input mode is changed from the second mode to the third mode.

3. The apparatus according to claim 2 , wherein the circuitry is configured to control the display to display text recognized by the voice recognition unit in a first area on the display.

4. The apparatus according to claim 3 , wherein the circuitry is configured to control the display to move the text in the first area to a second area when an action by the user is detected within a predetermined time period.

5. The apparatus according to claim 4 , wherein the circuitry is configured to perform a search query on text in the first area and the second area if the action by the user is not detected within the predetermined time period.

6. The apparatus according to claim 1 , wherein the circuitry is configured to control the display to display the feedback based on the input sound signal from the user.

7. The apparatus according to claim 6 , wherein the circuitry is configured to control the display to display an indication that the input sound signal is one of too loud, too quiet, and appropriate.

8. The apparatus according to claim 7 , wherein the circuitry is configured to control the display to display the indication that the input sound signal is one of too loud, too quiet, and appropriate by changing a shape of an icon.

9. The apparatus according to claim 7 , wherein the circuitry is configured to control the display to display the indication that the input sound signal is one of too loud, too quiet, and appropriate by changing a highlighted portion of an icon.

10. The apparatus according to claim 1 , wherein the input sound signal is a voice input as the third type input.

11. The apparatus according to claim 1 , wherein the circuitry is configured to display the feedback as an indication of the input mode.

12. The apparatus according to claim 11 , wherein the circuitry is configured to control the display to display the indication of the input mode by changing a color of an icon.

13. The apparatus according to claim 11 , wherein the circuitry is configured to control the display to display the indication of the input mode by changing a size of an icon.

14. The apparatus according to claim 11 , wherein the circuitry is configured to control the display to display the indication of the input mode by changing an opacity of an icon.

15. The apparatus according to claim 11 , wherein the circuitry is configured to control the display to display the indication of the input mode by changing a shape of an icon.

16. A method comprising:
receiving a first type input and a second type input;
receiving an input sound signal;
controlling a display to display feedback according to a type of input;
performing recognition processing on the input sound signal;
controlling the display to display the feedback based on the first type input being a touch input and the second type input being a tilting input from a user;
changing an input mode from a first mode to a second mode based on the second type input being the tilt angle detected by a tilt sensor; and
changing the input mode from the second mode to a third mode based on the first type input, wherein
the second mode and the third mode are each a different state of a voice input mode associated with a third type input,
the second mode is one where the voice input mode is in a state of being prepared,
the third mode is one where the voice input mode is in a state of readiness,
the feedback based on the first type input being the touch input is feedback corresponding to the third mode, and
the feedback based on the second type input being the tilting input from the user is feedback corresponding to the second mode.

17. A non-transitory computer readable medium encoded with a program that, when loaded on a processor, causes the processor to perform a method comprising:
receiving a first type input and a second type input;
receiving an input sound signal;
controlling a display to display feedback according to a type of input;
performing recognition processing on the input sound signal;
controlling the display to display the feedback based on the first type input being a touch input and the second type input being a tilting input from a user;
changing an input mode from a first mode to a second mode based on the second type input being the tilt angle detected by a tilt sensor; and
changing the input mode from the second mode to a third mode based on the first type input, wherein
the second mode and the third mode are each a different state of a voice input mode associated with a third type input,
the second mode is one where the voice input mode is in a state of being prepared,
the third mode is one where the voice input mode is in a state of readiness,
the feedback based on the first type input being the touch input is feedback corresponding to the third mode, and
the feedback based on the second type input being the tilting input from the user is feedback corresponding to the second mode.

18. An apparatus comprising:
circuitry configured to:
receive a first type input and a second type input;
receive an input sound signal;
control a display to display feedback according to a type of input;
perform recognition processing on the input sound signal;
control the display to display feedback based on receiving the first type input being a physical key input;
control the display to display feedback based on receiving the second type input being a touch panel input;
control the display to display text recognized by the recognition processing in a first area on the display; and
control the display to move the text in the first area to a second area.

Assignees

• Sakurada Akiko
• Shigeta Osamu
• Sato Nariaki
• Koga Yasuyuki
• Yamamoto Kazuyuki
• Sony Corp

Inventors

• Sakurada Akiko
• Shigeta Osamu
• Sato Nariaki
• Koga Yasuyuki
• Yamamoto Kazuyuki

Classifications

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/0416

  Control or interface arrangements specially adapted for digitisers · CPC title

• G06F3/038

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• G10L2015/221

  Announcement of recognition results · CPC title