Remote controller for controlling an external device using voice recognition and method thereof

Patent metadata

Field	Value
Publication number	US-11449307-B2
Application number	US-201816001598-A
Country	US
Kind code	B2
Filing date	Jun 6, 2018
Priority date	Jul 10, 2017
Publication date	Sep 20, 2022
Grant date	Sep 20, 2022

Abstract

A remote controller for controlling an external device by using voice recognition. The remote controller includes a microphone, at least one sensor, a communication interface, and a processor for controlling the microphone, the at least one sensor, and the communication interface. The controller identifies a user utterance intention based on utterance intention information of the remote controller and utterance intention information of the external device. The controller controls whether to supply power to the microphone according to a result of an identification of the user utterance intention, and controls the communication interface to transmit an electrical signal corresponding to a voice of user received through the microphone to a display device.

First claim

What is claimed is:

1. A remote controller for controlling an external device by using voice recognition, the remote controller comprising:
a microphone;
at least one sensor;
a communication interface; and
a processor configured to control the microphone, the at least one sensor, and the communication interface,
wherein the processor is further configured to:
obtain first information from the at least one sensor,
receive second information indicating a preference settings interface for guiding a user input is displayed on a display of the external device from the external device through the communication interface,
identify, after receipt of the second information indicating the preference settings interface is displayed, a user utterance intention based on a combination of the first information obtained from the at least one sensor and the second information received from the external device, the first information obtained from the at least one sensor being based on a state of the remote controller or an external state identified by the at least one sensor,
control, after identification of the user utterance intention, power to be supplied to the microphone based on the user utterance intention being identified, and
control the communication interface to transmit an electrical signal corresponding to a user voice received through the microphone to the external device.

2. The remote controller as claimed in claim 1 , wherein the at least one sensor comprises a plurality of sensors, and
wherein the processor is further configured to identify the user utterance intention by combining states identified by the plurality of sensors corresponding to a distance between the remote controller and a face of a user.

3. The remote controller as claimed in claim 1 , wherein the second information received from the external device includes third information about whether a pop-up guide for guiding a user to utter the user voice is displayed on the display of the external device.

4. The remote controller as claimed in claim 1 , wherein the second information received from the external device includes third information about a user utterance history corresponding to a content displayed on the display of the external device.

5. The remote controller as claimed in claim 1 , wherein the second information received from the external device includes third information about whether a subsequent utterance of a user is predicted.

6. The remote controller as claimed in claim 5 , wherein the third information about whether the subsequent utterance of the user is predicted is identified based on at least one from among a previous utterance, contents of a user interface displayed on the display of the external device, or a result of performing an operation or a function of the external device according to the previous utterance.

7. The remote controller as claimed in claim 1 , wherein the processor is further configured to, in response to identifying that there is the user utterance intention, supply power to the microphone, control the communication interface, and transmit the user utterance intention to the external device, and
wherein the external device is configured to display a user interface with a voice recognition guide on the display.

8. The remote controller as claimed in claim 1 , wherein the at least one sensor comprises at least one from among a grip sensor configured to identify a gripping of the remote controller, a motion sensor configured to identify a motion of the remote controller, and a gas sensor configured to identify gas from an exhalation of a user.

9. The remote controller as claimed in claim 1 , wherein the processor is further configured to receive third information from the external device indicating a usage pattern corresponding to the preference settings interface currently displayed on the external device, and identify the user utterance intention based on a combination of the first information obtained from the at least one sensor and the usage pattern corresponding to the preference settings interface currently displayed on the external device.

10. The remote controller as claimed in claim 1 , wherein the at least one sensor comprises a grip sensor configured to identify a gripping of the remote controller.

11. The remote controller as claimed in claim 1 , wherein the at least one sensor comprises a gas sensor configured to identify gas from an exhalation of a user.

12. A display device comprising:
a display;
a communication interface; and
a processor configured to control the display and the communication interface,
wherein the processor is further configured to:
control the display to display a preference settings interface for guiding a user input,
obtain first information corresponding to a user's usage pattern obtained based on the preference settings interface,
receive second information from a remote controller through the communication interface,
identify, after receipt of the second information from the remote controller, a user utterance intention based on a combination of the first information obtained based on the user's usage pattern with respect to the preference settings interface and the second information received from the remote controller, the second information received from the remote controller being based on a state of the remote controller or an external state identified by at least one sensor of the remote controller, and
control, after identification of the user utterance intention, power to be supplied to a microphone and the display to display a user interface with a voice recognition guide to be distinguished from the preference settings interface based on the user utterance intention being identified,
wherein the voice recognition guide is displayed in less than a predetermined time after the identifying of the user utterance intention.

13. The display device as claimed in claim 12 , wherein the processor is further configured to control the display to display the user interface with the voice recognition guide indicating the state of the remote controller or the external state available for receiving a voice to be distinguished from the preference settings interface in accordance with the second information received from the remote controller through the communication interface.

14. The display device as claimed in claim 12 , wherein the processor is further configured to control the communication interface to transmit an electrical signal corresponding to a user voice received from the remote controller to a voice recognition server, and based on response information or control information being received from the voice recognition server through the communication interface, control the display to display the response information on the display or perform a function based on the control information.

15. A method for receiving a user voice of a remote controller, the method comprising:
communicably connecting to an external device;
obtaining first information from at least one sensor;
receiving second information indicating a preference settings interface for guiding a user input is displayed on a display of the external device from the external device;
identifying, after receipt of the second information indicating the preference settings interface is displayed, a user utterance intention based on a combination of the first information obtained from the at least one sensor and the second information received from the external device, the first information obtained from the at least one sensor being based on a state of the remote controller or an external st

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lim Chae-Young
• Park Jong-Jin
• Kim Min-Sup
• Yun Hyun-Kyu
• Lee Won-Jae
• Cho Kyung-Ik

Classifications

• G10L15/28 Primary

  Constructional details of speech recognition systems · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L25/78

  Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10) · CPC title

• H04N21/42203

  sound input device, e.g. microphone · CPC title