Display device and operating method thereof

Patent metadata

Field	Value
Publication number	US-12469493-B2
Application number	US-202318187833-A
Country	US
Kind code	B2
Filing date	Mar 22, 2023
Priority date	Sep 28, 2022
Publication date	Nov 11, 2025
Grant date	Nov 11, 2025

Abstract

In order to assist a voice recognition function when voice recognition has failed, a display device may comprise a display, a user input interface configured to receive a command from a remote control device, and a controller configured to display a keyboard window including one or more queries and a keyboard item on the display when voice recognition for a voice command uttered by a user has failed in a state in which a voice recognition function is activated.

First claim

What is claimed is:

1 . A display device comprising:
a display; a user interface; and a controller configured to: receive, via the user interface, a command provided by a remote control device, wherein the command is for activating a voice recognition function; cause the display to display a keyboard window including one or more queries and a keyboard item, based on a failed voice recognition for a voice command received from a user and further based on an utterance source providing the voice command being the remote control device, while the voice recognition function is activated; and cause the display to display a recommended query window including a plurality of recommended queries, based on the utterance source providing the voice command being direct from the user.

2 . The display device of claim 1 , wherein the controller is further configured to:
determine that the voice recognition has failed, based on the voice command not being received within a defined time.

3 . The display device of claim 2 , wherein each of the plurality of recommended queries is any one of a query related to an application executable on the display device, a query related to a content image being reproduced on the display, or a query for controlling a function of the display device.

4 . The display device of claim 1 , wherein the controller is further configured to:
cause the display to display a search result for a query in response to a command for selecting the query from among the one or more queries displayed on the display.

5 . The display device of claim 1 , wherein the controller is further configured to:
determine that the voice recognition has failed, and cause the display to display the keyboard window including a plurality of candidate queries, based on the voice command not being recognized within a defined time and voice recognition being not possible for a defined number of utterances.

6 . The display device of claim 5 , wherein each of the plurality of candidate queries includes the voice command and a keyword that meets a reliability threshold.

7 . The display device of claim 1 , wherein the controller is further configured to:
determine that the voice recognition has failed, and cause the display to display a keyboard window movement key for providing the plurality of recommended queries and a query input box for input of a recommended query, based on the voice command not being recognized within a defined time.

8 . The display device of claim 1 , wherein the controller is further configured to:
cause the display to display a setting menu for setting display of the keyboard window on the display and to set whether to display the keyboard window according to a command input using the setting menu.

9 . The display device of claim 1 , wherein the plurality of recommended queries represent words previously uttered by the user.

10 . A method for operating a display device, the method comprising:
receiving a command provided by a remote control device, wherein the command is for activating a voice recognition function; determining whether voice recognition for a voice command uttered by a user has failed in a state in which the voice recognition function is activated according to the command; and displaying, on a display, a keyboard window including one or more queries and a keyboard item, based on a failed voice recognition for a voice command received from a user and further based on an utterance source providing the voice command being the remote control device, while the voice recognition function is activated; and displaying, on the display, a recommended query window including a plurality of recommended queries, based on the utterance source providing the voice command being direct from the user.

11 . The method of claim 10 , further comprising:
determining that the voice recognition has failed, based on the voice command not being received within a defined time.

12 . The method of claim 11 , wherein each of the plurality of recommended queries is any one of a query related to an application executable on the display device, a query related to a content image being reproduced on the display, or a query for controlling a function of the display device.

13 . The method of claim 10 , further comprising:
displaying, on the display, a search result for a query in response to a command for selecting the query from among the one or more queries displayed on the display.

14 . The method of claim 10 , further comprising:
determining that the voice recognition has failed, and displaying, on the display, the keyboard window including a plurality of candidate queries, based on the voice command not being recognized within a defined time and voice recognition being not possible for a defined number of utterances.

15 . The method of claim 14 , wherein each of the plurality of candidate queries includes the voice command and a keyword that meets a reliability threshold.

16 . The method of claim 10 , further comprising:
determining that the voice recognition has failed, and displaying, on the display, a keyboard window movement key for providing the plurality of recommended queries and a query input box for input of a recommended query, based on the voice command not being recognized within a defined time.

17 . The method of claim 10 , further comprising:
displaying, on the display, a setting menu for setting display of the keyboard window on the display and to set whether to display the keyboard window according to a command input using the setting menu.

18 . The method of claim 10 , wherein the plurality of recommended queries represent words previously uttered by the user.

Assignees

• Lg Electronics Inc

Inventors

• Kim Taejoon
• Lee Jaekyung
• Kwak Changmin
• Kim Yongtae
• Min Sunki
• Lee Hyangjin
• Byeon Yeongbin

Classifications

• H04N21/472

  End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)} · CPC title

• H04N21/42203

  sound input device, e.g. microphone · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G06F3/04886

  by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title