Display device and system comprising same

Patent metadata

Field	Value
Publication number	US-10901690-B2
Application number	US-202016923446-A
Country	US
Kind code	B2
Filing date	Jul 8, 2020
Priority date	Jan 8, 2018
Publication date	Jan 26, 2021
Grant date	Jan 26, 2021

Abstract

A display device according to an embodiment of the present invention may comprise: a display unit for displaying a content image; a microphone for receiving voice commands from a user; a network interface unit for communicating with a natural language processing server and a search server; and a control unit for transmitting the received voice commands to the natural language processing server, receiving intention analysis result information indicating the user's intention corresponding to the voice commands from the natural language processing server, and performing a function of the display device according to the received intention analysis result information.

First claim

The invention claimed is:

1. A display device comprising:
a display configured to display a content image;
a network interface configured to perform communication with a natural language processing server and a search server; and
a controller configured to:
acquire a voice command of a user,
transmit the received voice command to the natural language processing server,
receive intention analysis result information indicating an intention of the user corresponding to the voice command from the natural language processing server, wherein the intention of the voice command is an intention to turn off the display device when playback of the content image ends,
acquire a playback end time point of the content image from broadcasting information,
displays, on the display, a window indicating that the display device is turned off at the playback end time point of the content image, and
turn off the display device when the playback end time of the content image is reached.

2. The display device of claim 1 , wherein the broadcasting information includes electronic program guide information, the controller extracts the playback end time point of the content image from the electronic program guide information.

3. The display device of claim 1 , further comprising a microphone configured to receive the voice command of the user.

4. The display device of claim 1 , further comprising a wireless communication interface configured to receive the voice command of the user from a remote controller.

5. The display device of claim 1 , wherein the controller is configured to:
transmit an information request message for requesting search of information corresponding to the intention to the search server, upon determining that the function of the display device corresponding to the intention of the user is not able to be autonomously performed, and
display search information received from the search server on the display.

6. The display device of claim 5 , wherein the controller is configured to:
transmit the information request message for requesting a story of the content image to the search server, when the intention of the voice command is an intention to give the story of the content image, and
display the story received from the search server on the display.

7. The display device of claim 4 , wherein the controller is configured to:
transmit an image obtained by capturing the content image to an auto content recognition server, when the intention of the voice command is an intention to request information on an object included in the content image,
receive identification information of the object from the auto content recognition server,
transmit the received identification information of the object to the search server,
receive detailed information of the object from the search server, and
display the received detailed information of the object on the display.

8. The display device of claim 4 , wherein the controller is configured to:
transmit audio to a sound source analysis server, when the intention of the voice command is an intention to request information on audio output along with the content image,
receive identification information of the audio from the sound source analysis server,
transmit the received identification information of the audio to the search server,
receive detailed information of the audio from the search server, and
display the received detailed information of the audio on the display.

9. The display device of claim 1 , wherein, when an intention corresponding to the received voice command is autonomously acquired, the controller is configured to perform a function corresponding to the intention without transmitting the voice command to the natural language processing server.

10. A system comprising:
a natural language processing server configured to generate intention analysis result information indicating a result of analyzing an intention of a voice command; and
a display device configured to:
transmit the voice command to the natural language processing server, receive the intention analysis result information corresponding to the voice command from the natural language processing server, wherein the intention of the voice command is an intention to turn off the display device when playback of the content image ends,
acquire a playback end time point of the content image from broadcasting information,
displays, on the display, a window indicating that the display device is turned off at the playback end time point of the content image, and
turn off the display device when the playback end time of the content image is reached.

11. The system of claim 10 , wherein the broadcasting information includes electronic program guide information, the display device extracts the playback end time point of the content image from the electronic program guide information.

12. The system of claim 10 , further comprising a search server,
wherein the display device transmits an information request message for requesting search of information corresponding to the intention to the search server, upon determining that the function of the display device corresponding to the intention of the user is not able to be autonomously performed.

13. The system of claim 10 , wherein the display device performs a function corresponding to the intention without transmitting the voice command to the natural language processing server, when the intention corresponding to the received voice command is autonomously acquired.

Assignees

• Lg Electronics Inc

Inventors

• Min Sunki
• Lee Kiwoong
• Lee Hyangjin
• Chang Jeean
• Heo Seunghyun
• Lee Jaekyung

Classifications

• H04N21/4828

  for searching programme descriptors (retrieval of video data G06F16/739) · CPC title

• H04N21/47

  End-user applications · CPC title

• H04N21/42203 Primary

  sound input device, e.g. microphone · CPC title

• H04N21/42204

  User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205) · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title