Artificial intelligence refrigerator having transparent display assembly

Patent metadata

Field	Value
Publication number	US-10599392-B2
Application number	US-201815860191-A
Country	US
Kind code	B2
Filing date	Jan 2, 2018
Priority date	Jan 2, 2017
Publication date	Mar 24, 2020
Grant date	Mar 24, 2020

Abstract

Provided is an artificial intelligence refrigerator. The artificial intelligence refrigerator includes a cabinet defining a storage space, a door opening and closing the cabinet, a transparent display assembly which covers an opened see-through part of the door and through which an inner space of the artificial intelligence refrigerator is seen, and a screen is outputted, a display PCB controlling an operation of the transparent display assembly, a voice recognition unit connected to the display PCB to process a user's voice signal, and a microphone connected to the voice recognition unit. The display PCB outputs output screens of the transparent display assembly in stages according to a processing state of the voice signal when a user's voice is inputted.

First claim

What is claimed is:

1. A refrigerator comprising:
a cabinet defining a storage space;
a door configured to open and close at least a portion of the cabinet, the door defining an opening;
a light device disposed in the cabinet or the door;
a transparent display assembly that covers the opening of the door, that allows an inner space of the refrigerator to be visible through the transparent display assembly, and that is configured to display one or more screens, the transparent display assembly comprising:
a display configured to output the one or more screens, and
a back light disposed behind the display and configured to emit light to the display based on operation of the display;

a display printed circuit board (PCB) configured to control an operation of the transparent display assembly;
a microphone configured to receive a voice signal based on a voice recognition mode;
a voice recognition unit connected to the display PCB and to the microphone, and configured to process the voice signal,
wherein the transparent display assembly is configured to have any one of a plurality of states, the plurality of states comprising:
a transparent mode state in which the light device is turned on to allow the inner space of the refrigerator to be visible through the transparent display assembly, the display being configured to not operate based on the transparent display assembly being in the transparent mode state,
an opaque mode state in which the light device is turned off to make the inner space of the refrigerator invisible through the transparent display assembly, the display being configured to not operate based on the transparent display assembly being in the opaque mode state, and
a display mode state in which the light device is turned off and the back light is turned on, the display being configured to, based on the transparent display assembly being in the display mode state, operate and output the one or more screens, and wherein the transparent display assembly is configured to:
based on a start of the voice recognition mode, change from the transparent mode state or the opaque mode state into the display mode state, and
in response to an input of the voice signal in the voice recognition mode, output a screen indicating processing of the voice signal to the display according to a processing state of the voice signal.

2. The refrigerator according to claim 1 , wherein the voice recognition unit and the display PCB are integrated into one board and connected to each other.

3. The refrigerator according to claim 1 , wherein the voice recognition unit is a separate voice recognition module connected to the display PCB by a connector.

4. The refrigerator according to claim 3 , further comprising a controller disposed at one side of the display PCB and connected to a second connector,
wherein an operating system of the controller is different from an operating system of the display PCB, the operating system of the display PCB being configured to control what is visualized on the transparent display assembly.

5. The refrigerator according to claim 1 , wherein the display PCB comprises a communication unit configured to communicate with home appliances that are connected through a remote internet server or a network, and
wherein the microphone is configured to receive, through the remote internet server, the voice signal to control operations of the home appliances.

6. The refrigerator according to claim 1 , wherein the display PCB comprises a communication unit configured to communicate with an indoor home appliance through a near-field wireless communication, and
wherein the microphone is configured to receive the voice signal to control an operation of the indoor home appliance.

7. The refrigerator according to claim 1 , wherein the transparent display assembly is further configured to:
change a transparency level or a brightness level of the transparent display assembly;
before a user inputs the voice signal, increase the transparency level or the brightness level of the transparent display assembly to raise visibility of the inner space of the refrigerator through the transparent display assembly; and
after the user has input the voice signal, decrease the transparency level or the brightness level of the transparent display assembly to raise readability of the one or more screens displayed on the display.

8. The refrigerator according to claim 1 , wherein the display PCB is connected to a main PCB that is configured to control an overall operation of the refrigerator and to control the overall operation of the refrigerator by the voice signal.

9. The refrigerator according to claim 1 , wherein the transparent display assembly is further configured to:
display an initial screen;
in response to a touch manipulation or an input of a triggering voice command through the microphone at the initial screen, display a screen indicating activation of a voice command input function.

10. The refrigerator according to claim 1 , wherein the transparent display assembly is configured to, based on the microphone receiving a specific command, display a screen indicating activation of a voice command input function.

11. The refrigerator according to claim 1 , wherein the transparent display assembly is configured to, while outputting the one or more screens to the display:
based on the voice signal, display an initial screen that shows the inner space of the refrigerator;
display a voice input standby screen based on an input on the initial screen to activate a voice command input function;
display a voice input screen based on a reception of a voice command at the voice input standby screen;
display an operation processing screen based on a completion of the voice command input at the voice input screen; and
display a response screen indicating a processing result together with a sound corresponding to the processing result.

12. The refrigerator according to claim 11 , wherein the transparent display assembly is configured to increase a brightness level or a transparency level of the transparent display assembly to a maximum level based on displaying the initial screen.

13. The refrigerator according to claim 11 , wherein each of the voice input standby screen, the voice input screen, the operation processing screen, and the response screen, includes a different status bar and text corresponding to a present state.

14. The refrigerator according to claim 11 , wherein the initial screen includes a menu button, and
wherein the transparent display assembly is further configured to receive, in a state in which the menu button is removed from each of the voice input standby screen, the voice input screen, the operation processing screen, and the response screen, a touch input on a corresponding position where the menu button was displayed in the initial screen.

15. The refrigerator according to claim 11 , wherein each of the voice input standby screen, the voice input screen, the operation processing screen, and the response screen, includes a cancel button, and
wherein the transparent display assembly is further configured to display the initial screen based on a manipulation of the cancel button.

16. The refrigerator according to claim 11 , wherein the transparent display assembly is further configured to:
based on a determination that the microphone is turned off, stop displaying the voice input standby screen, and display a microphone off screen; and
based on display of the microphone off screen, display the response screen indicating that the microphone off screen has b

Assignees

• Lg Electronics Inc

Inventors

• Jeon Chansung
• Jeong Hyocheol
• Cho Sanghun

Classifications

• F25D29/00

  Arrangement or mounting of control or safety devices · CPC title

• G06F3/04886

  by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus · CPC title

• F25D23/02

  Doors; Covers (F25D23/08 takes precedence {locks or fastenings E05B65/0042}) · CPC title

• G09G5/10

  Intensity circuits · CPC title

• G02B6/0088

  of the light guide or other optical sheets in the package · CPC title