Method for preventing accident performed by home appliance and cloud server using artificial intelligence

Patent metadata

Field	Value
Publication number	US-11585039-B2
Application number	US-201916533379-A
Country	US
Kind code	B2
Filing date	Aug 6, 2019
Priority date	Aug 7, 2018
Publication date	Feb 21, 2023
Grant date	Feb 21, 2023

Abstract

Provided is a method for preventing an accident related to children or pets that may occur by a home appliance using artificial intelligence. According to the present disclosure, the method for preventing the accident comprises comparing a distance between the home appliance and a generation position of the voice signal and a reference distance when the generation position of the voice signal is outside of the home appliance. Then, the present disclosure enables switching a door of the home appliance to a lock state when a distance between the home appliance and the generation position of the voice signal is less than the reference distance. Thus, the present disclosure may enable controlling the home appliance to prevent children or pets from entering an inside of the home appliance.

First claim

What is claimed is:

1. A method for preventing an accident performed by a home appliance and a cloud server that communicates with the home appliance, comprising:
sensing, by an audio input of the home appliance, a voice signal;
calculating a generation position of the voice signal;
comparing a distance between the home appliance and the generation position of the voice signal with a reference distance when the generation position of the voice signal is outside of the home appliance; and
switching a door of the home appliance to a lock state when the distance between the home appliance and the generation position of the voice signal is less than the reference distance;
wherein calculating the generation position of the voice signal comprises:
generating a parameter for the sensed voice signal;
inputting the parameter as a learning factor to a learning unit of the home appliance and receiving state information indicating a state of a speaker who has output the voice signal as an output; and
calculating the generation position of the voice signal when the state of the speaker is determined to be in a dangerous state based on the state information.

2. The method for preventing the accident of claim 1 , further comprising switching an operation button of the home appliance to the lock state when the distance between the home appliance and the generation position of the voice signal is less than the reference distance.

3. The method for preventing the accident of claim 1 , further comprising generating a warning sound, by an audio output of the home appliance, when the distance between the home appliance and the generation position of the voice signal is less than the reference distance.

4. The method for preventing the accident of claim 1 , further comprising transmitting a notification message to a user terminal registered in advance when the distance between the home appliance and the generation position of the voice signal is less than the reference distance.

5. The method for preventing the accident of claim 1 ,
wherein the state information comprises steady-state information and dangerous state information expressed by a probability, and
wherein the dangerous state indicates a case in which the probability of the dangerous state information is greater than the probability of the steady-state information.

6. The method for preventing the accident of claim 1 , wherein the parameter comprises at least one of a ratio of high-pitched tone of the voice signal, an average magnitude of the voice signal, and pattern information of the voice signal.

7. The method for preventing the accident of claim 1 ,
wherein the learning unit comprises:
an input layer that has the parameter as an input node,
an output layer that has the state information as an output node, and
at least one hidden layer between the input layer and the output layer,
wherein weights of nodes and edges between the input node and the output node are updated by a learning process of the learning unit.

8. A method for preventing an accident performed by a home appliance and a cloud server that communicates with the home appliance, comprising:
sensing, by an audio input of the home appliance, a voice signal;
determining a generation position of the voice signal; and
stopping an operation of the home appliance and switching a door of the home appliance to an open state when the generation position is the inside of the home appliance and the home appliance is in operation;
wherein determining the generation position of the voice signal comprises:
generating a parameter for the sensed voice signal;
inputting the parameter to a learning unit of the home appliance as a learning factor and receiving state information indicating a state of a speaker who has output the voice signal as an output; and
determining whether the generation position of the voice signal is inside of the home appliance when the state of the speaker is determined to be in a dangerous state based on the state information.

9. The method for preventing the accident of claim 8 , further comprising transmitting a notification message to a user terminal registered in advance when the generation position is inside of the home appliance and the home appliance is in operation.

10. The method for preventing the accident of claim 8 , further comprising generating, by an audio output of the home appliance, warning sound when the generation position of the voice signal is inside of the home appliance and the home appliance is in operation.

11. The method for preventing the accident of claim 8 ,
wherein the state information comprises steady-state information and dangerous state information expressed by a probability, and
wherein the dangerous state indicates a case in which the probability of the dangerous state information is greater than the probability of the steady-state information.

12. The method for preventing the accident of claim 8 , wherein the parameter comprises at least one of ratio of a high-pitched tone of the voice signal, an average magnitude of the voice signal, and pattern information of the voice signal.

13. The method for preventing the accident of claim 8 ,
wherein the learning unit comprises:
an input layer that has the parameter as an input node,
an output layer that has the state information as an output node, and
at least one hidden layer between the input layer and the output layer, and
wherein weights of a node and an edge between the input node and the output node are updated by a learning process of the learning unit.

14. A processor for configuring a home appliance or a cloud server that communicates with the home appliance,
wherein the processor senses a voice signal and calculates a generation position of the voice signal by an audio input of the home appliance,
wherein, the processor, when the generation position is outside of the home appliance, is configured to compare the distance between the home appliance and the generation position with a reference distance, and if the distance between the home appliance and the generation position is less than the reference distance, the processor is configured to switch a door of the home appliance to a lock state, and
wherein the processor is configured to stop an operation of the home appliance and switch the door of the home appliance to an open state when the generation position of the voice signal is the inside of the home appliance and the home appliance is in operation;
wherein the processor is configured to generate a parameter for the sensed voice signal,
wherein the processor is configured to input the parameter to a learning unit of the processor as a learning factor and receive state information indicating a state of a speaker who has output the voice signal as an output thereof, and
wherein the processor is configured to determine whether the generation position of the voice signal is inside of the home appliance when the state of the speaker is determined to be in a dangerous state based on the state information.

15. The processor of performing control to prevent an accident of claim 14 , wherein the processor is configured to generate, by the audio output of the home appliance, a warning sound.

16. The processor of performing control to prevent the accident of claim 14 , wherein the processor is configured to transmit a notification message to a user terminal registered in advance.

17. The processor of performing control to prevent an accident of claim 14 ,
wherein the state information comprises steady-state information and dangerous

Assignees

• Lg Electronics Inc

Inventors

• Jang Yongwoon

Classifications

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/09

  Supervised learning · CPC title

• G06N3/0442

  characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] · CPC title

• D06F34/00

  Details of control systems for washing machines, washer-dryers or laundry dryers · CPC title

• D06F2105/60

  Audible signals · CPC title