Refrigerator and home automation system having the same

Patent metadata

Field	Value
Publication number	US-10769916-B2
Application number	US-201715689623-A
Country	US
Kind code	B2
Filing date	Aug 29, 2017
Priority date	Sep 28, 2016
Publication date	Sep 8, 2020
Grant date	Sep 8, 2020

Abstract

A refrigerator may include: a communication device, an object detection sensor for sensing an object positioned within a predetermined region around the refrigerator door; and a controller for controlling the refrigerator to operate in a specific mode based on a connected state between the communication network and preset mobile terminals. If an object sensing signal is received from the object detection sensor in the specific mode, the controller may send a notification to at least one of the preset mobile terminals through the communication network.

First claim

What is claimed is:

1. A refrigerator, comprising:
a communication device at the refrigerator to connect to a communication network;
an object detection sensor provided at an outer surface of a refrigerator door, and the object detection sensor to detect an object within a predetermined distance from the object detection sensor; and
a controller that controls the refrigerator to operate in a specific mode based on a connected state between the communication network and at least one of a plurality of preset mobile terminals,
wherein in response to receiving an object sensing signal from the object detection sensor while the refrigerator is operating in the specific mode, the controller contacts the communication device to send a notification to at least one of the preset mobile terminals through the communication network,
wherein the object detection sensor detects any object that can move by itself,
wherein the refrigerator and one of the preset mobile terminals are connected to an access point (AP) at home for communication through Wi-Fi access when a user of the one of the preset mobile terminals is at home, and the one of the preset mobile terminals is disconnected from the AP when the user of the one of the preset mobile terminals is not at home, so that whether the user of the one of the preset mobile terminals is at home is determined,
wherein the controller is to perform a determination whether the one of the preset mobile terminals is connected to the access point at preset time intervals to continuously monitor whether the user of the one of the preset mobile terminals is at home, and
wherein the object detection sensor includes:
a first sensor spaced apart from a floor that senses an object located in a first area that is positioned on a front side of the refrigerator door and spaced apart from the floor; and
a second sensor disposed below the first sensor and to be adjacent the floor, and the second sensor to sense an object located in a second area that is positioned on the front side of the refrigerator door and positioned below the first area,
wherein when the second sensor senses an object while the first sensor does not sense an object, the controller controls components such that a notification is not to be sent.

2. The refrigerator of claim 1 , wherein when at least one of the mobile terminals is not connected to the wireless communication network, the controller controls the refrigerator to enter the specific mode, and
wherein the specific mode is a crime prevention mode to perform a security function for an empty house.

3. The refrigerator of claim 2 , further comprising:
a camera at the refrigerator, and the camera is exposed to outside the refrigerator when the refrigerator door is open; and
a door switch that senses whether the refrigerator door is open,
wherein in response to receiving, from the door switch, a signal indicating the refrigerator door is open while the refrigerator is in the specific mode, the controller controls the camera to capture an image, and controls the communication device to send the captured image to at least one of the mobile terminals through the communication network.

4. The refrigerator of claim 3 , wherein the controller performs an image processing with respect to a face included in the captured image, and deletes the captured image when the face included in the captured image is determined to match a preset face.

5. The refrigerator of claim 4 , wherein the controller controls the communication device to send a notification requesting a connection with the communication network, to a mobile terminal of a user determined to match the face in the captured image.

6. The refrigerator of claim 2 , further comprising a camera at the refrigerator, and the camera is exposed to outside the refrigerator when the refrigerator door is open,
wherein in response to receiving an object sensing signal from the object detection sensor while the refrigerator is in the specific mode, the controller controls the refrigerator door to open, controls the camera to capture an image while the refrigerator door is open, and controls the communication device to send the captured image to at least one of the mobile terminals through the communication network.

7. The refrigerator of claim 1 , wherein when only a specific mobile terminal, from among the mobile terminals, is connected to the communication network, the controller controls the refrigerator to enter the specific mode,
wherein a user of the specific mobile terminal is classified in a first group and a second group according to age, and
wherein the specific mode includes:
a silver care mode to monitor an activity state of an old person when a user of the specific mobile terminal is determined as belonging to the first group; and
a children care mode to monitor an activity state of a child when a user of the specific mobile terminal is determined as belonging to the second group.

8. The refrigerator of claim 1 , further comprising:
a door switch that senses an open state of the refrigerator door, and
wherein the controller is to perform a determination whether the one of the preset mobile terminals is connected to an access point at preset time intervals to continuously monitor whether the user of the one of the preset mobile terminals is at home.

9. The refrigerator of claim 8 , wherein when at least one of the mobile terminals is not connected to the communication network, the controller controls the refrigerator to enter the specific mode, and
wherein the specific mode is a crime prevention mode to perform a security function for an empty house.

10. The refrigerator of claim 9 , further comprising a camera at the refrigerator, and the camera is exposed to outside the refrigerator when the refrigerator door is open,
wherein in response to receiving a signal indicating the open state of the refrigerator door when the refrigerator is operating in the specific mode, the controller controls the camera to capture an image, and controls the communication device to send the captured image to at least one of the mobile terminals through the communication network.

11. The refrigerator of claim 10 , wherein the controller performs an image processing with respect to a face included in the captured image, and deletes the captured image when the face included in the captured image is determined to match a preset face.

12. The refrigerator of claim 11 , wherein the controller controls the communication device to send a notification requesting a connection with the communication network, to a mobile terminal of a user determined to match the face in the captured image.

13. The refrigerator of claim 8 , wherein when only a specific mobile terminal, from among the mobile terminals, is connected to the communication network, the controller controls the refrigerator to enter the specific mode,
wherein a user of the specific mobile terminal is classified in a first group and a second group according to age, and
wherein the specific mode includes:
a silver care mode to monitor an activity state of an old person when a user of the specific mobile terminal is determined as belonging to the first group; and
a children care mode to monitor an activity state of a child when a user of the specific mobile terminal is determined as belonging to the second group.

14. A refrigerator, comprising:
a communication device provided at the refrigerator to connect to a communication network;
an object detection sensor provided at an outer surface of a refrigerator door to detect an object within a predetermined distance from the sensor;
a camer

Assignees

• Lg Electronics Inc

Inventors

• Kim Sangoh
• Kim Hyungyul
• Yun Jongho
• Han Cholok

Classifications

• G06V40/173

  face re-identification, e.g. recognising unknown faces across different face tracks · CPC title

• G06V40/168

  Feature extraction; Face representation · CPC title

• F25D2700/04

  Sensors detecting the presence of a person · CPC title

• G06V40/166

  using acquisition arrangements · CPC title

• G06V40/172

  Classification, e.g. identification · CPC title