Refrigerator with camera and control method for the same

Patent metadata

Field	Value
Publication number	US-9915471-B2
Application number	US-201414786719-A
Country	US
Kind code	B2
Filing date	Apr 22, 2014
Priority date	Apr 23, 2013
Publication date	Mar 13, 2018
Grant date	Mar 13, 2018

Abstract

A refrigerator includes a storage compartment formed in a cabinet of the refrigerator by a fixed insulation wall, the storage compartment provided with an access opening, a door rotatably provided to the cabinet to open and close the access opening, a drawer provided in the storage compartment, a camera fixed to a ceiling of the storage compartment to photograph both a first region for storing of food arranged in an external space of the drawer in the storage compartment and a second region for storing of food arranged in an internal space of the drawer in the storage compartment, and a controller to separate, through a capturing time of a picture containing both the first region and the second region, a first region picture and a second region picture from the picture to individually divide and store the first region picture and the second region picture.

First claim

The invention claimed is:

1. A refrigerator comprising:
a storage compartment;
a drawer movably provided in the storage compartment and provided with a marker;
a camera arranged to photograph inside the drawer from outside the drawer; and
a controller arranged to sense a position of the marker in a plurality of photographs taken through the camera at time intervals and to determine state information about the drawer based on a change in position of the marker in the plurality of photographs.

2. The refrigerator according to claim 1 , wherein the state information about the drawer includes at least one selected from the group comprising: a degree of withdrawal of the drawer; whether the drawer is withdrawn; a movement direction of the drawer; and a stopped state or moving state of the drawer.

3. The refrigerator according to claim 1 , wherein the controller is arranged to process the marker in a single photo within a predetermined range allowing the marker to be positioned.

4. The refrigerator according to claim 1 , wherein the controller is arranged to determine a coordinate of the marker within a taken photograph with respect to a reference coordinate in order to determine a path of movement of the marker, and wherein the reference coordinate is a one-dimensional coordinate in a direction parallel with the movement direction of the drawer.

5. The refrigerator according to claim 1 , wherein the controller is arranged to compare two photographs of the plurality of photographs to determine movement of the drawer and movement direction of the drawer according to change in the position of the marker.

6. The refrigerator according to claim 1 , wherein the controller is arranged to:
determine the position of the marker in one photograph in a first section of the moveable distance of the drawer, wherein the first section is a section from an introduced position of the drawer to a position reached by the drawer withdrawn by a predetermined distance, and
determine a change in the position of the marker by comparing two photographs of the plurality of photographs in a second section of the moveable distance of the drawer, wherein the second section is a section from the position reached by the drawer withdrawn by the predetermined distance to the position reached by the drawer when the drawer is fully withdrawn.

7. The refrigerator according to claim 6 , wherein the length of the second section is less than or equal to the first section, and wherein a capturing time interval of the camera is longer than or equal to a time taken for the controller to compare the positions of the marker located in the second section in the two photographs.

8. The refrigerator according to claim 1 , wherein the capturing time interval of the camera is longer than or equal to a time taken for the controller to determine the position of the marker.

9. The refrigerator according to claim 1 , wherein the marker is disposed on a top surface of a front wall of the drawer.

10. The refrigerator according to claim 9 , wherein the drawer comprises a drawer disposed on a left side of a lateral center of the storage compartment and a drawer disposed on a right side of the lateral center, and the marker is installed at each of the drawers,
wherein the camera is fixed to a ceiling over the drawers at a position of the lateral center of the storage compartment, and the marker installed at each of the drawers is arranged close to the lateral center of the storage compartment.

11. The refrigerator according to claim 1 , wherein the marker comprises a colour different from a colour of the drawer positioned at a boundary of the marker.

12. The refrigerator according to claim 11 , wherein
the marker comprises a width side defined to be parallel with the movement direction of the drawer and a length side defined to be perpendicular to the movement direction of the drawer, the length side is longer than the width side;
or,
the marker comprises a first color portion and a second color portion having a different color than the first color portion, wherein the first color portion and the second color portion are alternately disposed.

13. The refrigerator according to claim 1 , wherein the marker comprises at least one shape having a different color and repeatedly disposed.

14. A method of controlling a refrigerator provided with a drawer and a camera fixedly provided to a ceiling of a storage compartment of the refrigerator, the method comprising:
recognizing closing of the drawer, wherein the recognizing comprises:
sensing start of opening of the drawer;
acquiring an image of the interior of drawer using the camera;
processing the acquired image;
recognizing a predetermined marker from the acquired image as a result of the processing;
tracing movement of the recognized marker;
acquiring a final image of an interior of the drawer using the camera at a moment the closing the drawer begins; and
displaying the final image.

15. The method according to claim 14 , wherein the tracing comprises:
sensing termination of the opening of the drawer using the recognized marker; and
sensing the closing of the drawer using the marker.

16. The method according to claim 14 , further comprising displaying, when the predetermined marker is not recognized from the acquired image as a result of the processing, failure of recognition of the marker.

17. The method according to claim 15 , further comprising:
determining, when the termination of the closing of the drawer is sensed, whether acquisition of the final image through recognition of the marker has been successful; and
displaying, when acquisition of the final image through recognition of the marker the marker has been failed.

18. The method according to claim 15 , wherein the predetermined marker is provided with a pattern of repeated identical shapes having different colors.

Assignees

• Lg Electronics Inc

Inventors

• Kim Kwanhyung
• Hong Samnyol
• Kwon Sungdu
• Lee Ikkyu
• Lee Myoungju
• Kim Jeonghwan

Classifications

• F25D29/00 Primary

  Arrangement or mounting of control or safety devices · CPC title

• F25D29/005 Primary

  Mounting of control devices · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• H04N23/57

  Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices · CPC title

• H04N23/51

  Housings · CPC title