Systems and methods for monitoring turn-over performance

Patent metadata

Field	Value
Publication number	US-12129588-B2
Application number	US-202117529632-A
Country	US
Kind code	B2
Filing date	Nov 18, 2021
Priority date	Nov 18, 2021
Publication date	Oct 29, 2024
Grant date	Oct 29, 2024

Abstract

A washing machine appliance includes a wash basket that is rotatably mounted within a wash tub and that defines a wash chamber for receiving a load of clothes. A camera assembly is used to monitor articles for washing within the wash basket. Specifically, a controller of the washing machine appliance uses the camera assembly to obtain a reference image and one or more test images, which utilize image recognition to assess turn-over of the articles for washing during a given wash cycle. When turn-over performance is inadequate, a controller may adjust one or more operating parameters of the wash cycle to improve performance. Turn-over performance of the wash cycle is determined to be adequate once the image recognition process fails to find adequate correlation between the reference image and the test image a predetermined number of times.

First claim

What is claimed is:

1. A washing machine appliance, comprising:
a wash tub positioned within a cabinet and containing water having a water temperature and a water height within the wash tub;
a wash basket rotatably mounted within the wash tub for agitating clothes therein at an agitation intensity for a duration at a ramp up speed and defining a wash chamber configured for receiving a load of clothes, the wash basket further including a wash basket floor;
a camera assembly mounted above the wash basket and having a field of view in the direction of the wash basket floor
a controller operably coupled to the camera assembly, the controller being configured to:
initiate a wash cycle;
perform a turn-over test process, wherein the turn-over test process includes
obtaining a reference image of the load of clothes using the camera assembly;
performing an image comparison process, wherein the image comparison process includes
obtaining one or more test images of the load of clothes using the camera assembly;
performing a comparison of the one or more test images to the reference image;
determining if the load of clothes has turned over based on the comparison of the one or more test images to the reference image;

adjust at least one operating parameter of the washing machine appliance relating to the wash cycle when it is determined that the load of clothes failed to turn-over and wherein the at least one operating parameter of the washing machine appliance includes one of adjusting the agitation intensity, duration, or ramp up speed of the wash basket, adjusting the water temperature in the wash tub, or adjusting the water level in the wash tub;
increment a turn-over counter value when it is determined that the load of clothes succeeded in turning over;
determine whether the turn-over counter value exceeds a predetermined turn-over threshold; and
initiate a rinse cycle when the turn-over counter value exceeds the predetermined turn-over threshold and repeat the turn-over test process when the turn-over counter value does not exceed the predetermined turn-over threshold.

2. The washing machine appliance of claim 1 , wherein the controller is further configured to increment an operational adjustment counter each time that the washing machine appliance adjusts at least one operating parameter in response to the determination that the load of clothes failed to turn-over and to raise a fault condition when the operational adjustment counter exceeds a predetermined adjustment threshold.

3. The washing machine appliance of claim 2 , wherein the controller is further configured to repeat the image comparison process when the operational adjustment counter does not exceed the predetermined adjustment threshold.

4. The washing machine appliance of claim 1 , wherein the controller is further configured to store one or more performance parameters of the wash cycle when it is determined that the turn-over counter exceeds the predetermined turn-over threshold.

5. The washing machine appliance of claim 4 , wherein the controller is further configured to set one or more of the agitation intensity, duration, or ramp up speed of the wash basket, the water temperature in the wash tub, or the water level in the wash tub for the rinse cycle based on the stored performance parameters of the wash cycle.

6. The washing machine appliance of claim 1 , wherein adjusting at least one operating parameter includes adjusting the agitation profile of the wash cycle.

7. The washing machine appliance of claim 1 , wherein adjusting at least one operating parameter includes adjusting the water temperature of the wash cycle.

8. The washing machine appliance of claim 1 , wherein adjusting at least one operating parameter includes adjusting the water level of the wash cycle.

9. The washing machine appliance of claim 1 , wherein determining if the load of clothes has turned over based on the comparison of the one or more test images to the reference image further includes applying feature matching to identify common features between the one or more test images and the reference image.

10. The washing machine appliance of claim 9 , wherein applying feature matching further includes identifying common features using artificial intelligence.

11. The washing machine appliance of claim 10 , wherein using artificial intelligence further comprises at least one of a convolution neural network (“CNN”), a region-based convolution neural network (“R-CNN”), a deep belief network (“DBN”), or a deep neural network (“DNN”) image recognition process.

12. A method of using a camera to assess turn-over performance in a washing machine appliance comprising a cabinet, a wash tub within the cabinet containing water having a water temperature and a water height within the wash tub, and a wash basket rotatably mounted within the wash basket for agitating clothes therein at an agitation intensity for a duration at a ramp up speed, and defining a wash chamber, the method comprising:
initiating a wash cycle;
performing a turn-over test process, wherein the turn-over test process includes
obtaining a reference image of the load of clothes using the camera;
performing an image comparison process, wherein the image comparison process includes
obtaining one or more test images of the load of clothes using the camera;
performing a comparison of the one or more test images to the reference image;
determining if the load of clothes has turned over based on the comparison of the one or more test images to the reference image;

adjusting at least one operating parameter of the washing machine appliance relating to the wash cycle when it is determined that the load of clothes failed to turn-over, wherein the at least one operating parameter of the washing machine appliance includes one of adjusting the agitation intensity, duration, or ramp up speed of the wash basket, adjusting the water temperature in the wash tub, or adjusting the water level in the wash tub;
incrementing a turn-over counter value when it is determined that the load of clothes succeeded in turning over;
determining whether the turn-over counter value exceeds a predetermined turn-over threshold; and
initiating a rinse cycle when the turn-over counter value exceeds the predetermined turn-over threshold and repeating the turn-over test process when the turn-over counter value does not exceed the predetermined turn-over threshold.

13. The method of claim 12 , wherein the method further comprises incrementing an operational adjustment counter each time that the washing machine appliance adjusts at least one operating parameter in response to the determination that the load of clothes failed to turn-over and raising a fault condition when the operational adjustment counter exceeds a predetermined adjustment threshold.

14. The method of claim 13 , wherein the method further comprises repeating the image comparison process when the operational adjustment counter does not exceed the predetermined adjustment threshold.

15. The method of claim 12 , wherein the method further comprises storing one or more performance parameters of the wash cycle when it is determined that the turn-over counter exceeds the predetermined turn-over threshold.

16. The method of claim 15 , wherein initiating the rinse cycle further comprises setting one or more of the agitation intensity, duration, or ramp up speed of the wash basket, the water temperature in the wash tub, or the water level in the wash tub for the rinse cycle based on the stored performance parameters of the wash cycle.

17. The

Assignees

• Haier Us Appliance Solutions Inc

Inventors

• Moon Hyeonsoo
• Lee Hoyoung
• Lee Jeonghoon
• Mashal Khalid Jamal
• Yoon Je Kwon

Classifications

• G06V20/00

  Scenes; Scene-specific elements (control of digital cameras H04N23/60) · CPC title

• G05B19/041

  Function-oriented details · CPC title

• D06F2105/52

  Changing sequence of operational steps; Carrying out additional operational steps; Modifying operational steps, e.g. by extending duration of steps · CPC title

• D06F2105/10

  Temperature of washing liquids; Heating means therefor · CPC title

• D06F2105/46

  Drum speed; Actuation of motors, e.g. starting or interrupting · CPC title