Domestic appliance having variable security based on automatic determination of user supervision

Patent metadata

Field	Value
Publication number	US-10559302-B2
Application number	US-201615564211-A
Country	US
Kind code	B2
Filing date	Feb 5, 2016
Priority date	Apr 13, 2015
Publication date	Feb 11, 2020
Grant date	Feb 11, 2020

Abstract

A domestic appliance includes a user interface for a user to input commands, a camera for taking an image of an operating area from which the user interface can be operated by the user, a speech recognition device for detecting a speech command, and a control device configured to determine a level of security depending on the image that was taken by the camera and to execute the speech command detected by the speech recognition device depending on the level of security that has been determined.

First claim

The invention claimed is:

1. A domestic appliance, comprising:
a user interface configured to receive manual input from a user to control the appliance;
a camera adapted to take an image of an operating area from which the user interface is operable by the user;
a speech recognition device configured to detect a speech command; and
a control device configured to:
automatically determine a level of security based on an evaluation of the image taken by the camera, wherein
(a) a first level of security corresponds to a failure to detect a presence of the user within the operating area,
(b) a second level of security corresponds to detection of the presence of the user within the operating area,
(c) a third level of security corresponds to detection of the presence of the user within the operating area and a detection of a presence of a face of the user, and
(d) a fourth level of security corresponds to detection of the presence of the user within the operating area, detection of the presence of the face of the user, and a recognition that the user is authorized;

in response to the fourth level of security, automatically execute the speech command detected by the speech recognition device; and
in response to the first level of security, ignore the speech command detected by the speech recognition device;
wherein the camera is configured to take the image of a head area of the operating area, such that detection of the presence of the user depends on a height of the user.

2. The domestic appliance of claim 1 , wherein the level of security is a numerical value which represents a quantitative measure of a supervision of the domestic appliance by the user.

3. The domestic appliance of claim 1 , wherein the speech recognition device is constructed to specify a probability of a correct detection of the speech command, said control device configured to take into account the probability for a decision regarding an execution of the speech command.

4. The domestic appliance of claim 1 , wherein the speech recognition device includes a microphone, an amplifier operably connected to the microphone and configured to amplify a sound signal received from the microphone, and a microprocessor circuit receiving the amplified sound signal from the amplifier.

5. The domestic appliance of claim 4 , wherein the microprocessor circuit includes an analog-to-digital converter adapted to digitize the sound signal, a first microprocessor configured to evaluate the digitized sound signal, and an interface connected to the control device.

6. The domestic appliance of claim 5 , wherein the control device includes a second microprocessor and an interface in communication with the second microprocessor for activating mechanical switches on the domestic appliance.

7. The domestic appliance of claim 6 , wherein the microprocessor circuit and the control device form an integrated component, said first and second microprocessors being constructed in the form of a single microprocessor.

8. The domestic appliance of claim 1 , wherein the speech recognition device comprises a speaker recognition unit for recognizing the user, said control device being constructed to define the level of security depending on the user recognized.

9. The domestic appliance of claim 1 , further comprising a display unit for displaying a change in response to the speech command.

10. The domestic appliance of claim 1 , constructed in the form of a domestic cooking appliance.

11. The domestic appliance of claim 10 , wherein the domestic cooking appliance is a cooker, an oven, a steam cooker, or a warming drawer.

12. A method for operating a domestic appliance, comprising:
automatically taking an image of an operating area of the domestic appliance using a camera;
detecting a speech command using a speech recognition device of the domestic appliance;
using a control device of the domestic appliance, automatically evaluating the image taken by the camera;
based on the evaluation of the image, automatically determining a first level of security if no user is detected within the operating area;
based on the evaluation of the image, automatically determining a second level of security if a user is detected within the operating area;
based on the evaluation of the image, automatically determining a third level of security if the user is detected within the operating area and a face of the user is detected;
based on the evaluation of the image, automatically determining a fourth level of security if the user is detected within the operating area, a face of the user is detected, and the user is recognized to be authorized;
in response to the fourth level of security, automatically executing the speech command detected by the speech recognition device; and
in response to the first level of security, ignoring the speech command detected by the speech recognition device;
wherein the camera is configured to take the image of a head area of the operating area, such that detection of the presence of the user depends on a height of the user.

13. The method of claim 12 , further comprising:
Specifying, using the speech recognition device, a probability of correct detection of the speech command; and
responding to the third level of security by automatically executing the speech command only if the probability of correct detection is above a selected threshold.

14. The method of claim 12 , further comprising determining that the user is authorized based on a facial recognition of the user within the image.

15. The domestic appliance of claim 1 , wherein the recognition that the user is authorized is based on a facial recognition of the user within the image.

16. The domestic appliance of claim 1 , wherein the speech recognition device is configured to specify a probability of a correct detection of the speech command; and
wherein, in response to the third level of security, the control device is configured to automatically execute the speech command only if the probability of correct detection is above a selected threshold.

Assignees

• Bsh Hausgeraete Gmbh

Inventors

• Beifuss Wolfgang
• Has Uwe

Classifications

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G10L2015/228

  of application context · CPC title

• F24C7/08

  Arrangement or mounting of control or safety devices · CPC title

• H04L2012/285

  Generic home appliances, e.g. refrigerators · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title