Method and apparatus for controlling device, smart home device, system, and storage medium

Patent metadata

Field	Value
Publication number	US-11716803-B2
Application number	US-202117482227-A
Country	US
Kind code	B2
Filing date	Sep 22, 2021
Priority date	Nov 27, 2020
Publication date	Aug 1, 2023
Grant date	Aug 1, 2023

Abstract

The present application relates to a method and an apparatus for controlling a device, a smart home device and system and a storage medium the device may be a lighting device. The method for controlling a device comprises: receiving a data stream including data for playing audio; acquiring reference data corresponding to a device control command controlling the device to perform one or more functions; determining whether at least a portion of the data in the data stream matches the reference data; and controlling, in case at least a portion of the data in the data stream matches the reference data, the device to perform one or more of the functions according to the corresponding device control command.

First claim

What is claimed is:

1. A method for controlling a device, wherein the method comprising:
receiving a data stream via an apparatus configured to control the device and an audio playback apparatus being in communication with the device, the data stream including data for playing audio;
transmitting the data stream to the audio playback apparatus to control the audio playback apparatus to play the audio;
acquiring reference data, via the apparatus, the reference data corresponding to a device control command controlling the device to perform one or more functions;
determining whether at least a portion of the data in the data stream corresponding to the audio from the audio playback apparatus matches the reference data; and
controlling, via the corresponding device control command, in case the at least a portion of the data in the data stream matches the reference data, the device to perform the one or more functions according to the corresponding device control command.

2. The method of claim 1 , wherein the reference data comprises at least one of:
one or more characteristic audio data;
a control data sequence indicating that commands to control playing the audio is input according to a predetermined rule; and
other characteristic data in the data for playing the audio.

3. The method of claim 2 , wherein determining whether at least a portion of the data in the data stream matches the reference data in the case where the reference data comprises the one or more characteristic audio data further comprises:
performing speech recognition on at least a portion of data in the data stream to acquire speech data; and
determining whether the acquired speech data matches the one or more characteristic audio data.

4. The method of claim 2 , wherein a frequency of the audio in the one or more characteristic audio data is 20 Hz to 20 kHz or a frequency of ultrasonic waves.

5. The method of claim 2 , wherein the data stream is a data stream of pre-recorded audio or a data stream of audio acquired by a microphone device.

6. The method of claim 2 , wherein the control data sequence indicates at least one of:
one or more commands of play, pause, previous song and next song are continuously input multiple times within a predetermined time; and
a button indicating that the one or more commands of play, pause, previous song and next song are entered is pressed for more than the predetermined time.

7. The method of claim 6 , wherein the device is a lamp and the device control command comprises:
a command instructing the lamp to perform the one or more functions of turning on, turning off, brighter, dimmer and color adjustment.

8. An apparatus for controlling a device being in communication with an audio playback apparatus, wherein said apparatus comprises:
a data stream receiving module configured to receive a data stream including data for playing audio;
wherein the data stream is transmitted to the audio playback apparatus to control the audio playback apparatus to play the audio;
a reference data acquisition module configured to acquire reference data corresponding to a device control command controlling the device to perform one or more functions;
a comparison module configured to determine whether at least a portion of the data in the data stream corresponding to the audio from the audio playback apparatus matches the reference data; and
a device control module, which includes the corresponding device control command being configured to control, in case the at least a portion of the data in the data stream matches the reference data, the device to perform the one or more functions according to the corresponding device control command.

9. The apparatus of claim 8 , wherein the apparatus further comprises:
an audio playback apparatus control module configured to send the data stream to the audio playback apparatus to control the audio playback apparatus to play the audio.

10. The apparatus of claim 8 , wherein the reference data comprises at least one of:
one or more characteristic audio data;
a control data sequence indicating that commands to control playing audio is input according to a predetermined rule; and
other characteristic data in the data for playing audio.

11. The apparatus of claim 10 , wherein the apparatus further comprising a speech recognition module, wherein, in the case where the reference data comprises the one or more characteristic audio data, determining whether the at least a portion of the data in the data stream matches the reference data further comprises:
performing, by the speech recognition module, speech recognition on at least a portion of data in the data stream to acquire speech data; and
determining, by the comparison module, whether the acquired speech data matches the one or more characteristic audio data.

12. The apparatus of claim 10 , wherein a frequency of the audio in the one or more characteristic audio data is 20 Hz to 20 kHz or a frequency of ultrasonic waves.

13. The apparatus of claim 10 , wherein the data stream is a data stream of pre-recorded audio or a data stream of audio acquired by a microphone device.

14. The apparatus of claim 10 , wherein the control data sequence indicates at least one of:
one or more commands of play, pause, previous song and next song are continuously input multiple times within a predetermined time; and
a button indicating that the one or more commands of play, pause, previous song and next song are entered is pressed for more than the predetermined time.

15. The apparatus of claim 14 , wherein the device is a lamp, and the device control command comprises:
a command instructing the lamp to perform the one or more functions of turning on, turning off, brighter, dimmer and color adjustment.

16. A smart home device comprising:
an audio playback apparatus configured to play audio based on a data stream, the data stream including data for the audio playback apparatus to play audio;
a device being in communication with the audio playback apparatus and configured to perform one or more functions in accordance with device control commands; and
an apparatus for controlling the device, the apparatus comprising:
a data stream receiving module configured to receive the data stream including data for playing audio;
wherein the data stream is transmitted to the audio playback apparatus to control the audio playback apparatus to play the audio;
a reference data acquisition module configured to acquire reference data corresponding to a device control command controlling the device to perform the one or more functions;
a comparison module configured to determine whether at least a portion of the data in the data stream corresponding to the audio from the audio playback apparatus matches the reference data; and
a device control module, which includes the corresponding device control command being configured to control, in case the at least a portion of the data in the data stream matches the reference data, the device to perform the one or more functions according to the corresponding device control command.

17. The smart home device of claim 16 , wherein the apparatus for controlling the device further comprises:
an audio playback apparatus control module configured to send the data stream to the audio playback apparatus to control the audio playback apparatus to play the audio.

18. The smart home device of claim 17 , wherein the device is a lamp and the device control command comprises:
a command instructing the lamp to perform the one or more functions of

Assignees

• Savant Tech Llc

Inventors

• Chen Weihu
• Guo Guangting
• Zhao Hong
• Hu Jinpeng
• Sommers Mathew

Classifications

• H05B47/12 Primary

  by detecting audible sound · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• H05B45/10

  Controlling the intensity of the light · CPC title