Driving interaction object

Patent metadata

Field	Value
Publication number	US-11769499-B2
Application number	US-202117204568-A
Country	US
Kind code	B2
Filing date	Mar 17, 2021
Priority date	Nov 28, 2019
Publication date	Sep 26, 2023
Grant date	Sep 26, 2023

Abstract

Methods, electronic devices, and storage media for driving an interaction object are provided. The methods include: obtaining an audio signal at a periphery of a display device; obtaining, based on the audio signal, first driving data for driving the interaction object to respond; monitoring, in response to outputting the first driving data, the audio signal for detecting a sound of a target object; and driving, based on a presence state of the sound of the target object in the audio signal, the interaction object to respond.

First claim

The invention claimed is:

1. A method of driving an interaction object, comprising:
obtaining an audio signal at a periphery of a display device;
obtaining, based on the audio signal, first driving data for driving the interaction object to respond, wherein the first driving data is used to drive the interaction object to perform a first specified action;
monitoring, in response to outputting the first driving data, the audio signal for detecting a sound of a target object; and
driving, based on a presence state of the sound of the target object in the audio signal, the interaction object to respond,
wherein driving, based on the presence state of the sound of the target object in the audio signal, the interaction object to respond comprises:
driving, in response to that the sound of the target object is detected within a first preset time, the interaction object to perform the first specified action repeatedly.

2. The method according to claim 1 , wherein obtaining, based on the audio signal, the first driving data for driving the interaction object to respond comprises:
determining, in response to that target information is detected in the audio signal, the first specified action matching the target information; and
obtaining the first driving data for driving the interaction object to perform the first specified action.

3. The method according to claim 2 , wherein
the first driving data comprises at least one of first audio driving data or first action driving data, the first audio driving data is data regarding a sound generated by performing the first specified action, and
monitoring, in response to outputting the first driving data, the audio signal for detecting the sound of the target object comprises:
driving, in response to outputting the first action driving data, the interaction object to perform the first specified action, and monitoring the audio signal for detecting the sound of the target object; or
monitoring, in response to outputting a sound based on the first audio driving data, the audio signal for detecting the sound of the target object.

4. The method according to claim 1 , wherein driving, based on the presence state of the sound of the target object in the audio signal, the interaction object to respond comprises:
driving, in response to that the sound of the target object is not detected within the first preset time, the interaction object to return to an initial posture after the first specified action is ended.

5. The method according to claim 4 , further comprising:
when the interaction object is driven to return to the initial posture after the first specified action is ended, obtaining, based on the audio signal, second driving data for driving the interaction object to respond, wherein the second driving data comprises at least one of second audio driving data or second action driving data; and
driving, based on the second driving data, the interaction object to respond.

6. The method according to claim 5 , wherein obtaining, based on the audio signal, the second driving data for driving the interaction object to respond comprises:
sending the audio signal to a server, so that the server generates, based on the audio signal, the second driving data for driving the interaction object to respond; and
receiving the second driving data from the server.

7. The method according to claim 6 , further comprising:
when the interaction object is driven to return to the initial posture after the first specified action is ended, calling, in response to not receiving the second driving data from the server within a second preset time, preset third driving data for driving the interaction object to respond, wherein the preset third driving data comprises at least one of third audio driving data or third action driving data.

8. The method according to claim 1 , further comprising:
detecting an intensity of environmental noise based on the audio signal; and
adjusting, based on the intensity of environmental noise, a volume of a sound output from the display device during the interaction object responding.

9. The method according to claim 1 , wherein
a plurality of audio signals are obtained by a plurality of sound detection modules distributed in different directions with respect to the display device, and
the method further comprises:
determining an intensity of environmental noise in different directions based on the plurality of A audio signals respectively obtained by the plurality of sound detection modules; and
driving, based on the intensity of environmental noise in different directions, the interaction object to guide the target object to change a position for interaction.

10. An electronic device, comprising:
a processor, and
a memory storing a computer program, wherein when executing the computer program, the processor is caused to:
obtain an audio signal at a periphery of a display device;
an A obtain, based on the audio signal, first driving data for driving an interaction object to respond, wherein the first driving data is used to drive the interaction object to perform a first specified action;
monitor, in response to outputting the first driving data, the audio signal for detecting a sound of a target object; and
drive, based on a presence state of the sound of the target object in the audio signal, the interaction object to respond,
wherein driving, based on the presence state of the sound of the target object in the audio signal, the interaction object to respond comprises:
driving, in response to that the sound of the target object is detected within a first preset time, the interaction object to perform the first specified action repeatedly.

11. The electronic device according to claim 10 , wherein the processor is caused to:
determine, in response to that target information is detected in the audio signal, the first specified action matching the target information; and
obtain the first driving data for driving the interaction object to perform the first specified action.

12. The electronic device according to claim 11 , wherein
the first driving data comprises at least one of first audio driving data or first action driving data, the first audio driving data is data regarding a sound generated by performing the first specified action;
the processor is caused to:
drive, in response to outputting the first action driving data, the interaction object to perform the first specified action, and monitor the audio signal for detecting the sound of the target object; or
monitor, in response to outputting a sound based on the first audio driving data, the audio signal for detecting the sound of the target object.

13. The electronic device according to claim 10 , wherein the processor is caused to:
drive, in response to that the sound of the target object is not detected within the first preset time, the interaction object to return to an initial posture after the first specified action is ended.

14. The electronic device according to claim 13 , wherein the processor is further caused to:
when the interaction object is driven to return to the initial posture after the first specified action is ended, obtain, based on the audio signal, second driving data for driving the interaction object to respond, wherein the second driving data comprises at least one of second audio driving data or second action driving data; and
drive, based on the second driving data, the interaction object to respond.

15. The electronic device according to claim 14 , wherein when obtaining, based on the audio signal, the second driving data for dr

Assignees

• Beijing Sensetime Tech Development Co Ltd

Inventors

• Zhang Zilong
• Luan Qing
• Sun Lin

Classifications

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• G10L25/84

  for discriminating voice from noise · CPC title

• G06F3/0484 Primary

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title