Audio control for extended-reality shared space

Patent metadata

Field	Value
Publication number	US-2022014839-A1
Application number	US-202016924714-A
Country	US
Kind code	A1
Filing date	Jul 9, 2020
Priority date	Jul 9, 2020
Publication date	Jan 13, 2022
Grant date	—

Abstract

Methods, systems, computer-readable media, and apparatuses for audio signal processing are presented. Some configurations include determining that first audio activity in at least one microphone signal is voice activity; determining whether the voice activity is voice activity of a participant in an application session active on a device; based at least on a result of the determining whether the voice activity is voice activity of a participant in the application session, generating an antinoise signal to cancel the first audio activity; and by a loudspeaker, producing an acoustic signal that is based on the antinoise signal. Applications relating to shared virtual spaces are described.

First claim

1 . An apparatus for audio signal processing, the apparatus comprising:
a memory configured to store at least one microphone signal; and a processor coupled to the memory and configured to retrieve the at least one microphone signal and to execute computer-executable instructions to:
determine that first audio activity in the at least one microphone signal is voice activity;
determine whether the voice activity is voice activity of a participant in an application session active on a device; and
based at least on a determination that the voice activity is voice activity of a participant in the application session, refrain from canceling the first audio activity using one or more antinoise signals.

2 . The apparatus according to claim 1 , wherein the processor is further configured to execute computer-executable instructions to:
determine that second audio activity in the at least one microphone signal is voice activity of a non-participant in the application session; in response to at least the determination that the second audio activity is voice activity of a non-participant in the application session, generate an antinoise signal to cancel the second audio activity; and cause a loudspeaker to produce an acoustic signal that is based on the antinoise signal.

3 . The apparatus according to claim 1 , wherein the processor is further configured to execute computer-executable instructions to:
in response to at least the determination that the voice activity is voice activity of a participant in the application session, cause wireless transmission of an indication that a participant in the application session is speaking.

4 . The apparatus according to claim 1 , wherein the processor is further configured to execute computer-executable instructions to:
determine that second audio activity in the at least one microphone signal is voice activity of a participant in the application session; in response to at least the determination that the second audio activity is voice activity of a participant in the application session, generate an antinoise signal to cancel the second audio activity; and cause a loudspeaker to produce an acoustic signal that is based on the antinoise signal.

5 . The apparatus according to claim 1 , wherein the processor is further configured to execute computer-executable instructions to:
receive a wireless indication that a participant in the application session is speaking; and refrain from canceling the first audio activity based on the determination that the voice activity is voice activity of a participant in the application session and based on the wireless indication.

6 . The apparatus according to claim 1 , wherein the processor is further configured to execute computer-executable instructions to:
detect a mode change condition; in response to the detected mode change condition, cause wireless transmission of an indication of a mode change; and refrain from canceling the first audio activity based on the determination that the voice activity is voice activity of a participant in the application session and based on the detected mode change condition.

7 . The apparatus according to claim 6 , wherein detecting the mode change condition is based on a result of at least one of a facial recognition operation or a gaze detection operation.

8 . The apparatus according to claim 6 , wherein detecting the mode change condition is based on a result of at least one of a keyword detection or a detection of a change of at least one of position or orientation.

9 . The apparatus according to claim 1 , wherein the processor is further configured to execute computer-executable instructions to:
receive a wireless indication of a mode change; determine that second audio activity in the at least one microphone signal is voice activity of an additional participant in the application session; in response to the indication of a mode change, generate an antinoise signal to cancel the second audio activity; and cause a loudspeaker to produce an acoustic signal that is based on the antinoise signal.

10 . The apparatus according to claim 1 , wherein the active application session is a session of a gaming application.

11 . The apparatus according to claim 9 , wherein the computer-executable instructions to generate the antinoise signal comprise computer-executable instructions to generate the antinoise signal based also on a context of the application session.

12 . The apparatus according to claim 11 , wherein the context indicates that the additional participant is an opponent.

13 . The apparatus according to claim 11 , wherein the context indicates that a voice of the additional participant is currently disabled.

14 . The apparatus according to claim 11 , wherein the context indicates that the additional participant is in a private mode with another participant.

15 . The apparatus according to claim 11 , wherein the context indicates that a voice of the additional participant is blocked by a virtual barrier.

16 . The apparatus according to claim 1 , wherein the active application session is a session of an application for sharing a virtual space.

17 . A method of audio signal processing, the method comprising:
determining that first audio activity in at least one microphone signal is voice activity; determining whether the voice activity is voice activity of a participant in an application session active on a device; and based at least on a determination that the voice activity is voice activity of a participant in the application session, refraining from canceling the first audio activity using one or more antinoise signals.

18 . The method according to claim 17 , wherein the method further comprises:
determining that second audio activity in the at least one microphone signal is voice activity of a non-participant in the application session; in response to at least the determining that the second audio activity is voice activity of a non-participant in the application session, generating an antinoise signal to cancel the second audio activity; and causing a loudspeaker to produce an acoustic signal that is based on the antinoise signal.

19 . The method according to claim 17 , wherein the method further comprises:
in response to at least the determining that the voice activity is voice activity of a participant in the application session, wirelessly transmitting an indication that a participant in the application session is speaking.

20 . (canceled)

21 . The method according to claim 17 , wherein the method further comprises:
wirelessly receiving an indication that a participant in the application session is speaking; and refraining from canceling the first audio activity based on the determination that the voice activity is voice activity of a participant in the application session and based on the indication.

22 . The method according to claim 17 , wherein the method further comprises:
detecting a mode change condition; in response to detecting the mode change condition, wirelessly transmitting an indication of a mode change; and refraining from canceling the first audio activity based on the determination that the voice activity is voice activity of a participant in the application session and based on the detected mode change condition.

23 . The method according to claim 22 , wherein detecting the mode change condition is based on a result of at least one of a facial recognit

Assignees

• Qualcomm Inc

Inventors

• Tartz Robert
• Beith Scott
• Tavakoli Mehrad
• Reitmayr Gerhard

Classifications

• H04R1/1083 Primary

  Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06) · CPC title

• G10K11/17823 Primary

  Reference signals, e.g. ambient acoustic environment · CPC title

• G10K11/17837

  by retaining part of the ambient acoustic environment, e.g. speech or alarm signals that the user needs to hear · CPC title

• G10K2210/3046

  Multiple acoustic inputs, multiple acoustic outputs · CPC title

• H04R3/005

  for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407) · CPC title