Apparatus, systems, and methods for audio and video filtering for electronic user devices

Patent metadata

Field	Value
Publication number	US-2022014815-A1
Application number	US-202117483552-A
Country	US
Kind code	A1
Filing date	Sep 23, 2021
Priority date	Sep 23, 2021
Publication date	Jan 13, 2022
Grant date	—

Abstract

Apparatus, systems, and methods for audio and video filtering for electronic user devices are disclosed. An example apparatus includes at least one memory, instructions in the apparatus, and processor circuitry to execute instructions to detect a visual event based on image data, the visual event representative of an activity associated with a likelihood of noise, the image data associated with a video stream output by a camera associated with a user device, and in response to the detection of the visual event, apply an audio filter to a portion of an audio stream corresponding to the image data in the video stream.

First claim

1 . An apparatus comprising:
at least one memory; instructions in the apparatus; and processor circuitry to execute the instructions to:
detect a visual event based on image data, the visual event representative of an activity associated with a likelihood of noise, the image data associated with a video stream output by a camera associated with a user device; and
in response to the detection of the visual event, apply an audio filter to a portion of an audio stream corresponding to the image data in the video stream.

2 . The apparatus of claim 1 , wherein the image data includes first image data and the processor circuitry is to:
identify a first stage of the activity represented by the visual event in the first image data, the processor circuitry to apply the audio filter in response to the detection of the first stage; detect a second stage of the activity represented by the visual event in a second image data associated with the video stream; and refrain from applying the audio filter in response to the detection of the second stage.

3 . The apparatus of claim 1 , wherein the processor circuitry is to apply the audio filter for a duration of time based on the activity.

4 . The apparatus of claim 1 , wherein the processor circuitry is to apply the audio filter by causing the portion of the audio stream to be muted.

5 . The apparatus of claim 1 , wherein the processor circuitry is to apply the audio filter by filtering the noise from the portion of the audio stream.

6 . The apparatus of claim 1 , wherein the audio filter is a first filter, and the processor circuitry is to apply a second filter to a portion of the video stream including the visual event.

7 . The apparatus of claim 6 , wherein the processor circuitry is to apply the second filter by causing the portion of the video stream to be blurred or concealed.

8 . The apparatus of claim 1 , wherein the activity includes an activity performed by a user.

9 . The apparatus of claim 1 , wherein the activity includes an event in an environment in which the user device is located.

10 . At least one non-transitory computer-readable storage medium comprising instructions that, when executed, cause processor circuitry to at least:
detect a visual event in a first frame of a video stream generated by a camera associated with a user device, the visual event representative of a user activity associated with a likelihood of noise; and in response to the detection of the visual event, cause a filter to be applied to a portion of an audio stream corresponding to the first frame to generate a filtered audio stream; and cause the filtered audio stream to be output for transmission.

11 . The computer-readable medium of claim 10 , wherein the instructions, when executed, cause the processor circuitry to:
detect a first stage of the user activity in the first frame of the video stream; cause the filter to be applied in response to the detection of the first stage; detect a second stage of the user activity in a second frame of the video stream; and cause the application of the filter to be maintained in response to the detection of the second stage.

12 . The computer-readable medium of claim 11 , wherein the instructions, when executed, cause the processor circuitry to:
detect a third stage of the user activity represented by the visual event in a third frame of the video stream; and generate instructions for application of the filter to end in response to the detection of the third stage.

13 . The computer-readable medium of claim 10 , wherein the instructions, when executed, cause the processor circuitry to instruct the filter to be applied for a duration of time based on the user activity.

14 . The computer-readable medium of claim 10 , wherein the instructions, when executed, cause the processor circuitry to instruct the filter to mute the portion of the audio stream.

15 . The computer-readable medium of claim 10 , wherein the instructions, when executed, cause the processor circuitry to instruct the filter to filter the noise from the portion of the audio stream.

16 . The computer-readable medium of claim 10 , wherein the filter is a first filter, and the instructions, when executed, cause the processor circuitry to cause a second filter to be applied to a portion of the video stream including the visual event.

17 . The computer-readable medium of claim 16 , wherein the instructions, when executed, cause the processor circuitry to instruct the second filter to conceal the portion of the video stream.

18 .- 26 . (canceled)

27 . A method comprising:
detecting, by executing an instruction with at least one processor, a visual event based on image data, the visual event representative of an activity associated with a likelihood of noise, the image data associated with a video stream output by a camera associated with a user device; and in response to detecting the visual event, applying, by executing an instruction with at least one processor, an audio filter to a portion of an audio stream corresponding to the image data in the video stream.

28 . The method of claim 27 , wherein the image data is first image data and further including:
identifying a first stage of the activity represented by the visual event in the first image data; applying of the audio filter in response to the detection of the first stage; detecting a second stage of the activity represented by the visual event in second image data associated with the video stream; and refrain from applying the audio filter in response to the detection of the second stage.

29 . The method of claim 27 , wherein applying the audio filter includes applying the audio filter for a duration of time based on the activity.

30 . The method of claim 27 , wherein applying the audio filter includes causing the portion of the audio stream to be muted.

31 . The method of claim 27 , wherein applying the audio filter includes filtering the noise from the portion of the audio stream.

32 . The method of claim 27 , wherein the audio filter is a first filter, and further including applying a second filter to a portion of the video stream including the visual event.

33 . The method of claim 32 , wherein applying the second filter includes blurring the portion of the video stream.

Assignees

• Intel Corp

Inventors

• Browning David
• Rosenzweig Michael

Classifications

• H04N21/4396 Primary

  by muting the audio signal · CPC title

• H04N7/15 Primary

  Conference systems · CPC title

• H04N21/4318

  by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00) · CPC title

• H04N21/4394

  involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58) · CPC title

• H04N21/45457

  applied to a time segment · CPC title