Systems and methods for composition of audio content from multi-object audio

Patent metadata

Field	Value
Publication number	US-11662972-B2
Application number	US-202117148471-A
Country	US
Kind code	B2
Filing date	Jan 13, 2021
Priority date	Feb 21, 2018
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

Embodiments are related to processing of one or more input audio feeds for generation of a target audio stream that includes at least one object of interest to a listener. In some embodiments, the target audio stream may exclusively or primarily include the sound of the object of interest to the listener, without including other persons. This allows a listener to focus on an object of his or her interest and not necessarily have to listen to the performances of other objects in the input audio feed. Some embodiments contemplate multiple audio feeds and/or with multiple objects of interest.

First claim

What is claimed is:

1. A method for composition of audio content comprising:
receiving an input audio feed including one or more objects distributed in multiple frames, wherein an object of interest in the one or more objects is identifiable based on a unique characteristic;
generating a fingerprint of at least a portion of the input audio feed;
retrieving, from a database, a fingerprint of the object of interest;
comparing the fingerprint of at least the portion of the input audio feed with the fingerprint of the object of interest to detect matched frames that include the fingerprint of the object of interest;
creating a timeline of the input audio feed;
annotating the timeline of the input audio feed at positions corresponding to positions of the matched frames;
generating a target audio stream having the object of interest by compositing the matched frames; and
partially eliminating objects that do not correspond to the object of interest, from the target audio stream.

2. The method of claim 1 , wherein partially eliminating objects includes partially suppressing the sounds of objects that do not correspond to the object of interest.

3. The method of claim 1 , wherein the annotating allows playing of the target audio stream at the positions of the matched frames.

4. The method of claim 1 , wherein the annotating allows selective seeking the positions of the matched frames, without generation of the target audio stream.

5. The method of claim 1 , wherein the user selects the object of interest from the timeline.

6. A non-transitory computer-readable storage medium storing instructions configured for composition of audio content to perform a method comprising:
receiving an input audio feed including one or more objects distributed in multiple frames, wherein an object of interest in the one or more objects is identifiable based on a unique characteristic;
generating a fingerprint of at least a portion of the input audio feed;
retrieving, from a database, a fingerprint of the object of interest;
comparing the fingerprint of at least the portion of the input audio feed with the fingerprint of the object of interest to detect matched frames that include the fingerprint of the object of interest;
creating a timeline of the input audio feed;
annotating the timeline of the input audio feed at positions corresponding to positions of the matched frames;
generating a target audio stream having the object of interest by compositing the matched frames; and
partially eliminating objects that do not correspond to the object of interest, from the target audio stream.

7. The computer-readable storage medium of claim 6 , wherein partially eliminating objects includes partially suppressing the sounds of objects that do not correspond to the object of interest.

8. The computer-readable storage medium of claim 6 , wherein the annotating allows playing of the target audio stream at the positions of the matched frames.

9. The computer-readable storage medium of claim 6 , wherein the annotating allows selective seeking the positions of the matched frames, without generation of the target audio stream.

10. The computer-readable storage medium of claim 6 , wherein the user selects the object of interest from the timeline.

11. An apparatus for composition of audio content comprising:
a memory;
one or more processors electronically coupled to the memory and configured for:
receiving an input audio feed including one or more objects distributed in multiple frames, wherein an object of interest in the one or more objects is identifiable based on a unique characteristic;
generating a fingerprint of at least a portion of the input audio feed;
retrieving, from a database, a fingerprint of the object of interest;
comparing the fingerprint of at least the portion of the input audio feed with the fingerprint of the object of interest to detect matched frames that include the fingerprint of the object of interest;
creating a timeline of the input audio feed; and
annotating the timeline of the input audio feed at positions corresponding to positions of the matched frames;
generating a target audio stream having the object of interest by compositing the matched frames; and
partially eliminating objects that do not correspond to the object of interest, from the target audio stream.

12. The apparatus of claim 11 , wherein partially eliminating objects includes partially suppressing the sounds of objects that do not correspond to the object of interest.

13. The apparatus of claim 11 , wherein the annotating allows playing of the target audio stream at the positions of the matched frames.

14. The apparatus of claim 11 , wherein the annotating allows selective seeking the positions of the matched frames, without generation of the target audio stream.

15. The apparatus of claim 11 , wherein the user selects the object of interest from the timeline.

Assignees

• Dish Network Technologies India Pvt Ltd

Inventors

• Raikar Yatish Jayant Naik
• Rasool Mohammed
• Pallapothu Trinadha Harish Babu

Classifications

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G10L25/51 Primary

  for comparison or discrimination · CPC title