Providing audio and alternate audio simultaneously during a shared multimedia presentation

Patent metadata

Field	Value
Publication number	US-10754313-B2
Application number	US-201815954872-A
Country	US
Kind code	B2
Filing date	Apr 17, 2018
Priority date	Apr 22, 2014
Publication date	Aug 25, 2020
Grant date	Aug 25, 2020

Abstract

Aspects of the subject disclosure may include, for example, decoding first and second encoded audio portions extracted from a digitally encoded data stream to obtain first and second decoded audio portions. The digitally encoded data stream includes an encoded video portion, multiple encoded audio portions including the first and second audio portions and a reference marker. The first and second decoded audio portions are synchronized to a decoded video portion based on the reference marker. The first decoded audio portion is forwarded to equipment of a first user and the second decoded audio portion is forwarded to equipment of a second user. Presentations of the first decoded audio portion by the equipment of the first user and the second decoded audio portion by the equipment of the second user are synchronized to a presentation of the decoded video portion. Other embodiments are disclosed.

First claim

What is claimed is:

1. A method comprising:
decoding, by a processing system including a processor, a first encoded audio portion of a plurality of encoded audio portions to obtain a first decoded audio portion, wherein the plurality of encoded audio portions and an encoded video portion are part of a data stream;
decoding, by the processing system responsive to a selection, a second encoded audio portion of the plurality of encoded audio portions to obtain a second decoded audio portion;
adjusting, by the processing system based on a determination of a timing error, a delay of the second decoded audio portion to obtain a delayed second decoded audio portion, wherein the determination of the timing error is between the first decoded audio portion and the second decoded audio portion, and wherein the timing error is determined based on monitoring synchronization markers in at least one of the first decoded audio portion or the second decoded audio portion; and
forwarding, by the processing system, the first decoded audio portion and the delayed second decoded audio portion to an audio system,
wherein a first audio presentation of the first decoded audio portion and a second audio presentation of the delayed second decoded audio portion by the audio system are synchronized to a video presentation of a decoded video portion obtained from the encoded video portion, and
wherein the audio system directs the first decoded audio portion and the delayed second decoded audio portion to different spatial regions, and
wherein the second audio presentation is acoustically isolated from the first audio presentation based on a first phasing of the first decoded audio portion and a second phasing of the delayed second decoded audio portion.

2. The method of claim 1 , wherein the different spatial regions correspond to different portions of a viewing range of the video presentation.

3. The method of claim 1 , wherein the first audio presentation and the second audio presentation comprise different languages.

4. The method of claim 3 , further comprising detecting, by the processing system, a selection of an option corresponding to a language of the second audio presentation.

5. The method of claim 1 , wherein the adjusting is performed by way of a feedback loop based on the timing error.

6. The method of claim 1 , wherein the first audio presentation comprises at least one of dialog, a musical score, or background sounds of an original program.

7. The method of claim 6 , wherein the second audio presentation comprises at least one of dialog, a musical score, or background sounds distinct from the original program.

8. The method of claim 1 , further comprising detecting, by the processing system, a selection of an option corresponding to a presentation adapted for a person having a hearing impairment.

9. The method of claim 8 , wherein the first decoded audio portion comprises a first verbal portion and a first non-verbal portion, and the delayed second decoded audio portion comprises a second verbal portion and a second non-verbal portion.

10. The method of claim 9 , wherein one of the second verbal portion, the second non-verbal portion, or both differ from a corresponding one of the first verbal portion, the first non-verbal portion, or both according to the hearing impairment.

11. A device, comprising:
a processing system including a processor; and
a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations comprising:
decoding a first encoded audio portion of a plurality of encoded audio portions to obtain a first decoded audio portion, wherein the plurality of encoded audio portions and an encoded video portion are part of a data stream;
decoding, responsive to a selection, a second encoded audio portion of the plurality of encoded audio portions to obtain a second decoded audio portion;

adjusting, based on a determination of a timing error, a delay of the second decoded audio portion to obtain a delayed second decoded audio portion, wherein the determination of the timing error is between the first decoded audio portion and the second decoded audio portion, wherein the timing error is determined based on monitoring synchronization markers in at least one of the first decoded audio portion or the second decoded audio portion, and wherein the adjusting is performed by way of a feedback loop based on the timing error; and
forwarding the first decoded audio portion and the delayed second decoded audio portion to an audio system,
wherein a first audio presentation of the first decoded audio portion and a second audio presentation of the delayed second decoded audio portion by the audio system are synchronized to a video presentation of a decoded video portion obtained from the encoded video portion, and
wherein the second audio presentation is acoustically isolated from the first audio presentation based on a first phasing of the first decoded audio portion and a second phasing of the delayed second decoded audio portion.

12. The device of claim 11 , wherein the audio system directs the first decoded audio portion and the delayed second decoded audio portion to different spatial regions corresponding to different portions of a viewing range of the video presentation.

13. The device of claim 11 , wherein the first audio presentation and the second audio presentation comprise different languages.

14. The device of claim 13 , wherein the operations further comprise detecting a selection of an option corresponding to a language of the second audio presentation.

15. The device of claim 11 , wherein the operations further comprise detecting a selection of an option corresponding to a presentation adapted for a person having a hearing impairment.

16. A non-transitory machine-readable medium comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations comprising:
decoding a first encoded audio portion of a plurality of encoded audio portions to obtain a first decoded audio portion, wherein the plurality of encoded audio portions and an encoded video portion are part of a data stream;
decoding, responsive to a selection, a second encoded audio portion of the plurality of encoded audio portions to obtain a second decoded audio portion;
adjusting, based on a determination of a timing error, a delay of the second decoded audio portion to obtain a delayed second decoded audio portion, wherein the determination of the timing error is between the first decoded audio portion and the second decoded audio portion, and wherein the timing error is determined based on monitoring synchronization markers in at least one of the first decoded audio portion or the second decoded audio portion; and
forwarding the first decoded audio portion and the delayed second decoded audio portion to an audio system,
wherein a first audio presentation of the first decoded audio portion and a second audio presentation of the delayed second decoded audio portion by the audio system are synchronized to a video presentation of a decoded video portion obtained from the encoded video portion, and
wherein the second audio presentation is acoustically isolated from the first audio presentation based on a first phasing of the first decoded audio portion and a second phasing of the delayed second decoded audio portion.

17. The non-transitory machine-readable medium of claim 16 , wherein the audio system directs the first decoded audio portion and the delayed second decoded

Assignees

• At & T Ip I Lp

Inventors

• Johnston Robert
• Kingsmill Kirk
• Wood James

Classifications

• H04N21/4112 Primary

  having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities · CPC title

• H04N21/43079

  of additional data with content streams on multiple devices · CPC title

• H04N21/43076

  of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices · CPC title

• H04N21/8106

  involving special audio data, e.g. different tracks for different languages · CPC title

• G05B15/02 Primary

  electric · CPC title