Providing audio and alternate audio simultaneously during a shared multimedia presentation

Patent metadata

Field	Value
Publication number	US-9971319-B2
Application number	US-201414258819-A
Country	US
Kind code	B2
Filing date	Apr 22, 2014
Priority date	Apr 22, 2014
Publication date	May 15, 2018
Grant date	May 15, 2018

Abstract

Aspects of the subject disclosure may include, for example, decoding first and second encoded audio portions extracted from a digitally encoded data stream to obtain first and second decoded audio portions. The digitally encoded data stream includes an encoded video portion, multiple encoded audio portions including the first and second audio portions and a reference marker. The first and second decoded audio portions are synchronized to a decoded video portion based on the reference marker. The first decoded audio portion is forwarded to equipment of a first user and the second decoded audio portion is forwarded to equipment of a second user. Presentations of the first decoded audio portion by the equipment of the first user and the second decoded audio portion by the equipment of the second user are synchronized to a presentation of the decoded video portion. Other embodiments are disclosed.

First claim

What is claimed is:

1. A method comprising:
receiving, by a media processing system including a processor, a digitally encoded data stream comprising an encoded video data portion, and a plurality of encoded audio data portions;
extracting, by the media processing system, from the digitally encoded data stream, a first encoded audio data portion of the plurality of encoded audio data portions comprising a default audio data portion;
decoding, by the media processing system, the first encoded audio data portion to obtain a first decoded audio portion;
forwarding, by the media processing system, the first decoded audio portion to a directional audio system, wherein a presentation of the first decoded audio portion by the directional audio system is synchronized to a presentation of a decoded video portion obtained from the encoded video data portion;
monitoring, by the media processing system, a selection of a second encoded audio data portion of the plurality of encoded audio data portions;
responsive to detecting the selection of the second encoded audio data portion:
extracting, by the media processing system, from the digitally encoded data stream, the second encoded audio data portion;
decoding, by the media processing system, the second encoded audio data portion to obtain a second decoded audio portion;
determining, by the media processing system, a timing error between the first decoded audio portion and the second decoded audio portion;
adjusting, by the media processing system, a variable delay of the second decoded audio portion by way of a feedback loop based on the timing error to obtain a delayed second decoded audio portion; and
forwarding, by the media processing system, the delayed second decoded audio portion to the directional audio system, wherein a presentation of the delayed second decoded audio portion by the directional audio system is synchronized to the presentation of the decoded video portion, and wherein the directional audio system directs first decoded audio portion and the delayed second decoded audio portion to different spatial regions within a viewing range of the presentation of the decoded video.

2. The method of claim 1 , wherein the presentation of the delayed second decoded audio portion is acoustically isolated from the presentation of the first decoded audio portion based on a phasing of the decoded audio portion and a phasing of the delayed second decoded audio portion.

3. The method of claim 2 , wherein the first decoded audio portion comprises a language and the delayed second decoded audio portion comprises a different language, each of the language and the different language corresponding to the presentation of the decoded video portion.

4. The method of claim 2 , wherein the first decoded audio portion comprises a first verbal portion and a first non-verbal portion, and the delayed second decoded audio portion comprises a second verbal portion and a second non-verbal portion, wherein one of the second verbal portion, the second non-verbal portion, or both differ from a corresponding one of the first verbal portion, the first non-verbal portion, or both according to a hearing impairment.

5. The method of claim 1 , further comprising providing by the media processing system, to equipment of a user, an indication of the plurality of encoded audio data portions.

6. The method of claim 5 , wherein the selection of the second encoded audio data portion is responsive to the providing of the indication of the plurality of encoded audio data portions.

7. The method of claim 1 , wherein the forwarding of the delayed second decoded audio portion to the directional audio system comprises forwarding the delayed second decoded audio portion, over-the-air, according to a wireless communication protocol.

8. A media processor comprising:
a memory that stores executable instructions; and
a processing system including a processor coupled to the memory, wherein the processing system, responsive to executing the instructions, facilitates performance of operations, the operations comprising:
extracting from a digitally encoded data stream, a first encoded audio portion, wherein the digitally encoded data stream comprises an encoded video portion, and a plurality of encoded audio portions;
decoding the first encoded audio portion to obtain a first decoded audio portion;
forwarding the first decoded audio portion to a directional audio system, wherein a presentation of the first decoded audio portion by the directional audio system is synchronized to a presentation of a decoded video portion obtained from the encoded video portion;
responsive to detecting a selection of a second encoded audio portion of the plurality of encoded audio portions:
extracting from the digitally encoded data stream, the second encoded audio portion;
decoding the second encoded audio portion to obtain a second decoded audio portion;
determining a timing error between the first decoded audio portion and the second decoded audio portion;
adjusting a variable delay of the second decoded audio portion by way of a feedback loop based on the timing error to obtain a delayed second decoded audio portion; and
forwarding the delayed second decoded audio portion to the directional audio system, wherein presentation of the delayed second decoded audio portion by the directional audio system is synchronized to the presentation of the decoded video portion, and wherein the directional audio system directs first decoded audio portion and the delayed second decoded audio portion to different spatial regions within a viewing range of the presentation of the decoded video.

9. The media processor of claim 8 , wherein the presentation of the delayed second decoded audio portion is acoustically isolated from the presentation of the first decoded audio portion.

10. The media processor of claim 9 , wherein the first decoded audio portion comprises a language and the delayed second decoded audio portion comprises a different language, each of the language and the different language corresponding to the presentation of the decoded video portion.

11. The media processor of claim 9 , wherein the first decoded audio portion comprises a first verbal portion and a first non-verbal portion, and the delayed second decoded audio portion comprises a second verbal portion and a second non-verbal portion, wherein one of the second verbal portion, the second non-verbal portion, or both differ from a corresponding one of the first verbal portion, the first non-verbal portion, or both according to a hearing impairment.

12. The media processor of claim 8 , wherein the operations further comprise providing to equipment of a user, an indication of the plurality of encoded audio portions.

13. The media processor of claim 12 , wherein the selection of the second encoded audio portion is responsive to the providing of the indication of the plurality of encoded audio portions.

14. The media processor of claim 8 , wherein the forwarding of the delayed second decoded audio portion to the directional audio system comprises forwarding the delayed second decoded audio portion, over-the-air, according to a wireless communication protocol.

15. A machine-readable storage device, comprising executable instructions which, responsive to being executed by a processing system including a processor, cause the processor to facilitate performance of operations comprising:
decoding a first encoded audio portion extracted from a digitally encoded data stream to obtain a first decoded audio portion, wherein the digitally encoded data stream comprises an encoded vi

Assignees

• At & T Ip I Lp

Inventors

• Johnston Robert
• Kingsmill Kirk
• Wood James

Classifications

• G05B15/02 Primary

  electric · CPC title

• H04N21/4307

  Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen · CPC title

• H04N21/4104

  Peripherals receiving signals from specially adapted client devices · CPC title

• H04N21/8106

  involving special audio data, e.g. different tracks for different languages · CPC title

• H04N21/4341

  Demultiplexing of audio and video streams · CPC title