Transcription presentation of communication sessions

Patent metadata

Field	Value
Publication number	US-10304459-B2
Application number	US-201715782728-A
Country	US
Kind code	B2
Filing date	Oct 12, 2017
Priority date	Oct 12, 2016
Publication date	May 28, 2019
Grant date	May 28, 2019

Abstract

A method may include establishing a communication session with a remote device over a network. After establishing the communication session with the remote device, the method may include obtaining remote audio from the remote device that is provided by the remote device as part of the communication session. The method may also include directing the remote audio received from the remote device to a local device participating in the communication session and to a remote transcription system and obtaining transcript data from the remote transcription system based on the remote audio. The transcript data may include a transcription of the remote audio. The method may further include directing the transcript data to a television for presentation of the transcription of the remote audio by the television such that the transcription of the remote audio is presented substantially aligned with presentation of the remote audio by the local device.

First claim

What is claimed is:

1. A method to present transcripts of a communication, the method comprising:
establishing, by a device associated with a user, a communication session with a remote device over a public switched telephone network;
after establishing the communication session with the remote device, obtaining, at the device, remote audio from the remote device that is provided by the remote device as part of the communication session;
directing, by the device and during the communication session, the remote audio received from the remote device to a local device associated with the user and configured to broadcast the remote audio to the user and to a remote transcription system, the local device and the remote transcription system only receiving the remote audio by way of the device;
obtaining, at the device, transcript data from the remote transcription system based on the remote audio, the transcript data including a transcription of the remote audio; and
directing, by the device and during the communication session, the transcript data to a television associated with the user for presentation of the transcription of the remote audio by the television such that the transcription of the remote audio is presented substantially aligned with the broadcasting of the remote audio by the local device, the device, the television, and the local device each being a separate distinct device that is associated with the user.

2. The method of claim 1 , wherein the transcript data is directed to the television by way of an adapter device.

3. The method of claim 1 , further comprising:
combining the transcript data with a television video stream; and
providing the combined transcript data and television video stream to the television to present the transcription of the remote audio.

4. The method of claim 3 , wherein the combining of the transcript data and the television video stream includes overlaying the transcription of the remote audio on the television video stream.

5. The method of claim 1 , further comprising, in response to directing the transcript data to the television, reducing a level of television audio output by the television.

6. The method of claim 1 , further comprising, in response to directing the transcript data to the television, directing the television to come to an awake state.

7. The method of claim 1 , further comprising:
obtaining local audio from the local device; and
directing the local audio to the remote device over the public switched telephone network.

8. A system that includes at least one non-transitory computer-readable media configured to store one or more instructions that, in response to being executed by one or more processors, cause the system to perform the method of claim 1 .

9. A method to present transcripts of a communication, the method comprising:
establishing, by a device associated with a user, a communication session with a remote device over a network;
after establishing the communication session with the remote device, obtaining, by the device, remote audio from the remote device that is provided by the remote device as part of the communication session;
directing, by the device and during the communication session, the remote audio received from the remote device to a local device associated with the user and configured to broadcast the remote audio to the user and to a remote transcription system, the local device and the remote transcription system only receiving the remote audio by way of the device;
obtaining, at the device, transcript data from the remote transcription system based on the remote audio, the transcript data including a transcription of the remote audio; and
directing, by the device and during the communication session, the transcript data to a television associated with the user for presentation of the transcription of the remote audio by the television such that the transcription of the remote audio is presented substantially aligned with the broadcasting of the remote audio by the local device, the device, the television, and the local device each being a separate distinct device that is associated with the user.

10. The method of claim 9 , wherein the network is selected from a group comprising: a cellular network, a public switched telephone network, and an Internet Protocol (IP) network.

11. The method of claim 9 , wherein the transcript data is directed to the television by way of an adapter device.

12. The method of claim 9 , further comprising combining the transcript data with a television video stream to present the transcription of the remote audio by the television.

13. The method of claim 9 , further comprising, in response to directing the transcript data to the television, directing the television to reduce a level of television audio output by the television.

14. The method of claim 9 , further comprising, in response to directing the transcript data to the television, directing the television to come to an awake state.

15. A system that includes at least one non-transitory computer-readable media configured to store one or more instructions that, in response to being executed by one or more processors, cause the system to perform the method of claim 9 .

16. A device comprising:
one or more computer-readable media configured to store instructions; and
at least one processor communicatively coupled to the computer-readable media, the at least one processor configured to execute the instructions to cause the device to perform operations, the operations comprising:
establish, by the device, which is associated with a user, a communication session with a remote device over a network;
after establishing the communication session with the remote device, obtain, at the device, remote audio from the remote device that is provided by the remote device as part of the communication session;
direct, by the device and during the communication session, the remote audio received from the remote device to a local device associated with the user and configured to broadcast the remote audio to the user and to a remote transcription system, the local device and the remote transcription system only receiving the remote audio by way of the device;
obtain, at the device, transcript data from the remote transcription system based on the remote audio, the transcript data including a transcription of the remote audio; and
direct, by the device and during the communication session, the transcript data to a television associated with the user for presentation of the transcription of the remote audio by the television such that the transcription of the remote audio is presented substantially aligned with the broadcasting of the remote audio by the local device, the device, the television, and the local device each being a separate distinct device that is associated with the user.

17. The device of claim 16 , wherein the network is selected from a group comprising: a cellular network, a public switched telephone network, and an Internet Protocol (IP) network.

18. The device of claim 16 , wherein the communication session enables a remote user of the remote device to audibly communicate with the user of the device through the remote device and the device, by exchange of the remote audio and audio from the device.

19. The device of claim 16 , wherein the communication session is a video communication session and the operations further comprise:
obtain remote video from the remote device that is provided by the remote device as part of the communication session; and

Assignees

• Holm Michael
• Pan Jasper C
• Sorenson Ip Holdings Llc

Inventors

• Holm Michael
• Pan Jasper C

Classifications

• G10L15/18

  using natural language modelling · CPC title

• H04M7/0036

  where the data service is an information service · CPC title

• G10L15/26 Primary

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• H04M1/2535

  adapted for voice communication over an Internet Protocol [IP] network (Voice over Internet Protocol (VoIP) network equipment and services H04M7/006; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16) · CPC title

• G10L15/01

  Assessment or evaluation of speech recognition systems · CPC title