Automatic connection to a transcription system

Patent metadata

Field	Value
Publication number	US-10230842-B2
Application number	US-201715728384-A
Country	US
Kind code	B2
Filing date	Oct 9, 2017
Priority date	Mar 25, 2015
Publication date	Mar 12, 2019
Grant date	Mar 12, 2019

Abstract

Apparatuses and methods are disclosed for automatically connecting to a relay service and establish a captioning communication session during a call between a hearing-impaired user and a far-end user. The apparatus includes communication elements configured to receive captions from a relay service, and a processor configured to automatically connect to the relay service and establish a captioning communication session during a call responsive to a determination that a connection to the relay service failed during a time in which the hearing-impaired user desired captions to be enabled. A method includes determining captions are desired by the hearing-impaired user at a first time to be enabled for display to the communication device during a call, detecting a failed connection to the relay service at a second time, and automatically connecting with the relay service and establishing a new captioning communication session at a third time during the call.

First claim

What is claimed is:

1. A communication device comprising:
one or more non-transitory media configured to store instructions; and
a processor coupled to the one or more non-transitory media, the processor configured to execute instruction to cause the communication device to perform operations, the operations comprising:
establish a communication session with a remote device to communicate audio data there between during the communication session;
detect that captioning is enabled for the communication session based on a first user indication obtained by the communication device;
in response to the captioning being enabled, establish a captioning communication session between the communication device and a remote caption service;
receive text data from the remote caption service during the communication session based on the audio data communicated during the communication session;
detect an error in transmission of the audio data to the remote caption service during the captioning communication session, the error in transmission not in response to obtaining, at the communication device, a second user indication to disable captioning; and
while maintaining the communication session with the remote device and in response to determining the captioning communication session has been terminated, automatically establishing a second captioning communication session with the remote caption service.

2. The communication device of claim 1 , wherein the first user indication with the communication device occurs during the communication session.

3. The communication device of claim 1 , wherein the communication session is a video communication session.

4. The communication device of claim 1 , wherein detecting the error in transmission of the audio data to the remote caption service is based on detecting the error after sending a ping message to the remote caption service.

5. The communication device of claim 1 , wherein detecting the error in transmission of the audio data to the remote caption service is based on receiving a termination message from the remote caption service indicating that a call assistant at the remote caption service terminated the captioning communication session.

6. A method to provide captions, the method comprising:
establishing a communication session with a remote device to communicate audio data between the remote device and a communication device during the communication session;
detecting that captioning is enabled for the communication session based on a first user indication obtained by the communication device;
in response to the captioning being enabled, establishing a captioning communication session between the communication device and a remote caption service;
receiving text data from the remote caption service during the communication session based on the audio data communicated during the communication session;
detecting an error in transmission of the audio data to the remote caption service during the captioning communication session, the error in transmission not in response to obtaining, at the communication device, a second user indication to disable captioning; and
while maintaining the communication session with the remote device and in response to determining the captioning communication session has been terminated, automatically establishing a second captioning communication session with the remote caption service.

7. The method of claim 6 , wherein the first user indication with the communication device occurs during the communication session.

8. The method of claim 6 , wherein the communication session is a video communication session.

9. The method of claim 6 , wherein detecting the error in transmission of the audio data to the remote caption service is based on detecting the error after sending a ping message to the remote caption service.

10. The method of claim 6 , wherein detecting the error in transmission of the audio data to the remote caption service is based on receiving a termination message from the remote caption service indicating that a call assistant at the remote caption service terminated the captioning communication session.

11. One or more non-transitory computer readable media that includes instructions, which in response to being executed by one or more processors, cause a system to perform operations, the operations comprising the method of claim 6 .

12. A method to provide captions, the method comprising:
obtaining an initiation request to establish a communication session between a first device and a second device to direct first audio data from the first device to the second device and to direct second audio data from the second device to the first device;
establishing a first captioning communication session with a remote caption service;
during the first captioning communication session and the communication session, directing the second audio data to the remote caption service;
during the first captioning communication session and the communication session, obtaining, at the first device, first text data from the remote caption service, the first text data including a transcription of the second audio data;
determining, during the communication session and without termination of the communication session, that the first captioning communication session has been terminated, wherein the termination is not based on a request from the first device;
in response to the communication session continuing and the determination of the termination of the first captioning communication session that is not based on the request from the first device, automatically establishing a second captioning communication session with the remote caption service;
during the second captioning communication session and the communication session, directing the second audio data to the remote caption service;
during the second captioning communication session and the communication session, obtaining, at the first device, second text data from the remote caption service, the second text data including a transcription of the second audio data;
determining a termination of the communication session based on an indication from one or more of the first device and the second device;
in response to the termination of the communication session, terminating the second captioning communication session; and
after termination of the communication session and before termination of the second captioning communication session, continuing to obtain the second text data based on the second audio data.

13. The method of claim 12 , wherein the communication session is a video communication session.

14. The method of claim 12 , further comprising establishing the communication session between the first device and the second device.

15. The method of claim 12 , wherein establishing the first captioning communication session with the remote caption service is in response to establishing the communication session or obtaining the initiation request.

16. The method of claim 12 , further comprising detecting that captioning is enabled for the communication session based on a first user indication obtained by the first device.

17. One or more non-transitory computer readable media that includes instructions, that in response to being executed by one or more processors, cause a system to perform operations, the operations comprising the method of claim 12 .

18. The communication device of claim 1 , wherein the operations further comprise:
receive second text data from the remote caption service during the second captioning

Assignees

• Sorenson Ip Holdings Llc

Inventors

• Chevrier Brian
• Stimpson Michael S

Classifications

• H04M1/2475

  for a hearing impaired user · CPC title

• H04M11/10

  with dictation recording and playback systems · CPC title

• H04M2201/40

  using speech recognition · CPC title

• H04M7/0042

  where the data service is a text-based messaging service (H04M7/0054 takes precedence) · CPC title

• H04M1/72591

  Electricity · mapped topic