Distribution of sign language enhanced content

Patent metadata

Field	Value
Publication number	US-12374013-B2
Application number	US-202217735907-A
Country	US
Kind code	B2
Filing date	May 3, 2022
Priority date	May 5, 2021
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

A system for distributing sign language enhanced content includes a computing platform having processing hardware and a system memory storing a software code. The processing hardware is configured to execute the software code to receive content including at least one of a sequence of audio frames or a sequence of video frames, perform an analysis of the content, and identify, based on the analysis, a message conveyed by the content. The processing hardware is further configured to execute the software code to generate a sign language translation of the content, the sign language translation including one or more of a gesture, body language, or a facial expression communicating the message conveyed by the content.

First claim

What is claimed is:

1. A system comprising:
a computing platform including a processing hardware and a system memory storing a software code;
the processing hardware configured to execute the software code to:
receive content including at least one of a sequence of audio frames or a sequence of video frames;
perform an analysis of the content;
identify, based on the analysis, a message conveyed by the content;
generate a sign language translation of the content, the sign language translation including one or more of a gesture, body language, or a facial expression communicating the message;
broadcast or stream the sign language translation, over a first communication channel, to a remote client system for rendering on a first display of the remote client system; and
concurrently with broadcasting or streaming the sign language translation, broadcast or stream the content, over a second communication channel separate from the first communication channel, to the remote client system for rendering on a second display of the remote client system.

2. The system of claim 1 , wherein the content is rendered on the second display, concurrently with rendering a performance of the sign language translation on the first display.

3. The system of claim 1 , wherein a performance of the sign language translation is rendered using a digital character.

4. The system of claim 1 , wherein a performance of the sign language translation is rendered on the first display such that the sign language translation is visible to at least one, but not all of a plurality of users concurrently viewing the content on the first display.

5. The system of claim 1 , wherein the remote client system comprises an augmented reality (AR) viewer.

6. The system of claim 1 , wherein the content comprises digital representations that populate a virtual reality, augmented reality, or mixed reality environment.

7. The system of claim 1 , wherein the processing hardware is further configured to execute the software code to:
synchronize the sign language translation to one of a timecode of the content, the sequence of audio frames, or the sequence of video frames.

8. The system of claim 1 , wherein the processing hardware is further configured to execute the software code to:
generate the sign language translation dynamically during the broadcasting or the streaming of the content.

9. A method comprising:
receiving content including at least one of a sequence of audio frames or a sequence of video frames;
performing an analysis of the content;
identifying, based on the analysis, a message conveyed by the content;
generating a sign language translation of the content, the sign language translation including one or more of a gesture, body language, or a facial expression communicating the message;
broadcasting or streaming the sign language translation, over a first communication channel, to a remote client system for rendering on a first display of the remote client system; and
concurrently with broadcasting or streaming the sign language translation, broadcasting or streaming the content, over a second communication channel separate from the first communication channel, to the remote client system for rendering on a second display of the remote client system.

10. The method of claim 9 , further comprising:
rendering, concurrently with rendering the content on the second display, a performance of the sign language translation on the first display.

11. The method of claim 9 , wherein a performance of the sign language translation is rendered using a digital character.

12. The method of claim 9 , wherein the sign language translation is rendered on the first display such that the sign language translation is visible to at least one, but not all of a plurality of users concurrently viewing the content on the first display.

13. The method of claim 9 , wherein the remote client system comprises an augmented reality (AR) viewer.

14. The method of claim 9 , further comprising:
before rendering a performance of the sign language translation on the first display, synchronizing the sign language translation to one of a timecode of the content, the sequence of audio frames, or the sequence of video frames.

15. The method of claim 9 , wherein the content comprises digital representations that populate a virtual reality, augmented reality, or mixed reality environment.

16. The method of claim 9 , further comprising:
generating the sign language translation dynamically during the broadcasting or the streaming of the content.

Assignees

• Disney Entpr Inc

Inventors

• Arana Mark

Classifications

• H04N21/488

  Data services, e.g. news ticker {(systems specially adapted for using meteorological information in broadcast systems H04H60/71)} · CPC title

• H04N21/242

  Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)} · CPC title

• G10L25/57

  for processing of video signals · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G09B21/009 Primary

  Teaching or communicating with deaf persons (G09B21/04 takes precedence) · CPC title