Accessibility enhanced content rendering

Patent metadata

Field	Value
Publication number	US-11936940-B2
Application number	US-202217735935-A
Country	US
Kind code	B2
Filing date	May 3, 2022
Priority date	May 5, 2021
Publication date	Mar 19, 2024
Grant date	Mar 19, 2024

Abstract

A user system for rendering accessibility enhanced content includes processing hardware, a display, and a memory storing software code. The processing hardware executes the software code to receive primary content from a content distributor and determine whether the primary content is accessibility enhanced content including an accessibility track. When the primary content omits the accessibility track, the processing hardware executes the software code to perform a visual analysis, an audio analysis, or both, of the primary content, generate, based on the visual analysis and/or the audio analysis, the accessibility track to include at least one of a sign language performance or one or more video tokens configured to be played back during playback of the primary content, and synchronize the accessibility track to the primary content. The processing hardware also executes the software code to render, using the display, the primary content or the accessibility enhanced content.

First claim

What is claimed is:

1. A user system comprising:
a processing hardware;
a display, and
a memory storing a software code;
the processing hardware configured to execute the software code to:
receive, from a content distributor, a primary content;
determine whether the primary content is an accessibility enhanced content that includes an accessibility track;
wherein when the primary content is determined to not include the accessibility track:
perform at least one of a visual analysis or an audio analysis of the primary content;
generate, based on the at least one of the visual analysis or the audio analysis, the accessibility track comprising at least one of (i) a sign language performance, or (ii) at least one video token configured to be played back during playback of the primary content; and
synchronize the accessibility track to the primary content; and

render, using the display, at least one of the primary content or the accessibility enhanced content that includes the primary content and the accessibility track synchronized to the primary content.

2. The user system of claim 1 , wherein the sign language performance is performed using an animated model, and wherein the accessibility track further comprises an emotive data set utilized to control the animated model to perform emotions or gestures.

3. The user system of claim 1 , wherein rendering the accessibility enhanced content comprises displaying, using the display, the at least one of the sign language performance or the at least one video token of the accessibility track as a picture-in-picture (PiP) overlay on the primary content, and wherein the PiP overlay is configured to be repositioned or toggled on or off based on a user selection.

4. The user system of claim 1 , wherein when the accessibility track comprises the at least one video token, the processing hardware is further configured to execute the software code to:
play back the at least one video token in response to a playback status of the primary content; and
transmit or receive the playback status of the primary content over the network interface.

5. The user system of claim 1 , wherein the sign language performance is performed using an animated model, and wherein the animated model changes orientation during a scene to appear as facing a camera.

6. The user system of claim 1 , wherein the accessibility track further comprises one or more haptic effects configured to be actuated when the primary content reaches a playback location corresponding to each of the one or more haptic effects.

7. The user system of claim 1 , wherein the processing hardware is further configured to execute the software code to render the accessibility track on the display such that a content of the accessibility track is visible to at least one, but not all of a plurality of users concurrently viewing the primary content on the display.

8. The user system of claim 1 , wherein the user system is communicatively coupled to a personal device, and wherein the processing hardware is further configured to execute the software code to:
transmit, concurrently with rendering the primary content on the display, the accessibility track to the personal device for rendering on the personal device.

9. The user system of claim 2 , wherein the emotions and the gestures include facial expressions.

10. A method for use by a user system including a processing hardware, a display, and a system memory storing a software code, the method comprising:
receiving, by the software code executed by the processing hardware, from a content distributor, a primary content;
determining, by the software code executed by the processing hardware, whether the primary content is an accessibility enhanced content that includes an accessibility track;
wherein when the primary content is determined to not include the accessibility track the method further comprises:
performing, by the software code executed by the hardware processor, at least one of a visual analysis or an audio analysis of the primary content;
generating, by the software code executed by the hardware processor based on the at least one of the visual analysis or the audio analysis, the accessibility track comprising at least one of (i) a sign language performance, or (ii) at least one video token configured to be played back during playback of the primary content, and
synchronizing, by the software code executed by the processing hardware, the accessibility track to the primary content; and

rendering, by the software code executed by the processing hardware and using the display, at least one of the primary content or the accessibility enhanced content that includes the primary content and the accessibility track.

11. The method of claim 10 , wherein the sign language performance is performed using an animated model, and wherein the accessibility track further comprises an emotive data set utilized to control the animated model to perform emotions or gestures.

12. The method of claim 10 , wherein rendering the accessibility enhanced content comprises displaying, using the display, the at least one of the sign language performance or the at least one video token as a picture-in-picture (PiP) overlay on the primary content, and wherein the PiP overlay is configured to he repositioned or toggled on or off based on a user selection.

13. The method of claim 10 , wherein when the accessibility track comprises the at least one video token, the method further comprises:
playing back the at least one video token, by the software code executed by the processing hardware, in response to a playback status of the primary content; and
transmitting or receiving, by the software code executed by the processing hardware, the playback status of the primary content over the network interface.

14. The method of claim 10 , wherein the sign language performance is performed using an animated model, and wherein the animated model changes orientation during a scene to appear as facing a camera.

15. The method of claim 10 , wherein the accessibility track further comprises one or more haptic effects configured to be actuated when the primary content reaches a playback location corresponding to each of the one or more haptic effects.

16. The method of claim 10 , wherein rendering the accessibility track on the display comprises rendering the accessibility track such that a content of the accessibility track is visible to at least one, but not all of a plurality of users concurrently viewing the primary content on the display.

17. The method of claim 10 , wherein the user system is communicatively coupled to a personal device, the method further comprising:
transmitting concurrently with rendering the primary content on the display, by the software code executed by the processing hardware, the accessibility track to the personal device for rendering on the personal device.

18. The method of claim 11 , wherein the emotions and the gestures include facial expressions.

19. A method for use by a user system including a processing hardware, a display, and a system memory storing a software code, the method comprising:
receiving, by the software code executed by the processing hardware, from a content distributor, a primary content;
determining, by the software code executed by the processing hardware, whether the primary content is an accessibility enhanced content that includes an accessibility track;
wherein when the primary content is determined to not include the accessibility track, the method further comp

Assignees

• Disney Entpr Inc

Inventors

• Arana Mark
• Navarre Katherine S
• Radford Michael A
• Rice Joseph S
• Vasquez Noel Brandon

Classifications

• H04N21/4316 Primary

  for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window · CPC title

• G06T13/40

  of characters, e.g. humans, animals or virtual beings · CPC title

• G06T13/80

  Two-dimensional [2D] animation, e.g. using sprites · CPC title

• G09B21/009

  Teaching or communicating with deaf persons (G09B21/04 takes precedence) · CPC title

• G11B27/10

  Indexing; Addressing; Timing or synchronising; Measuring tape travel · CPC title