Video content controller and associated method

Patent metadata

Field	Value
Publication number	US-12167070-B2
Application number	US-202217867601-A
Country	US
Kind code	B2
Filing date	Jul 18, 2022
Priority date	Jul 10, 2017
Publication date	Dec 10, 2024
Grant date	Dec 10, 2024

Abstract

A video content controller includes a memory and a microprocessor. The memory is configured to store non-transitory computer-readable instructions and video data representing a temporally-varying scene having a plurality of scene-regions. The microprocessor adapted to execute the instructions to (i) receive a current stream-segment of a video stream corresponding to a first scene-region of the plurality of scene-regions during a current playback-time interval, (ii) download, to a memory, a first video segment of a tagged scene-region within the first scene-region, (iii) receive a first display-region signal indicating at least one of a selection and a feature of the first scene-region, (iv) combine the current stream-segment and the first video segment as a video signal, and (vi) transmit, in response to the first display-region signal, the video signal to a display device.

First claim

What is claimed is:

1. A method for generating a video signal representing a temporally-varying scene having a plurality of scene-regions, comprising:
receiving, with a controller, a first segment of a video stream corresponding to a first scene-region of the plurality of scene-regions during a current playback-time interval;
receiving, with the controller, a second segment corresponding to a second scene-region within the first scene-region;
modifying, with the controller, the first segment with either composite metadata or interpolated metadata to generate a modified first segment, wherein the composite metadata is associated with an average of metadata over plurality of time segments, and wherein the interpolation metadata is associated with a blend of metadata over the plurality of time segments;
generating, with the controller, a combined signal by combining the modified first segment and the second segment, the combined signal including data corresponding to the first scene-region at a first image resolution and data corresponding to the second scene-region at a second image resolution different from the first image resolution; and
transmitting, with the controller and after combining the modified first segment and the second segment, the combined signal to a display device that displays the temporally-varying scene represented by the combined signal.

2. The method of claim 1 , wherein the first image resolution is lower than the second image resolution.

3. The method of claim 1 , further comprising:
stochastically determining, with the controller, an integer; and
repeating the operations, in claim 1 , of receiving, generating, and transmitting a number of times equal to the absolute value of the integer.

4. The method of claim 1 , further comprising, before generating:
modifying, with the controller, the second segment based on at least one of a visual effect or a metadata stored in a memory.

5. The method of claim 4 , further comprising downloading, with the controller, at least one of the metadata or the visual effect to the memory.

6. The method of claim 4 , the modifying being based on the stored metadata, and further comprising modifying, with the controller, at least one of luminance, chrominance, color histogram, brightness, contrast, gamma correction, saturation, or local spatial pixel or area context of the first segment.

7. The method of claim 1 , further comprising:
receiving, with the controller, a region signal from a user, and
determining, with the controller, an area of the second scene-region within the first scene-region based on the region signal.

8. The method of claim 7 , wherein the region signal indicates a field-of-view of the user or a change in the field-of-view of the user.

9. The method of claim 7 , wherein receiving the second segment includes retrieving, with the controller, video data corresponding to the second scene-region from a memory.

10. A non-transitory computer-readable-medium storing instructions that, when executed by a processor of a computer, cause the computer to perform operations comprising the method of claim 1 .

11. A video content controller comprising:
a memory; and
a microprocessor configured to:
receive a first segment of a video stream corresponding to a first scene-region of the plurality of scene-regions during a current playback-time interval,
receive a second segment corresponding to a second scene-region within the first scene-region,
modify the first segment with one of either composite metadata or interpolated metadata to generate a modified first segment, wherein the composite metadata is associated with an average of metadata over plurality of time segments, and wherein the interpolation metadata is associated with a blend of metadata over the plurality of time segments,
generate a combined signal by combining the modified first segment and the second segment, the combined signal including data corresponding to the first scene-region at a first image resolution and data corresponding to the second scene-region at a second image resolution different from the first image resolution, and
transmit, after combining the modified first segment and the second segment, the combined signal to a display device that displays the temporally-varying scene represented by the combined signal.

12. The video content controller of claim 11 , wherein the first image resolution is lower than the second image resolution.

13. The video content controller of claim 11 , wherein the microprocessor is further configured to:
stochastically determine an integer; and
repeating the operations of receiving, generating, and transmitting a number of times equal to the absolute value of the integer.

14. The video content controller of claim 11 , wherein the microprocessor is further configured to, before generating:
modify the second segment based on at least one of a visual effect or a metadata stored in the memory.

15. The video content controller of claim 14 , wherein the microprocessor is further configured to download at least one of the metadata or the visual effect to the memory.

16. The video content controller of claim 14 , wherein the microprocessor is configured to modify the second segment based on the stored metadata, and wherein the microprocessor is further configured to modify at least one of luminance, chrominance, color histogram, brightness, contrast, gamma correction, saturation, or local spatial pixel or area context of the
first segment.

17. The video content controller of claim 11 , wherein the microprocessor is further configured to:
receive a region signal from a user, and
determine an area of the second scene-region within the first scene-region based on the region signal.

18. The video content controller of claim 17 , wherein the region signal indicates a field-of-view of the user or a change in the field-of-view of the user.

19. The video content controller of claim 17 , wherein the microprocessor is configured to receive the second segment by retrieving video data corresponding to the second scene-region from the memory.

20. The video content controller of claim 11 , wherein the display device is separate from the video content controller.

Assignees

• Dolby Laboratories Licensing Corp

Inventors

• Kunkel Timo

Classifications

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• H04N21/4728 Primary

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title

• H04N21/47217

  for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312) · CPC title

• H04N13/366

  using viewer tracking · CPC title

• G06F3/16

  Sound input; Sound output (speech processing G10L) · CPC title