Embedding codebooks for resource optimization

Patent metadata

Field	Value
Publication number	US-11893007-B2
Application number	US-202117369527-A
Country	US
Kind code	B2
Filing date	Jul 7, 2021
Priority date	Oct 19, 2017
Publication date	Feb 6, 2024
Grant date	Feb 6, 2024

Abstract

Embodiments of the present disclosure provide systems, methods, and computer storage media for optimizing computing resources generally associated with cloud-based media services. Instead of decoding digital assets on-premises to stream to a remote client device, an encoded asset can be streamed to the remote client device. A codebook employable for decoding the encoded asset can be embedded into the stream transmitted to the remote client device, so that the remote client device can extract the embedded codebook, and employ the extracted codebook to decode the encoded asset locally. In this way, not only are processing resources associated with on-premises decoding eliminated, but on-premises storage of codebooks can be significantly reduced, while expensive bandwidth is freed up by virtue of transmitting a smaller quantity of data from the cloud to the remote client device.

First claim

What is claimed is:

1. A computer-implemented method for offloading decoding resources to remote client devices, comprising:
training a codebook based on a set of digital assets, the codebook being trained to decode at least an encoded portion of a first digital asset in the set of digital assets;
transmitting at least a first data stream to a remote client device, the first data stream including the encoded portion of the first digital asset; and
embedding the codebook into at least the first data stream as the first data stream is transmitted such that the codebook itself is amortized over a duration of the first data stream, wherein the remote client device is configured to employ one or more received portions of the amortized codebook to decode the encoded portion of the first digital asset as the encoded portion is received via the first data stream.

2. The method of claim 1 , wherein the set of digital assets is associated with a usage history of the remote client device.

3. The method of claim 1 , wherein the set of digital assets is associated with a user preference associated with the remote client device.

4. The method of claim 1 , wherein each digital asset of the set of digital assets includes one of a set of different representations of a common content.

5. The method of claim 1 , wherein each digital asset of the set of digital assets includes one of a set of different pieces of content, each piece of content of the set of different pieces of content having at least one common asset characteristic.

6. The method of claim 1 , wherein a second data stream including at least an encoded portion of a second digital asset in the set of digital assets is transmitted to the remote client device.

7. The method of claim 6 , wherein the remote client device is configured to employ the one or more received portions of the amortized codebook to decode the encoded portion of the second digital asset as the encoded portion of the second digital asset is received via the second data stream.

8. The method of claim 1 , wherein the codebook is embedded into at least the first data stream based on a determination that the codebook itself has not been previously transmitted to the remote client device.

9. The method of claim 1 , wherein the first data stream corresponds to a channel selected from a plurality of channels.

10. A computer-implemented method for offloading decoding resources to remote client devices comprising:
receive at least a first data stream transmitted from a remote computing device, wherein a codebook that was generated based at least in part on an encoding of at least a portion of a first digital asset is embedded into at least the first data stream during transmission thereof such that the codebook itself is amortized over a duration of the first data stream;
reconstruct at least a portion of the amortized codebook based at least in part on a received portion of the first data stream; and
employ at least the reconstructed portion of the amortized codebook to decode at least a portion of the first digital asset received via the first data stream.

11. The method of claim 10 , wherein the codebook was generated based further in part on an encoding of a second digital asset.

12. The method of claim 11 , wherein the second digital asset is included in a second data stream transmitted from the remote computing device, and the reconstructed portion of the codebook is employable to decode at least a portion of the first digital asset and the second digital asset.

13. The method of claim 10 , wherein the codebook was generated based further in part on an encoding of a second digital asset having content that is different than the first digital asset and at least one asset characteristic that is similar to the first digital asset.

14. The method of claim 10 , wherein the codebook is embedded into at least the first data stream and a second data stream being transmitted from the remote computing device, and at least the portion of the amortized codebook is reconstructed based at least in part on a received portion of the first data stream and a received portion of the second data stream.

15. The method of claim 10 , further comprising:
determine that the reconstructed portion of the codebook is employable to decode at least a portion of a second digital asset received via a second data stream transmitted from the remote computing device; and
employ the reconstructed portion of the codebook to decode at least a portion of the second digital asset.

16. The method of claim 10 , wherein the amortized codebook includes a modification to a locally-stored codebook, and at least the portion of the amortized codebook is reconstructed based on the locally-stored codebook and the received portion of the first data stream.

17. A computer-implemented method for offloading decoding resources to remote client devices, comprising:
training a codebook based on a set of digital assets associated with a usage history of a remote client device, the codebook being trained to decode at least an encoded portion of a first digital asset having at least one asset characteristic in common with the set of digital assets;
transmitting at least a first data stream to the remote client device, the first data stream including the encoded portion of the first digital asset; and
embedding the codebook into at least the first data stream as at least the first data stream is transmitted such that the codebook itself is amortized over a duration of the first data stream, wherein the remote client device is configured to employ one or more received portions of the amortized codebook to decode the encoded portion of the first digital asset as the encoded portion is received via the first data stream.

18. The method of claim 17 , wherein the set of digital assets is selected from a plurality of digital assets based on the usage history of the remote client device.

19. The method of claim 18 , wherein the usage history includes a history of digital assets accessed via the remote client device.

20. The method of claim 18 , wherein the set of digital assets is further associated with a set of user preferences associated with the remote client device and the set of digital assets is selected from the plurality of digital assets based further on the set of user preferences.

Assignees

• Adobe Inc

Inventors

• Swaminathan Viswanathan
• Mitra Saayan

Classifications

• G06F16/2365 Primary

  Ensuring data consistency and integrity · CPC title

• G06F16/5862

  using texture · CPC title

• H03M7/30

  Compression (speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N); Expansion; Suppression of unnecessary data, e.g. redundancy reduction · CPC title

• H03M7/6088 Primary

  according to the data type · CPC title

• H04N21/21

  Server components or server architectures · CPC title