Systems and methods for distributed quantization of multimodal images

Patent metadata

Field	Value
Publication number	US-2024283945-A1
Application number	US-202418426586-A
Country	US
Kind code	A1
Filing date	Jan 30, 2024
Priority date	Sep 30, 2016
Publication date	Aug 22, 2024
Grant date	—

Abstract

A system and method for implementing a distributed source coding quantization scheme is provided. In one example, two independent but statistically correlated data sources can be asymmetrically compressed so that one source is compressed at a higher ratio than the other. The resulting signals are transmitted and decoded by a receiver. The highly compressed source can utilize the non-highly compressed source as side information so as to minimize the compression loss associated with the higher compression ratio. A conditional codebook can be created that not only depends on the highly compressed quantizer, but also depends on the quantized symbol received from the non-highly compressed data source.

First claim

1 . A system configured to decode quantized signals, the system comprising:
a decoder, wherein the decoder is configured to:
receive a first quantized collection of bits, wherein the first quantized collection of bits is based on data acquired by a first data source, and wherein the first quantized collection of bits represents a compressed first file;
receive a second quantized collection of bits, wherein the second quantized collection of bits is based on data acquired by a second data source, wherein the first data source and second data source acquire data independently from one another, wherein the second quantized collection of bits represents a compressed second file, wherein an amount of compression of the compressed second file is greater than an amount of compression of the compressed first file, and wherein the data acquired by the first data source and the data acquired by the second data source are statistically correlated with respect to one another;
select a codeword from a first codebook based on the second received quantized collection of bits and the first received quantized collection of bits, wherein the first codebook is based on a second codebook and a relationship between the first quantized collection of bits and the second quantized collection of bits; and
reconstruct the data acquired by the second data source based on the received second quantized collection of bits and the selected codeword.

2 . The device of claim 1 , wherein the first codebook is generated during a training process, and wherein the training process comprises:
receiving a first training sequence, wherein the first training sequence is based on the first data source; generating the second codebook based on the received training sequence; receiving a second training sequence, wherein the second training sequence is based on the second data source; determining an initial codebook based on the second training sequence; determining a first optimized quantizer based on the initial codebook; determining a first optimized codebook based on the determined first optimized quantizer; determining a second optimized quantizer based on the determined first optimized codebook; determining a second optimized codebook based on the determined second optimized quantizer; and generating the first codebook based on the second optimized codebook.

3 . The device of claim 2 , wherein determining the initial codebook includes applying a Lloyd algorithm to the second training sequence.

4 . The device of claim 2 , wherein generating the second codebook includes applying a Lloyd algorithm to the first training sequence.

5 . The device of claim 2 , wherein the training process further comprises: converting the first training sequence into a first set of one or more image patches; and converting the second training sequence into a second set of or more image patches.

6 . The device of claim 1 , wherein the data acquired by the first source is transmitted at a higher rate than the data acquired by the second source.

7 . The device of claim 6 , wherein a number of bits of the first quantized collection of bits is greater than a number of bits of the second quantized collection of bits.

Assignees

• Mitre Corp

Inventors

• Taylor Jr Robert M
• Woodard Jeffrey P

Classifications

• H04N19/105

  Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title

• H04N19/157

  Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter · CPC title

• H04N19/124 Primary

  Quantisation · CPC title

• H04N19/463

  by compressing encoding parameters before transmission · CPC title