Systems and methods for distributed quantization of multimodal images

Patent metadata

Field	Value
Publication number	US-2018097557-A1
Application number	US-201615282830-A
Country	US
Kind code	A1
Filing date	Sep 30, 2016
Priority date	Sep 30, 2016
Publication date	Apr 5, 2018
Grant date	—

Abstract

A system and method for implementing a distributed source coding quantization scheme is provided. In one example, two independent but statistically correlated data sources can be asymmetrically compressed so that one source is compressed at a higher ratio than the other. The resulting signals are transmitted and decoded by a receiver. The highly compressed source can utilize the non-highly compressed source as side information so as to minimize the compression loss associated with the higher compression ratio. A conditional codebook can be created that not only depends on the highly compressed quantizer, but also depends on the quantized symbol received from the non-highly compressed data source.

First claim

What is claimed is:

1 . An electronic device configured to decode quantized signals, the device comprising:
a first decoder, wherein the first decoder is configured to:
receive a first quantized collection of bits, wherein the first quantized collection of bits is based on data acquired by a first data source;
select a first codeword from a first codebook based on the first received quantized collection of bits; and
reconstruct the data acquired by the first data source using the selected first codeword; and
a second decoder, wherein the second decoder is configured to:
receive a second quantized collection of bits, wherein the second quantized collection of bits is based on data acquired by a second data source, and wherein the data acquired by the first data source and the data acquired by the second data source are related; and
select a codeword from a second codebook based on the second received quantized collection of bits and the first received quantized collection of bits, wherein the second codebook is based on the first codebook and a relationship between the first quantized collection of bits and the second quantized collection of bits.

2 . The device of claim 1 , wherein the second codebook is generated during a training process, and wherein the training process comprises:
receiving a first training sequence, wherein the first training sequence is based on the first data source; generating the first codebook based on the received training sequence; receiving a second training sequence, wherein the second training sequence is based on the second data source; determining an initial codebook based on the second training sequence; determining a first optimized quantizer based on the initial codebook; determining a first optimized codebook based on the determined first optimized quantizer; determining a second optimized quantizer based on the determined first optimized codebook; determining a second optimized codebook based on the determined second optimized quantizer; and generating the second codebook based on the second optimized codebook and the second optimized codebook.

3 . The device of claim 2 , wherein determining the initial codebook includes applying a Lloyd algorithm to the second training sequence.

4 . The device of claim 2 , wherein generating the first codebook includes applying a Lloyd algorithm to the first training sequence.

5 . The device of claim 2 , wherein the training process further comprises:
converting the first training sequence into a first set of one or more image patches; and converting the second training sequence into a second set of or more image patches.

6 . The device of claim 1 , wherein the data acquired by the first source is transmitted at a higher rate than the data acquired by the second source.

7 . The device of claim 6 , wherein a number of bits of the first quantized collection of bits is greater than a number of bits of the second quantized collection of bits.

8 . A method for creating a conditional codebook, the method comprising:
receiving a first training sequence, wherein the first training sequence is based on a first data source; generating a first codebook based on the received first training sequence; receiving a second training sequence, wherein the second training sequence is based on a second data source; determining an initial codebook based on the second training sequence; determining a first optimized quantizer based on the initial codebook; determining a first optimized codebook based on the determined first optimized quantizer; determining a second optimized quantizer based on the determined first optimized codebook; determining a second optimized codebook based on the determined second optimized quantizer; and generating the second codebook based on the second optimized codebook and the second optimized codebook.

9 . The method of claim 8 , wherein the first data source and the second data source are statistically correlated.

10 . The method of claim 9 , wherein determining the initial codebook includes applying a Lloyd algorithm to the second training sequence.

11 . The method of claim 9 , wherein generating the first codebook includes applying a Lloyd algorithm to the first training sequence.

12 . The method of claim 9 , wherein the method comprises:
converting the first training sequence into a first set of one or more image patches; and converting the second training sequence into a second set of or more image patches.

13 . The method of claim 8 , wherein the data acquired by the first source is transmitted at a higher rate than the data acquired by the second source.

14 . The method of claim 13 , wherein a number of bits of the first quantized collection of bits is greater than a number of bits of the second quantized collection of bits.

15 . A method for decoding quantized signals, the method comprising:
receiving a first quantized collection of bits, wherein the first quantized collection of bits is based on data acquired by a first data source; selecting a first codeword from a first codebook based on the first received quantized collection of bits; reconstructing the data acquired by the first data source using the selected first codeword; receiving a second quantized collection of bits, wherein the second quantized collection of bits is based on data acquired by a second data source, and wherein the data acquired by the first data source and the data acquired by the second data source are related; and selecting a codeword from a second codebook based on the second received quantized collection of bits and the first received quantized collection of bits, wherein the second codebook is based on the first codebook and a relationship between the first quantized collection of bits and the second quantized collection of bits.

16 . The method of claim 1 , wherein the second codebook is generated during a training process, and wherein the training process comprises:
receiving a first training sequence, wherein the first training sequence is based on the first data source; generating the first codebook based on the received training sequence; receiving a second training sequence, wherein the second training sequence is based on the second data source; determining an initial codebook based on the second training sequence; determining a first optimized quantizer based on the initial codebook; determining a first optimized codebook based on the determined first optimized quantizer; determining a second optimized quantizer based on the determined first optimized codebook; determining a second optimized codebook based on the determined second optimized quantizer; and generating the second codebook based on the second optimized codebook and the second optimized codebook.

17 . The method of claim 16 , wherein determining the initial codebook includes applying a Lloyd algorithm to the second training sequence.

18 . The method of claim 16 , wherein generating the first codebook includes applying a Lloyd algorithm to the first training sequence.

19 . The method of claim 16 , wherein the training process further comprises:
converting the first training sequence into a first set of one or more image patches; and converting the second training sequence into a second set of or more image patches.

20 . The method of claim 15 , wherein the data acquired by the first source is transmitted at a higher rate than the data acquired by the second source.

Assignees

• Mitre Corp

Inventors

• Taylor Jr Robert M
• Woodard Jeffrey P

Classifications

• H04N19/157

  Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter · CPC title

• H04N19/179

  the unit being a scene or a shot · CPC title

• H04N19/13

  Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC] · CPC title

• H04N19/463

  by compressing encoding parameters before transmission · CPC title

• H04N19/132

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title