Supporting random access of compressed data

Patent metadata

Field	Value
Publication number	US-11243836-B2
Application number	US-202016908686-A
Country	US
Kind code	B2
Filing date	Jun 22, 2020
Priority date	Jun 20, 2018
Publication date	Feb 8, 2022
Grant date	Feb 8, 2022

Abstract

A processing device comprising compression circuitry to: determine a compression configuration to compress source data; generate a checksum of the source data in an uncompressed state; compress the source data into at least one block based on the compression configuration, wherein the at least one block comprises: a plurality of sub-blocks, wherein the plurality of sub-block includes a predetermined size; a block header corresponding to the plurality of sub-blocks; and decompression circuitry coupled to the compression circuitry, wherein the decompression circuitry to: while not outputting a decompressed data stream of the source data: generate index information corresponding to the plurality of sub-blocks; in response to generating the index information, generate a checksum of the compressed source data associated with the plurality of sub-blocks; and determine whether the checksum of the source data in the uncompressed format matches the checksum of the compressed source data.

First claim

The invention claimed is:

1. An apparatus comprising:
a compression circuit to:
receive source data to compress according to a compression configuration,
generate a checksum of the source data in an uncompressed state, and
compress the source data into at least one block based on the compression configuration to generate compressed source data, wherein the at least one block comprises a plurality of sub-blocks, and each sub-block of the plurality of sub-blocks is to include a corresponding amount of data; and

a decompression circuit coupled to the compression circuit, wherein the decompression circuit is to:
generate index information corresponding to the plurality of sub-blocks,
in response to generating the index information, generate a checksum of the compressed source data associated with the plurality of sub-blocks, and
determine whether the checksum of the source data in the uncompressed state matches the checksum of the compressed source data.

2. The apparatus of claim 1 , wherein the decompression circuit is further to:
in response to determining that the checksum of the source data in the uncompressed state matches the checksum of the compressed source data, verify that the source data was properly compressed.

3. The apparatus of claim 1 , wherein the decompression circuit is further to:
in response to determining that the checksum of the source data in the uncompressed state does not match the checksum of the compressed source data, verify that the source data was not properly compressed.

4. The apparatus of claim 1 , wherein the decompression circuit is further to:
determine whether the source data was compressed into the at least one block based on the compression configuration.

5. The apparatus of claim 1 , wherein the at least one block is a Deflate block.

6. The apparatus of claim 1 , wherein the index information comprises a bit offset of each of the plurality of sub-blocks.

7. The apparatus of claim 1 , wherein the decompression circuit is further to:
generate a cumulative checksum of the compressed source data at a bit offset of each of the plurality of sub-blocks.

8. The apparatus of claim 1 , wherein a sub-block of the plurality of sub-blocks comprises history information for decompressing all data in the sub-block, the history information not including information for other sub-blocks of the plurality of sub-blocks.

9. The apparatus of claim 1 , wherein the decompression circuit is further to:
provide for access of a single sub-block of the plurality of sub-blocks by receiving a request for the single sub-block and decompressing the requested single sub-block while not decompressing other sub-blocks of the plurality of sub-blocks.

10. The apparatus of claim 1 , wherein the decompression circuit is to generate the index information corresponding to the plurality of sub-blocks while not outputting a decompressed data stream of the source data.

11. An apparatus comprising:
a core;
memory coupled to the core;
a compression circuit coupled to the core and the memory, the compression circuit to:
receive source data to compress according to a compression configuration,
generate a checksum of the source data in an uncompressed state, and
compress the source data into at least one block based on the compression configuration to generate compressed source data, wherein the at least one block comprises a plurality of sub-blocks, and each sub-block of the plurality of sub-blocks is to include a corresponding amount of data; and

a decompression circuit coupled to the compression circuit, the core and the memory, wherein the decompression circuit is to:
generate index information corresponding to the plurality of sub-blocks;
in response to generating the index information, generate a checksum of the compressed source data associated with the plurality of sub-blocks; and
determine whether the checksum of the source data in the uncompressed state matches the checksum of the compressed source data.

12. The apparatus of claim 11 , wherein the decompression circuit is further to:
in response to determining that the checksum of the source data in the uncompressed state matches the checksum of the compressed source data, verify that the source data was properly compressed.

13. The apparatus of claim 11 , wherein the decompression circuit is further to:
in response to determining that the checksum of the source data in the uncompressed state does not match the checksum of the compressed source data, verify that the source data was not properly compressed.

14. The apparatus of claim 11 , wherein the decompression circuit is further to:
determine whether the source data was compressed into the at least one block based on the compression configuration.

15. The apparatus of claim 11 , wherein the at least one block is a Deflate block.

16. The apparatus of claim 11 , wherein the index information comprises a bit offset of each of the plurality of sub-blocks.

17. The apparatus of claim 11 , wherein the decompression circuit is further to:
generate a cumulative checksum of the compressed source data at a bit offset of each of the plurality of sub-blocks.

18. The apparatus of claim 11 , wherein a sub-block of the plurality of sub-blocks comprises history information for decompressing all data in the sub-block, the history information not including information for other sub-blocks of the plurality of sub-blocks.

19. The apparatus of claim 11 , wherein the decompression circuit is further to:
provide for access of a single sub-block of the plurality of sub-blocks by receiving a request for the single sub-block and decompressing the requested single sub-block while not decompressing other sub-blocks of the plurality of sub-blocks.

20. The apparatus of claim 11 , wherein the decompression circuit is to generate the index information corresponding to the plurality of sub-blocks while not outputting a decompressed data stream of the source data.

21. A method comprising:
receiving source data to compress according to a compression configuration;
generating a checksum of the source data in an uncompressed state;
compressing the source data into at least one block based on the compression configuration to generate compressed source data, wherein the at least one block comprises a plurality of sub-blocks, and each sub-block of the plurality of sub-blocks includes a corresponding amount of data;
generating index information corresponding to the plurality of sub-blocks;
in response to generating the index information, generating a checksum of the compressed source data associated with the plurality of sub-blocks; and
determining whether the checksum of the source data in the uncompressed state matches the checksum of the compressed source data.

22. The method of claim 21 , further comprising:
in response to determining that the checksum of the source data in the uncompressed state matches the checksum of the compressed source data, verifying that the source data was properly compressed.

23. The method of claim 21 , further comprising:
determining whether the source data was compressed into the at least one block based on the compression configuration.

24. The method of claim 21 , further comprising:
generating a cumulative checksum of the compressed source data at a bit offset of each of the plurality of sub-blocks.

25. The method of claim 21 , wherein the generating the

Assignees

• Intel Corp

Inventors

• Gopal Vinodh
• Guilford James
• Cutter Daniel
• Yap Kirk

Classifications

• G06F16/1744

  using compression, e.g. sparse files · CPC title

• H03M7/3086 Primary

  employing a sliding window, e.g. LZ77 · CPC title

• G06F11/1004 Primary

  to protect a block of data words, e.g. CRC or checksum (G06F11/1076 takes precedence; security arrangements for protecting computers or computer systems against unauthorized activity G06F21/00) · CPC title

• H03M7/42

  using table look-up for the coding or decoding process, e.g. using read-only memory {(H03M7/4006 takes precedence)} · CPC title

• H03M7/40

  Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code · CPC title