Techniques for parallel data compression

Patent metadata

Field	Value
Publication number	US-9853660-B1
Application number	US-201715468061-A
Country	US
Kind code	B1
Filing date	Mar 23, 2017
Priority date	Mar 23, 2017
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

Techniques and apparatus for parallel data compression are described. An apparatus to provide parallel data compression may include at least one memory and logic for a compression component, at least a portion of the logic comprised in hardware coupled to the at least one memory, the logic to provide at least one data input sequence to a plurality of compression components, determine compression information for the plurality of compression components, and perform a compression process on the at least one data input sequence via the plurality of compression components to generate at least one data output sequence, the plurality of compression components to perform the compression process in parallel based on the compression information.

First claim

What is claimed is:

1. An apparatus to provide parallel data compression, the apparatus comprising:
a processor; and
a non-transitory, computer-readable storage medium in operable communication with the processor, wherein the computer-readable storage medium contains one or more programming instructions that, when executed, cause the processor to:
provide a first data input sequence to a plurality of compression components,
determine compression information for the plurality of compression components, and
perform a compression process on the first data input sequence via the plurality of compression components to generate at least one data output sequence, the plurality of compression components to perform the compression process in parallel based on the compression information.

2. The apparatus of claim 1 , the one or more programming instructions, when executed, to cause the processor to provide at least one second data input sequence to the plurality of compression components.

3. The apparatus of claim 1 , the compression process comprising one of an LZ77 compression process or a Deflate compression process.

4. The apparatus of claim 1 , the compression information comprising a compression level.

5. The apparatus of claim 1 , the compression information comprising a number of active compression components, a start offset, and a skip value.

6. The apparatus of claim 1 , at least a portion of the plurality of compression components to compress the first data input sequence at a different compression level.

7. The apparatus of claim 1 , the first data input sequence comprising a plurality of data input sequences.

8. The apparatus of claim 1 , the compression process comprising at least one of a parallel multi-sequence compression process and a parallel single-sequence compression process.

9. The apparatus of claim 1 , the one or more programming instructions, when executed, to cause the processor to receive a compression mode indicator to cause the compression process to switch between a parallel multi-sequence compression process and a parallel single-sequence compression process.

10. The apparatus of claim 1 , the one or more programming instructions, when executed, to cause the processor to provide a different sequence of a plurality of data input sequences to each of the plurality of compression components to perform a parallel multi-sequence compression process.

11. The apparatus of claim 1 , the one or more programming instructions, when executed, to cause the processor to provide a single data input sequence to each of the plurality of compression components to perform a parallel single-sequence compression process.

12. The apparatus of claim 1 , the plurality of compression components to generate a plurality of compression records.

13. The apparatus of claim 1 , the one or more programming instructions, when executed, to cause the processor to perform a lazy matching process on a plurality of compression records generated by the plurality of compression components.

14. The apparatus of claim 1 , the one or more programming instructions, when executed, to cause the processor to merge a plurality of compression records generated by the plurality of compression components to generate a single data output.

15. The apparatus of claim 1 , the one or more programming instructions, when executed, to cause the processor to provide a start position having a different offset value for each of the plurality of compression components.

16. The apparatus of claim 1 , the one or more programming instructions, when executed, to cause the processor to provide a skip value for each of the plurality of compression components.

17. A method to provide parallel data compression, the method comprising:
providing a first data input sequence to a plurality of compression components;
determining compression information for the plurality of compression components; and
performing a compression process on the first data input sequence via the plurality of compression components to generate at least one data output sequence, the plurality of compression components to perform the compression process in parallel based on the compression information.

18. The method of claim 17 , the compression process comprising one of an LZ77 compression process or a Deflate compression process.

19. The method of claim 17 , the compression information comprising a compression level.

20. The method of claim 17 , at least a portion of the plurality of compression components to compress the first data input sequence at a different compression level.

21. The method of claim 17 , the compression process comprising at least one of a parallel multi-sequence compression process and a parallel single-sequence compression process.

22. The method of claim 17 , comprising providing a different sequence of a plurality of data input sequences to each of the plurality of compression components to perform a parallel multi-sequence compression process.

23. The method of claim 17 , comprising providing a single data input sequence to each of the plurality of compression components to perform a parallel single-sequence compression process.

24. A computer-readable storage medium that stores instructions for execution by processing circuitry of a computing device for parallel compression, the instructions to cause the computing device to:
provide a first data input sequence to a plurality of compression components,
determine compression information for the plurality of compression components, and
perform a compression process on the first input sequence via the plurality of compression components to generate at least one data output sequence, the plurality of compression components to perform the compression process in parallel based on the compression information.

25. The computer-readable storage medium of claim 24 , the compression process comprising at least one of a parallel multi-sequence compression process and a parallel single-sequence compression process.

Assignees

• Intel Corp

Inventors

• Gopal Vinodh
• Yap Kirk S
• Cutter Daniel F
• Guilford James D
• Feghali Wajdi K

Classifications

• H03M7/3086 Primary

  employing a sliding window, e.g. LZ77 · CPC title

• H03M7/40

  Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code · CPC title

• H03M7/6023 Primary

  Parallelization · CPC title