Hardware acceleration for a compressed computation database

Patent metadata

Field	Value
Publication number	US-9858285-B2
Application number	US-201514702889-A
Country	US
Kind code	B2
Filing date	May 4, 2015
Priority date	Oct 3, 2014
Publication date	Jan 2, 2018
Grant date	Jan 2, 2018

Abstract

According to embodiments of the present invention, machines, systems, methods and computer program products for hardware acceleration are presented. A plurality of computational nodes for processing data is provided, each node performing a corresponding operation for data received at that node. A metric module is used to determine a compression benefit metric pertaining to performance of the corresponding operations of one or more computational nodes with recompressed data. An accelerator module recompresses data for processing by the one or more computational nodes based on the compression benefit metric indicating a benefit gained by using the recompressed data. A distribution function may be used to distribute data among a plurality of nodes.

First claim

What is claimed is:

1. A method of processing data using a plurality of computational nodes, each node performing a corresponding operation in a data flow for data received at that node, wherein each node is implemented by a first processor and utilizes second special-purpose processor, and said method comprising:
determining, via the first processor, a compression benefit metric pertaining to performance of the corresponding operations of one or more of said plurality of computational nodes in the data flow with recompressed data, wherein determining a compression benefit metric further determines a priority for recompressing data based on the compression benefit metric;
recompressing the data according to the priority, via the second special-purpose processor, for processing by the one or more computational nodes in the data flow based on the compression benefit metric indicating a benefit in processing performance gained by using the recompressed data for computational operations; and
performing the corresponding operation using the recompressed data, via the first processor, to provide the benefit in processing performance.

2. The method of claim 1 , wherein the compression benefit metric is determined using one or more of the following:
(a) a measure of data compression preserved by one or more destination computational nodes;
(b) a measure of an estimated reduction in a size of the data resulting from recompression;
(c) a measure of an estimated computational benefit from a destination node performing an operation on recompressed data; and
(d) a measure of a computational benefit of a destination node performing an operation on data in a particular compressed form.

3. The method of claim 1 , wherein one or more of said plurality of computational nodes process data without recompression in response to data awaiting recompression by the second special-purpose processor and being unavailable for processing.

4. The method of claim 1 , further comprising:
decompressing compressed data via the second special-purpose processor; and
compressing the decompressed data and producing recompressed data via the second special-purpose processor.

5. The method of claim 1 , wherein a plurality of processors interconnected by a network are utilized to process data in parallel, and said method further comprising:
applying a distribution function to distribute data among the plurality of processors;
compressing data prior to transmission to the plurality of processors; and
compressing data received from the plurality of processors.

6. The method of claim 1 , wherein the second special-purpose processor includes a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC) to recompress the data.

Assignees

• IBM

Inventors

• Dickie Garth A
• Sporer Michael
• Viehland Jason A

Classifications

• G06F17/30303

  Physics · mapped topic

• G06F17/30153 Primary

  Physics · mapped topic

• G06F17/30371

  Physics · mapped topic

• G06F16/215

  Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors · CPC title

• G06F16/2365

  Ensuring data consistency and integrity · CPC title