Offloading client-side deduplication operations using a data processing unit

Patent metadata

Field	Value
Publication number	US-2024256491-A1
Application number	US-202318160148-A
Country	US
Kind code	A1
Filing date	Jan 26, 2023
Priority date	Jan 26, 2023
Publication date	Aug 1, 2024
Grant date	—

Abstract

Embodiments for performing the inline deduplication by filtering streaming data as it is received by a backup client through a backup server executing a backup process. A data processing unit (DPU) is deployed to offload certain processing operations performed by a central processing unit (CPU) of the backup client. An inline deduplication operation comprises file operations, data segmentation, segment fingerprinting, compression, and encryption prior to storage in a backup target. The DPU is deployed and configured to perform the compression and encryption steps, the entire inline deduplication stack, or the entire inline deduplication stack plus the file system operations.

First claim

What is claimed is:

1 . A computer-implemented method of optimizing client-side inline deduplication of backup data, comprising:
performing the inline deduplication by filtering streaming data as it is received by a backup client through a backup server executing a backup process; performing, in a central processing unit (CPU) of the backup client, a segmentation process to determine where to break the streaming data into a plurality of segments; calculating, in the CPU, a reference for each segment of the plurality of segments; deploying a data processing unit (DPU) functionally coupled to the CPU to perform at least some of the processing performed by the CPU; compressing, in the DPU, each segment; and encrypting, in the DPU, each compressed segment.

2 . The method of claim 1 further comprising storing the encrypted and compressed segments in a storage device coupled to the CPU and DPU.

3 . The method of claim 1 wherein the reference comprises a fingerprint of data calculated using a secure hash algorithm (SHA).

4 . The method of claim 1 wherein the backup process is executed by a data storage server running a Data Domain File System (DDFS).

5 . The method of claim 1 wherein the DPU comprises a hardware compression and encryption accelerator component, and the CPU comprises data buffers, reference buffers, segment buffers executing a distributed segment processing send file loop.

6 . The method of claim 5 wherein the backup client utilizes a Data Domain (DD) Boost application program interface (API) to access a DD Boost library to perform the segmentation and the reference calculating steps.

7 . A computer-implemented method of optimizing client-side inline deduplication of backup data, comprising:
performing the inline deduplication by filtering streaming data as it is received by a backup client through a backup server executing a backup process; deploying a data processing unit (DPU) functionally coupled to the CPU to perform at least some of the processing performed by the CPU; performing, in DPU, a segmentation process to determine where to break the streaming data into a plurality of segments; calculating, in the DPU, a reference for each segment of the plurality of segments; compressing, in the DPU, each segment; and encrypting, in the DPU, each compressed segment.

8 . The method of claim 7 further comprising storing the encrypted and compressed segments in a storage device coupled to the CPU and DPU.

9 . The method of claim 7 wherein the reference comprises a fingerprint of data calculated using a secure hash algorithm (SHA).

10 . The method of claim 9 wherein the DPU comprises data buffers, reference buffers, segment buffers executing a distributed segment processing send file loop and further comprises a hardware compression and encryption accelerator component, and a checksum SHA hash accelerator component.

11 . The method of claim 7 wherein the backup process is executed by a data storage server running a Data Domain File System (DDFS).

12 . The method of claim 11 wherein the CPU comprises a DD protocol layer managing client resources and translating backend processing into application consumable application program interfaces (APIs).

13 . The method of claim 12 wherein the DPU utilizes a Data Domain (DD) Boost application program interface (API) to access a DD Boost library to perform the segmentation and the reference calculating steps.

14 . A computer-implemented method of optimizing client-side inline deduplication of backup data, comprising:
deploying a Data Domain (DD) Boost file system (FS) interface (API) to access a DD Boost library on a host computer hosting one or more applications generating the backup data; deploying a data processing unit (DPU) functionally coupled to the CPU to perform at least some of the processing performed by the CPU; performing, in the DPU, one or more filesystem operations accessing the backup data through the DD Boost API; performing, in DPU, a segmentation process to determine where to break the streaming data into a plurality of segments; calculating, in the DPU, a reference for each segment of the plurality of segments; compressing, in the DPU, each segment; and encrypting, in the DPU, each compressed segment.

15 . The method of claim 14 further comprising storing the encrypted and compressed segments in a storage device coupled to the host computer and DPU.

16 . The method of claim 14 wherein the reference comprises a fingerprint of data calculated using a secure hash algorithm (SHA).

17 . The method of claim 14 wherein the DPU comprises data buffers, reference buffers, segment buffers executing a distributed segment processing send file loop and further comprises a hardware compression and encryption accelerator component, and a checksum SHA hash accelerator component.

18 . The method of claim 17 wherein the host further comprises a DD protocol layer managing client resources and translating backend processing into application consumable application program interfaces (APIs).

19 . The method of claim 18 wherein the backup process is executed by a data storage server running a Data Domain File System (DDFS).

20 . The method of claim 19 wherein the DPU further a Data Domain (DD) Boost application program interface (API) to access the DD Boost library and DD Boost FS to process the backup data of the application programs.

Assignees

• Dell Products Lp

Inventors

• Bhanjois Bhimsen
• Lewis Donna Barry
• Vinod Chegu

Classifications

• G06F11/1456

  Hardware arrangements for backup · CPC title

• G06F11/1464

  for networked environments · CPC title

• G06F11/1453

  using de-duplication of the data · CPC title

• G06F16/1752 Primary

  based on file chunks · CPC title

• G06F16/137 Primary

  Hash-based (content-based indexing of textual data G06F16/31) · CPC title