Network data management protocol restore using logical seek

Patent metadata

Field	Value
Publication number	US-2022091742-A1
Application number	US-202016951693-A
Country	US
Kind code	A1
Filing date	Nov 18, 2020
Priority date	Sep 24, 2020
Publication date	Mar 24, 2022
Grant date	—

Abstract

An information management system implements a media agent that communicates with a network area storage (NAS) device to receive secondary copy data that has been backed-up by the NAS. The secondary copy data may include primary data managed or maintained by the NAS. The secondary copy data may be in a proprietary format or other data format specific to the NAS. The NAS may prepare metadata or other information about the secondary copy data that informs the media agent as to the contents of the secondary copy data. The media agent may segment the secondary copy data into one or more backup chunks for storing in a secondary storage device. In addition, each of the backup chunks may be associated with backup chunk metadata, where the backup chunk metadata includes information that describes certain information stored by a corresponding backup chunk.

First claim

What is claimed is:

1 . A method comprising:
receiving, by a media agent being executed on a first computing device, a first request from a network attached storage device to read a first data block from secondary copy data from a secondary storage device, wherein:
the first request comprises:
a first logical offset that indicates a first location for locating the data block within the secondary copy data, wherein:
the first logical offset is determined relative to the secondary copy data, and
the secondary copy data was generated by the network attached storage device and transmitted to the media agent for storage at the secondary storage device, and

a first size indicating an amount of data to read starting from the logical offset; and
the secondary copy data has been segmented into a plurality of backup chunks stored within the secondary storage device, wherein each backup chunk has a predetermined size;
determining, based on the first logical offset of the first request, a backup chunk selected from the plurality of backup chunks corresponding to the first data block; determining a first physical offset at the secondary storage device to start reading the first data block from the determined backup chunk, wherein the determined first physical offset is associated with the first logical offset and is measured relative to the secondary storage device; reading from the first physical offset a second size of data from the determined backup chunk to obtain the first data block, wherein the second size of the data is determined based on the first size; and sending the obtained first data block to the network attached storage device, wherein the network attached storage device restores a first file based on the first data block.

2 . The method of claim 1 , wherein a control connection for receiving the first logical offset and first size is established by the media agent with the network attached storage device using Network Data Management Protocol (NDMP).

3 . The method of claim 1 , wherein a data connection is established by the media agent with the network attached storage device using NDMP for receiving the secondary copy data for storing in the secondary storage device.

4 . The method of claim 1 , wherein:
each backup chunk of the plurality of backup chunks is associated with corresponding backup chunk metadata generated by the media agent, wherein the backup chunk metadata comprises a plurality of logical offsets corresponding to the files represented by the secondary copy data; and determining the backup chunk selected from the plurality of backup chunks comprises reading the backup chunk metadata to determine the backup chunk that includes the first file.

5 . The method of claim 1 , further comprising:
receiving, from the network attached storage device, a file list comprising a file name corresponding to the first file and the first logical offset; and segmenting the plurality of backup chunks comprises updating backup chunk metadata with the first logical offset.

6 . The method of claim 1 , wherein the total size of the plurality of backup chunks is smaller than the total size of the secondary copy data being stored in the secondary storage device.

7 . The method of claim 1 , wherein:
each backup chunk of the plurality of backup chunks comprises one or more data segments, wherein at least one data segment of the one or more data segments is associated with a predetermined amount of the secondary copy data received from the network attached storage device; each backup chunk is associated with corresponding backup chunk metadata, and each backup chunk metadata includes at least:
a logical offset, received from the network attached storage device, that corresponds to a file stored in the secondary copy data;
a physical offset, corresponding to the logical offset, that indicates a location within a backup chunk for locating the at least one data segment; and
reading from the first physical offset comprises reading the physical offset stored in backup chunk metadata of the determined backup chunk.

8 . A system comprising:
one or more non-transitory computer-readable medium having computer-executable instructions stored thereon; and one or more processors that, having executed the computer-executable instructions, cause a system to perform a plurality of operations comprising:
receiving, by a media agent being executed on a first computing device, a first request from a network attached storage device to read a first data block from secondary copy data from a secondary storage device, wherein:
the first request comprises:
a first logical offset that indicates a first location for locating the first data block within the secondary copy data, wherein:
 the first logical offset is determined relative to the secondary copy data, and
 the secondary copy data was generated by the network attached storage device and transmitted to the media agent for storage at the secondary storage device, and

a first size indicating an amount of data to read starting from the logical offset; and
the secondary copy data has been segmented into a plurality of backup chunks stored within the secondary storage device, wherein each backup chunk has a predetermined size;

determining, based on the first logical offset of the first request, a backup chunk selected from the plurality of backup chunks corresponding to the first data block;
determining a first physical offset at the secondary storage device to start reading the first data block from the determined backup chunk, wherein the determined first physical offset is associated with the first logical offset and is measured relative to the secondary storage device;
reading from the first physical offset a second size of data from the determined backup chunk to obtain the first data block, wherein the second size of the data is determined based on the first size; and
sending the obtained first data block to the network attached storage device, wherein the network attached storage device restores a first file based on the first data block.

9 . The system of claim 8 , wherein a control connection for receiving the first logical offset and first size is established by the media agent with the network attached storage device using Network Data Management Protocol (NDMP).

10 . The system of claim 8 , wherein a data connection is established by the media agent with the network attached storage device using NDMP for receiving the secondary copy data for storing in the secondary storage device.

11 . The system of claim 8 , wherein:
each backup chunk of the plurality of backup chunks is associated with corresponding backup chunk metadata generated by the media agent, wherein the backup chunk metadata comprises a plurality of logical offsets corresponding to the files represented by the secondary copy data; and determining the backup chunk selected from the plurality of backup chunks comprises reading the backup chunk metadata to determine the backup chunk that includes the first data block.

12 . The system of claim 8 , wherein the plurality of operations further comprises:
receiving, from the network attached storage device, a file list comprising a file name corresponding to the first data block and the first logical offset; and segmenting the plurality of backup chunks comprises updating backup chunk metadata with the first logical offset.

13 . The system of claim 8 , wherein the total size of the plurality of backup chunks is smaller than the total size of the secondary copy data being stored in the secondary storage device.

14 . The s

Assignees

• Commvault Systems Inc

Inventors

• Littlefield Duncan Alden
• Arakkal Shali Sidharthan
• Bangaru Mounika
• Nannuri Ravinder Reddy
• Marella Chiranjeevi
• Mohanty Satya Narayan
• Lande Suhas T
• Joshi Hetalkumar N

Classifications

• G06F3/065 Primary

  Replication mechanisms · CPC title

• G06F3/0619

  in relation to data integrity, e.g. data losses, bit errors · CPC title

• G06F3/067

  Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS] · CPC title

• G06F11/1469

  Backup restoration techniques · CPC title

• G06F16/907 Primary

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title