Managing scanning of databases in data storage systems

Patent metadata

Field	Value
Publication number	US-9569477-B1
Application number	US-98085310-A
Country	US
Kind code	B1
Filing date	Dec 29, 2010
Priority date	Dec 29, 2010
Publication date	Feb 14, 2017
Grant date	Feb 14, 2017

Abstract

A method, system, and program, product for managing scanning of databases in data storage system, the method comprising receiving a query request from an application server to a data storage system, scanning data stored in the data storage system and based on the query request, returning a set of data to the application server, wherein the set of data corresponds to the query request.

First claim

The invention claimed is:

1. A method for use in managing scanning of databases in data storage systems, the method comprising:
receiving a query request from an application server to a data storage system, wherein the application server includes a database logic, wherein the application server queries a set of databases based on the database logic, wherein the database logic includes a query planner and a query optimizer;
managing scanning of data within the data storage system instead of transferring the data to the application server for scanning by scanning data blocks stored in the data storage system within the data storage system, wherein the data blocks are organized on a set of logical volumes, wherein the set of databases is organized on the set of logical volumes, wherein the data storage system processes the data blocks associated with the query request inside the data storage system by using a scan processor and a data block retrieval logic included in the data storage system, wherein the data storage system uses information associated with the data blocks for processing the data blocks and creating a result set, wherein the scanning of the data blocks is performed inside the data storage system by the scan processor, wherein the data blocks are retrieved from the data storage system by using the data block retrieval logic in a cache of the data storage system, wherein the scan processor evaluates the data blocks retrieved by the data block retrieval logic in the cache for determining whether a subset of the data blocks corresponds to the query request, wherein the result set includes a portion of the data blocks processed by the data storage system;
storing information associated with the scanning of data blocks for optimizing subsequent query requests received from the application server, wherein the information associated with the scanning of the data blocks for optimizing subsequent query requests include data block processing patterns, wherein optimizing the subsequent query requests include scan optimizations, wherein the data storage system minimizes amount of data transferred to the application server in the result set by using the scan optimizations; and
based on the query request, the data storage system provides the result set to the application server, wherein the result set corresponds to the query request, wherein the result set includes the subset of the data blocks.

2. The method of claim 1 , further comprising storing information regarding scanning of data in the data storage system for optimizing processing of next query request from the application server.

3. The method of claim 1 , wherein a query request is targeted to a storage of a data storage system, wherein the storage is selected from the group consisting of a storage based on a data block, a storage based on a file and a storage based on an object.

4. The method of claim 1 , wherein scan processing logic is provided in the data storage system.

5. The method of claim 1 , wherein data retrieval logic is provided in the data storage system.

6. The method of claim 1 , wherein a database processing logic is provided in the data storage system, wherein the database processing logic allows partitioning of scanning of data.

7. The method of claim 1 , wherein the query request is selected from the group consisting of a query request based on a SQL, and a query request based on a map-reduce.

8. The method of claim 1 , wherein the application server executes an on line transaction processing (OLTP) applications.

9. The method of claim 1 , wherein scanning of data further comprising scanning one or more data sets in parallel, wherein data is partitioned into one or more data sets.

10. The method of claim 2 , wherein the information stored in the data storage system includes usage of data.

11. A system comprising:
a data storage system including at least one storage device;
an application server in communication with the data storage system; and
a computer-executable logic in communication with the data storage system and the application server for carrying out the steps of:
receiving a query request from the application server to the data storage system, wherein the application server includes a database logic, wherein the application server queries a set of databases based on the database logic, wherein the database logic includes a query planner and a query optimizer;
managing scanning of data within the data storage system instead of transferring the data to the application server for scanning by scanning data blocks stored in the data storage system within the data storage system, wherein the data blocks are organized on a set of logical volumes, wherein the set of databases is organized on the set of logical volumes, wherein the data storage system processes the data blocks associated with the query request inside the data storage system by using a scan processor and a data block retrieval logic included in the data storage system, wherein the data storage system uses information associated with the data blocks for processing the data blocks and creating a result set, wherein the scanning of the data blocks is performed inside the data storage system by the scan processor, wherein the data blocks are retrieved from the data storage system by using the data block retrieval logic in a cache of the data storage system, wherein the scan processor evaluates the data blocks retrieved by the data block retrieval logic in the cache for determining whether a subset of the data blocks corresponds to the query request, wherein the result set includes a portion of the data blocks processed by the data storage system;
storing information associated with the scanning of data blocks for optimizing subsequent query requests received from the application server, wherein the information associated with the scanning of the data blocks for optimizing subsequent query requests include data block processing patterns, wherein optimizing the subsequent query requests include scan optimizations, wherein the data storage system minimizes amount of data transferred to the application server in the result set by using the scan optimizations; and
based on the query request, the data storage system provides the result set to the application server, wherein the result set corresponds to the query request, wherein the result set includes the subset of the data blocks.

12. The system of claim 11 , wherein the data storage system stores information regarding scanning of data in the data storage system for optimizing processing of next query request from the application server.

13. The system of claim 11 , wherein scan processing logic is provided in the data storage system.

14. The system of claim 11 , wherein data retrieval logic is provided in the data storage system.

15. The system of claim 11 , wherein a database processing logic is provided in the data storage system, wherein the database processing logic allows partitioning of scanning of data.

16. The system of claim 11 , wherein the query request is selected from the group consisting of a query request based on a SQL, and a query request based on a map-reduce.

17. The system of claim 11 , wherein the application server executes an on line transaction processing (OLTP) applications.

18. The system of claim 11 , wherein scanning of data further comprising scanning one or more data sets in parallel, wherein data is partitioned into one or more data sets.

19. The system of claim 12 , wherein the information stored in the data storage sys

Assignees

• Mcsweeney Thomas J
• Hushon John D
• Rodriguez Humberto
• Todd Stephen J
• Mccann Peter J
• Emc Ip Holding Co Llc

Inventors

• Mcsweeney Thomas J
• Hushon John D
• Rodriguez Humberto
• Todd Stephen J
• Mccann Peter J

Classifications

• G06F17/30336 Primary

  Physics · mapped topic

• G06F16/24532 Primary

  of parallel queries · CPC title

• G06F16/2272 Primary

  Management thereof · CPC title