Method and system for data handling

Patent metadata

Field	Value
Publication number	US-11663237-B2
Application number	US-202117504912-A
Country	US
Kind code	B2
Filing date	Oct 19, 2021
Priority date	Apr 29, 2016
Publication date	May 30, 2023
Grant date	May 30, 2023

Abstract

A method of transferring data between database locations comprising: providing a location reference comprising location values of one or more data collections stored in a database; providing an indicator in association with at least one data collection of the one or more data collections, the indicator being provided in response to initiation of a transfer process of the at least one data collection from a first location of the database to a second location of the database; wherein the indicator is changeable between a first state and a second state, the first state being indicative of the initiation of the transfer process; and as part of the transfer process of the at least one data collection, selectively updating a location value of the at least one data collection in the location reference, in dependence on a determination of whether the indicator is in the first state or the second state.

First claim

The invention claimed is:

1. A method of migrating data between a first database location and a second database location of a computer implemented database, the method comprising:
storing in at least one memory in at least one server, a look-up table comprising respective location values of a plurality of data collections stored in said computer implemented database, wherein a respective location value indicates a respective first location within the computer implemented database where an associated data collection is stored, wherein when access to a respective data collection is required, a look up request is performed with respect to the look up table for the respective location value for said respective data collection;
providing at least a part of the look-up table to a first cache;
storing by at least one processor, in the look-up table which is stored in the at least one memory in said at least one server, an indicator for each of said data collections being migrated in response to initiation of a respective data migration process of one or more of said data collections from a respective first database location to a respective second database location, wherein the indicator indicates the initiation of the data migration process for a respective data collection;
causing information associated with the data collections being migrated to be removed from the at least a part of the look-up table in the first cache; and
at an end of a data migration process for a given data collection, determining if the location value of the given data collection in the look-up table which is stored in the at least one memory in said at least one server is to be updated to the second database.

2. The method of claim 1 , comprising receiving a look up request for a location of at least one data collection after said initiation of the respective data migration process has been initiated.

3. The method of claim 2 , comprising removing the indicator associated with the at least one data collection in response to receiving the look up request for the location of the at least one data collection.

4. The method as claimed in claim 2 , comprising determining based on a type of the look up request if a modification is to be made to said indicator.

5. The method as claimed in claim 4 , comprising when it is determined that that said indicator is to be modified, modifying the indicator by one of removing said indicator and changing the indicator to a different state to one which indicates the initiation of the data migration process for the given data collection.

6. The method as claimed in claim 4 , wherein said determining if a modification is to be made to said indicator is dependent on if the look up request is associated with a read or if the look up request is associated with a write.

7. The method as claimed in claim 6 , wherein the write request comprises a request to update at least part of the data associated with the one of the plurality of data collections being migrated, and wherein the read request comprises a request that does not update at least part of the data associated with the one of the plurality of data collections being migrated.

8. The method of claim 1 , wherein at least one indicator associated with the data collections being migrated is shared by one or more data collections.

9. The method as claimed in claim 8 , wherein for N data collections, M indicators are provided, wherein M is less than N, and wherein M is selected based on an expected frequency of look-up requests.

10. The method as claimed in claim 1 , wherein the first cache comprises one of a local cache and a global cache.

11. The method as claimed in claim 1 , wherein the first cache comprises a local cache and the method comprises providing at least a part of the look up table to a global cache.

12. The method of claim 1 , wherein in response to receiving the lookup request, routing the lookup request to the look-up table stored in the first cache.

13. The method of claim 1 , wherein the first cache is configured to delete data stored in the first cache after expiry of a predetermined time period, and wherein the method comprises copying one or more of the data collections being migrated from the respective first location to the respective second location, wherein the copying is performed after expiry of the predetermined time period.

14. The method of claim 1 , comprising causing at least a part of the look-up table to be stored in a global cache, wherein the lookup request is routed to the look-up table stored in the global cache in response to the look-up table stored in the first cache not having data necessary for fulfilling the lookup request.

15. The method of claim 11 , comprising causing removal of the respective location values associated with each of the data collections being migrated from the at least a part of the look-up table stored in the global cache in response to the initiation of the data migration process.

16. The method of claim 1 , comprising at the end of a data migration process for the given data collection, determining that the location value of the given data collection in the look-up table which is stored in the at least one memory in said at least one server is to be updated to indicate the second database if the look up table has an indicator indicating the initiation of the data migration process for the given data collection.

17. An apparatus comprising at least one memory and at least one processor, the at least one memory storing computer executable instructions which, when run by the at least one processor, cause the apparatus to:
store in the at least one memory, a look-up table comprising respective location values of a plurality of data collections stored in said computer implemented database, wherein a respective location value indicates a respective first location within the computer implemented database where an associated data collection is stored, wherein when access to a respective data collection is required, a look up request is performed with respect to the look up table for the respective location value for said respective data collection;
provide at least a part of the look-up table to a first cache;
store, in the look-up table, an indicator for each of said data collections being migrated in response to initiation of a respective data migration process of one or more of said data collections from a respective first database location to a respective second database location, wherein the indicator indicates the initiation of the data migration process for a respective data collection;
cause information associated with the data collections being migrated to be removed from the at least a part of the look-up table in the first cache; and
at an end of a data migration process for a given data collection, determine if the location value of the given data collection in the look-up table which is stored in the at least one memory in said at least one server is to be updated to the second database.

18. The apparatus of claim 17 , wherein the at least one processor causes the apparatus to receive a look up request for a location of at least one data collection after said initiation of the respective data migration process has been initiated.

19. The apparatus as claimed in claim 17 , wherein the first cache comprises one of a local cache and a global cache.

20. The apparatus as claimed in claim 17 , wherein the first cache comprises one of a local cache and a global cache.

21. The apparatus as cla

Assignees

• King Com Ltd

Inventors

• Persson Fredrik

Classifications

• G06F16/2315

  Optimistic concurrency control · CPC title

• G06F16/273 Primary

  Asynchronous replication or reconciliation · CPC title

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• G06F16/278 Primary

  Data partitioning, e.g. horizontal or vertical partitioning · CPC title

• G06F16/2379

  Updates performed during online database operations; commit processing · CPC title