Systems and methods for generating and processing secure search queries

Patent metadata

Field	Value
Publication number	US-11080422-B2
Application number	US-201916375721-A
Country	US
Kind code	B2
Filing date	Apr 4, 2019
Priority date	Mar 12, 2019
Publication date	Aug 3, 2021
Grant date	Aug 3, 2021

Abstract

Generating a first signature value corresponding to a first dataset stored in a first data region having a first access permission level. Determining a signature anonymization value. Truncating the first signature value based on the signature anonymization value. Generating a secure search query for identifying, based on the truncated first signature value, second signature values corresponding to entries of a second dataset stored in one or more second data regions having one or more second access permission levels. Receiving a response to the secure search query including the plurality of second signature values. Determining the entries of the second dataset from the second signature values. Comparing the respective entries of the second dataset to the at least a portion of the first dataset. Generating one or more notifications based on the comparisons indicating a potential match between a particular respective entry of the second dataset and the at least a portion of a first dataset.

First claim

The invention claimed is:

1. A system comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the system to perform:
generating a first signature value corresponding to a search term based on a cryptographic hash function, wherein the first signature value is a cryptographic hash value and the search term corresponds to a portion of a first dataset stored in a first data region having a first access permission level;
truncating the first signature value based on a signature anonymization value, wherein the signature anonymization value indicates a number of character placements at which to truncate the first signature value and corresponds to at least a predetermined number of matches if a second dataset includes at least a threshold number of entries;
generating, based on the truncated first signature value, a secure search query for the search term with which to search the second dataset stored in a second data region having a second access permission level;
receiving a response to the secure search query, wherein the response includes a plurality of second signature values based on the cryptographic hash function and each of the plurality of second signature values corresponding to an entry of the second dataset that is associated with the search term;
disambiguating the plurality of the second signature values based on the cryptographic technique to reveal entries of the second dataset that are associated with the search term; and
generating a notification in response to each of the entries of the second dataset matching the portion of the first dataset.

2. The system of claim 1 , wherein each of the plurality of second signature values comprises a hash value.

3. The system of claim 1 , wherein the first data region comprises an enclave data region and the second data region comprises a public data region.

4. The system of claim 1 , wherein the response further includes data source metadata associated with the second data region.

5. The system of claim 1 , wherein the first data region is associated with a network enclave system and the first access permission level prohibits the search term to be based on the portion of the first dataset.

6. The system of claim 5 , wherein the second data region is associated with a central system and the second permission level permits the search query to be performed on the second dataset.

7. The system of claim 1 , wherein the signature anonymization value is generated based on a number of entries of the second dataset.

8. The system of claim 7 , wherein the signature anonymization value is dynamically scaled based on the number of entries in the second dataset.

9. The system of claim 1 , wherein the first data region is distinct from the second data region.

10. A method being implemented by a computing system including one or more processors and a storage media storing machine-readable instructions, the method comprising:
generating a first signature value corresponding to a search term based on a cryptographic hash function, wherein the first signature value is a cryptographic hash value and the search term corresponds to a portion of a first dataset stored in a first data region having a first access permission level;
truncating the first signature value based on a signature anonymization value, wherein the signature anonymization value indicates a number of character placements at which to truncate the first signature value and corresponds to at least a predetermined number of matches if a second dataset includes at least a threshold number of entries;
generating, based on the truncated first signature value, a secure search query for the search term with which to search the second dataset stored in a second data region having a second access permission level;
receiving a response to the secure search query, wherein the response includes a plurality of second signature values based on the cryptographic hash function and each of the plurality of second signature values corresponding to an entry of the second dataset that is associated with the search term;
disambiguating the plurality of the second signature values based on the cryptographic technique to reveal entries of the second dataset that are associated with the search term; and
generating a notification in response to each of the entries of the second dataset matching the portion of the first dataset.

11. The method of claim 10 , wherein each of the plurality of second signature values comprises a hash value.

12. The method of claim 10 , wherein the first data region comprises an enclave data region and the second data region comprises a public data region.

13. The method of claim 10 , wherein the response further includes data source metadata associated with the second data region.

14. The method of claim 10 , wherein the first data region is associated with a network enclave system and the first access permission level prohibits the search term to be based on the portion of the first dataset.

15. The method of claim 14 , wherein the second data region is associated with a central system and the second permission level permits the search query to be performed on the second dataset.

16. The method of claim 10 , wherein the signature anonymization value is generated based on a number of entries of the second dataset.

17. The method of claim 10 , wherein the first data region is distinct from the second data region.

18. A non-transitory computer readable medium of a computing system storing instructions that, when executed by one or more processors, cause the computing system to perform:
generating a first signature value corresponding to a search term based on a cryptographic hash function, wherein the first signature value is a cryptographic hash value and the search term corresponds to a portion of a first dataset stored in a first data region having a first access permission level;
truncating the first signature value based on a signature anonymization value, wherein the signature anonymization value indicates a number of character placements at which to truncate the first signature value and corresponds to at least a predetermined number of matches if a second dataset includes at least a threshold number of entries;
generating, based on the truncated first signature value, a secure search query for the search term with which to search the second dataset stored in a second data region having a second access permission level;
receiving a response to the secure search query, wherein the response includes a plurality of second signature values based on the cryptographic hash function and each of the plurality of second signature values corresponding to an entry of the second dataset that is associated with the search term;
disambiguating the plurality of the second signature values based on the cryptographic technique to reveal entries of the second dataset that are associated with the search term; and
generating a notification in response to each of the entries of the second dataset matching the portion of the first dataset.

19. The non-transitory memory of claim 18 , wherein each of the plurality of second signature values comprises a hash value.

20. The non-transitory memory of claim 18 , wherein the first data region comprises an enclave data region and the second data region comprises a public data region.

Assignees

• Palantir Technologies Inc

Inventors

• Doyle John
• Free Jason
• Magid Jacob
• Rochlin Michael
• Hacker Sean

Classifications

• H04L63/105

  Multiple levels of security · CPC title

• G06F21/64

  Protecting data integrity, e.g. using checksums, certificates or signatures · CPC title

• G06F16/90335

  Query processing · CPC title

• G06F21/6245

  Protecting personal data, e.g. for financial or medical purposes · CPC title

• G06F21/602

  Providing cryptographic facilities or services · CPC title