Systems and methods for importing data from electronic data files

Patent metadata

Field	Value
Publication number	US-11816124-B2
Application number	US-202117304293-A
Country	US
Kind code	B2
Filing date	Jun 17, 2021
Priority date	Sep 4, 2015
Publication date	Nov 14, 2023
Grant date	Nov 14, 2023

Abstract

Computer implemented systems and methods are disclosed for importing data from electronic data files. In accordance with some embodiments, a file format is assigned to a source electronic data files by a data importation system. The data importation system may further identify a file type identifier associated with the source electronic data file and map the source electronic data file to a transformation template. The data importation system may further store the file format, file type identifier, and an indication of the transformation template as a file type profile associated with the source electronic data file in a database.

First claim

What is claimed is:

1. A data importation system comprising:
one or more computer processors;
one or more computer memories; and
a set of instructions incorporated into the one or more computer memories, the set of instructions configuring the one or more computer processors to perform operations for deleting an electronic data file, the operations comprising:
receiving a request to perform the deleting of the electronic data file;
determining automatically, by the data importation system, before effecting the request to perform the deleting of the electronic data file, if any transformed data associated with the electronic data file has been imported by an external system; and
based on an automatic determination, by the data importation system, that transformed data associated with the electronic data file has been imported by an external system, sending a request, by the data importation system, to the external system to delete the transformed data, wherein the transformed data was previously transformed from a format used by the electronic data file into a format used by the external system.

2. The system of claim 1 , wherein the transformed data was generated by application of a transformation template to the electronic data file.

3. The system of claim 2 , wherein the transformation template was mapped to the electronic data file based on a file type associated with the electronic data file.

4. The system of claim 1 , further comprising performing the deleting of the electronic data file.

5. The system of claim 4 , wherein the performing of the deleting of the electronic data file is based on a determination that a group of electronic data files is to be deleted, the group of electronic data files including the electronic data file.

6. The system of claim 1 , further comprising:
detecting that a transformed electronic data file is associated with the electronic data file; and
based on the detecting, deleting the transformed electronic data file.

7. The system of claim 1 , wherein the transformed data was previously transformed by a selected detector/transformer plugin from a plurality of detector/transformer plugins stored in a database, the selecting including cycling through at least a portion of the plurality of detector/transformer plugins based on priorities associated with the plurality of detector/transformer plugins and determining which of the at least the portion of the plurality of detector/transformer plugins is capable of processing the electronic data file to generate the transformed data.

8. A method comprising:
receiving a request to delete an electronic data file; and
determining automatically, by a data importation system, before effecting the request to delete the electronic data file, if any transformed data associated with the electronic data file has been imported by an external system; and

based on an automatic determination, by the data importation system, that transformed data associated with the electronic data file has been imported by an external system, sending a request, by the data importation system, to the external system to delete the transformed data, wherein the transformed data was previously transformed from a format used by the electronic data file into a format used by the external system.

9. The method of claim 8 , wherein the transformed data was generated by application of a transformation template to the electronic data file.

10. The method of claim 9 , wherein the transformation template was mapped to the electronic data file based on a file type associated with the electronic data file.

11. The method of claim 8 , further comprising performing the deleting of the electronic data file.

12. The method of claim 11 , wherein the performing of the deleting of the electronic data file is based on a determination that a group of electronic data files is to be deleted, the group of electronic data files including the electronic data file.

13. The method of claim 8 , further comprising:
detecting that a transformed electronic data file is associated with the electronic data file; and
based on the detecting, deleting the transformed electronic data file.

14. The method of claim 8 , wherein the transformed data was previously transformed by a selected detector/transformer plugin from a plurality of detector/transformer plugins stored in a database, the selecting including cycling through at least a portion of the plurality of detector/transformer plugins based on priorities associated with the plurality of detector/transformer plugins and determining which of the at least the portion of the plurality of detector/transformer plugins is capable of processing the electronic data file to generate the transformed data.

15. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by one or more computer processors, causes the one or more computer processors to perform operations comprising:
receiving a request to delete an electronic data file; and
determining automatically, by a data importation system, before effecting the request to delete the electronic data file, if any transformed data associated with the electronic data file has been imported by an external system; and
based on an automatic determination, by the data importation system, that transformed data associated with the electronic data file has been imported by an external system, sending a request, by the data importation system, to the external system to delete the transformed data, wherein the transformed data was previously transformed from a format used by the electronic data file into a format used by the external system.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the transformed data was generated by application of a transformation template to the electronic data file.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the transformation template was mapped to the electronic data file based on a file type associated with the electronic data file.

18. The non-transitory computer-readable storage medium of claim 15 , further comprising performing the deleting of the electronic data file.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the performing of the deleting of the electronic data file is based on a determination that a group of electronic data files is to be deleted, the group of electronic data files including the electronic data file.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the transformed data was previously transformed by a selected detector/transformer plugin from a plurality of detector/transformer plugins stored in a database, the selecting including cycling through at least a portion of the plurality of detector/transformer plugins based on priorities associated with the plurality of detector/transformer plugins and determining which of the at least the portion of the plurality of detector/transformer plugins is capable of processing the electronic data file to generate the transformed data.

Assignees

• Palantir Technologies Inc

Inventors

• Yazicioglu Stephen
• Luck Christopher
• Giardina Robert
• Streufert Justin
• Slatcher Timothy
• O'Connor Gregory
• Marc-Aurele Brandon
• Zhu Olivia
• Schindel Howard
• Tung Henry
• Ray Lucas
• Leech Christopher
• Jeney Eric
• Negrus Stefan
• Lee Jason
• Mingione Alessandro
• Doyle John McKinstry
• Pitelka Hunter
• Lozano Ethan
• Ossher Joel
• Fedderly Matthew

Classifications

• G06F16/258 Primary

  Data format conversion from or to a database · CPC title

• G06F16/162

  Delete operations (erasing in storage systems G06F3/0652) · CPC title

• G06F16/22

  Indexing; Data structures therefor; Storage structures · CPC title

• G06F16/235

  Update request formulation · CPC title

• G06F16/245

  Query processing · CPC title