System and method for efficient real time log export and view in a micro services system

Patent metadata

Field	Value
Publication number	US-11947415-B2
Application number	US-202217574906-A
Country	US
Kind code	B2
Filing date	Jan 13, 2022
Priority date	Jan 13, 2022
Publication date	Apr 2, 2024
Grant date	Apr 2, 2024

Abstract

According to various embodiments, a method, medium, and system for exporting log messages related to a particular job running in a micro services system is described in this disclosure. The method uses a mapping table to narrow down the search scope for finding relevant log files. The mapping table maps a job attribute combination to one or more micro services, and thus will direct the search for relevant log messages only to those log files related to the one or more micro services. The search scope can be further narrowed down using a start time and end time of the job. Once the relevant log files are found, log messages containing an identifier of the job can be extracted from the relevant log files for display or for a user to download. The mapping table can be automatically generated by parsing through historical files in a system non-busy time.

First claim

What is claimed is:

1. A computer-implemented method of exporting log messages in real time in a micro services system, comprising:
receiving, by a data protect manager, a request for exporting log messages related to a job completed in the micro services system, the request including a plurality of attributes of the job;
retrieving, by the data protect manager, one or more micro services from a mapping table based on values of the plurality of attributes, wherein the mapping table includes an entry for each unique combination of values of the plurality of attributes, the entry mapping the unique combination to a set of micro services;
selecting, by the data protect manager, a first set of one or more log files corresponding to the one or more micro services from a plurality of log files generated by the micro services system;
selecting, by the data protect manager, a second set of one or more log files from the first set of one or more log files, each of the second set of one or more log files generated within a period of time between a start time and an end time of the job; and
retrieving log messages containing an identifier of the job from the second set of one or more log files.

2. The computer-implemented method of claim 1 , wherein the plurality of attributes include a job type, an asset type, a mode of trigger, and a job status.

3. The computer-implemented method of claim 1 , wherein the mapping table is generated by the data protect manager from a plurality of log files generated by the micro services system in one or more system non-busy periods of time in the past.

4. The computer-implemented method of claim 3 , wherein each of the one or more system non-busy times is determined based on configurations for jobs that generated the plurality of log files in the past.

5. The computer-implemented method of claim 3 , wherein the mapping table is generated by the data protect manager from a plurality of log files generated by the micro services system using one or more low-priority threads.

6. The computer-implemented method of claim 1 , wherein the request for exporting log messages related to the job identifier is made via a graphical user interface of the data protect manager by a user checking a check box.

7. The computer-implemented method of claim 6 , wherein the data protect manager runs on a single instance of virtual machines, and wherein the job is one of a backup job, a restore job, a replication job, a cloud tiering job, and a cloud disaster recovery job.

8. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations of exporting log messages in real time in a micro services system, comprising:
receiving, by a data protect manager, a request for exporting log messages related to a job completed in the micro services system, the request including a plurality of attributes of the job;
retrieving, by the data protect manager, one or more micro services from a mapping table based on values of the plurality of attributes, wherein the mapping table includes an entry for each unique combination of values of the plurality of attributes, the entry mapping the unique combination to a set of micro services;
selecting, by the data protect manager, a first set of one or more log files corresponding to the one or more micro services from a plurality of log files generated by the micro services system;
selecting, by the data protect manager, a second set of one or more log files from the first set of one or more log files, each of the second set of one or more log files generated within a period of time between a start time and an end time of the job; and
retrieving log messages containing an identifier of the job from the second set of one or more log files.

9. The non-transitory machine-readable medium of claim 8 , wherein the plurality of attributes include a job type, an asset type, a mode of trigger, and a job status.

10. The non-transitory machine-readable medium of claim 8 , wherein the mapping table is generated by the data protect manager from a plurality of log files generated by the micro services system in one or more system non-busy periods of time in the past.

11. The non-transitory machine-readable medium of claim 10 , wherein each of the one or more system non-busy times is determined based on configurations for jobs that generated the plurality of log files in the past.

12. The non-transitory machine-readable medium of claim 10 , wherein the mapping table is generated by the data protect manager from a plurality of log files generated by the micro services system using one or more low-priority threads.

13. The non-transitory machine-readable medium of claim 8 , wherein the request for exporting log messages related to the job identifier is made via a graphical user interface of the data protect manager by a user checking a check box.

14. The non-transitory machine-readable medium of claim 13 , wherein the data protect manager runs on a single instance of virtual machines, and wherein the job is one of a backup job, a restore job, a replication job, a cloud tiering job, and a cloud disaster recovery job.

15. A data processing system, comprising:
a processor; and
a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations of exporting log messages in real time in a micro services system, comprising:
receiving, by a data protect manager, a request for exporting log messages related to an identifier of a job completed in the micro services system, the request including a plurality of attributes of the job;
retrieving, by the data protect manager, one or more micro services from a mapping table based on values of the plurality of attributes, wherein the mapping table includes an entry for each unique combination of values of the plurality of attributes, the entry mapping the unique combination to a set of micro services;
selecting, by the data protect manager, a first set of one or more log files corresponding to the one or more micro services from a plurality of log files generated by the micro services system;
selecting, by the data protect manager, a second set of one or more log files from the first set of one or more log files, each of the second set of one or more log files generated within a period of time between a start time and an end time of the job; and
retrieving log messages containing an identifier of the job from the second set of one or more log files.

16. The data processing system of claim 15 , wherein the plurality of attributes include a job type, an asset type, a mode of trigger, and a job status.

17. The data processing system of claim 15 , wherein the mapping table is generated by the data protect manager from a plurality of log files generated by the micro services system in one or more system non-busy periods of time in the past.

18. The data processing system of claim 17 , wherein each of the one or more system non-busy times is determined based on configurations for jobs that generated the plurality of log files in the past.

19. The data processing system of claim 15 , wherein the mapping table is generated by the data protect manager from a plurality of log files generated by the micro services system using one or more low-priority threads.

20. The data processing system of claim 15 , wherein the request for exporting log messages related to the job identifier is made via a graphical user interface

Assignees

• Dell Products Lp

Inventors

• Liao mengze
• Pande Pankaj
• Wang Jinjin
• Quesnelle Scott

Classifications

• G06F11/0784 Primary

  Routing of error reports, e.g. with a specific transmission path or data flow · CPC title

• G06F9/45558

  Hypervisor-specific management and integration aspects · CPC title

• G06F11/0781

  Error filtering or prioritizing based on a policy defined by the user or on a policy defined by a hardware/software module, e.g. according to a severity level · CPC title

• G06F11/0787

  Storage of error reports, e.g. persistent data storage, storage using memory protection · CPC title

• G06F2009/4557

  Distribution of virtual machine instances; Migration and load balancing · CPC title