Methods and systems for integrating business intelligence data into continuous integration environments

Patent metadata

Field	Value
Publication number	US-11334823-B2
Application number	US-201916290270-A
Country	US
Kind code	B2
Filing date	Mar 1, 2019
Priority date	Mar 1, 2019
Publication date	May 17, 2022
Grant date	May 17, 2022

Abstract

A method and system for integrating business intelligence data into a continuous integration system are provided. In one embodiment, a method is provided comprising receiving business intelligence data regarding utilized product features and job data regarding tested product features. The method may further include converting the business intelligence data and the job data into unified business intelligence data and unified job data in a unified format. The method may also include generating a feature map based on the unified business intelligence data and unified job data, determining an insufficient mapping based on the feature map, and identifying a job flag based on the insufficient mapping.

First claim

The invention claimed is:

1. A method comprising:
receiving business intelligence data comprising data regarding a plurality of utilized product features;
receiving job data comprising one or more jobs, wherein each job executes within a continuous integration environment and relates to at least one of a plurality of tested product features;
converting the business intelligence data into unified business intelligence data in a unified format;
converting the job data into unified job data in the unified format;
generating a feature map between the utilized product features and the tested product features based on the unified business intelligence data and the unified job data;
determining an insufficient mapping of the feature map between a tested product feature and at least one of the plurality of utilized product features; and
identifying, based on the insufficient mapping, a first job flag for a first job that corresponds to a tested product feature with no corresponding utilized product feature in the feature map; and
based on the first job flag, at least one of: (i) removing the first job from the continuous integration environment to prevent future executions of the first job and (ii) adjusting an execution frequency for the first job within the continuous integration environment.

2. The method of claim 1 , wherein the business intelligence data further comprises data regarding a plurality of developed product features and the method further comprises identifying a second job flag for a stale job related to a tested product feature with no corresponding developed product feature in the feature map.

3. The method of claim 1 , further comprising identifying a third job flag for a wasteful job configured to execute at a frequency that exceeds a threshold set based on a number of utilized product features in the feature map corresponding to the tested product feature.

4. The method of claim 1 , further comprising identifying a fourth job flag for a missing job corresponding to a utilized product feature with no corresponding tested product feature in the feature map.

5. The method of claim 1 , further comprising:
removing the first job flag from a continuous integration environment corresponding to the job data.

6. The method of claim 1 , further comprising:
generating a job recommendation based on the first job flag.

7. The method of claim 6 , wherein the job recommendation includes one or more recommendations selected from the group consisting of: (i) removing the first job associated with the first job flag, (ii) adjusting an execution frequency of the first job, and (iii) creating a new job to test a utilized product feature.

8. The method of claim 1 , wherein converting the job data into the unified job data comprises:
analyzing one or both of (i) a job name of a job and (ii) a job parameter of a job to identify a tested product feature.

9. The method of claim 1 , wherein the business intelligence data comprises one or more of the data types consisting of: customer support data, customer relationship management (CRM) data, code submission data, and customer sales orders.

10. The method of claim 9 , wherein the business intelligence data comprises a plurality of data types, and wherein converting the business intelligence data into the unified business intelligence data comprises:
converting data of each of the plurality of data types into converted data in the unified format; and
removing duplicate entries within the converted data.

11. The method of claim 1 , wherein the business intelligence data represents one or both of developer behavior regarding the product feature and customer behavior regarding the product feature.

12. A system comprising:
a processor; and
a memory containing instructions which, when executed by the processor, cause the processor to:
receive business intelligence data comprising data regarding a plurality of utilized product features;
receive job data comprising one or more jobs, wherein each job executes within a continuous integration environment and relates to at least one of a plurality of tested product features;
convert the business intelligence data into unified business intelligence data in a unified format;
convert the job data into unified job data in the unified format;
generate a feature map between the utilized product features and the tested product features based on the unified business intelligence data and the unified job data;
determine an insufficient mapping of the feature map between a tested product feature and at least one of the plurality of utilized product features;
identify, based on the insufficient mapping, a first job flag for a first job that corresponds to a tested product feature with no corresponding utilized product feature in the feature map; and
based on the first job flag, at least one of: (i) remove the first job from the continuous integration environment to prevent future executions of the first job and (ii) adjust an execution frequency for the first job within the continuous integration environment.

13. The system of claim 12 , wherein the business intelligence data further comprises data regarding a plurality of developed product features and the instructions further cause the processor to identify a second job flag for a stale job related to a tested product feature with no corresponding developed product feature in the feature map.

14. The system of claim 12 , wherein the instructions further cause the process to identify a third job flag for a wasteful job configured to execute at a frequency that exceeds a threshold set based on a number of utilized product features in the feature map corresponding to the tested product feature.

15. The system of claim 12 , wherein the instructions further cause the processor to identify a fourth job flag for a missing job corresponding to a utilized product feature with no corresponding tested product feature in the feature map.

16. The system of claim 12 , wherein the memory contains further instructions which, when executed by the processor, cause the processor to:
remove the first job flag from a continuous integration environment corresponding to the job data.

17. The system of claim 12 , wherein the memory contains further instructions which, when executed by the processor, cause the processor to:
generate a job recommendation based on the first job flag.

18. A non-transitory, computer-readable medium storing instructions which, when executed by a processor, cause the processor to:
receive business intelligence data comprising data regarding a plurality of utilized product features;
receive job data comprising one or more jobs, wherein each job executes within a continuous integration environment and relates to at least one of a plurality of tested product features;
convert the business intelligence data into unified business intelligence data in a unified format;
convert the job data into unified job data in the unified format;
generate a feature map between the utilized product features and the tested product features based on the unified business intelligence data and the unified job data;
determine an insufficient mapping of the feature map between a tested product feature and at least one of the plurality of utilized product features;
identify, based on the insufficient mapping, a first job flag for a first job that corresponds to a tested product feature with no corresponding utilized product feature in the feature map; and
based on the first job flag, at least one of: (i) remove the first

Assignees

• Red Hat Israel Ltd

Inventors

• Kuris Eran
• Stafeyev Alexander
• Bregman Arie

Classifications

• G06Q30/01

  Customer relationship services · CPC title

• G06F8/60

  Software deployment · CPC title

• G06N5/022

  Knowledge engineering; Knowledge acquisition · CPC title

• G06Q10/06312 Primary

  Adjustment or analysis of established resource schedule, e.g. resource or task levelling, or dynamic rescheduling · CPC title

• G06Q10/06315

  Needs-based resource requirements planning or analysis · CPC title