Method for optimized canary deployments for improved customer experience

Patent metadata

Field	Value
Publication number	US-10936465-B2
Application number	US-201916502741-A
Country	US
Kind code	B2
Filing date	Jul 3, 2019
Priority date	Jul 25, 2017
Publication date	Mar 2, 2021
Grant date	Mar 2, 2021

Abstract

Described embodiments may provide deployment of updates to multiple entities. A canary deployment manager may receive a request to deploy an update in canary deployments. The canary deployment manager may determine, for each entity of a plurality of entities, a support score based on support issues experienced by each entity. The canary deployment manager may determine, for each entity, a monitoring score based on at least one performance or availability issue experienced by each entity. The canary deployment manager may generate, for each entity, based on the support score of each entity and the monitoring score of each entity, a canary score used to identify a canary deployment to which to assign each entity. The canary deployment manager may select a subset of the plurality of entities to assign to a first canary wave of the canary deployments based on the respective canary scores of each of the subset.

First claim

What is claimed is:

1. A method, comprising:
identifying, by a device, for each entity of a plurality of entities, a support score based at least on support issues experienced by each entity with one or more applications being used in a plurality of canary deployments;
identifying, by the device, for each entity of the plurality of entities, a monitoring score based at least on one of performance or availability of the one or more applications experienced by each entity;
determining, by the device, for each entity of the plurality of entities, a canary score for each entity based at least on the support score and monitoring score identified for each entity; and
assigning, by the device, one or more entities of the plurality of entities to one or more canary deployments of the plurality of canary deployments based at least on the canary score of each of the one or more entities.

2. The method of claim 1 , further comprising receiving, by the device, a request to update an application of the one or more applications.

3. The method of claim 2 , further comprising assigning the one or more entities to the one or more canary deployments responsive to the request.

4. The method of claim 1 , further comprising identifying, by the device, for each entity of the plurality of entities a complexity score based at least on a level of complexity of an environment of the one or more applications for each entity.

5. The method of claim 4 , further comprising determining, by the device, for each entity of the plurality of entities, the canary score for each entity based at least on the support score and monitoring score and the complexity score for each entity.

6. The method of claim 1 , further comprising identifying, by the device, for each entity of the plurality of entities a scale score based at least on a number of accounts managed by each entity for the one or more applications.

7. The method of claim 6 , further comprising determining, by the device, for each entity of the plurality of entities, the canary score for each entity based at least on the support score and monitoring score and the scale score for each entity.

8. The method of claim 1 , wherein the support score for each tenant is increased based at least on an increase in one of quantity or severity of support issues experienced by each entity.

9. The method of claim 1 , wherein the monitoring score for each tenant is increased based at least on one of unavailability or performance degradation of the one or more applications.

10. The method of claim 1 , further comprising deploying a first entity of the one or more entities to a first canary deployment of the one or more canary deployments at a time later than deploying a second entity of the one or more entities to a second canary deployment of the one or more canary deployments responsive to a first canary score of the first entity being higher than a second canary score of the second entity.

11. A system, comprising:
a device comprising one or more processors, coupled to memory and configured to:
identify, for each entity of a plurality of entities, a support score based at least on support issues experienced by each entity with one or more applications being used in a plurality of canary deployments;
identify, for each entity of the plurality of entities, a monitoring score based at least on one of performance or availability of the one or more applications experienced by each entity;
determine, for each entity of the plurality of entities, a canary score for each entity based at least on the support score and monitoring score identified for each entity; and
assign one or more entities of the plurality of entities to one or more canary deployments of the plurality of canary deployments based at least on the canary score of each of the one or more entities.

12. The system of claim 11 , wherein the device is further configured to receive a request to update an application of the one or more applications.

13. The system of claim 12 , wherein the device is further configured to assign the one or more entities to the one or more canary deployments responsive to the request.

14. The system of claim 11 , wherein the device is further configured to identify for each entity of the plurality of entities a complexity score based at least on a level of complexity of an environment of the one or more applications for each entity.

15. The system of claim 14 , wherein the device is further configured to determine for each entity of the plurality of entities, the canary score for each entity based at least on the support score and monitoring score and the complexity score for each entity.

16. The system of claim 11 , wherein the device is further configured to identify for each entity of the plurality of entities a scale score based at least on a number of accounts managed by each entity for the one or more applications.

17. The system of claim 16 , wherein the device is further configured to determine for each entity of the plurality of entities, the canary score for each entity based at least on the support score and monitoring score and the scale score for each entity.

18. The system of claim 11 , wherein the support score for each tenant is increased based at least on an increase in one of quantity or severity of support issues experienced by each entity.

19. The system of claim 11 , wherein the monitoring score for each tenant is increased based at least on one of unavailability or performance degradation of the one or more applications.

20. The system of claim 11 , wherein the device is further configured to deploy a first entity of the one or more entities to a first canary deployment of the one or more canary deployments at a time later than deploying a second entity of the one or more entities to a second canary deployment of the one or more canary deployments responsive to a first canary score of the first entity being higher than a second canary score of the second entity.

Assignees

• Citrix Systems Inc

Inventors

• Acosta Santiago
• Gujarathi Ashish

Classifications

• G06F8/658

  Incremental updates; Differential updates · CPC title

• G06Q10/06393

  Score-carding, benchmarking or key performance indicator [KPI] analysis · CPC title

• G06F11/3466 Primary

  Performance evaluation by tracing or monitoring · CPC title

• G06F2201/865

  Monitoring of software · CPC title

• G06F8/71

  Version control (security arrangements therefor G06F21/57); Configuration management · CPC title