Automated testing of push notification service in cloud computing system

Patent metadata

Field	Value
Publication number	US-11044188-B2
Application number	US-201916671874-A
Country	US
Kind code	B2
Filing date	Nov 1, 2019
Priority date	Nov 1, 2019
Publication date	Jun 22, 2021
Grant date	Jun 22, 2021

Abstract

Techniques are provided for automatically testing and verifying the functionality of push notification services of a cloud computing system. For example, a computing system performs an automated push notification test to test a push notification service of the computing system. The computing system sends a test push message over a communications network to a plurality of test devices that are located in different geolocations. The test devices are configured to automatically generate a response message in response to receiving the test push message. The computing system determines if a response message is received from each test device within a predefined response timeout period associated with the test device. The computing system determines that the push notification test fails in response to determining that a response message is not received from at least one test device within the predefined response timeout period associated with the at least one test device.

First claim

What is claimed is:

1. A method, comprising:
performing, by a computing system, an automated push notification test to test a push notification service of the computing system, wherein performing the automated push notification test comprises:
sending, by the computing system, a test push message over a communications network to each test device of a plurality of test devices that are located in different geolocations, wherein each test device is configured to (i) automatically generate a response message in response to receiving the test push message and (ii) automatically make an application programming interface (API) call to a test message handler of an API gateway of the computing system to provide the response message to the computing system;
determining, by the computing system, if a response message is received from each test device of the plurality of test devices within a predefined response timeout period associated with the test device; and
determining, by the computing system, that the push notification test fails in response to determining that a response message is not received from at least one test device within the predefined response timeout period associated with the at least one test device.

2. The method of claim 1 , wherein sending the test push message comprises automatically sending push test messages to each test device of the plurality of test devices on a periodic basis.

3. The method of claim 1 , wherein a given test device of the plurality of test devices is accorded a predefined response timeout period that is determined, by the computing system, based on historical response times of the given test device.

4. The method of claim 1 , wherein performing the automated push notification test further comprises:
analyzing, by the computing system, message content of each response message received from each test device of the plurality of test devices to determine if the message content is valid; and
determining, by the computing system, that the push notification test fails in response to determining that a response message received from at least one test device of the plurality of test devices comprises invalid message content.

5. The method of claim 1 , wherein sending the test push message comprises sending a generic test push message to each test device of the plurality of test devices, wherein the generic test push message comprises a push message identifier, and wherein each test device is configured to automatically generate a response message which comprises the push message identifier, in response to receiving the generic test push message.

6. The method of claim 1 , wherein sending the test push message comprises:
generating a simulated event; and
injecting the simulated event to a service of the computing system;
wherein the simulated event is configured to trigger the service to generate and send a push message to each test device of the plurality of test devices.

7. The method of claim 6 , wherein the simulated event comprises an event that indicates one of (i) a change in a configuration of a storage system monitored by the computing system and (ii) a change in a health score of a storage system monitored by the computing system.

8. The method of claim 6 , wherein performing the automated push notification test further comprises:
analyzing, by the computing system, message content of each response message received from each test device of the plurality of test devices to determine if the message content comprises a valid response to the simulated event; and
determining, by the computing system, that the push notification test fails in response to determining that a response message from at least one test device does not comprise a valid response to the simulated event.

9. The method of claim 1 , further comprising, in response to determining that the push notification test has failed, automatically sending, by the computing system, a test notification message to at least one entity responsible for managing the push notification service of the computing system, wherein the test notification message provides notification that the push notification test has failed.

10. An article of manufacture comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code is executable by one or more processors to implement a method comprising:
performing, by a computing system, an automated push notification test to test a push notification service of the computing system, wherein performing the automated push notification test comprises:
sending, by the computing system, a test push message over a communications network to each test device of a plurality of test devices that are located in different geolocations, wherein each test device is configured to (i) automatically generate a response message in response to receiving the test push message and (ii) automatically make an application programming interface (API) call to a test message handler of an API gateway of the computing system to provide the response message to the computing system;
determining, by the computing system, if a response message is received from each test device of the plurality of test devices within a predefined response timeout period associated with the test device; and
determining, by the computing system, that the push notification test fails in response to determining that a response message is not received from at least one test device within the predefined response timeout period associated with the at least one test device.

11. The article of manufacture of claim 10 , wherein sending the test push message comprises automatically sending push test messages to each test device of the plurality of test devices on a periodic basis.

12. The article of manufacture of claim 10 , wherein a given test device of the plurality of test devices is accorded a predefined response timeout period that is determined, by the computing system, based on historical response times of the given test device.

13. The article of manufacture of claim 10 , wherein performing the automated push notification test further comprises:
analyzing, by the computing system, message content of each response message received from each test device of the plurality of test devices to determine if the message content is valid; and
determining, by the computing system, that the push notification test fails in response to determining that a response message received from at least one test device of the plurality of test devices comprises invalid message content.

14. The article of manufacture of claim 10 , wherein sending the test push message comprises sending a generic test push message to each test device of the plurality of test devices, wherein the generic test push message comprises a push message identifier, and wherein each test device is configured to automatically generate a response message which comprises the push message identifier, in response to receiving the generic test push message.

15. The article of manufacture of claim 10 , wherein sending the test push message comprises:
generating a simulated event; and
injecting the simulated event to a service of the computing system;
wherein the simulated event is configured to trigger the service to generate and send a push message to each test device of the plurality of test devices.

16. The article of manufacture of claim 15 , wherein the simulated event comprises an event that indicates one of (i) a change in a configuration of a storage system monitored by the compu

Assignees

• Emc Ip Holding Co Llc

Inventors

• Martin Yingying Wang
• Joyce Scott E
• Akerman Scott R
• Miles Norman M
• Yuan Dan

Classifications

• H04L43/20

  the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV · CPC title

• H04L41/40

  using virtualisation of network functions or resources, e.g. SDN or NFV entities · CPC title

• H04L67/55

  Push-based network services · CPC title

• H04L67/52

  specially adapted for the location of the user terminal · CPC title

• H04L41/145

  involving simulating, designing, planning or modelling of a network · CPC title