Automated throttling of website polling

Patent metadata

Field	Value
Publication number	US-9692702-B1
Application number	US-201414571123-A
Country	US
Kind code	B1
Filing date	Dec 15, 2014
Priority date	Dec 15, 2014
Publication date	Jun 27, 2017
Grant date	Jun 27, 2017

Abstract

Techniques and solutions are described for throttling automated polling requests. For example, an automated polling request that is generated by a web page can be received and a decision can be made to throttle, or not throttle, the automated polling request. The decision can be made based on comparison of the automated polling request with previous automated polling requests (e.g., during a throttling time period). For example, repetitive automated polling requests that occur during a throttling time period can be throttled.

First claim

What is claimed is:

1. A method, implemented by a client computing device, for automatic throttling of web site polling, the method comprising:
receiving, by a component of the client computing device, an automated polling request comprising a uniform resource locator (URL) that is generated by a web page running within a web browser of the client computing device, wherein the automated polling request polls a remote web site for web content;
obtaining, by the client computing device, a throttling time period;
determining, by the client computing device, whether there was a previous automated polling request during the throttling time period that matches the received automated polling request, wherein the determining comprises:
comparing the received automated polling request to previous automated polling requests that occurred during the throttling time period, wherein the comparing is performed, at least in part, using URLs; and

upon determining that there was a previous automated polling request during the throttling time period that matches the received automated polling request, blocking, by the client computing device, the received automated polling request.

2. The method of claim 1 wherein comparing the received automated polling request to previous automated polling requests comprises:
comparing at least a portion of the URL of the received automated polling request to at least portions of URLs of the previous automated polling requests using one or more of hashed URL values and normalized URLs.

3. The method of claim 1 wherein the method limits automated polling requests to one per throttling time period, the method further comprising:
obtaining a second throttling time period longer than the throttling time period; and
permitting one additional automated polling request during the second throttling time period.

4. The method of claim 1 further comprising;
determining that the received request is a non-user-initiated request.

5. The method of claim 1 wherein the automated polling request comprising the URL is received from an automated web page process that generates the automated polling request on a periodic basis to poll the remote web site for web content.

6. The method of claim 5 wherein the automated polling request is received by one of a web browser plug-in and a networking component.

7. The method of claim 1 further comprising:
upon determining that there was not a previous automated polling request during the throttling time period that matches the automated polling request, permitting the received automated polling request.

8. A computing device comprising:
one or more processing units; and
one or more network interfaces;
the computing device configured to perform operations for automatic throttling of web site polling, the operations comprising:
receiving, by the computing device, an automated polling request generated by a web page within a web browser running on the computing device;
obtaining, by the computing device, a throttling policy;
determining, by the computing device, whether the received automated polling request is a repetitive automated polling request based on the throttling policy; and
upon determining that the received automated polling request is a repetitive automated polling request, throttling, by the computing device, the received automated polling request.

9. The computing device of claim 8 wherein determining whether the received automated polling request is a repetitive automated polling request comprises:
identifying a throttling time period defined by the throttling policy; and
determining that the received automated polling request is a repetitive automated polling request when a matching previous automated request is present during the throttling time period.

10. The computing device of claim 9 wherein determining whether a previous automated polling request matches the received automated polling request comprises:
normalizing the received automated polling request; and
comparing the normalized received automated polling request to normalized previous automated polling requests.

11. The computing device of claim 9 wherein determining whether a previous automated polling request matches the received automated polling request comprises:
hashing the received automated polling request to create a hash value; and
comparing the hash value to hash values of previous automated polling requests.

12. The computing device of claim 8 wherein determining whether the received automated polling request is a repetitive automated polling request comprises:
identifying a number of pervious automated polling requests that match the automated polling request, wherein the matching is performed, at least in part, based on comparison of URLs; and
determining whether the number of previous automated polling requests is above a threshold value defined by the throttling policy.

13. The computing device of claim 8 the operations further comprising, upon determining that the received automated polling request is a repetitive automated polling request:
obtaining a cached response from a matching previous automated polling request; and
providing the cached response to the web page running within the web browser.

14. The computing device of claim 8 the operations further comprising, upon determining that the received automated polling request is a repetitive automated polling request:
saving the received automated polling request in a batch with other throttled automated polling requests; and
at a later time, sending the batch of throttled automated polling requests.

15. The computing device of claim 8 further comprising:
sending a request for the web page to a headless browser environment; and
in response to sending the request, receiving the requested web page and the throttling policy from the headless browser environment;
wherein the received automated polling request is generated on a periodic basis to poll a web site for web content, and wherein the throttling policy is specific to the web site.

16. The computing device of claim 8 wherein the throttling policy comprises:
one or more throttling rules that apply to a cellular network connection;
one or more other throttling rules that apply to a WiFi network connection; and
one or more rules that define one or more Internet Protocol (IP) ranges to which the throttling policy applies.

17. The computing device of claim 8 wherein determining whether the received automated polling request is a repetitive automated polling request comprises:
determining whether a WiFi wireless network connection is available for sending the received automated polling request; and
when a WiFi wireless network connection is available:
determining that the received automated polling request is not repetitive; and
permitting the received automated polling request to be sent via the WiFi wireless network connection.

18. A non-transitory computer-readable storage medium storing computer-executable instructions for causing a computing device to perform operations for automatic throttling of web site polling, the operations comprising:
receiving, by the computing device, an automated polling request comprising a uniform resource locator (URL) that is generated by a web page within a web browser running on the computing device;
obtain, by the computing device, a throttling time period;
identifying, by the computing device, a number of previous automated polling requests that were permitted during the throttling time period and tha

Assignees

• Amazon Tech Inc

Inventors

• Brown Aaron Michael
• Karppanen Jari Juhani

Classifications

• H04L47/12 Primary

  Avoiding congestion; Recovering from congestion · CPC title