CPC G06F 16/951 (2019.01) [G06F 9/4881 (2013.01); G06F 9/547 (2013.01); G06F 16/953 (2019.01); G06Q 10/105 (2013.01); H04L 63/083 (2013.01); H04L 67/133 (2022.05)] | 20 Claims |
1. A computer-implemented method for securing a web scraping system, comprising:
(a) receiving, at a load balancer, an API request to scrape content from a target website from a client computing device;
(b) generating a token indicating an identity of a client associated with the API request;
(c) identifying a server configured to initiate a scraping process on the web scraping system based on a hostname in the API request;
(d) transmitting the API request along with the token to the server;
at the server configured to initiate the scraping process on the web scraping system:
(e) authorizing the client using the token; and
(f) causing the web scraping system to scrape the target website in response to the authorization.
|