CPC G06F 16/955 (2019.01) [G06F 11/3409 (2013.01); G06F 16/951 (2019.01)] | 20 Claims |
1. A computer-readable storage medium for optimizing a scraping request comprising instructions which, when executed by a computer device, causes the computer device to:
execute the scraping request;
receive a result of the scraping request, wherein the result comprises: a classification decision, a target domain, and a plurality of scraping request parameters;
score each of the plurality of scraping request parameters to form a scored set of scraping request parameters;
store the scored set of scraping request parameters with the result in a database;
select from the database an other scored set of scraping request parameters comprising either an entirety of the plurality of scraping request parameters or a partial set of the plurality of scraping request parameters comprising less than an entirety of the plurality of scraping request parameters, wherein the other scored set of scraping parameters is not identical to the scored set of scraping request parameters; and,
execute a subsequent scraping request with the other scored set of scraping request parameters by applying a machine learning algorithm to process the at least one set of scored scraping request parameters.
|