US 11,809,509 B2
Adaptive data collection optimization
Martynas Juravicius, Vilnius (LT); Erikas Bulba, Vilnius (LT); and Mantas Briliauskas, Vilnius (LT)
Assigned to OXYLABS, UAB, Vilnius (LT)
Filed by OXYLABS, UAB, Vilnius (LT)
Filed on Mar. 10, 2023, as Appl. No. 18/181,742.
Application 18/181,742 is a continuation of application No. 17/823,660, filed on Aug. 31, 2022.
Application 17/823,660 is a continuation of application No. 17/655,932, filed on Mar. 22, 2022, granted, now 11,468,137, issued on Oct. 11, 2022.
Application 17/655,932 is a continuation of application No. 17/454,074, filed on Nov. 9, 2021, granted, now 11,314,833, issued on Apr. 26, 2022.
Claims priority of provisional application 63/260,530, filed on Aug. 24, 2021.
Prior Publication US 2023/0214436 A1, Jul. 6, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/955 (2019.01); G06F 16/951 (2019.01); G06F 11/34 (2006.01)
CPC G06F 16/955 (2019.01) [G06F 11/3409 (2013.01); G06F 16/951 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A computer-readable storage medium for optimizing a scraping request comprising instructions which, when executed by a computer device, causes the computer device to:
execute the scraping request;
receive a result of the scraping request, wherein the result comprises: a classification decision, a target domain, and a plurality of scraping request parameters;
score each of the plurality of scraping request parameters to form a scored set of scraping request parameters;
store the scored set of scraping request parameters with the result in a database;
select from the database an other scored set of scraping request parameters comprising either an entirety of the plurality of scraping request parameters or a partial set of the plurality of scraping request parameters comprising less than an entirety of the plurality of scraping request parameters, wherein the other scored set of scraping parameters is not identical to the scored set of scraping request parameters; and,
execute a subsequent scraping request with the other scored set of scraping request parameters by applying a machine learning algorithm to process the at least one set of scored scraping request parameters.