	US 12,229,210 B2
	System and method for URL fetching retry mechanism
Derry Shribman, Tel Aviv (IL); and Ofer Vilenski, Moshav Hadar Am (IL)
Assigned to BRIGHT DATA LTD., Netanya (IL)
Filed by BRIGHT DATA LTD., Netanya (IL)
Filed on Jan. 10, 2022, as Appl. No. 17/572,177.
Application 17/572,177 is a continuation of application No. 16/938,991, filed on Jul. 26, 2020, granted, now 11,657,110.
Application 16/938,991 is a continuation of application No. PCT/IL2020/050194, filed on Feb. 21, 2020.
Claims priority of provisional application 62/948,265, filed on Dec. 15, 2019.
Claims priority of provisional application 62/855,036, filed on May 31, 2019.
Claims priority of provisional application 62/809,847, filed on Feb. 25, 2019.
Prior Publication US 2022/0138278 A1, May 5, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/909 (2019.01); G06F 9/54 (2006.01); G06F 16/955 (2019.01); H04L 1/00 (2006.01); H04L 67/01 (2022.01); H04L 67/02 (2022.01); H04L 67/146 (2022.01); H04L 67/568 (2022.01); H04L 69/40 (2022.01); H04L 61/59 (2022.01); H04L 67/56 (2022.01)

CPC G06F 16/9566 (2019.01) [G06F 9/547 (2013.01); G06F 16/909 (2019.01); G06F 16/955 (2019.01); G06F 16/9558 (2019.01); H04L 1/00 (2013.01); H04L 67/01 (2022.05); H04L 67/02 (2013.01); H04L 67/146 (2013.01); H04L 67/568 (2022.05); H04L 69/40 (2013.01); H04L 61/59 (2022.05); H04L 67/56 (2022.05)]

93 Claims

1. A method for use with a content that comprises a web-page or a part thereof, that is stored in a web server, and that is identified by a Uniform Resource Locator (URL), for use with a group of devices each of which is identified by an Internet Protocol (IP) address, the method comprising:

sending, by a first client to a first server over the Internet, the URL;

receiving, by the first server from the first client over the Internet, the URL;

selecting, a first device from the group, by selecting the respective IP address of the first device;

sending, to the selected first device over the Internet, the URL;

sending, by the selected first device to the web server over the Internet, the URL;

receiving, by the selected first device from the web server over the Internet, a first response;

sending, by the selected first device to the first server over the Internet, the received first response;

receiving, by the first server from the selected first device over the Internet, the received first response; and

determining whether the received first response is a proper response that comprises the content,

responsive to determining that the received first response is not a proper response, performing the steps of:

sending, by the first client to a second server over the Internet, the URL;

sending, by the second server to the web server over the Internet, the URL as part of a request, so that the request received by the web server does not include the IP address of the first client so that the IP address of the first client is unknown to the web server;

receiving, by the second server from the web server over the Internet, a second response;

sending, by the second server to the first client over the Internet, the received second response;

receiving, by the first client from the second server over the Internet, the received second response; and

determining, whether the received second response is a proper response that comprises the content,

wherein the IP addresses of the devices in the group are stored in a third server that is distinct from the first server, and

wherein the determining of the received first response comprises identifying and checking a HTTP status code that is received in response to a sending of the URL.