US 12,010,101 B2
System and method for managing non-direct URL fetching service
Derry Shribman, Tel Aviv (IL); and Ofer Vilenski, Moshav Hadar Am (IL)
Assigned to BRIGHT DATA LTD., Netanya (IL)
Filed by BRIGHT DATA LTD., Netanya (IL)
Filed on Jul. 12, 2022, as Appl. No. 17/862,457.
Application 17/862,457 is a continuation of application No. 17/599,584, granted, now 11,411,922, previously published as PCT/IL2020/050335, filed on Mar. 20, 2020.
Claims priority of provisional application 62/872,926, filed on Jul. 11, 2019.
Claims priority of provisional application 62/827,889, filed on Apr. 2, 2019.
Prior Publication US 2022/0360565 A1, Nov. 10, 2022
Int. Cl. G06F 15/16 (2006.01); G06F 16/955 (2019.01); H04L 9/40 (2022.01)
CPC H04L 63/0272 (2013.01) [G06F 16/955 (2019.01); G06F 16/9566 (2019.01); H04L 63/029 (2013.01)] 111 Claims
OG exemplary drawing
 
1. A method for fetching, by a client device, a web-page that is identified by a Uniform Resource Locator (URL) and stored in a web server, and for identifying and overcoming blocking, the method comprising:
identifying, as part of executing of a web browser at the client device, the web-page;
sending, by the client device to the web server over the Internet, a first Hypertext Transfer Protocol (HTTP) request that includes the URL and includes an Internet Protocol (IP) of the client device as a source address, in response to the identifying of the web-page, so that the IP address of the client device is available to the web server;
receiving, by the client device from the web server over the Internet, a first response, in response to the sending of the first HTTP request;
before receiving of the first response, sending, by the client device over the Internet to a first device that is distinct from the web server, a second HTTP request that includes the URL;
receiving, by the client device from the first device over the Internet, a second response, in response to the sending of the second HTTP request;
determining, by the client device, whether the first response is a proper response;
in response to the determining that the first response is a proper response, using, as part of executing of a web browser at the client device, the first response, responsive to the identifying;
in response to the determining that the first response is not a proper response, determining, by the client device, that the second response is a proper response or a failed response; and
in response to the determining that the first response is not a proper response and that the second response is a proper response, using, as part of executing of a web browser at the client device, the second response, responsive to the identifying.