US 12,292,867 B2
Efficient data scraping and deduplication system for registered sex offender queries
Namita Magoon, Dulles, VA (US); and Sanjay Magoon, Dulles, VA (US)
Assigned to KnowPeds, LLC, McLean, VA (US)
Filed by KnowPeds, LLC, McLean, VA (US)
Filed on Oct. 19, 2023, as Appl. No. 18/490,676.
Application 18/490,676 is a continuation of application No. 17/538,828, filed on Nov. 30, 2021, granted, now 11,829,339.
Application 17/538,828 is a continuation of application No. 16/441,515, filed on Jun. 14, 2019, granted, now 11,216,426, issued on Jan. 4, 2022.
Claims priority of provisional application 62/815,952, filed on Mar. 8, 2019.
Claims priority of provisional application 62/685,191, filed on Jun. 14, 2018.
Prior Publication US 2024/0273073 A1, Aug. 15, 2024
Int. Cl. G06F 17/00 (2019.01); G06F 16/215 (2019.01); G06F 16/9535 (2019.01); G06F 16/9538 (2019.01); G06F 16/958 (2019.01); G06Q 50/26 (2012.01)
CPC G06F 16/215 (2019.01) [G06F 16/9535 (2019.01); G06F 16/9538 (2019.01); G06F 16/986 (2019.01); G06Q 50/265 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
a processed data store configured to store data records corresponding to a plurality of registered sex offenders; and
a computing system comprising a processor and computer-executable instructions, wherein the computer-executable instructions, when executed, cause the computing system to:
obtain first content page source code from a first external data source;
generate a first document object model (DOM) tree using the first content page source code, wherein the DOM tree comprises a first path corresponding to a first registered sex offender and a second path corresponding to a second registered sex offender;
request second content page source code of a content page corresponding to the first registered sex offender;
obtain the second content page source code;
modify the first path of the DOM tree to include a pointer;
scrape the second content page source code to identify first data corresponding to the first registered sex offender;
request third content page source code of a content page corresponding to the second registered sex offender;
pause, at a first time, a scraping process in response to the third content page source code not being obtained;
using the pointer included in the first path of the DOM tree, determine that the second content page source code corresponding to the first registered sex offender has been obtained and request the third content page source code corresponding to the second registered sex offender at a second time after the first time; and
resume the scraping process.