US 12,287,840 B1
Systems and methods for using crowd sourcing to evaluate truthfulness or bias in online content
Travis Trammell, Stanford, CA (US); and Richard Kim, Stanford, CA (US)
Assigned to Applied Decision Research LLC, Middletown, DE (US)
Filed by Applied Decision Research LLC, Middletown, DE (US)
Filed on Nov. 20, 2024, as Appl. No. 18/954,278.
Application 18/954,278 is a continuation of application No. 17/869,138, filed on Jul. 20, 2022, granted, now 12,248,481.
Application 17/869,138 is a continuation of application No. 17/582,500, filed on Jan. 24, 2022, granted, now 11,803,559, issued on Oct. 31, 2023.
Application 17/582,500 is a continuation of application No. 17/412,150, filed on Aug. 25, 2021, granted, now 11,250,009, issued on Feb. 15, 2022.
Application 17/412,150 is a continuation of application No. 16/190,100, filed on Nov. 13, 2018, granted, now 11,157,503, issued on Oct. 26, 2021.
Claims priority of provisional application 62/586,821, filed on Nov. 15, 2017.
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/958 (2019.01); G06F 16/9536 (2019.01)
CPC G06F 16/958 (2019.01) [G06F 16/9536 (2019.01)] 26 Claims
OG exemplary drawing
 
1. A system comprising:
at least one hardware processor; and
memory storing computer instructions configured to assist in having content items that are presented by a web browser or an application evaluated, the computer instructions when executed by the at least one hardware processor being configured to cause the system to
identify a particular content item made available on a publication date for presentation to users by the web browser or the application, the particular content item having particular subject matter content, the particular subject matter content containing stated facts or opinions which a user is unsure whether to trust;
during a first time period, obtain first content evaluations of the particular content item from first users, each first content evaluation defining a first user evaluation of a belief state of the stated facts or opinions of the particular subject matter content in the particular content item;
assist in displaying the first content evaluations in association with the particular content item;
during a second time period, the first time period initiating nearer to the publication date than the second time period, obtain second evaluations from second users regardless of second user expertise, the second users during the second time period defined as having benefit of hindsight as to the stated facts or opinions greater than most of the first users and thus being presumed to have knowledge as to the belief state of the stated facts or opinions of the particular subject matter content in the particular content item greater than most of the first users;
generate an expert score for each of the first users who provided the first content evaluations of the particular content item, the expert score for each of the first users being based on the second evaluations from the second users;
issue the expert score to each of the first users; and
elevate an influential characteristic of each of the first users having an expert score higher than a certain threshold when providing another evaluation during another time period.