US 12,248,481 B2
Systems and methods for using crowd sourcing to score online content as it relates to a belief state
Richard Kim, Stanford, CA (US); and Travis Trammell, Stanford, CA (US)
Assigned to Applied Decision Research LLC, Middletown, DE (US)
Filed by Applied Decision Research LLC, Middletown, DE (US)
Filed on Jul. 20, 2022, as Appl. No. 17/869,138.
Application 17/869,138 is a continuation of application No. 17/582,500, filed on Jan. 24, 2022, granted, now 11,803,559.
Application 17/582,500 is a continuation of application No. 17/412,150, filed on Aug. 25, 2021, granted, now 11,250,009, issued on Feb. 15, 2022.
Application 17/412,150 is a continuation of application No. 16/190,100, filed on Nov. 13, 2018, granted, now 11,157,503, issued on Oct. 26, 2021.
Claims priority of provisional application 62/586,821, filed on Nov. 15, 2017.
Prior Publication US 2022/0358133 A1, Nov. 10, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 16/435 (2019.01); G06F 16/2457 (2019.01); G06F 16/248 (2019.01); G06F 16/31 (2019.01); G06F 16/9535 (2019.01); G06F 16/9536 (2019.01); G06N 7/01 (2023.01); G06Q 30/0201 (2023.01); G06Q 30/0202 (2023.01); G06Q 50/00 (2012.01); H04N 21/442 (2011.01); H04N 21/45 (2011.01); H04N 21/466 (2011.01); H04N 21/475 (2011.01); H04N 21/482 (2011.01)
CPC G06F 16/24578 (2019.01) [G06F 16/248 (2019.01); G06F 16/313 (2019.01); G06F 16/435 (2019.01); G06F 16/9535 (2019.01); G06F 16/9536 (2019.01); G06N 7/01 (2023.01); G06Q 30/0201 (2013.01); G06Q 30/0202 (2013.01); G06Q 50/01 (2013.01); H04N 21/44226 (2020.08); H04N 21/4532 (2013.01); H04N 21/4668 (2013.01); H04N 21/4756 (2013.01); H04N 21/4826 (2013.01)] 36 Claims
OG exemplary drawing
 
1. A system comprising:
at least one hardware processor; and
memory storing computer instructions configured to assist in having content items that are presented by a web browser or an application evaluated, the computer instructions when executed by the at least one hardware processor being configured to cause the system to
identify a particular content item made available on a publication date for presentation to users by the web browser or the application, the particular content item having particular subject matter content, the particular subject matter content containing stated facts and/or opinions which a user is unsure whether to trust;
during a first time period, obtain first content evaluations of the particular content item from first users, each first content evaluation defining a first user evaluation of a belief state of the stated facts and/or opinions of the particular subject matter content in the particular content item;
during a second time period, the first time period initiating nearer to the publication date than the second time period, obtain second evaluations from second users regardless of second user expertise, the second users during the second time period defined as having benefit of hindsight as to the stated facts and/or opinions greater than most of the first users and thus being presumed to have knowledge as to the belief state of the stated facts and/or opinions of the particular subject matter content in the particular content item greater than most of the first users;
generate an expert score for each of the first users who provided the first content evaluations of the particular content item, the expert score for each of the first users being based on the second evaluations from the second users of each of the first content evaluations from each of the first users;
assist in displaying the first content evaluations in association with the particular content item;
issue the expert score to each of the first users;
elevate an influential characteristic of each of the first users having an expert score higher than a certain threshold when providing another content evaluation of another content item during another time period; and
generate an author score of an author of the particular content item based on at least a portion of the first content evaluations.