US 12,141,413 B2
Evaluation of interactions with a user interface
Joel Grayson Webber, Marietta, GA (US); Stephanie Jill Brubaker, Marietta, GA (US); Hollis Bruce Johnson, Jr., Atlanta, GA (US); Ian Thomas Rose, Decatur, GA (US); Scott Mitchell Voigt, Atlanta, GA (US); Jaime Michael Yap, Atlanta, GA (US); and Joshua Calvin Teague, Marietta, GA (US)
Assigned to FullStory, Inc., Atlanta, GA (US)
Filed by FullStory, Inc., Atlanta, GA (US)
Filed on May 15, 2023, as Appl. No. 18/317,636.
Application 18/317,636 is a continuation of application No. 17/548,856, filed on Dec. 13, 2021, granted, now 11,687,208.
Application 17/548,856 is a continuation of application No. 17/094,390, filed on Nov. 10, 2020, granted, now 11,199,939, issued on Dec. 14, 2021.
Application 17/094,390 is a continuation of application No. 16/535,799, filed on Aug. 8, 2019, granted, now 10,838,571, issued on Nov. 17, 2020.
Application 16/535,799 is a continuation of application No. 15/896,887, filed on Feb. 14, 2018, granted, now 10,402,041, issued on Sep. 3, 2019.
Application 15/896,887 is a continuation of application No. 15/695,951, filed on Sep. 5, 2017, granted, now 9,927,947, issued on Mar. 27, 2018.
Application 15/695,951 is a continuation of application No. 14/587,481, filed on Dec. 31, 2014, granted, now 9,766,769, issued on Sep. 19, 2017.
Prior Publication US 2023/0400954 A1, Dec. 14, 2023
Int. Cl. G06F 3/0481 (2022.01); G06F 9/451 (2018.01); G06F 11/30 (2006.01); G06F 11/34 (2006.01); G06F 11/36 (2006.01); G06F 40/14 (2020.01)
CPC G06F 3/0481 (2013.01) [G06F 9/451 (2018.02); G06F 11/302 (2013.01); G06F 11/3438 (2013.01); G06F 11/3668 (2013.01); G06F 40/14 (2020.01)] 14 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving, from a client device, a query specifying a given user interface condition;
identifying, from a multidimensional index of prior user sessions, a set of user sessions in which the given user interface condition existed;
responding, by one or more data processing apparatus, to the query with (i) a list of user sessions included in the set of user sessions in which the given user interface condition existed and (ii) information indicating how many user sessions in which the given user interface condition existed;
reconstituting, by the one or more data processing apparatus, playback of at least one user session among the set of users sessions in which the given user interface condition existed, wherein reconstituting playback of the at least one user session comprises generating playback data that cause the client device to present (i) a first visual representation of a particular version of a user interface as previously presented during the at least one user session and (ii) visual changes to the particular version of the user interface that occurred during the at least one user session according to mutation data specifying user interface structure changes to the particular version of the user interface that occurred during the at least one user session;
providing the reconstituted playback of the at least one user session to the client device; and
highlighting, in a presentation of an activity list at the client device, a portion of the activity list specifying a user interaction that corresponds to visual changes of the given user interface in the reconstituted playback being presented at the client device.