US 12,271,707 B1
Chat integration with grid-based data structure
George Sivulka, New York, NY (US)
Assigned to Hebbia Inc., New York, NY (US)
Filed by Hebbia Inc., New York, NY (US)
Filed on Nov. 26, 2024, as Appl. No. 18/961,216.
Claims priority of provisional application 63/563,117, filed on Mar. 8, 2024.
Claims priority of provisional application 63/604,124, filed on Nov. 29, 2023.
Int. Cl. G06F 40/35 (2020.01); G06F 16/334 (2025.01); G06F 16/338 (2019.01); G06F 16/383 (2019.01)
CPC G06F 40/35 (2020.01) [G06F 16/3344 (2019.01); G06F 16/338 (2019.01); G06F 16/383 (2019.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving a chat query from a client device associated with a user through a chat user interface, wherein the chat query comprises a text query;
accessing a grid-based data structure comprising a set of rows and a set of columns, where each row is associated with a source of a plurality of sources and each column is associated with a column prompt of a plurality of column prompts, and wherein the set of rows and set of columns define a set of cells for the grid-based data structure, and wherein each of the set of cells comprises contents from applying a column prompt of a corresponding column to a source of a corresponding row using a large language model;
identifying a subset of the set of cells that relate to the received chat query;
generating a final prompt based on contents of the identified subset of cells and the text query, wherein the final prompt comprises text instructions for a large language model to generate a response to the chat query from the user based on contents of the identified subset of the set of cells;
transmitting the final prompt to the large language model;
receiving a response from the large language model, wherein the response comprises text for a chat response to the chat query; and
transmitting the text for the chat response to the client device for display in the chat user interface.