| CPC G07C 5/0825 (2013.01) | 9 Claims |
|
1. A computerized method, performed by a user device having one or more hardware computer processors and one or more non-transitory computer readable storage device storing an inspection application executable by the user device to perform the computerized method comprising:
causing to display instructions on a display of the user device for the user to obtain inspection information of a vehicle, the inspection information including an inspection video of at least a portion of the vehicle or information related to the vehicle;
causing to determine a textual prompt including textual instructions to analyze the inspection video and to identify one or more particular vehicle components included in the inspection video;
causing to transmit a prompt to a large language model (“LLM”), wherein the LLM is a multimodal LLM capable of processing at least text and image data, wherein the prompt includes at least inspection information and the textual prompt;
causing to receive a first response from the LLM indicating that additional inspection information is needed to identify a particular vehicle component in the inspection video;
causing to display instructions on the display of the user device for the user to obtain the additional inspection information;
causing to transmit an updated prompt including at least a portion of the additional inspection information to the LLM;
causing to receive a second response from the LLM identifying a particular vehicle component of the vehicle;
causing to generate a component prompt including a plurality of possible inspection features that are specifically associated with the particular vehicle component;
causing to transmit the component prompt to the LLM; and
causing to receive a third response from the LLM indicating one or more inspection features of the plurality of possible inspection features that are identified by the LLM as associated with the particular vehicle component.
|