Language model assisted error analysis system

Patent metadata

Field	Value
Publication number	US-12487876-B2
Application number	US-202418735057-A
Country	US
Kind code	B2
Filing date	Jun 5, 2024
Priority date	Nov 6, 2023
Publication date	Dec 2, 2025
Grant date	Dec 2, 2025

Abstract

Computer-implemented systems and methods including language models for explaining and resolving code errors. A computer-implemented method may include: receiving or accessing a log comprising an error message, the error message indicating an error in code; determining the error message from the log; determining a context associated with the error; generating a prompt for a large language model (“LLM”), the prompt comprising at least: the error message, and the context associated with the error; transmitting the prompt to the LLM; and receiving an output from the LLM in response to the prompt, the output comprising at least: an explanation of the error message, and a suggested fix for the error.

First claim

What is claimed is:

1 . A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer-readable storage devices storing software instructions executable by the computing system, the computerized method comprising:
receiving or accessing a log comprising an error message, the error message indicating an error in code; determining the error message from the log; determining a context associated with the error, wherein the context associated with the error comprises portions of one or more documents associated with the code, and wherein the portions of the one or more documents associated with the code comprise document portions having a threshold similarity with the error message; generating a prompt for a large language model (“LLM”), the prompt comprising at least: the error message, and the context associated with the error; transmitting the prompt to the LLM; receiving an output from the LLM in response to the prompt, the output comprising at least: an explanation of the error message, and a suggested fix for the error; and implementing the suggested fix in response to a user input accepting the suggested fix, or automatically implementing the suggested fix.

2 . The computerized method of claim 1 , wherein the error is at least one of: a compile time error of the code or a run time error of the code.

3 . The computerized method of claim 2 , wherein determining the error message from the log comprises:
executing a semantic search or a regular expression (“regex”) search on the log to identify the error message, wherein the error message comprises one or more text strings.

4 . The computerized method of claim 3 , wherein the one or more text strings comprises at least one of: a natural language word, a natural language phrase, or a natural language sentence that indicates an occurrence of the error.

5 . The computerized method of claim 1 , wherein determining the context associated with the error comprises:
generating, based at least in part on the error message, one or more search criteria; and executing, using at least the one or more search criteria, a similarity search in a set of documents to identify the portions of the one or more documents associated with the code.

6 . The computerized method of claim 5 , wherein the similarity search comprises execution of a document search model, and wherein the computerized method further comprises:
generating the document search model, wherein generating the document search model comprises:
chunking the set of documents into a plurality of portions of the set of documents; and
vectorizing the plurality of portions of the set of documents to generate a plurality of vectors.

7 . The computerized method of claim 6 , wherein executing the similarity search comprises using at least one of: a language model, an artificial intelligence (“AI”) model, a generative model, a machine learning (“ML”) model, a neural network (“NN”), or another LLM.

8 . The computerized method of claim 7 , wherein the portions of the one or more documents associated with the code comprise a quantity n portions of the one or more documents most associated with the code.

9 . The computerized method of claim 8 , wherein the context associated with the error comprises one or more citations to the one or more documents.

10 . The computerized method of claim 9 , wherein the context associated with the error comprises extended portions of the log that are adjacent to the error message in the log.

11 . The computerized method of claim 10 , wherein the context associated with the error comprises a portion of the code associated with the error.

12 . The computerized method of claim 11 , wherein determining the context associated with the error comprises:
accessing the code from a repository that stores the code; and identifying, based on the error message, the portion of the code associated with the error.

13 . The computerized method of claim 12 , wherein the portion of the code associated with the error comprises a difference between multiple versions of at least a section of the code.

14 . The computerized method of claim 13 , wherein the prompt further comprises at least: one or more instructions that instruct the LLM to generate the explanation of the error message and/or the suggested fix for the error based on the error message and the context associated with the error.

15 . The computerized method of claim 14 further comprising:
providing, via a user interface, the output from the LLM.

16 . The computerized method of claim 15 , wherein the suggested fix comprises a modification to at least a section of the code.

17 . A system comprising:
one or more computer-readable storage media having program instructions embodied therewith; and one or more processors configured to execute the program instructions to cause the system to perform the computerized method of claim 1 .

18 . A computer program product comprising one or more computer-readable storage media having program instructions embodied therewith, the program instructions executable by one or more processors to cause the one or more processors to perform the computerized method of claim 1 .

Assignees

• Palantir Technologies Inc

Inventors

• Agrawal Akshay
• Diop Ndeye Fatou
• Hein Frauke
• Jeganathan Christopher
• Busko Oleh Igorovych
• Rogoz Claudia Rafaela
• Abdykaparov Dauren
• Shchekin Philipp
• Norris Ryan
• Ruikar Sudarshan Sanjay

Classifications

• G06F11/0706

  the processing taking place on a specific hardware platform or in a specific software environment · CPC title

• G06F11/0793

  Remedial or corrective actions (recovery from an exception in an instruction pipeline G06F9/3861; by retry G06F11/1402; for recovering from a failure of a protocol instance or entity H04L69/40) · CPC title

• G06F11/079

  Root cause analysis, i.e. error or fault diagnosis (in a hardware test environment G06F11/22; in a software test environment G06F11/36) · CPC title

• G06F11/0787

  Storage of error reports, e.g. persistent data storage, storage using memory protection · CPC title

• G06F11/0778

  Dumping, i.e. gathering error/state information after a fault for later diagnosis · CPC title