Supplemental content and generative language models

Patent metadata

Field	Value
Publication number	US-12579358-B2
Application number	US-202318478934-A
Country	US
Kind code	B2
Filing date	Sep 29, 2023
Priority date	Feb 1, 2023
Publication date	Mar 17, 2026
Grant date	Mar 17, 2026

Abstract

A computing system includes a processor and memory storing instructions that, when executed by the processor, cause the processor to perform several acts. The acts include providing a prompt to a generative language model, where the generative language model generates output based upon the prompt, identifies text in the output that is to be associated with a supplemental content item, and assigning a hyperlink to the text in the output. Upon the hyperlink being selected or hovered over, the supplemental content item is displayed.

First claim

What is claimed is:

1 . A computing system comprising:
a processor; and memory storing instructions that, when executed by the processor, cause the processor to perform acts comprising:
receiving user input set forth by a user of a client computing device;
providing a prompt to a generative model, wherein the prompt comprises at least a portion of the user input;
causing the generative model to, responsive to receiving the prompt, generate output based upon the prompt;
identifying text in the output generated by the generative model that is to be associated with a supplemental content, wherein the supplemental content is not included in the output;
causing the generative model to generate a query for a supplemental content provision system based upon the identified text and the supplemental content;
obtaining, from the supplemental content provision system, a supplemental content item relevant to the query and the supplemental content;
assigning a hyperlink to the identified text in the output, wherein the hyperlink is associated with the supplemental content;
causing the output to be displayed upon a display of the client computing device; and
responsive to determining that the hyperlink is being hovered over, causing the supplemental content item to be displayed concurrently with the output on the display.

2 . The computing system of claim 1 , wherein upon the hyperlink being selected, a webpage pertaining to the supplemental content is loaded by a web browser of the client computing device and presented on the display.

3 . The computing system of claim 1 , where the generative model generates a second query based upon the user input, the acts further comprising:
providing the second query to a search engine, where the search engine identifies a search result based upon the second query; and including at least a portion of the search result in the prompt.

4 . The computing system of claim 1 , the acts further comprising:
subsequent to causing the output to be displayed on the display of the client computing device, receiving a second user input; providing the second user input to the generative model; causing the generative model to generate a second query for the supplemental content provision system based upon the second user input; providing the second query to the supplemental content provision system, where the supplemental content provision system identifies a second supplemental content item based upon the query; providing the second supplemental content item to the generative model; and causing the second supplemental content item to be displayed on the display concurrently with the output.

5 . The computing system of claim 4 , the acts further comprising:
providing the second query to a search engine, where the search engine identifies an image based upon the second query; and inserting the image into the second supplemental content item.

6 . The computing system of claim 1 , wherein the prompt includes instructions to refrain from considering information pertaining to the supplemental content item when identifying that the text in the output is to be associated with the supplemental content item.

7 . The computing system of claim 1 , wherein the prompt includes user history information, and further wherein text in the output is identified as being associated with the supplemental content item based upon the user history information.

8 . A method performed by a computing system, the method comprising:
at a generative model, receiving a prompt; generating, by the generative model, output based upon the prompt, where the output includes text; identifying, by the generative model, that at least one word in the text is to be associated with supplemental content; generating, by the generative model, a query for a supplemental content provision system, wherein the query is based upon the identified at least one word and the supplemental content; obtaining, from the supplemental content provision system, a supplemental content item relevant to the query and the supplemental content; obtaining a hyperlink that points to the supplemental content; assigning, by the generative model that generated the output, the hyperlink to the at least one word in the text of the output; causing the output to be displayed on a display, where the at least one word in the text is displayed as having the hyperlink assigned thereto, and further where the supplemental content item is displayed in a graphical user interface (GUI) associated with the generative model together with the output of the generative model in response to the hyperlink being hovered over.

9 . The method of claim 8 , further comprising:
receiving an indication that the supplemental content item has been selected; and in response to receiving the indication that the supplemental content item has been selected, updating a prompt of the generative model to include content of a webpage pointed to by the supplemental content item.

10 . The method of claim 8 , further comprising:
prior to the generative model generating the output, receiving user input, where the user input is included in the prompt.

11 . The method of claim 10 , further comprising:
generating, by the generative model, a query based upon the user input; providing the query to a search engine, where the search engine identifies a search result based upon the query; and including at least a portion of the search result in the prompt.

12 . A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to perform acts comprising:
providing a prompt to a generative model, where the prompt includes an instruction to the generative model, the instruction instructs the generative model to review an output that is generated by the generative model based upon the prompt for text that is to be associated with a supplemental content item, wherein the supplemental content item is not included in the output; identifying text in the output that is to be associated with the supplemental content item; generating a query for a supplemental content provision system based upon the identified text; responsive to executing a search of the supplemental content provision system based upon the query, obtaining the supplemental content item; assigning a hyperlink to the text in the output, wherein the hyperlink is associated with the supplemental content item; receiving the output from the generative model, where the output includes the text and the hyperlink assigned to the text; and causing the output to be displayed in a graphical user interface (GUI), where the text has the hyperlink assigned thereto, and further where upon the hyperlink being hovered over, the supplemental content item is displayed concurrently with the output.

13 . The computer-readable storage medium of claim 12 , wherein upon the hyperlink being selected, a webpage pertaining to the supplemental content item is loaded by a web browser and presented on a display of a client computing device.

14 . The computer-readable storage medium of claim 12 , the acts further comprising:
prior to providing the prompt to the generative model:
receiving user input;
providing the user input to the generative model;
receiving a second query generated by the generative model based upon the user input;
providing the second query to a search engine, where the search engine identifies a search result based upon the query; and
including at least a portion of the search result in the prompt.

15 . The computer-readable stora

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Manavoglu Eren
• Basu Debapriya

Classifications

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F16/954

  Navigation, e.g. using categorised browsing · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F16/953

  Querying, e.g. by the use of web search engines · CPC title

• G06F40/279

  Recognition of textual entities · CPC title