Multi-media summary generation based on meeting discussions

Patent metadata

Field	Value
Publication number	US-2026064939-A1
Application number	US-202418819811-A
Country	US
Kind code	A1
Filing date	Aug 29, 2024
Priority date	Aug 29, 2024
Publication date	Mar 5, 2026
Grant date	—

Abstract

Aspects of the disclosure are directed to multi-media summary generation based on meeting discussions. A virtual meeting user interface (UI) can be presented during a virtual meeting between a plurality of participants. A command can be received, via the virtual meeting UI, a from a first participant of the plurality of participants to enable automatic note taking. A meeting summary of the virtual meeting can be generated, wherein the meeting summary includes a plurality of embedded references, wherein each embedded reference of the plurality of embedded references identifies at least one corresponding portion of media streams generated by a plurality of client devices associated with the plurality of participants of the virtual meeting. The meeting summary can be provided to the first participant.

First claim

What is claimed is:

1 . A method comprising:
causing a virtual meeting user interface (UI) to be presented during a virtual meeting between a plurality of participants; receiving, via the virtual meeting UI, a command from a first participant of the plurality of participants to enable automatic note taking; generating a meeting summary of the virtual meeting, wherein the meeting summary includes a plurality of embedded references, wherein each embedded reference of the plurality of embedded references identifies at least one corresponding portion of media streams generated by a plurality of client devices associated with the plurality of participants of the virtual meeting; and providing the meeting summary to the first participant.

2 . The method of claim 1 , wherein the meeting summary is generated using an artificial intelligence (AI) model and using the media streams generated by the plurality of client devices associated with the plurality of participants as input to the AI model.

3 . The method of claim 2 , wherein the AI model is trained to generate meeting summaries of virtual meetings using training data comprising media streams generated by a second plurality of client devices associated with a second plurality of participants of past virtual meetings.

4 . The method of claim 1 , wherein the meeting summary is generated based on a transcript of the virtual meeting, wherein the transcript comprises a second plurality of embedded references, wherein each embedded reference of the second plurality of embedded references identifies at least one corresponding portion of the media streams.

5 . The method of claim 1 , wherein the meeting summary comprises at least one of:
one or more action items assigned to respective one or more participants of the plurality of participants; a list of topics discussed during the virtual meeting; one or more documents presented via the virtual meeting UI; or one or more portions of a textual chat presented via the virtual meeting UI.

6 . The method of claim 1 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, the method further comprising:
visually rendering the meeting summary; receiving a user selection of a portion of the meeting summary; identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of the media streams associated with the selected portion of the meeting summary; and visually rendering the identified portion of the media streams.

7 . The method of claim 6 , further comprising:
visually distinguishing the selected portion of the meeting summary.

8 . The method of claim 1 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, the method further comprising:
visually rendering the meeting summary; receiving a user selection of a portion of the meeting summary identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of a meeting transcript associated with the selected portion of the meeting summary; and visually rendering the identified portion of the meeting transcript.

9 . The method of claim 1 , wherein each embedded reference is a hyperlink that is visually identifiable in a visual rendering of the meeting summary.

10 . The method of claim 1 , wherein each embedded reference is a visually hidden hyperlink.

11 . A system comprising:
a memory; and a processing device, coupled to the memory, configured to perform operations comprising:
causing a virtual meeting user interface (UI) to be presented during a virtual meeting between a plurality of participants;
receiving, via the virtual meeting UI, a command from a first participant of the plurality of participants to enable automatic note taking;
generating a meeting summary of the virtual meeting, wherein the meeting summary includes a plurality of embedded references, wherein each embedded reference of the plurality of embedded references identifies at least one corresponding portion of media streams generated by a plurality of client devices associated with the plurality of participants of the virtual meeting; and
providing the meeting summary to the first participant.

12 . The system of claim 11 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, and wherein the processing device is further configured to perform operations comprising:
visually rendering the meeting summary; receiving a user selection of a portion of the meeting summary; identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of the media streams associated with the selected portion of the meeting summary; and visually rendering the identified portion of the media streams.

13 . The system of claim 12 , wherein the processing device is further configured to perform operations comprising:
visually distinguishing the selected portion of the meeting summary.

14 . The system of claim 11 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, and wherein the processing device is further configured to perform operations comprising:
visually rendering the meeting summary; receiving a user selection of a portion of the meeting summary; identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of a meeting transcript associated with the selected portion of the meeting summary; and visually rendering the identified portion of the meeting transcript.

15 . The system of claim 11 , wherein each embedded reference is a hyperlink that is visually identifiable in a visual rendering of the meeting summary.

16 . A non-transitory computer readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:
causing a virtual meeting user interface (UI) to be presented during a virtual meeting between a plurality of participants; receiving, via the virtual meeting UI, a command from a first participant of the plurality of participants to enable automatic note taking; generating a meeting summary of the virtual meeting, wherein the meeting summary includes a plurality of embedded references, wherein each embedded reference of the plurality of embedded references identifies at least one corresponding portion of media streams generated by a plurality of client devices associated with the plurality of participants of the virtual meeting; and providing the meeting summary to the first participant.

17 . The non-transitory computer readable storage medium of claim 16 , wherein each embedded reference of the plurality of embedded references is associated with a respective portion of the meeting summary, and wherein the processing device is further configured to perform operations comprising:
visually rendering the meeting summary; receiving a user selection of a portion of the meeting summary; identifying, based on an embedded reference associated with the selected portion of the meeting summary, a portion of the media streams associated with the selected portion of the meeting summary; and visually rendering the identified portion of the media streams.

18 . The non-transitory comput

Assignees

• Google Llc

Inventors

• Shernan Ethan Samuel
• Sanglaji Maryam
• Shen Jennifer
• Levin Dmitry Denisovich
• Moore Kristin
• Callas Jan Arvid Kristoffer
• Volkov Anton
• Littlewood Dan
• Liu Yan
• Liu Lixia
• Liu Decheng
• Tsay Jacqueline Amy
• Mao Yu
• Fatiha Deeni
• Sandholm Anders Thorhauge
• Chin Constance

Classifications

• H04L12/1831

  Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status · CPC title

• G06F40/134 Primary

  Hyperlinking · CPC title