Contextual messaging in video conference

Patent metadata

Field	Value
Publication number	US-12438835-B2
Application number	US-202318503712-A
Country	US
Kind code	B2
Filing date	Nov 7, 2023
Priority date	Aug 31, 2021
Publication date	Oct 7, 2025
Grant date	Oct 7, 2025

Abstract

Generally discussed herein are devices, systems, and methods for contextual messaging in a conference. A method can include receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference, while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied, responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data, and providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

First claim

What is claimed is:

1. A method for contextual messaging in an audiovisual conference, the method comprising:
receiving, by a first user interface (UI), data indicating content of respective first and second messages, respective different recipients of the respective messages, and respective different conditions that, when satisfied during the conference, causes the respective messages to be visually displayed during the audiovisual conference;
determining, based on audio data, video data, or a combination thereof of the audiovisual conference, whether any of the respective conditions are satisfied;
responsive to determining the respective conditions associated with a satisfied message of the first message or the second message are satisfied, augmenting subsequent video data, audio data, or a combination thereof, to include the satisfied message resulting in augmented audiovisual data; and
providing, to the respective recipients of the satisfied message and on a second UI of an audiovisual conference application, a view of the augmented audiovisual data.

2. The method of claim 1 , wherein the data further comprises respective different formats in which to present the first and second messages.

3. The method of claim 2 , wherein a format of the respective different formats varies based on an inference determined based on the audio data, the video data, or a combination thereof.

4. The method of claim 1 , wherein the respective different recipients are defined based on their role in a company or a role in the audiovisual conference.

5. The method of claim 1 , wherein the respective recipients include a presented for the first message and a participant for the second message.

6. The method of claim 1 , wherein the data is provided by a presenter of the audiovisual conference and the respective recipients are participants.

7. The method of claim 1 , wherein the data is provided by a participant of the audiovisual conference and the respective different recipients are presenters.

8. The method of claim 1 , wherein the data further includes criterion that defines a characteristic of the recipients and which portions of the content of the satisfied message are provided to the recipients.

9. The method of claim 8 , wherein the criterion is determined based on an organizational policy, user-specified, or inferred based on the audio data, visual data, or a combination thereof.

10. A compute device comprising:
processing circuitry; and
a memory coupled to the processing circuitry, the memory including instructions that, when executed by the processing circuitry, cause the processing circuitry to perform operations for contextual messaging in an audiovisual conference, the operations comprising:
receiving, by a first user interface (UI), data indicating content of respective first and second messages, respective different recipients of the respective messages, and respective different conditions that, when satisfied during the conference, causes the respective messages to be visually displayed during the audiovisual conference;
determining, based on audio data, video data, or a combination thereof of the audiovisual conference and using one or more machine learning models, whether any of the respective conditions are satisfied;
responsive to determining the respective conditions associated with a satisfied message of the first message or the second message are satisfied, augmenting subsequent video data, audio data, or a combination thereof, to include the satisfied message resulting in augmented audiovisual data; and
providing, to the respective recipients of the satisfied message and on a second UI of an audiovisual conference application, a view of the augmented audiovisual data.

11. The compute device of claim 10 , wherein the data further comprises respective different formats in which to present the first and second messages.

12. The compute device of claim 11 , wherein a format of the respective different formats varies based on an inference determined based on the audio data, the video data, or a combination thereof.

13. The compute device of claim 10 , wherein the respective different recipients are defined based on their role in a company or a role in the audiovisual conference.

14. The compute device of claim 10 , wherein the respective recipients include a presented for the first message and a participant for the second message.

15. The compute device of claim 10 , wherein the data is provided by a presenter of the audiovisual conference and the respective recipients are participants.

16. The compute device of claim 10 , wherein the data is provided by a participant of the audiovisual conference and the respective different recipients are presenters.

17. The compute device of claim 10 , wherein the data further includes criterion that defines a characteristic of the recipients and which portions of the content of the satisfied message are provided to the recipients.

18. The compute device of claim 17 , wherein the criterion is determined based on an organizational policy, user-specified, or inferred based on the audio data, visual data, or a combination thereof.

19. A non-transitory machine-readable medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
receiving data indicating content of respective first and second messages, respective different recipients of the respective messages, and respective different conditions that, when satisfied during an audiovisual conference, causes the respective messages to be visually displayed during the audiovisual conference;
storing the received data such that, while the conference is being held via an audiovisual conference application, the audiovisual conference application monitors audiovisual conference data for user contextual data, the audiovisual conference data including audio and video of the audiovisual conference, the video including data of images of multiple participants in the audiovisual conference;
responsive to receiving data indicating that the respective conditions associated with a satisfied message of the first message or the second message are satisfied, augmenting subsequent video data, audio data, or a combination thereof, to include the satisfied message resulting in augmented audiovisual data; and
providing, to the respective recipients of the satisfied message, a view of the augmented audiovisual data.

20. The non-transitory machine-readable medium of claim 19 , wherein the data further indicates a format in which to present the first and second messages, the format including one of a ticker tape, thought bubble, notification, hyperlink, or text box for the first message and a different one of the ticker tape thought bubble, notification, hyperlink, or text box for the second message.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• White Ryen William
• Bailey Peter

Classifications

• H04L65/403

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title

• G06F2203/04804

  Transparency, e.g. transparent or translucent windows · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06V20/44

  Event detection · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title