Contextual messaging in video conference

Patent metadata

Field	Value
Publication number	US-11848900-B2
Application number	US-202117463010-A
Country	US
Kind code	B2
Filing date	Aug 31, 2021
Priority date	Aug 31, 2021
Publication date	Dec 19, 2023
Grant date	Dec 19, 2023

Abstract

Generally discussed herein are devices, systems, and methods for contextual messaging in a conference. A method can include receiving, by a first user interface, data indicating content of a message, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference, while the conference is being held via an audiovisual conference application, monitoring user contextual data for whether the condition is satisfied, responsive to the condition being satisfied, augmenting audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data, and providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

First claim

What is claimed is:

1. A method for contextual messaging in an audiovisual conference, the method comprising:
receiving, by an attendee of the audiovisual conference and by a first user interface, data indicating content of a message relevant to content of the audiovisual conference, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference;
while the conference is being held via an audiovisual conference application, monitoring audiovisual conference data for user contextual data, the audiovisual conference data including audio and video of the audiovisual conference, the video including data of images of multiple participants in the audiovisual conference:
determining, based on the user contextual data, whether the condition is satisfied;
responsive to determining the condition is satisfied, augmenting further subsequent video data from audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data; and
providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

2. The method of claim 1 , wherein the data further indicates a location on the second user interface to present the message and the content of the message is presented at the location on the second user interface.

3. The method of claim 1 , wherein the audiovisual conference application is executed on a client or a server.

4. The method of claim 1 , wherein the data further indicates a form of the content of the message, the form including a type of presentation of the content, the type including ticker tape, thought bubble, notification, hyperlink, or text box.

5. The method of claim 4 , wherein the form further includes a visual transparency of the content of the message.

6. The method of claim 1 , wherein the recipient of the data includes a characteristic condition that indicates that only users that satisfy the characteristic condition receive the content of the message.

7. The method of claim 6 , wherein the data further includes a criterion that defines a further characteristic condition that defines which portions of the content of the message are provided to the recipient.

8. The method of claim 1 , wherein the condition includes an event occurring in audiovisual data of the conference, the event including a gesture being performed, a phrase being spoken, a time elapsing, check of user contextual information, or an object appearing.

9. The method of claim 1 , wherein the user contextual information includes a job title, education status, expertise, task status, training status, device type, or current location.

10. The method of claim 1 , further comprising:
receiving, by an attendee of the audiovisual conference and by a first user interface, data indicating content of a second message, a second, different recipient of the second message, and a second condition that, when satisfied, causes the second message to be displayed during the conference;
while the conference is being held via a conference application, monitoring, by the conference application, audiovisual data of the conference for whether the second condition is satisfied;
responsive to the second condition being satisfied, augmenting the audiovisual data to include the second message resulting in second augmented audiovisual data; and
providing, to only the second recipient on a third user interface of the conference application, a view of the augmented audiovisual data.

11. The method of claim 1 , wherein the recipient is only a presenter participant.

12. A compute device comprising:
processing circuitry; and
a memory coupled to the processing circuitry, the memory including instructions that, when executed by the processing circuitry, cause the processing circuitry to perform operations for contextual messaging in an audiovisual conference, the operations comprising:
receiving, by a first user interface, data indicating content of a message relevant to content of the audiovisual conference, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference;
while the conference is being held via an audiovisual conference application, monitoring audiovisual conference data for user contextual data, the audiovisual conference data including audio and video of the audiovisual conference, the video including data of images of multiple participants in the audiovisual conference:
determining, based on the user contextual data, whether the condition is satisfied;
responsive to determining the condition is satisfied, augmenting further subsequent video data from audiovisual conference data from the audiovisual conference application to include the message resulting in augmented audiovisual data; and
providing, to the recipient on a second user interface of the audiovisual conference application, a view of the augmented audiovisual data.

13. The compute device of claim 12 , wherein the data further indicates a location on the second user interface to present the message and the content of the message is presented at the location on the second user interface.

14. The compute device of claim 12 , wherein the data further indicates a form of the content of the message, the form including a type of presentation of the content, the type including ticker tape, thought bubble, or text box.

15. The compute device of claim 14 , wherein the form further includes a visual transparency of the content of the message.

16. The compute device of claim 12 , wherein the recipient of the data includes a characteristic condition that indicates that only users that satisfy the characteristic condition receive the content of the message.

17. The compute device of claim 16 , wherein the data further includes a criterion that defines a further characteristic condition that defines which portions of the content of the message are provided to the recipient.

18. A user interface for an audiovisual conference compatible application, the user interface configured to perform operations comprising:
receiving, by an attendee of the audiovisual conference, data indicating content of a message relevant to content of the audiovisual conference, a recipient of the message, and a condition that, when satisfied during the conference, causes the message to be visually displayed during the audiovisual conference;
storing the received data such that, while the conference is being held via an audiovisual conference application, the audiovisual conference application monitors audiovisual conference data for user contextual data, the audiovisual conference data including audio and video of the audiovisual conference, the video including data of images of multiple participants in the audiovisual conference:
responsive to determining, based on the user contextual data, the condition is satisfied augmenting further subsequent video data from audiovisual conference data from the audiovisual data to include the message resulting in augmented audiovisual data; and
providing, to the recipient, a view of the augmented audiovisual data.

19. The user interface of claim 18 , wherein the condition includes an event occurring in audiovisual data of the conference, the event including a gesture being performed, a phrase being spoken, a time elapsing, or an object appearing.

20. The u

Assignees

• Microsoft Technology Licensing Llc

Inventors

• White Ryen William
• Bailey Peter

Classifications

• H04L51/046 Primary

  Interoperability with other network applications or services · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06V20/40

  in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) · CPC title

• H04L65/403

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title

• G06F2203/04804

  Transparency, e.g. transparent or translucent windows · CPC title