Computer support for meetings

Patent metadata

Field	Value
Publication number	US-11113672-B2
Application number	US-201815933249-A
Country	US
Kind code	B2
Filing date	Mar 22, 2018
Priority date	Mar 22, 2018
Publication date	Sep 7, 2021
Grant date	Sep 7, 2021

Abstract

A system and method to provide computer support for a meeting of invitees comprises accessing one or more sensory data streams providing digitized sensory data responsive to an activity of one or more of the invitees during the meeting, the one or more sensory data streams including at least one audio stream. The method also comprises subjecting the at least one audio stream to phonetic and situational computer modeling to recognize a sequence of words in the audio stream and to assign each word to an invitee, subjecting the sequence of words to semantic computer modeling to recognize a sequence of directives in the sequence of words, and releasing one or more output data streams based on the sequence of directives, the one or more output data streams including one or more notifications.

First claim

The invention claimed is:

1. A method to provide computer support for a meeting of invitees, the method comprising:
accessing one or more sensory data streams providing digitized sensory data responsive to an activity of one or more of the invitees during the meeting, the one or more sensory data streams including at least one audio stream and a video stream;
subjecting the at least one audio stream to phonetic and situational computer modeling to recognize a sequence of words in the at least one audio stream;
assigning each word of the sequence of words to an invitee based at least in part on an analysis of image data from the video stream;
subjecting the sequence of words to semantic computer modeling by a machine-learning model to recognize a sequence of directives in the sequence of words, each directive associated with at least one invitee or other individual;
releasing one or more output data streams based on the sequence of directives, the one or more output data streams including one or more notifications comprising a list of directives recognized by the machine-learning model;
receiving an edited list of directives actually discussed during the meeting; and
refining the machine-learning model based on the edited list of directives.

2. The method of claim 1 wherein releasing the one or more output data streams includes submitting the sequence of directives to a user that organized the meeting for editing and subsequent distribution to one or more of the invitees.

3. The method of claim 1 wherein recognizing the sequence of directives includes extracting features from the sequence of words to recognize one or more of a directive, acceptance of a directive, and revocation of a directive.

4. The method of claim 1 wherein recognizing the sequence of directives includes classification via a trained machine-learning model.

5. The method of claim 1 wherein the sequence of directives includes a personal directive to be enacted by a first invitee.

6. The method of claim 1 wherein the one or more sensory data streams includes data revealing geophysical location of a first invitee.

7. The method of claim 1 wherein the sequence of directives includes a personal directive to a first invitee to remind the first invitee to attend the meeting.

8. The method of claim 1 wherein the one or more output data streams include an email or sms stream through which the one or more notifications are issued.

9. An automated meeting-support system comprising:
a processor;
a network device operatively coupled to the processor; and
computer memory operatively coupled to the processor and configured to hold program instructions executable by the processor, the program instructions comprising:
instructions to train a machine-learning model on previous meeting minutes to recognize directives;
instructions to access one or more sensory data streams providing digitized sensory data responsive to an activity of one or more invitees during a meeting, the one or more sensory data streams including at least one audio stream,
instructions to subject the at least one audio stream to phonetic and situational computer modeling to recognize a sequence of words in the at least one audio stream and to assign each word of the sequence of words to an invitee,
instructions to subject the sequence of words to semantic computer modeling by the machine-learning model to recognize a sequence of directives in the sequence of words,
instructions to release, via the network device, one or more output data streams based on the sequence of directives, the one or more output data streams including one or more notifications comprising a list of directives recognized by the machine-learning model,
instructions to receive an edited list of directives actually discussed during the meeting, and
instructions to refine the machine-learning model based on the edited list of directives.

10. The system of claim 9 wherein the program instructions further comprise instructions to receive a plurality of agenda items and to determine, based on the sequence of words, which agenda items have been discussed at the meeting.

11. The system of claim 9 wherein the program instructions further comprise instructions to prompt the one or more invitees during the meeting for commitments.

12. The system of claim 9 wherein the program instructions further comprise instructions to track a geophysical location of a first invitee and to issue a notification via the one or more output data streams when the first invitee is late for the meeting.

13. The system of claim 12 wherein the instructions to release the one or more output data streams specify that the notification is directed to the first invitee.

14. The system of claim 12 wherein the instructions to release the one or more output data streams specify that the notification is directed to a user that is an organizer of the meeting.

15. The system of claim 9 wherein the program instructions further comprise instructions to receive a plurality of agenda items and to determine, based on the sequence of words, which agenda items have been discussed at the meeting.

16. One or more memory devices having embodied thereon computer-executable instructions which, when executed by one or more processors, performs a method of providing support for a meeting of invitees, the method comprising:
accessing one or more sensory data streams providing digitized sensory data responsive to an activity of one or more invitees during the meeting, the one or more sensory data streams including at least one audio stream;
subjecting the at least one audio stream to phonetic and situational computer modeling to recognize a sequence of words in the at least one audio stream;
accessing depth images obtained by a depth-imaging camera;
analyzing the depth images to determine relative postures of the invitees;
assigning each word of the sequence of words to an invitee based at least in part on the relative postures of the invitees to associate audio with individual invitees;
subjecting the sequence of words to semantic computer modeling by a machine-learning model to recognize a sequence of directives in the sequence of words;
releasing, via a network device, one or more output data streams based on the sequence of directives, the one or more output data streams including one or more notifications comprising a list of directives recognized by the machine-learning model;
receiving an edited list of directives actually discussed during the meeting; and
refining the machine-learning model based on the edited list of directives.

17. The one or more memory devices of claim 16 , the method further comprising prompting the one or more invitees during the meeting for commitments.

18. The one or more memory devices of claim 16 , the method further comprising tracking a geophysical location of a first invitee and to issue a notification via the one or more output data streams when the first invitee is late for the meeting.

19. The one or more memory devices of claim 18 , wherein the notification is directed to the first invitee.

20. The one or more memory devices of claim 18 , wherein the notification is directed to a user that is an organizer of the meeting.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Sim Robert Alexander
• Mendes Hasegawa Marcello
• White Ryen William
• Jain Mudit
• Hermelin Tomer
• Gerzi Rosenthal Adi
• HILLELI Sagi

Classifications

• G06Q10/1093 Primary

  Calendar-based scheduling for persons or groups · CPC title

• G06F40/10

  Text processing (natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40) · CPC title

• G10L2015/088

  Word spotting · CPC title

• G10L15/02

  Feature extraction for speech recognition; Selection of recognition unit · CPC title

• G10L2015/025

  Phonemes, fenemes or fenones being the recognition units · CPC title