Accelerated instant replay for co-present and distributed meetings

Patent metadata

Field	Value
Publication number	US-9977574-B2
Application number	US-201414327421-A
Country	US
Kind code	B2
Filing date	Jul 9, 2014
Priority date	Apr 30, 2010
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

Techniques for recording and replay of a live conference while still attending the live conference are described. A conferencing system includes a user interface generator, a live conference processing module, and a replay processing module. The user interface generator is configured to generate a user interface that includes a replay control panel and one or more output panels. The live conference processing module is configured to extract information included in received conferencing data that is associated with one or more conferencing modalities, and to display the information in the one or more output panels in a live manner (e.g., as a live conference). The replay processing module is configured to enable information associated with the one or more conferencing modalities corresponding to a time of the conference session prior to live to be presented at a desired rate, possibly different from the real-time rate.

First claim

What is claimed is:

1. A conferencing system, comprising:
a user interface generator configured to generate a user interface that includes a replay control panel and a first output panel, the replay control panel being configured to enable a user to select a replay mode by interacting with the replay control panel;
a live conference processing module configured to receive conferencing data associated with a conference session, to extract information included in the received conferencing data that is associated with a first conferencing modality to be displayed in the first output panel in a live manner; and
a conference summary generator configured to generate from a textual transcript of the conference session a keyword cloud that includes a display of a plurality of weighted textually descriptive keywords and that summarizes the textual transcript of the conference session as a whole, and to display the generated keyword cloud simultaneous with the first conferencing modality displayed in the live manner, the keyword cloud being interactive, with keywords in the keyword cloud being selectable by a user to navigate the textual transcript.

2. The conferencing system of claim 1 , further comprising:
the keyword cloud indicating one or more of a topic of the conference session being discussed live and a topic of the conference session being discussed at the selected replay time.

3. The conferencing system of claim 1 , wherein the conference summary generator indicates keywords in the keyword cloud with different weights to indicate relative importance of the keywords.

4. The conferencing system of claim 3 , wherein the conference summary generator distinguishes a first keyword in the keyword cloud from a second keyword in the keyword cloud based on a frequency of the first and second keywords in the textual transcript.

5. The conferencing system of claim 1 , wherein keywords in the keyword cloud are selectable to cause the textual transcript to scroll to the next instance of the keyword in the textual transcript.

6. The conferencing system of claim 1 , wherein the first conferencing modality is a textual transcript modality, wherein the live conference processing module is configured to enable the textual transcript of the conference session to be displayed in the first output panel in the live manner; and
a replay processing module configured to receive a replay time selected by a user that interacts with the replay control panel, and to enable text of the textual transcript corresponding to the selected replay time to be displayed.

7. The conferencing system of claim 1 , further comprising:
a conference data analyzer configured to analyze the conferencing data received to determine at least one of a speech activity, a speaker change event, or a content change event; and
the determined at least one of the speech activity, the speaker change event, or the content change event being presented to a user as at least one cue in the textual transcript.

8. The conferencing system of claim 1 , the user interface generator being configured to generate a second output panel if a replay mode is selected;
the conferencing system further comprising:
a replay processing module being configured to display a conferencing modality in the second output panel in a replay manner occurring simultaneous with display of the first conferencing modality in the first output panel in a live manner.

9. The conferencing system of claim 8 , wherein a plurality of different combinations of conferencing modalities are selectable for live display in the first output panel and replay display in the second output panel.

10. A method, comprising:
receiving conferencing data associated with a conference session;
generating a user interface that includes a replay control panel;
enabling a user to interact with the replay control panel to play one or more conferencing modalities of the conference session in a replay manner;
generating from the conferencing data a keyword cloud that includes a display of a plurality of weighted textually descriptive keywords and that summarizes a textual transcript of the conference session as a whole;
displaying the generated keyword cloud simultaneous with at least one of the one or more conferencing modalities in a first output panel in a live manner; and
enabling a user to select keywords in the keyword cloud to navigate the conference session.

11. The method of claim 10 , further comprising:
beginning replay of the conference session at a first instance of a selected keyword in the conferencing data.

12. The method of claim 11 , further comprising:
advancing replay of the conference session to a next instance of a repeatedly selected keyword in the conferencing data.

13. The method of claim 10 , further comprising:
enabling a user to select one of a plurality of different combinations of conferencing modalities in the conferencing data for simultaneous live play and replay of the conference session.

14. The method of claim 10 , further comprising:
displaying emphasized keywords in the keyword cloud.

15. The method of claim 14 , wherein the emphasized keywords comprise one or more of a present topic of the conference, a past topic in the conference session, a relative importance of keywords, or a frequency of occurrence of keywords in the conferencing data.

16. A conferencing system, comprising:
a user interface generator configured to generate a user interface that includes a replay control panel and a first output panel, the replay control panel being configured to enable a user to select a replay mode by interacting with the replay control panel;
a live conference processing module configured to receive conferencing data associated with a conference session, to extract information included in the received conferencing data that is associated with a first conferencing modality to be displayed in the first output panel in a live manner; and
a conference data analyzer configured to analyze the information associated with the first conferencing modality to determine cues to areas of interest in the conferencing data, the cues being presented to a user simultaneous with the first conferencing modality displayed in the live manner as selectable navigation cues inserted in the first conferencing modality displayed in the first output panel.

17. The conferencing system of claim 16 , wherein the first conferencing modality is a textual transcript.

18. The conferencing system of claim 16 , wherein the areas of interest comprise at least one of a speech activity, a speaker change event and a content change event.

19. The conferencing system of claim 1 , wherein a user status is displayed by the user interface for each user of the conference.

20. The conferencing system of claim 16 , wherein a user status is displayed by the user interface for each user of the conference.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Quinn Kori Inkpen
• Hegde Rajesh
• Zhang Zhengyou
• Tang John
• Junuzovic Sasa
• Brooks Christopher

Classifications

• H04N7/15 Primary

  Conference systems · CPC title

• G06F3/04842 Primary

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06K9/4676

  Physics · mapped topic

• H04N7/155

  involving storage of or access to video conference sessions (tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831) · CPC title

• H04N21/47202

  for requesting content on demand, e.g. video on demand · CPC title