Systems and methods for peripheral awareness of, and nominal interaction with, a remote meeting using a wearable device

Patent metadata

Field	Value
Publication number	US-2016006983-A1
Application number	US-201514856535-A
Country	US
Kind code	A1
Filing date	Sep 16, 2015
Priority date	Oct 11, 2013
Publication date	Jan 7, 2016
Grant date	—

Abstract

Provided is a system and associated method that allow meeting participants to maintain a basic awareness of the audio and visual content of a meeting using a wearable device, such as a smartwatch, well known to persons of ordinary skill in the art. Embodiments of the described system and method also provide essential interaction mechanisms such that the remote, mobile users can interact with the distributed meeting without distracting them from their other tasks. In one embodiment, the described techniques provide an unobtrusive way for users to participate in ongoing distributed meetings using a smartwatch-based interface for a video conferencing application.

First claim

What is claimed is:

1 . A computer-implemented method performed on a wearable device worn by a user in connection with a meeting between a plurality of participants, the wearable device comprising a processing unit, a memory and a display, the computer-implemented method comprising:
a. extracting a plurality of keyframes from each of a plurality of live meeting streams; b. displaying one of a plurality of keyframes from one of the plurality of streams to the user on the display device; c. detecting input from the user; d. if the detected input from the user is of a first type, displaying another one of a plurality of keyframes from the one of the plurality of streams; and e. if the detected input from the user is of a second type, displaying one of a plurality of keyframes from another one of the plurality of streams.

2 . The computer-implemented method of claim 1 , wherein the user input of a first type comprises a user gesture in a first direction.

3 . The computer-implemented method of claim 2 , wherein the first direction is a horizontal direction.

4 . The computer-implemented method of claim 1 , wherein the user input of a second type comprises a user gesture in a second direction.

5 . The computer-implemented method of claim 4 , wherein the second direction is a vertical direction.

6 . The computer-implemented method of claim 1 , further comprising, if the detected input from the user is of a third type, zooming the displayed keyframe.

7 . The computer-implemented method of claim 6 , wherein the user input of a third type comprises a double tap gesture.

8 . The computer-implemented method of claim 1 , further comprising, if the detected input from the user is of a fourth type, showing one of the plurality of live meeting streams to the user.

9 . The computer-implemented method of claim 8 , wherein the he user input of a fourth type comprises turning the display of the wearable device towards a face of the user.

10 . The computer-implemented method of claim 8 , further comprising ceasing showing one of the plurality of live meeting streams to the user when the user turns the display of the wearable device away from the face of the user

11 . The computer-implemented method of claim 1 , wherein each of the plurality of keyframes are generated based on a difference between two keyframes in the corresponding live meeting stream.

12 . The computer-implemented method of claim 11 , wherein a keyframe is generated when the difference between two keyframes in the corresponding live meeting stream exceeds a predetermined threshold.

13 . The computer-implemented method of claim 12 , wherein the predetermined threshold is determined based on a type of content in the corresponding live meeting stream.

14 . The computer-implemented method of claim 1 , further comprising using the display device to display chat messages to the user.

15 . The computer-implemented method of claim 1 , further comprising receiving chat input from the user and transmitting the chat input to the plurality of meeting participants.

16 . The computer-implemented method of claim 15 , wherein the chat input is received from the user using a graphical user interface generated on the display.

17 . The computer-implemented method of claim 16 , wherein the graphical user interface comprises at least one user-selectable widget, wherein upon selection of the user-selectable widget by the user, a corresponding chat input is generated.

18 . The computer-implemented method of claim 15 , wherein the chat input is received from the user by converting a speech of the user to a textual chat messages.

19 . The computer-implemented method of claim 11 , wherein detecting input from the user comprises detecting words spoken by the user and converting the detected spoken words to a corresponding user input of the first type or of the second type.

20 . A wearable device worn by a user, the wearable device comprising a processing unit, a memory and a display, the memory storing a sequence of computer-executable instruction, which, when executed in connection with a meeting between a plurality of participants, cause the wearable device to perform a computer-implemented method comprising:
a. extracting a plurality of keyframes from each of a plurality of live meeting streams; b. displaying one of a plurality of keyframes from one of the plurality of streams to the user on the display device; c. detecting input from the user; d. if the detected input from the user is of a first type, displaying another one of a plurality of keyframes from the one of the plurality of streams; and e. if the detected input from the user is of a second type, displaying one of a plurality of keyframes from another one of the plurality of streams.

21 . A non-transitory computer-readable medium embodying a set of computer-executable instructions, which, when executed in a wearable device worn by a user comprising a processing unit, a memory and a display in connection with a meeting between a plurality of participants, cause the wearable device to perform a method comprising:
a. extracting a plurality of keyframes from each of a plurality of live meeting streams; b. displaying one of a plurality of keyframes from one of the plurality of streams to the user on the display device; c. detecting input from the user; d. if the detected input from the user is of a first type, displaying another one of a plurality of keyframes from the one of the plurality of streams; and e. if the detected input from the user is of a second type, displaying one of a plurality of keyframes from another one of the plurality of streams.

Assignees

• Fuji Xerox Co Ltd

Inventors

• Mäkelä Ville
• Marlow Jennifer
• Carter Scott

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• H04N7/147

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• G06F2203/04808

  Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen · CPC title