Communication system

Patent metadata

Field	Value
Publication number	US-9516255-B2
Application number	US-201514602217-A
Country	US
Kind code	B2
Filing date	Jan 21, 2015
Priority date	Jan 21, 2015
Publication date	Dec 6, 2016
Grant date	Dec 6, 2016

Abstract

A user device has a display, a user interface and a network interface. The network interface receive a video data stream from another user interface. A user of the user device is able to pause the video stream. The paused image of the video stream and the video stream are both displayed on the display. The user is able to annotate the paused image.

First claim

The invention claimed is:

1. A user device comprising:
a display;
a user interface;
a network interface configured to receive a video data stream at the user device from another user device via a communication network, said display configured to display said video data stream; and
at least one processor configured to:
detect an interaction via said user interface to pause said video stream and to display a paused video frame of said video stream and to also display said video data stream;
detect application of at least one annotation via the user interface to said paused video frame;
cause said paused video frame and said at least one annotation to be displayed by said display along with said video data stream;
cause information about said at least one annotation to be sent via said network interface to said another user device; and
control display of an unpausing icon based on a time since the at least one annotation has last been applied, a selection of the unpausing icon configured to unpause the paused video frame.

2. The device of claim 1 , wherein said network interface is configured to receive video frames of said stream of video data comprising an object and said at least one annotation and said display is configured to display said received video frames of said stream of video data comprising said object and said at least one annotation along with said paused video frame.

3. The device of claim 1 , wherein said display is a touch screen display and is configured to provide said user interface, and said detected interaction via said user interface to pause said video stream comprises an interaction with said touch screen display.

4. A computer-readable storage device comprising instructions stored thereon that, responsive to execution by one or more processors of a user device, are configured to cause:
display of video frames of a stream of video data received from a further user device over a communications network;
detection of selection of a pause option via a user interface of said user device when a received video frame is being displayed to pause said received video frame;
display of both said paused received video frame and received video frames of the stream of video data, in response to said detection;
receiving via the user interface of at least one annotation input defining at least one annotation to be applied to an object of said paused received video frame;
sending of information about said at least annotation to said further user device; and
display of an unpausing icon based on a time since the at least one annotation has last been applied, a selection of the unpausing icon configured to unpause the paused video frame.

5. The computer-readable storage device of claim 4 , wherein received video frames of the stream of video data are of a mixed reality scene.

6. The computer-readable storage device of claim 4 , wherein the user device and the further user device are in a video call.

7. The user device of claim 1 , wherein received video frames of the video data stream are of a mixed reality scene.

8. The user device of claim 1 , wherein the user device and the another user device are in a video call.

9. A computer-implemented method comprising:
receiving, at a user device, a video data stream from an additional user device via a communication network;
detecting, via a user interface displayed on a display of the user device, an interaction to pause said video stream;
displaying both a paused video frame of said video stream and the video data stream on the display of the user device;
detecting, via the user interface, application of at least one annotation to said paused video frame;
causing said paused video frame and said at least one annotation to be displayed by said display along with said video data stream;
cause information about said at least one annotation to be sent via a network interface to the additional user device; and
control display of an unpausing icon based on a time since the at least one annotation has last been applied, a selection of the unpausing icon configured to unpause the paused video frame.

10. The computer-implemented method of claim 9 , wherein received video frames of the video data stream are of a mixed reality scene.

11. The computer-implemented method of claim 9 , wherein the user device and the additional user device are in a video call.

12. The computer-implemented method of claim 9 , wherein said network interface is configured to receive video frames of said stream of video data comprising an object and said at least one annotation and said display is configured to display said received video frames of said stream of video data comprising said object and said at least one annotation along with said paused video frame.

13. The computer-implemented method of claim 9 , wherein said display is a touch screen display and is configured to provide said user interface, and said detected interaction via said user interface to pause said video stream comprises an interaction with said touch screen display.

14. The computer-implemented method of claim 9 , further comprising displaying said received video frames of the stream of video data in a peripheral area of said display when said paused received video frame is displayed.

15. The computer-implemented method of claim 9 , wherein the displayed paused video frame is larger than the displayed received video data stream.

16. The computer-implemented method of claim 9 , further comprising responsive to detection of interaction to pause said video, displaying menu information providing one or more annotation options.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Lee Austin S
• Taylor Brandon Vaughn
• Swift Mark Robert
• Hsu Bofan
• Wright Shawn Crispin
• Robles Albert Anthony
• Faulkner Jason Thomas

Classifications

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• H04N21/4788 Primary

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• H04N7/141

  between two video terminals, e.g. videophone (telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085) · CPC title