Privacy protection during video conferencing screen share

Patent metadata

Field	Value
Publication number	US-11165755-B1
Application number	US-202017073773-A
Country	US
Kind code	B1
Filing date	Oct 19, 2020
Priority date	Aug 27, 2020
Publication date	Nov 2, 2021
Grant date	Nov 2, 2021

Abstract

Techniques are disclosed for providing privacy protection for video conference screen sharing. An example methodology implementing the techniques includes receiving a video stream of a first participant in a video conference session between at least the first participant and a second participant, wherein the first participant is associated with a first conference client device and the second participant is associated with a second conference client device, and determining that the first participant is performing screen sharing. The method also includes identifying a first item of content in the video stream to shield from being viewable during rendering of the video stream, obfuscating the identified first item of content in the video stream, and providing the video stream showing the obfuscated first item of content to the second conference client device to be rendered for display on a display device of the second conference client device.

First claim

What is claimed is:

1. A method comprising:
receiving, by a conference server device, a video stream of a first participant in a video conference session between at least the first participant and a second participant, wherein the first participant is associated with a first conference client device and the second participant is associated with a second conference client device;
receiving, by the conference server device, auxiliary information with the video stream, the auxiliary information including information associated with an operating system (OS) call on the first conference client device by an application executing on the first conference client device;
determining, by the conference server device, that the first participant is performing screen sharing;
identifying, by the conference server device, a first item of content in the video stream to shield from being viewable during rendering of the video stream, wherein identifying the first item of content in the video stream is based on the auxiliary information;
obfuscating, by the conference server device, the identified first item of content in the video stream; and
providing, by the conference server device, the video stream showing the obfuscated first item of content to the second conference client device to be rendered for display on a display device of the second conference client device.

2. The method of claim 1 , wherein identifying the first item of content in the video stream to shield is based on a privacy protection policy.

3. The method of claim 2 , wherein the privacy protection policy is specified by the first participant.

4. The method of claim 1 , wherein obfuscating the identified first item of content in the video stream includes processing by a trained machine learning model.

5. The method of claim 1 , wherein obfuscating the identified first item of content includes adding a mosaic to the identified first item of content.

6. The method of claim 1 , wherein obfuscating the identified first item of content includes one of applying an overlay with distortion effects to the identified first item of content, applying a transformation to the identified first item of content, adding an artifact to the identified first item of content, or redacting the identified first item of content.

7. The method of claim 1 , further comprising:
identifying a second item of content in the video stream to shield from being viewable during rendering of the video stream, wherein identifying the second item of content in the video stream is based on the auxiliary information and a privacy protection policy; and
obfuscating the identified second item of content in the video stream.

8. The method of claim 1 , wherein the auxiliary information includes information regarding a window being generated by an application executing on the first conference client device.

9. A system comprising:
a conference server device including a memory and one or more processors in communication with the memory, and configured to:
receive a video stream of a first participant in a video conference session between at least the first participant and a second participant, wherein the first participant is associated with a first conference client device and the second participant is associated with a second conference client device;
receive auxiliary information with the video stream, the auxiliary information including information associated with an operating system (OS) call on the first conference client device by an application executing on the first conference client device;
determine that the first participant is performing screen sharing;
identify a first item of content in the video stream to shield from being viewable during rendering of the video stream, wherein to identify the first item of content in the video stream is based on the auxiliary information;
obfuscate the identified first item of content in the video stream; and
provide the video stream showing the obfuscated first item of content to the second conference client device to be rendered for display on a display device of the second conference client device.

10. The system of claim 9 , wherein to identify the first item of content in the video stream to shield is based on a privacy protection policy.

11. The system of claim 10 , wherein the privacy protection policy is specified by the first participant.

12. The system of claim 9 , wherein to obfuscate the identified first item of content in the video stream includes use of a trained machine learning model.

13. The system of claim 9 , wherein to obfuscate the identified first item of content includes one of to add a mosaic to the identified first item of content, to apply an overlay with distortion effects to the identified first item of content, to apply a transformation to the identified first item of content, to add an artifact to the identified first item of content, or to redact the identified first item of content.

14. The system of claim 9 , wherein the one or more processors are further configured to:
identify a second item of content in the video stream to shield from being viewable during rendering of the video stream, wherein to identify the second item of content in the video stream is based on the auxiliary information and a privacy protection policy; and
obfuscate the identified second item of content in the video stream.

15. The system of claim 9 , wherein the auxiliary information includes information regarding a window being generated by an application executing on the first conference client device.

16. A method comprising:
receiving, by a conference server device, from a first conference client device a video stream in a video conference session between at least a first participant and a second participant, wherein the first conference client device is associated with the first participant;
receiving, by the conference server device, auxiliary information with the video stream, the auxiliary information including information associated with an operating system (OS) call on the first conference client device by an application executing on the first conference client device;
determining, by the conference server device, that a screen sharing mode is activated at the first conference client device;
identifying, by the conference server device, a first item of content in the video stream to shield from being viewable during rendering of the video stream based on a privacy protection policy, wherein identifying the first item of content in the video stream is based on the auxiliary information;
obfuscating, by the conference server device, the identified first item of content in the video stream; and
providing, by the conference server device, the video stream showing the obfuscated first item of content to a second conference client device, wherein the second conference client device is associated with the second participant.

17. The method of claim 16 , wherein the privacy protection policy is specified by the first participant.

18. The method of claim 16 , further comprising:
identifying a second item of content in the video stream to shield from being viewable during rendering of the video stream based on the auxiliary information and the privacy protection policy;
obfuscating the identified second item of content in the video stream; and
providing the video stream showing the obfuscated first item of content and the obfuscated second item of content to the second conference client device.

Assignees

• Citrix Systems Inc

Inventors

• Qian Shihao
• Zang Bo

Classifications

• H04N7/152

  Multipoint control units therefor · CPC title

• H04L63/0428 Primary

  wherein the data content is protected, e.g. by encrypting or encapsulating the payload · CPC title

• G06F3/147

  using display panels · CPC title

• H04N5/272

  Means for inserting a foreground image in a background image, i.e. inlay, outlay · CPC title

• G06F21/6263

  during internet communication, e.g. revealing personal data from cookies · CPC title