Real time machine learning-based privacy filter for removing reflective features from images and video

Patent metadata

Field	Value
Publication number	US-2022318954-A1
Application number	US-202117219766-A
Country	US
Kind code	A1
Filing date	Mar 31, 2021
Priority date	Mar 31, 2021
Publication date	Oct 6, 2022
Grant date	—

Abstract

A method for removing reflections from images is disclosed. The method includes identifying one or more segments of an image, the one or more segments including a reflection; identifying one or more features of the one or more segments; removing the one or more features from the segments to generate one or more sanitized segments; and combining the one or more sanitized segments with the image to generate a sanitized image.

First claim

What is claimed is:

1 . A method for removing reflections from images, comprising:
first identifying that a first image includes an object deemed to be a reflective object; responsive to the first identifying, removing one or more reflections from the first image to generate a modified first image; second identifying that a second image does not include an object deemed to be a reflective object; and foregoing processing the second image to remove one or more reflections from the second image.

2 . The method of claim 1 , wherein the first image comprises a still image.

3 . The method of claim 1 , wherein the first image comprises a frame of a video conference.

4 . The method of claim 3 , further comprising:
obtaining video from a camera of a video conferencing system; analyzing the video to generate modified video; and transmitting the video to a receiver of the video conferencing system, wherein the analyzing includes the first identifying, the removing, the second identifying, and the foregoing, and the modified video includes the first image with one or more reflections removed and the second image.

5 . The method of claim 1 , further comprising transmitting the modified first image and the second image to a display.

6 . The method of claim 5 , wherein identifying that the first image includes the object deemed to be a reflective object comprises processing the first image with a classifier configured to identify images as either including objects deemed to be reflective or as not including objects deemed to be reflective.

7 . The method of claim 6 , wherein the classifier includes a neural network classifier.

8 . The method of claim 1 , wherein identifying that the first image includes an object deemed to be a reflective object comprises searching for the object within a region of interest of the first image.

9 . The method of claim 1 , wherein second identifying that a second image does not include an object deemed to be a reflective object comprises determining that the second image does not include the object within a region of interest of the second image.

10 . A system for removing reflections from images, the system comprising:
an input source; and an analysis system configured to:
retrieve a first image and a second image from the input source;
perform first identifying that the first image includes an object deemed to be a reflective object;
responsive to the first identifying, remove one or more reflections from the first image;
perform second identifying that the second image does not include an object deemed to be a reflective object; and
forego processing the second image to remove one or more reflections from the second image.

11 . The system of claim 10 , wherein the first image comprises a still image.

12 . The system of claim 10 , wherein the first image comprises a frame of a video conference.

13 . The system of claim 12 , wherein:
the input source comprises a camera of a video conferencing system; and the analysis system is further configured to:
obtain video from a camera of a video conferencing system;
analyze the video to generate modified video; and
transmit the video to a receiver of the video conferencing system,
wherein the analyzing includes the first identifying, the removing, the second identifying, and the foregoing, and the modified video includes the first image with one or more reflections removed and the second image.

14 . The system of claim 10 , wherein the analysis system is further configured to output the modified image and the second image for display.

15 . The system of claim 14 , wherein identifying that the first image includes the object deemed to be a reflective object comprises processing the first image with a classifier configured to identify images as either including objects deemed to be reflective or as not including objects deemed to be reflective.

16 . The system of claim 15 , wherein the classifier includes a neural network classifier.

17 . The system of claim 10 , wherein identifying that the first image includes an object deemed to be a reflective object comprises searching for the object within a region of interest of the first image.

18 . The system of claim 10 , wherein second identifying that a second image does not include an object deemed to be a reflective object comprises determining that the second image does not include the object within a region of interest of the second image.

19 . A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
first identifying that a first image includes an object deemed to be a reflective object; responsive to the first identifying, removing one or more reflections from the first image; second identifying that a second image does not include an object deemed to be a reflective object; and foregoing processing the second image to remove one or more reflections from the second image.

20 . The non-transitory computer-readable medium of claim 19 , wherein the first image comprises a still image.

Assignees

• Advanced Micro Devices Inc
• Ati Technologies Ulc

Inventors

• Wu Vickie Youmin
• Yu Wilson Hung
• Karaimer Hakki Can

Classifications

• H04N7/147 Primary

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• G06T2207/10004

  Still image; Photographic image · CPC title

• G06T2207/20084

  Artificial neural networks [ANN] · CPC title

• H04N7/15

  Conference systems · CPC title

• G06T2207/20081

  Training; Learning · CPC title