Imaging privacy filter for objects of interest in hardware firmware platform

Patent metadata

Field	Value
Publication number	US-2025111638-A1
Application number	US-202318477389-A
Country	US
Kind code	A1
Filing date	Sep 28, 2023
Priority date	Sep 28, 2023
Publication date	Apr 3, 2025
Grant date	—

Abstract

A method and computing device is provided for filtering objects of interest of images. The computing device comprises an image capturing device and memory configured to store objects of interest. In one example, the computing device comprises a processor configured to, for a captured image, determine one or more regions of interest in the image based on the objects of interest and modify the image based on the determined regions of interest. In another example, the computing device comprises a first processor configured to determine one or more regions of interest to be modified in an image based on the one or more objects of interest and a second processor configured to convert the image to be processed by the first processor and modify the image based on regions of interest determined by the first processor. The image is displayed without the one or more objects of interest being viewable.

First claim

What is claimed is:

1 . A method of filtering objects of interest of images captured at a computing device, the method comprising:
for a captured image:
determining one or more regions of interest in the captured image based on one or more objects of interest; and
modifying the captured image for display based on the determined one or more regions of interest,
wherein the captured image is displayed without the one or more objects of interest being viewable.

2 . The method of claim 1 , further comprising:
identifying an application executing on the computing device as a video conferencing application: in response to the identification of the application executing on the computing device, selecting the one or more objects of interest from a stored list of objects of interest; and determining the one or more regions of interest in the captured image based on the selected one or more objects of interest.

3 . The method of claim 2 , wherein the stored list of objects of interest are stored in a secure portion of memory which is not accessible by an operating system of the computing device.

4 . The method of claim 2 , wherein the stored list of objects of interest comprise one or more nonviewable objects of interest, and
the captured image is modified to prevent the one or more nonviewable objects of interest, in the stored list of objects of interest, from being viewable in the captured image.

5 . The method of claim 4 , wherein modifying the captured image to prevent the one or more nonviewable objects of interest from being viewable comprises blurring the one or more nonviewable objects of interest, blacking out the one or more nonviewable objects of interest, or distorting the one or more nonviewable objects of interest.

6 . The method of claim 4 , wherein the stored list of objects of interest further comprise one or more viewable objects of interest, and
the captured image is modified to prevent the one or more nonviewable objects of interest from being viewable in the captured image by cropping the captured image to include the one or more viewable objects of interest without the one or more nonviewable objects of interest.

7 . The method of claim 1 , further comprising determining the one or more regions of interest by performing inference processing, using a neural network, on the captured image.

8 . The method of claim 7 , further comprising:
providing, as inputs to the neural network, image data representing the captured image and image data representing the one or more objects of interest; and identifying the one or more regions of interest as comprising the one or more objects of interest.

9 . The method of claim 1 , further comprising identifying the one or more regions of interest as comprising the one or more objects of interest using a neural network, trained prior to runtime, to recognize the one or more objects of interest.

10 . A computing device for filtering objects of interest of images comprising:
an image capturing device; memory configured to store objects of interest; and a processor configured to, for an image captured by the image capturing device:
determine one or more regions of interest in the image based on one or more objects of interest; and
modify the image based on the determined one or more regions of interest,
wherein the image is displayed without the one or more objects of interest being viewable.

11 . The computing device of claim 10 , wherein the processor is configured to:
identify an application executing on the computing device as a video conferencing application: select, from a stored list of objects of interest, the one or more objects of interest, in response to the application executing on the computing device being identified; and determine the one or more regions of interest in the captured image based on the selected one or more objects of interest.

12 . The computing device of claim 10 , wherein the objects of interest are stored in a secure portion of the memory which is not accessible by a non-secure operating system of the computing device.

13 . The computing device of claim 10 , wherein the objects of interest comprise one or more nonviewable objects of interest, and
the processor is configured to:
select the one or more nonviewable objects of interest; and
modify the image by preventing the one or more nonviewable objects of interest from being viewable in the image.

14 . The computing device of claim 13 , wherein the objects of interest further comprise one or more viewable objects of interest, and
the processor is configured to modify the image and prevent the one or more nonviewable objects of interest from being viewable in the image by cropping the image to include the one or more viewable objects of interest without the one or more nonviewable objects of interest.

15 . The computing device of claim 10 , wherein the processor is configured to determine the one or more regions of interest by performing inference processing, using a neural network, on the image.

16 . The computing device of claim 15 , wherein the processor is configured:
input, to the neural network, image data representing the image and image data representing the one or more objects of interest; and identify the one or more regions of interest as comprising the one or more objects of interest according to a result of the inference processing.

17 . The computing device of claim 10 , further comprising a display, wherein the modified image is displayed at the display.

18 . A computing device for filtering objects of interest of images comprising:
an image capturing device; memory configured to store objects of interest; and a first processor configured to, for an image captured by the image capturing device, determine one or more regions of interest to be modified in an image captured by the image capturing device based on the one or more objects of interest; and a second processor configured to, for the image captured by the image capturing device:
convert the image for processing by the first processor; and
modify the image based on the one or more regions of interest determined by the first processor,
wherein the image is displayed without the one or more objects of interest being viewable.

19 . The computing device of claim 18 , wherein,
the first processor is an inference processing unit configured to determine the one or more regions of interest by performing inference processing on the image using a neural network, and the second processor is an image signal processor, in a secure domain separate from a domain comprising an operating system of the computing device.

20 . The computing device of claim 18 , wherein portions of the memory accessed by the first processor and the second processor are secure portions of memory which are not accessible by a non-secure operating system of the computing device.

Assignees

• Ati Technologies Ulc

Inventors

• Atkinson William Lloyd
• Yu Wilson Hung

Classifications

• G06T5/70

  Denoising; Smoothing · CPC title

• G06V10/25 Primary

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• G06V2201/07

  Target detection · CPC title

• G06T2207/20132

  Image cropping · CPC title

• G06T2207/20084

  Artificial neural networks [ANN] · CPC title