Privacy filtering of area description file prior to upload

Patent metadata

Field	Value
Publication number	US-10033941-B2
Application number	US-201514708955-A
Country	US
Kind code	B2
Filing date	May 11, 2015
Priority date	May 11, 2015
Publication date	Jul 24, 2018
Grant date	Jul 24, 2018

Abstract

A mobile device includes at least one imaging sensor to capture imagery of an environment of the mobile device, a privacy filter module, a spatial feature detection module, an assembly module, and a network interface. The privacy filter module is to perform at least one image-based privacy filtering process using the captured imagery to generate filtered imagery. The spatial feature detection module is to determine a set of spatial features in the filtered imagery. The assembly module is to generate an area description file representative of the set of spatial features. The network interface is to transmit the area description file to a remote computing system. The assembly module may select only a subset of the set of spatial features for inclusion in the area description file.

First claim

What is claimed is:

1. At a mobile device communicatively coupled to a remote computing system, a method comprising:
capturing imagery of an area at which the mobile device is located;
performing at least one image-based privacy filtering process using the captured imagery to generate filtered imagery;
determining a set of spatial features in the filtered imagery;
selecting a subset having fewer spatial features than the determined set of spatial features for inclusion in an area description file, the subset based on a maximum spatial feature density criterion; and
transmitting the area description file representative of the subset having fewer spatial features than the determined set of spatial features to the remote computing system.

2. The method of claim 1 , wherein performing the at least one image-based privacy filtering process comprises:
performing a text detection process to detect one or more first regions of the imagery that potentially represent text content; and
modifying the imagery to remove image content from the detected one or more first regions.

3. The method of claim 2 , wherein performing the at least one image-based privacy filtering process further comprises:
performing a face detection process to detect one or more second regions of the imagery that potentially represent human faces; and
modifying the imagery to remove image content from the detected one or more second regions.

4. The method of claim 1 , wherein performing the at least one image-based privacy filtering process comprises:
performing a face detection process to detect one or more regions of the imagery that potentially represent human faces; and
modifying the imagery to remove image content from the detected one or more regions.

5. The method of claim 1 , wherein the maximum spatial feature density criterion comprises a specified maximum number of spatial features per cubic unit.

6. At a mobile device communicatively coupled to a remote computing system, a method comprising:
capturing imagery of an area in which the mobile device is located;
determining a set of spatial features in the imagery;
downsampling the set of spatial features to generate a sparse set of spatial features, wherein the sparse set represents fewer spatial features than the determined set of spatial features in the imagery and is based on a maximum spatial feature density criterion; and
transmitting an area description file representing the sparse set of spatial features to the remote computing system.

7. The method of claim 6 , wherein the maximum spatial feature density criterion comprises a specified maximum number of spatial features per cubic unit.

8. A mobile device comprising:
at least one imaging sensor to capture imagery of an environment of the mobile device;
at least one processor;
a storage component to store a set of executable instructions, the set of executable instructions configured to manipulate the at least one processor to:
perform at least one image-based privacy filtering process using the captured imagery to generate filtered imagery;
determine a set of spatial features in the filtered imagery;
select only a subset having fewer spatial features than the determined set of spatial features for inclusion in an area description file by selecting spatial features for the subset based on a maximum spatial feature density criterion;
generate the area description file representative of the subset having fewer spatial features than the determined set of spatial features; and
a network interface coupled to the at least one processor, the network interface to transmit the area description file to a remote computing system.

9. The mobile device of claim 8 , wherein the set of executable instructions are further configured to manipulate the at least one processor to:
detect one or more first regions of the imagery that potentially represent text content and to modify the imagery to remove image content the detected one or more first regions.

10. The mobile device of claim 9 , wherein the set of executable instructions are configured to manipulate the at least one processor to:
detect one or more second regions of the imagery that potentially represent human faces and to modify the imagery to remove image content the detected one or more second regions.

11. The mobile device of claim 8 , wherein the set of executable instructions are configured to manipulate the at least one processor to:
detect one or more regions of the imagery that potentially represent human faces and to modify the imagery to remove image content the detected one or more regions.

12. The mobile device of claim 8 , wherein the maximum spatial feature density criterion comprises a specified maximum number of spatial features per cubic unit.

13. A mobile device comprising:
at least one imaging sensor to capture imagery of an environment of the mobile device;
at least one processor;
a storage component to store a set of executable instructions, the set of executable instructions configured to manipulate the at least one processor to:
determine a set of spatial features in the imagery;
downsample the set of spatial features to determine a sparse set of spatial features having fewer spatial features than the determined set of spatial features in the imagery, the sparse set based on a maximum spatial feature density criterion;
generate an area description file representative of the sparse set of spatial features; and
a network interface coupled to the at least one processor, the network interface to transmit the area description file to a remote computing system.

14. The mobile device of claim 13 , wherein the maximum spatial feature density criterion comprises a specified maximum number of spatial features per cubic unit.

Assignees

• Google Inc
• Google Llc

Inventors

• Williams Brian Patrick
• Hickman Ryan Michael

Classifications

• G01C21/28 Primary

  with correlation of data from several navigational instruments · CPC title

• H04N5/262 Primary

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title

• G06V10/242

  by image rotation, e.g. by 90 degrees · CPC title

• G06T2207/30204

  Marker · CPC title

• G06T2207/20024

  Filtering details · CPC title