Privacy filtering of area description file prior to upload

Patent metadata

Field	Value
Publication number	US-2016337599-A1
Application number	US-201514708955-A
Country	US
Kind code	A1
Filing date	May 11, 2015
Priority date	May 11, 2015
Publication date	Nov 17, 2016
Grant date	—

Abstract

A mobile device includes at least one imaging sensor to capture imagery of an environment of the mobile device, a privacy filter module, a spatial feature detection module, an assembly module, and a network interface. The privacy filter module is to perform at least one image-based privacy filtering process using the captured imagery to generate filtered imagery. The spatial feature detection module is to determine a set of spatial features in the filtered imagery. The assembly module is to generate an area description file representative of the set of spatial features. The network interface is to transmit the area description file to a remote computing system. The assembly module may select only a subset of the set of spatial features for inclusion in the area description file.

First claim

What is claimed is:

1 . At a mobile device communicatively coupled to a remote computing system, a method comprising:
capturing imagery of an area at which the mobile device is located; performing at least one image-based privacy filtering process using the captured imagery to generate filtered imagery; determining a set of spatial features in the filtered imagery; and transmitting an area description file representative of the set of spatial features to the remote computing system.

2 . The method of claim 1 , wherein performing the at least one image-based privacy filtering process comprises:
performing a text detection process to detect one or more first regions of the imagery that potentially represent text content; and modifying the imagery to remove image content from the detected one or more first regions.

3 . The method of claim 2 , wherein performing the at least one image-based privacy filtering process further comprises:
performing a face detection process to detect one or more second regions of the imagery that potentially represent human faces; and modifying the imagery to remove image content from the detected one or more second regions.

4 . The method of claim 1 , wherein performing the at least one image-based privacy filtering process comprises:
performing a face detection process to detect one or more regions of the imagery that potentially represent human faces; and modifying the imagery to remove image content from the detected one or more regions.

5 . The method of claim 1 , further comprising:
selecting only a subset of the set of spatial features for inclusion in the area description file.

6 . The method of claim 5 , wherein:
selecting only the subset of the set of spatial features for inclusion in the area description file comprises selecting spatial features for the subset based on a maximum spatial feature density criterion.

7 . The method of claim 6 , wherein the maximum spatial feature density criterion comprises a specified maximum number of spatial features per cubic unit.

8 . At a mobile device communicatively coupled to a remote computing system, a method comprising:
capturing imagery of an area in which the mobile device is located; determining a set of spatial features in the imagery; downsampling the set of spatial features to generate a sparse set of spatial features; and transmitting an area description file representing the sparse set of spatial features to the remote computing system.

9 . The method of claim 8 , wherein:
downsampling the set of spatial features comprises selecting spatial features for the sparse set based on a maximum spatial feature density criterion.

10 . The method of claim 9 , wherein the maximum spatial feature density criterion comprises a specified maximum number of spatial features per cubic unit.

11 . A mobile device comprising:
at least one imaging sensor to capture imagery of an environment of the mobile device; a privacy filter module coupled to the at least one imaging sensor, the privacy filter module to perform at least one image-based privacy filtering process using the captured imagery to generate filtered imagery; a spatial feature detection module coupled to the privacy filter module, the spatial feature detection module to determine a set of spatial features in the filtered imagery; an assembly module to generate an area description file representative of the set of spatial features; and a network interface coupled to the assembly module, the network interface to transmit the area description file to a remote computing system.

12 . The mobile device of claim 11 , wherein the privacy filter module comprises:
a text filter module to detect one or more first regions of the imagery that potentially represent text content and to modify the imagery to remove image content the detected one or more first regions.

13 . The mobile device of claim 12 , wherein the privacy filter module further comprises:
a facial filtering module to detect one or more second regions of the imagery that potentially represent human faces and to modify the imagery to remove image content the detected one or more second regions.

14 . The mobile device of claim 11 , wherein the privacy filter module comprises:
a facial filtering module to detect one or more regions of the imagery that potentially represent human faces and to modify the imagery to remove image content the detected one or more regions.

15 . The mobile device of claim 11 , wherein:
the assembly module is to select only a subset of the set of spatial features for inclusion in the area description file.

16 . The mobile device of claim 15 , wherein:
the assembly module is to select only a subset of the set of spatial features for inclusion in the area description file by selecting spatial features for the subset based on a maximum spatial feature density criterion.

17 . The mobile device of claim 16 , wherein the maximum spatial feature density criterion comprises a specified maximum number of spatial features per cubic unit.

18 . A mobile device comprising:
at least one imaging sensor to capture imagery of an environment of the mobile device; a spatial feature detection module coupled to the at least one imaging sensor, the spatial feature detection module to determine a set of spatial features in the imagery; a downsampler module coupled to the spatial feature detection module, the downsampler module to downsample the set of spatial features to determine a sparse set of spatial features; an assembly module to generate an area description file representative of the sparse set of spatial features; and a network interface coupled to the assembly module, the network interface to transmit the area description file to a remote computing system.

19 . The mobile device of claim 18 , wherein:
the downsampler module is to downsample the set of spatial features by selecting spatial features for the sparse set based on a maximum spatial feature density criterion.

20 . The mobile device of claim 19 , wherein the maximum spatial feature density criterion comprises a specified maximum number of spatial features per cubic unit.

Assignees

• Google Inc

Inventors

• Williams Brian Patrick
• Hickman Ryan Michael

Classifications

• G01C21/28 Primary

  with correlation of data from several navigational instruments · CPC title

• H04N5/262 Primary

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title

• G06V10/242

  by image rotation, e.g. by 90 degrees · CPC title

• G06T2207/20224

  Image subtraction · CPC title

• G06T2207/20024

  Filtering details · CPC title