Localisation and mapping

Patent metadata

Field	Value
Publication number	US-9779509-B2
Application number	US-201514657296-A
Country	US
Kind code	B2
Filing date	Mar 13, 2015
Priority date	Jul 30, 2012
Publication date	Oct 3, 2017
Grant date	Oct 3, 2017

Abstract

A method of detecting the presence of a building in a captured image is provided. The method includes dividing the captured image into a plurality of image regions, detecting a dominant angle of detected edges within each image region, and detecting the presence of a building in an image region if the dominant angle of detected edges within that image region, excluding edges within a first threshold angle of vertical, is within a second threshold angle of horizontal and if the distribution of detected edges within the second threshold angle of horizontal is substantially the same as that of at least one adjacent image region.

First claim

The invention claimed is:

1. A method of detecting a presence of a building in a captured image, the method comprising:
dividing, by a processor, the captured image into a plurality of image regions;
detecting, by the processor, a dominant angle of detected edges within each of the plurality of image regions; and
detecting, by the processor, the presence of a building in a given one of the plurality of image regions if the dominant angle of detected edges within the given image region, excluding all substantially vertical edges, being edges that are within a first threshold angle of vertical, is substantially horizontal, being an angle within a second threshold angle of horizontal, and if a distribution of the substantially horizontal detected edges is substantially the same as that of at least one adjacent image region in both a horizontal and a vertical direction.

2. A method according to claim 1 , in which the step of detecting the dominant angle comprises detecting a median value of detected edge directions.

3. A method according to claim 1 , comprising the steps of:
capturing one or more images of the building using a camera;
detecting a gravitational vertical direction with respect to the camera so as to detect a direction of features within the first threshold angle of vertical in the captured images; and
removing features within the first threshold angle of vertical from the captured images.

4. A method according to claim 3 , comprising:
detecting image features in the one or more captured images representing horizontal features of the building; and
detecting an orientation of the building, in the one or more captured images, from the detected vertical direction and the detected orientation of the horizontal features.

5. A method according to claim 4 , comprising:
applying an image transformation based upon the detected orientation of the building, prior to the step of detecting the presence of the building.

6. A method according to claim 1 , comprising the step of performing the step of detecting the presence of a building in respect of an array of image regions.

7. A method of detecting an orientation of a building in an image captured by a camera, the method comprising the steps of:
detecting, by a processor, a gravitational vertical direction with respect to the camera so as to detect a direction of vertical features of the building in the captured image;
detecting, by a processor, image features in the captured image representing horizontal features of the building, excluding image features that are substantially vertical, being within a threshold angle of vertical according to the detected gravitational vertical direction; and
detecting, by a processor, the orientation of the building, in the captured image, from the detected vertical direction and a detected orientation of the horizontal features.

8. A non-transitory computer readable medium storing computer instructions thereon, the instructions, when executed by a processor, cause the processor to carry out a method of detecting a presence of a building in a captured image, the method comprising:
dividing the captured image into a plurality of image regions;
detecting a dominant angle of detected edges within each of the plurality of image regions; and
detecting the presence of a building in a given one of the plurality of image regions if the dominant angle of detected edges within the given image region, excluding all substantially vertical edges, being edges that are within a first threshold angle of vertical, is substantially horizontal, being an angle within a second threshold angle of horizontal, and if a distribution of the substantially horizontal detected edges is substantially the same as that of at least one adjacent image region in both a horizontal and a vertical direction.

9. A non-transitory computer readable medium storing computer instructions thereon, the instructions, when executed by a processor, cause the processor to carry out a method of detecting an orientation of a building in an image captured by a camera, the method comprising the steps of:
detecting a gravitational vertical direction with respect to the camera so as to detect a direction of vertical features of the building in the captured image;
detecting image features in the captured image representing horizontal features of the building, excluding image features that are substantially vertical, being within a threshold angle of vertical according to the detected gravitational vertical direction; and
detecting the orientation of the building, in the captured image, from the detected vertical direction and a detected orientation of the horizontal features.

10. Image processing apparatus operable to detect a presence of a building in a captured image, the apparatus comprising:
an image region processor configured to divide the captured image into a plurality of image regions and to detect a dominant angle of detected edges within each of the plurality of image regions; and
a processor configured to detect the presence of a building in a given one of the plurality of image regions if the dominant angle of detected edges within the given image region, excluding all substantially vertical edges, being edges that are within a first threshold angle substantially of vertical, is substantially horizontal, being an angle within a second threshold angle of horizontal, and if a distribution of the substantially horizontal detected edges is substantially the same as that of at least one adjacent image region in both a horizontal and a vertical direction.

11. Image processing apparatus operable to detect an orientation of a building in an image captured by a camera, the apparatus comprising:
a gravity detector configured to detect a gravitational vertical direction with respect to the camera so as to detect a direction of vertical features of the building in the captured image; and
an orientation detector configured to detect image features in the captured image representing horizontal features of the building excluding image features that are substantially vertical, being within a threshold angle of vertical as detected by the gravity detector, and to detect the orientation of the building, in the captured image, from the detected vertical direction and a detected orientation of the horizontal features.

12. Computer games apparatus comprising:
an image processing apparatus configured to detect a presence of a building in a captured image, the image processing apparatus comprising:
an image region processor configured to divide the captured image into a plurality of image regions and to detect a dominant angle of detected edges within each of the plurality of image regions, and
a processor configured to detect the presence of a building in a given one of the plurality of image regions if the dominant angle of detected edges within the given image region, excluding all substantially vertical edges, being edges that are within a first threshold angle of vertical, is substantially horizontal, being an angle within a second threshold angle of horizontal, and if a distribution of the substantially horizontal detected edges is substantially the same as that of at least one adjacent image region in both a horizontal and a vertical direction; and

an image renderer configured to render an image for display by combining a particular image with one or more computer-generated image portions generated with respect to detected buildings in the captured image.

13. Apparatus according to claim 12 , comprising a camera configured to capture the images.

14. Computer games apparatus comprising:
a

Assignees

• Sony Computer Entertainment Europe Ltd
• Sony Interactive Entertainment Europe Ltd

Inventors

• Martini Antonio

Classifications

• G06T7/0008 Primary

  checking presence/absence · CPC title

• G06T7/337

  involving reference images or patches · CPC title

• G06T2207/10012

  Stereo images · CPC title

• G06K9/52

  Physics · mapped topic

• G06T7/13

  Edge detection · CPC title