Method and apparatus for generating superpixel clusters

Patent metadata

Field	Value
Publication number	US-10127671-B2
Application number	US-201514877791-A
Country	US
Kind code	B2
Filing date	Oct 7, 2015
Priority date	Oct 8, 2014
Publication date	Nov 13, 2018
Grant date	Nov 13, 2018

Abstract

A method and an apparatus for generating a superpixel cluster for an image or a sequence of images. A primary clustering unit generates a primary superpixel cluster using a fixed reference superpixel, whereas a secondary clustering unit generates two or more secondary superpixel clusters using a propagating reference superpixel. A combining unit then combines intersections between the primary superpixel cluster and the two or more secondary superpixel clusters to generate a final superpixel cluster.

First claim

The invention claimed is:

1. A method for generating by at least one processor a superpixel cluster for an image or a sequence of images through successive propagation stages leading to add neighboring superpixels into said superpixel cluster, the method comprising at each of said propagation stages:
generating a primary interim superpixel cluster using a fixed reference superpixel;
generating two or more secondary interim superpixel clusters using a propagating reference superpixel;
combining intersections between the primary interim superpixel cluster and the two or more secondary interim superpixel clusters to generate a combined interim superpixel cluster;
said method further comprising outputting the generated superpixel cluster for processing said image or sequence of images; and
wherein said superpixel cluster for the image or the sequence of images is generated through said successive propagation stages, each of said successive propagation stages generating said combined interim superpixel, said combined interim superpixel being used by a subsequent propagation stage for the generating the primary interim superpixel cluster using a fixed reference superpixel and for the generating the two or more secondary interim superpixel clusters using a propagating reference superpixel.

2. The method according to claim 1 , wherein the primary interim superpixel cluster and the two or more secondary interim superpixel clusters are generated by analyzing distances between properties of a superpixel and the respective reference superpixel.

3. The method according to claim 1 , wherein the primary interim superpixel cluster is generated based on a first property of the superpixels and the two or more secondary interim superpixel clusters are generated based on a second property of the superpixels.

4. The method according to claim 3 , wherein the first property is color information and the second property is depth information.

5. The method according to claim 1 , wherein a superpixel is marked as tentatively accepted if a distance between a selected property of the superpixel and said selected property of the respective reference superpixel does not exceed a respective threshold.

6. The method according to claim 1 , wherein the primary interim superpixel cluster and the two or more secondary interim superpixel clusters are generated from superpixels associated to the same image.

7. The method according to claim 1 , wherein the primary interim superpixel cluster and the two or more secondary interim superpixel clusters are generated from superpixels associated to the same image and superpixels associated to different images of the sequence of images.

8. An apparatus configured to generate a superpixel cluster for an image or a sequence of images through successive propagation stages leading to add neighboring superpixels into said superpixel cluster, the apparatus comprising at least one processor configured for, at each of said propagation stages:
generating at each of said propagation stages a primary interim superpixel cluster using a fixed reference superpixel;
generating at each of said propagation stages two or more secondary interim superpixel clusters using a propagating reference superpixel; and
combining at each of said propagation stages intersections between the primary interim superpixel cluster and the two or more secondary interim superpixel clusters to generate a combined interim superpixel cluster

and said apparatus further comprising at least one output adapted to output the generated superpixel cluster for processing said image or sequence of images; and
wherein said superpixel cluster for the image or the sequence of images is generated through said successive propagation stages, each of said successive propagation stages generating said combined interim superpixel, said combined interim superpixel being used by a subsequent propagation stage for the generating the primary interim superpixel cluster using a fixed reference superpixel and for the generating the two or more secondary interim superpixel clusters using a propagating reference superpixel.

9. A computer readable non-transitory storage medium having stored therein instructions enabling generating a superpixel cluster for an image or a sequence of images through successive propagation stages leading to add neighboring superpixels into said superpixel cluster, which when executed by a computer, cause the computer at each of said propagation stages to:
generate a primary interim superpixel cluster using a fixed reference superpixel;
generate two or more secondary interim superpixel clusters using a propagating reference superpixel; and
combine intersections between the primary interim superpixel cluster and the two or more secondary interim superpixel clusters to generate a combined interim superpixel cluster

and to output the generated superpixel cluster for processing said image or sequence of images; and
wherein said superpixel cluster for the image or the sequence of images is generated through said successive propagation stages, each of said successive propagation stages generating said combined interim superpixel, said combined interim superpixel being used by a subsequent propagation stage for the generating the primary interim superpixel cluster using a fixed reference superpixel and for the generating the two or more secondary interim superpixel clusters using a propagating reference superpixel.

10. The apparatus according to claim 8 , wherein said at least one processor is configured for generating the primary interim superpixel cluster by analyzing distances between properties of a superpixel and the respective reference superpixel and for generating the two or more secondary interim superpixel clusters by analyzing distances between properties of a superpixel and the respective reference superpixel.

11. The apparatus according to claim 8 , wherein said at least one processor is configured for generating the primary interim superpixel cluster based on a first property of the superpixels and for generating the two or more secondary interim superpixel clusters based on a second property of the superpixels.

12. The apparatus according to claim 11 , wherein the first property is color information and the second property is depth information.

13. The apparatus according to claim 8 , wherein the apparatus is configured to mark a superpixel as tentatively accepted if a distance between a selected property of the superpixel and said selected property of the respective reference superpixel does not exceed a respective threshold.

14. The apparatus according to claim 8 , wherein said at least one processor is configured for generating the primary interim superpixel cluster and the two or more secondary interim superpixel clusters, respectively, from superpixels associated to the same image.

15. The apparatus according to claim 8 , wherein said at least one processor is configured for generating the primary interim superpixel cluster and the two or more secondary interim superpixel clusters, respectively, from superpixels associated to the same image and superpixels associated to different images of the sequence of images.

16. The computer readable non-transitory storage medium according to claim 9 , wherein the instructions cause the computer to generate the primary interim superpixel cluster and the two or more secondary interim superpixel clusters by analyzing distances between properties of a superpixel and the respective reference superpixel.

17. The computer readable non-transitory storage m

Assignees

• Thomson Licensing

Inventors

• Gandolph Dirk
• Putzke-Roeming Wolfram

Classifications

• G06T7/11

  Region-based segmentation · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2207/20101

  Interactive definition of point of interest, landmark or seed · CPC title

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T7/187 Primary

  involving region growing; involving region merging; involving connected component labelling · CPC title