Method for determining stereo quality score and automatically improving the quality of stereo images

Patent metadata

Field	Value
Publication number	US-9530192-B2
Application number	US-201113173264-A
Country	US
Kind code	B2
Filing date	Jun 30, 2011
Priority date	Jun 30, 2011
Publication date	Dec 27, 2016
Grant date	Dec 27, 2016

Abstract

A method for improving a stereo image including a left view image and a right view image, comprising: using a data processor to automatically analyze the stereo image to determine an original stereo quality score responsive to relative positions of corresponding points in the left view image and the right view image; specifying a set of one or more candidate modifications to the stereo image; determining revised stereo quality scores based on each of the candidate modifications to the stereo image; selecting a particular candidate modification that produces a revised stereo quality score which indicates a higher quality level than the original stereo quality score; forming an output stereo image corresponding to the selected particular candidate modification; and storing the output stereo image in a processor-accessible memory.

First claim

The invention claimed is:

1. A method for improving a stereo image including a left view image and a right view image, comprising:
using a digital processor to automatically analyze the stereo image to determine an original stereo quality score responsive to relative positions of corresponding points in the left view image and the right view image;
specifying a set of one or more candidate modifications to the stereo image;
determining revised stereo quality scores based on each of the candidate modifications to the stereo image;
generating a plurality of iterated revised stereo quality scores and a new set of modifications until either the iterated revised stereo quality score does not change or until an iteration limit is reached;
selecting a particular candidate modification that produces a revised stereo quality score which indicates a higher quality level than the original stereo quality score;
forming an output stereo image corresponding to the selected particular candidate modification; and
storing the output stereo image in a processor-accessible memory.

2. The method of claim 1 wherein the candidate modifications include applying a geometric transform to the left view image or the right view image or both.

3. The method of claim 2 wherein the geometric transform includes a translation, a rotation or a scaling operation.

4. The method of claim 2 wherein different geometric transforms are applied to different image regions.

5. The method of claim 1 wherein the set of one or more candidate modifications are determined using an iterative optimization process.

6. The method of claim 1 wherein each candidate modification is specified using one or more parameters.

7. The method of claim 6 wherein the set of one or more candidate modifications correspond to a systematic sampling of the one or more parameters.

8. The method of claim 7 wherein the systematic sampling involves selecting random values for the one or more parameters according to a predefined distribution.

9. The method of claim 7 wherein the systematic sampling involves selecting values for the one or more parameters according to a regular pattern.

10. The method of claim 1 wherein the selected particular candidate modification is the candidate modification that produces the revised stereo quality score corresponding to the highest quality level among the one or more candidate modifications.

11. The method of claim 1 wherein the process of determining the stereo quality score includes:
extracting a set of features from the stereo image, wherein the features include a set of motion vectors between corresponding points in the left view image and the right view image;
determining the stereo quality score using a classifier responsive to the set of features.

12. The method of claim 11 wherein the classifier is trained using a training set of stereo images having reference stereo quality scores determined by human observers.

13. The method of claim 11 wherein the set of motion vectors are determined by tracking a set of interest points between the left view image and the right view image.

14. The method of claim 13 wherein the set of interest points are tracked using a Kanade-Lucas-Tomasi feature tracking algorithm.

15. The method of claim 11 wherein the set of features further includes one or more features incorporating epipolar geometry characteristics determined from the set of motion vectors.

16. The method of claim 11 wherein the set of features further includes one or more features determined by applying statistical calculations to the set of motion vectors.

17. The method of claim 11 wherein the classifier is a support vector machine classifier.

18. The method of claim 1 further including displaying the stereo image pair using a stereo image display system.

Assignees

• Park Minwoo
• Luo Jiebo
• Gallagher Andrew Charles
• Kodak Alaris Inc

Inventors

• Park Minwoo
• Luo Jiebo
• Gallagher Andrew Charles

Classifications

• G06T2207/10024

  Color image · CPC title

• G06T7/285

  using a sequence of stereo image pairs · CPC title

• G06T2207/20081

  Training; Learning · CPC title

• H04N13/144

  for flicker reduction · CPC title

• G06T2207/10021

  Stereoscopic video; Stereoscopic image sequence · CPC title