Stereoscopic view synthesis method and apparatus using the same

Patent metadata

Field	Value
Publication number	US-9729845-B2
Application number	US-201414555555-A
Country	US
Kind code	B2
Filing date	Nov 26, 2014
Priority date	Jun 3, 2014
Publication date	Aug 8, 2017
Grant date	Aug 8, 2017

Abstract

A stereoscopic image synthesis method includes the following: receiving a first image corresponding to a first view angle and a second image corresponding to a second view angle; obtaining a disparity map corresponding to the first image and the second image; determining a zero disparity region according to the disparity map; adjusting the disparity map according to the zero disparity region to obtain a shifted disparity map; linearly or non-linearly adjusting the shifted disparity map according to the shifted disparity map and a preset maximum range to obtain an adjusted disparity map; generating a plurality of virtual view angle images according to the adjusted disparity map, the first image, and the second image; and enhancing a two-dimensional depth cue of the virtual view angle images according to the adjusted disparity map.

First claim

What is claimed is:

1. A stereoscopic image synthesis method, comprising:
receiving a first image corresponding to a first view angle and a second image corresponding to a second view angle;
obtaining a disparity map corresponding to the first image and the second image, and determining a zero disparity region according to the disparity map, wherein the disparity map comprises a plurality of disparity values corresponding to the first image and the second image;
adjusting the disparity map according to the zero disparity region to obtain a shifted disparity map;
linearly or non-linearly adjusting the shifted disparity map according to the shifted disparity map and a preset maximum range to obtain an adjusted disparity map;
generating a plurality of virtual view angle images according to the adjusted disparity map, the first image, and the second image; and
enhancing a two-dimensional depth cue of the virtual view angle images according to the adjusted disparity map.

2. The stereoscopic image synthesis method according to claim 1 , wherein the step of determining the zero disparity region in the disparity map comprises:
dividing the disparity map into a plurality of object regions according to the disparity values; and
determining one of the object regions in the disparity map as the zero disparity region according to an interest region and/or the zero disparity region of a previous time point.

3. The stereoscopic image synthesis method according to claim 2 , wherein before the step of determining the zero disparity region in the disparity map, the stereoscopic image synthesis method further comprises:
executing an interest region detection procedure to obtain the interest region corresponding to one of the object regions, or receiving a control signal and generating the interest region according to the control signal.

4. The stereoscopic image synthesis method according to claim 1 , wherein the preset maximum range comprises a preset maximum disparity value and a preset minimum disparity value, and the step of linearly or non-linearly adjusting the shifted disparity map according to the zero disparity region and the preset maximum range comprises:
obtaining a maximum shifted disparity value and a minimum shifted disparity value in the shifted disparity map;
selecting the smaller one of the maximum shifted disparity value and the preset maximum disparity value as an maximum adjusted disparity value;
selecting the larger one of the minimum shifted disparity value and the preset minimum disparity value as an minimum adjusted disparity value; and
linearly or non-linearly adjusting the shifted disparity map according to the maximum adjusted disparity value and the minimum adjusted disparity value to obtain the adjusted disparity map.

5. The stereoscopic image synthesis method according to claim 1 , wherein the step of enhancing the two-dimensional depth cue of the virtual view angle images comprises:
performing a low pass filtering process on a portion outside the zero disparity region in the virtual view angle images according to the adjusted disparity map.

6. The stereoscopic image synthesis method according to claim 1 , wherein the step of enhancing the two-dimensional depth cue of the virtual view angle images comprises:
adjusting a proportion of the zero disparity region in the virtual view angle images.

7. A stereoscopic image synthesis apparatus, comprising:
an image receiving unit receiving a first image corresponding to a first view angle and a second image corresponding to a second view angle;
a data processing unit coupled to the image receiving unit; and
an image outputting unit coupled to the data processing unit,
wherein the data processing unit obtains a disparity map corresponding to the first image and the second image, and determines a zero disparity region according to the disparity map, wherein the disparity map comprises a plurality of disparity values corresponding to the first image and the second image;
wherein the data processing unit adjusts the disparity map according to the zero disparity region to obtain a shifted disparity map;
the data processing unit linearly or non-linearly adjusts the shifted disparity map according to the shifted disparity map and a preset maximum range to obtain an adjusted disparity map;
the data processing unit generates a plurality of virtual view angle images according to the adjusted disparity map, the first image, and the second image;
the data processing unit enhances a two-dimensional depth cue of the virtual view angle images according to the adjusted disparity map; and
wherein the image outputting unit outputs the virtual view angle images.

8. The stereoscopic image synthesis apparatus according to claim 7 , wherein:
the data processing unit divides the disparity map into a plurality of object regions according to the disparity values; and
the data processing unit determines one of the object regions in the disparity map as the zero disparity region according to an interest region and/or the zero disparity region of a previous time point.

9. The stereoscopic image synthesis apparatus according to claim 8 , wherein:
the data processing unit executes an interest region detection procedure to obtain the interest region corresponding to one of the object regions, or receives a control signal and generates the interest region according to the control signal.

10. The stereoscopic image synthesis apparatus according to claim 7 , wherein:
the preset maximum range comprises a preset maximum disparity value and a preset minimum disparity value, wherein
the data processing unit obtains a maximum shifted disparity value and a minimum shifted disparity value in the shifted disparity map;
the data processing unit selects the smaller one of the maximum shifted disparity value and the preset maximum disparity value as an maximum adjusted disparity value;
the data processing unit selects the larger one of the minimum shifted disparity value and the preset minimum disparity value as an minimum adjusted disparity value; and
the data processing unit linearly or non-linearly adjusts the shifted disparity map according to the maximum adjusted disparity value and the minimum adjusted disparity value to obtain the adjusted disparity map.

11. The stereoscopic image synthesis apparatus according to claim 7 , wherein:
the data processing unit performs a low pass filtering process on a portion outside the zero disparity region in the virtual view angle images according to the adjusted disparity map.

12. The stereoscopic image synthesis apparatus according to claim 7 , wherein:
the data processing unit adjusts a proportion of the zero disparity region in the virtual view angle images.

Assignees

• Acer Inc

Inventors

• Chang Tian-Sheuan
• Chen Yi-Chun

Classifications

• H04N13/128 Primary

  Adjusting depth or disparity · CPC title

• H04N13/0022 Primary

  Electricity · mapped topic