Three-dimensional image display system and display method

Patent metadata

Field	Value
Publication number	US-2016191908-A1
Application number	US-201514711893-A
Country	US
Kind code	A1
Filing date	May 14, 2015
Priority date	Dec 30, 2014
Publication date	Jun 30, 2016
Grant date	—

Abstract

A display method includes the following steps: generating a first depth map and an edge map according to a color image; determining a first depth value of a first pixel and a second depth value of a second pixel of an edge region of the first depth map according to the edge map, in which the first pixel and the second pixel are arranged in a horizontal direction; adjusting N depth values of N pixels adjacent to the edge region of the first depth map according to a zero parallax setting reference level to generate a second depth map, where N is a positive integer, and the N pixels include at least one of the first pixel and the second pixel; and generating multiple-view images according to the second depth map and the color image to display a 3D image.

First claim

What is claimed is:

1 . A display method comprising:
generating a first depth map and an edge map according to a color image; determining a first depth value of a first pixel and a second depth value of a second pixel of an edge region of the first depth map according to the edge map, the first pixel and the second pixel being arranged in a horizontal direction and adjacent to each other; adjusting N depth values of N pixels adjacent to the edge region of the first depth map according to a zero parallax setting reference level to generate a second depth map, where N is a positive integer, and the N pixels comprise at least one of the first pixel and the second pixel; and generating multi-view images according to the second depth map and the color image to display a three-dimensional image.

2 . The display method of claim 1 , wherein the step of generating the second depth map comprises:
comparing the first depth value and the second depth value with the zero parallax setting reference level; and adjusting the second depth value and N−1 of the N depth values according to the first depth value and a filtering range to generate the second depth map when both the first depth value and the second depth value are less than the zero parallax setting reference level and the first depth value is greater than the second depth value or when both the first depth value and the second depth value are greater than the zero parallax setting reference level and the second depth value is greater than the first depth value; wherein the N−1 of the N depth values correspond to N−1 pixels arranged in the horizontal direction and adjacent to the second pixel.

3 . The display method of claim 2 , wherein N depth values after being adjusted, the first depth value, the second depth value, and the filtering range satisfy the following specific relationship:
G′[j+n]=G[j+n ]−[( G[j+n]−G[j ])/( FS )]×( FS−n )

wherein n is a positive integer from 1 to N, G′[j+n] are the N depth values after being adjusted, G[j] is the first depth value, G[j+1] is the second depth value, and FS is the filtering range.

4 . The display method of claim 1 , wherein the step of generating the second depth map comprises:
adjusting the first depth value and N−1 of the N depth values according to the second depth value and a filtering range to generate the second depth map when both the first depth value and the second depth value are less than the zero parallax setting reference level and the second depth value is greater than the first depth value or when both the first depth value and the second depth value are greater than the zero parallax setting reference level and the first depth value is greater than the second depth value; wherein the N−1 of the N depth values correspond to N−1 pixels arranged in the horizontal direction and adjacent to the first pixel.

5 . The display method of claim 4 , wherein N depth values after being adjusted, the first depth value, the second depth value, and the filtering range satisfy the following specific relationship:
G′[j−n]=G[j−n ]−[( G[j−n]−G[j ])/( FS )]×( FS−n ),
wherein n is a positive integer from 1 to N, G′[j−n] are the N depth values after being adjusted, G[j−1] is the first depth value, G[j] is the second depth value, and FS is the filtering range.

6 . The display method of claim 1 , wherein the step of generating the second depth map comprises:
setting the first depth value to be the zero parallax setting reference level when one of the first depth value and the second depth value is less than the zero parallax setting reference level and another one of the first depth value and the second depth value is greater than the zero parallax setting reference level; adjusting the second depth value and N−1 of the N depth values according to the first depth value and a filtering range, wherein the N−1 of the N depth values correspond to N−1 pixels arranged in the horizontal direction and adjacent to the second pixel; and adjusting M depth values according to the first depth value and the filtering range to generate the second depth map, wherein the M depth values correspond to M pixels arranged in the horizontal direction and adjacent to the first pixel, and M is equal to N.

7 . The display method of claim 6 , wherein N depth values after being adjusted, M depth values after being adjusted, the first depth value, the second depth value, and the filtering range satisfy the following specific relationship:
G′[j+n]=G[j+n ]−[( G[j+n]−G[j ])/( FS )]×( FS−n )
G′[j−n]=G[j−n ]−[( G[j−n]−G[j ])/( FS )]×( FS−n ),
wherein n is a positive integer from 1 to N, G′[j+n] are the N depth values after being adjusted, G′[j−n] are M depth values after being adjusted, G[j] is the first depth value, G[j+1] is the second depth value, and FS is the filtering range.

8 . The display method of claim 1 , wherein the step of displaying the three-dimensional image comprises:
calculating a plurality of depth sensing values according to the second depth map and the zero parallax setting reference level; and generating the multi-view images according to the color image and the depth sensing values to display the three-dimensional image.

9 . The display method of claim 1 , wherein each of the multi-view images has an object, a first distance exists between an edge of the object of a first multi-view image of the multi-view images and an edge of the object of a second multi-view image of the multi-view images, a second distance exists between the edge of the object of the second multi-view image and an edge of the object of a third multi-view image of the multi-view images, the first distance is different from the second distance.

10 . The display method of claim 1 , wherein the step of generating the second depth map further comprises:
averaging the first depth map to generate the second depth map after adjusting the N depth values.

11 . A three-dimensional image display system comprising:
a depth map generation unit configured to generate a first depth map according to a color image; a smooth processing unit comprising:
an edge detector configured to generate an edge map according to the first depth map; and
a controller configured to determine a first depth value of a first pixel and a second depth value of a second pixel of an edge region of the first depth map according to the edge map, and

adjust N depth values of N pixels adjacent to the edge region of the first depth map according to a zero parallax setting reference level to generate a second depth map;
wherein the first pixel and the second pixel are arranged in a horizontal direction, N is a positive integer, and the N pixels comprise at least one of the first pixel and the second pixel;
a depth image based rendering unit configured to generate multi-view images according to the second depth map and the color image; and
a three-dimensional image rendering unit configured to drive a display panel to display a three-dimensional image according to the multi-view images.

12 . The three-dimensional image display system of claim 11 , wherein the controller is configured to compare the first depth value and the second depth value with the zero parallax setting reference level, and adjust the second depth value and N−1 of the N depth values according to the first depth value and a filtering range to generate the second depth map when both the first depth value and the second depth value are less than the zero parallax setting reference level and the first depth value is greater than the second depth value or when both the first depth value and the second depth value are greater th

Assignees

• Au Optronics Corp

Inventors

• Yen Yi-Ting
• Tsai Fu-Chuan
• Ho Chia-Pu

Classifications

• G06T7/0075

  Physics · mapped topic

• H04N13/0445 Primary

  Electricity · mapped topic

• G06T5/002

  Physics · mapped topic

• H04N13/261

  with monoscopic-to-stereoscopic image conversion · CPC title

• H04N13/282

  for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems · CPC title