Method for enhancing depth images of scenes using trellis structures

Patent metadata

Field	Value
Publication number	US-8994722-B2
Application number	US-201213406139-A
Country	US
Kind code	B2
Filing date	Feb 27, 2012
Priority date	Feb 14, 2011
Publication date	Mar 31, 2015
Grant date	Mar 31, 2015

Abstract

An image for a virtual view of a scene is generated based on a set of texture images and a corresponding set of depth images acquired of the scene. A set of candidate depths associated with each pixel of a selected image is determined. For each candidate depth, a cost that estimates a synthesis quality of the virtual image is determined. The candidate depth with a least cost is selected to produce an optimal depth for the pixel. Then, the virtual image is synthesized based on the optimal depth of each pixel and the texture images. The method also applies first and second depth enhancement before, and during view synthesis to correct errors or suppress noise due to the estimation or acquisition of the dense depth images and sparse depth features.

First claim

We claim:

1. A method for generating a virtual image for a virtual view of a 3D scene based on a texture image and a depth image, wherein the depth image includes an associated dense depth image and associated sparse dense features, comprising steps of:
applying a first depth enhancement to the dense depth image and the sparse depth features to obtain a first enhanced depth image;
determining a plurality of candidate depths for each pixel of the first enhanced depth image;
det…

Assignees

• Tian Dong
• Wang Yongzhe
• Vetro Anthony
• Mitsubishi Electric Res Lab

Inventors

• Tian Dong
• Wang Yongzhe
• Vetro Anthony

Classifications

• G06T15/205 Primary

  Physics · mapped topic