Method and apparatus for processing three-dimensional image

Patent metadata

Field	Value
Publication number	US-10175651-B2
Application number	US-201615360248-A
Country	US
Kind code	B2
Filing date	Nov 23, 2016
Priority date	Jul 13, 2016
Publication date	Jan 8, 2019
Grant date	Jan 8, 2019

Abstract

A method and apparatus for processing a three-dimensional image are provided. The method includes receiving original color data and original depth data of a plurality of layers of an original holographic image, selecting reference layers from among the plurality of layers, mapping adjustment color data of a non-selected layer, which is determined based on using the original depth data of the non-selected layer and the reference layers, to each of the reference layers, and generating a computer generated hologram image by using the original color data of the reference layers and the adjustment color data that has been mapped to the reference layers.

First claim

What is claimed is:

1. A method for processing a three-dimensional image, the method comprising:
receiving original color data and original depth data of each of a plurality of layers with respect to an original holographic image;
selecting at least one reference layer from among the plurality of layers;
mapping adjustment color data of a non-selected layer, which is determined based on the original depth data of the non-selected layer and the at least one reference layer, to each of the at least one reference layer; and
generating a computer generated hologram (CGH) image based on the original color data of the at least one reference layer and the mapped adjustment color data,
wherein the mapping the adjustment color data comprises determining respective adjustment color values of pixels included in the non-selected layer in correspondence with each of the at least one reference layer by applying a respective weight value that corresponds to each respective distance between the non-selected layer and each of the at least one reference layer, to original color values of the pixels included in the non-selected layer, and mapping the determined adjustment color values of the pixels to each of the at least one reference layer, and
wherein each respective weight value is set in inverse proportion to a difference between a respective depth of a corresponding pixel included in the non-selected layer and a depth of the at least one reference layer.

2. The method of claim 1 , wherein the selecting the at least one reference layer comprises selecting at least three reference layers from among the plurality of layers such that an interval between a first reference layer and a second reference layer is equal to an interval between the second reference layer and a third reference layer.

3. The method of claim 1 , wherein the selecting the at least one reference layer comprises selecting the at least one reference layer from among the plurality of layers such that a respective interval between adjacent ones of the at least one reference layer narrows as a corresponding distance of the at least one reference layer to a viewpoint of a user is reduced.

4. The method of claim 1 , wherein the mapping the adjustment color data comprises mapping the adjustment color data to each of the at least one reference layer.

5. The method of claim 1 , wherein the mapping the adjustment color data comprises mapping the adjustment color data to two reference layers that are adjacent to the non-selected layer.

6. The method of claim 1 , wherein the generating the CGH image comprises:
performing, for each of the at least one reference layer, a respective frequency transformation with respect to the original color data of the corresponding at least one reference layer and the adjustment color data mapped to the corresponding at least one reference layer;
encoding respective results of each respective frequency transformation into respective integer values; and
generating the CGH image based on the integer values.

7. A non-transitory computer-readable recording medium having recorded thereon a program for executing the method of claim 1 on a computer.

8. An apparatus for processing a three-dimensional image, the apparatus comprising:
a memory configured to store original color data and original depth data of each of a plurality of layers with respect to an original holographic image; and
a processor configured:
to receive the original color data and the original depth data from the memory,
to select at least one reference layer from among the plurality of layers,
to map adjustment color data of a non-selected layer, which is determined based on the original depth data of the non-selected layer and the at least one reference layer, to each of the at least one reference layer, and
to generate a computer generated hologram (CGH) image based on the original color data of the at least one reference layer and the mapped adjustment color data,
wherein the processor is further configured to determine respective adjustment color values of pixels included in the non-selected layer in correspondence with each of the at least one reference layer by applying a respective weight value that corresponds to each respective distance between the non-selected layer and each of the at least one reference layer, to original color values of the pixels included in the non-selected layer, and to map the determined adjustment color values of the pixels to each of the at least one reference layer, and
wherein each respective weight value is set in inverse proportion to a difference between a respective depth of a corresponding pixel included in the non-selected layer and a depth of the at least one reference layer.

9. The apparatus of claim 8 , wherein the processor is further configured to select at least three reference layers from among the plurality of layers such that an interval between a first reference layer and a second reference layer is equal to an interval between the second reference layer and a third reference layer.

10. The apparatus of claim 8 , wherein the processor is further configured to select the at least one reference layer from among the plurality of layers such that a respective interval between adjacent ones of the at least one reference layer narrows as a corresponding distance of the at least one reference layer to a viewpoint of a user is reduced.

11. The apparatus of claim 8 , wherein the processor is further configured to map the adjustment color data to each of the at least one reference layer.

12. The apparatus of claim 8 , wherein the processor is further configured to map the adjustment color data to two reference layers that are adjacent to the non-selected layer.

13. The apparatus of claim 8 , wherein the processor is further configured:
to perform, for each of the at least one reference layer, a respective frequency transformation with respect to the original color data of the corresponding at least one reference layer and the adjustment color data mapped to the corresponding at least one reference layer,
to encode respective results of each respective frequency transformation into respective integer values, and
to generate the CGH image based on the integer values.

14. The apparatus of claim 8 , wherein the processor is further configured:
to separately generate a multi-layer mapping image to be displayed on each of at least two panels for a display on which the at least two panels are stacked and images are formed at spatially different locations, and
the multi-layer mapping image is generated based on the original color data of the at least one reference layer and the mapped adjustment color data.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Yuntae
• Sung Geeyoung
• Lee Hongseok

Classifications

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G09G3/003

  to produce spatial visual effects · CPC title

• G03H2210/33

  3D/2D, i.e. the object is formed of stratified 2D planes, e.g. tomographic data · CPC title

• G06T2207/10024

  Color image · CPC title

• G03H1/0808 Primary

  Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific · CPC title