Method and apparatus for processing three-dimensional (3d) image

Patent metadata

Field	Value
Publication number	US-2018018829-A1
Application number	US-201715455400-A
Country	US
Kind code	A1
Filing date	Mar 10, 2017
Priority date	Jul 13, 2016
Publication date	Jan 18, 2018
Grant date	—

Abstract

A method for processing a three-dimensional (3D) image includes acquiring a frame of a color image and a frame of a depth image, and generating a frame by combining the acquired frame of the color image with the acquired frame of the depth image. The generating of the frame includes combining a line of the color image with a corresponding line of the depth image.

First claim

What is claimed is:

1 . A method for processing a three-dimensional (3D) image, the method comprising:
acquiring a frame of a color image and a frame of a depth image; and generating a frame by combining the acquired frame of the color image with the acquired frame of the depth image, wherein the generating of the frame comprises combining a respective line of the acquired frame of the color image with a corresponding line of the acquired frame of the depth image.

2 . The method of claim 1 , wherein the generating of the frame comprises arranging the corresponding line of the acquired frame of the depth image on a next row to a row on which the respective line of the acquired frame of the color image is arranged.

3 . The method of claim 1 , wherein the generating of the frame comprises arranging the respective line of the acquired frame of the color image and the corresponding line of the acquired frame of the depth image on a same row.

4 . The method of claim 1 , wherein the generating of the frame comprises generating a frame by combining a frame of a left-eye image of the color image and a frame of a right-eye image of the color image with the acquired frame of the depth image.

5 . The method of claim 4 , wherein the generating of the frame comprises sequentially arranging a line of the frame of the left-eye image, a line of the acquired frame of the depth image that corresponds to the line of the left-eye image, a line of the frame of the right-eye image, and a line of the acquired frame of the depth image that corresponds to the line of the right-eye image.

6 . An apparatus for processing a three-dimensional (3D) image, the apparatus comprising:
a camera configured to acquire a frame of a color image and a frame of a depth image; a memory configured to store the acquired frame of the color image and the acquired frame of the depth image; and a processor configured to generate a frame by combining the acquired frame of the color image with the acquired frame of the depth image, wherein the processor is configured to combine a line of the acquired frame of the color image with a corresponding line of the acquired frame of the depth image.

7 . The apparatus of claim 6 , wherein the processor is configured to arrange the line of the acquired frame of the depth image on a next row to a row on which the corresponding line of the acquired frame of the color image is arranged.

8 . The apparatus of claim 6 , wherein the processor is configured to arrange the line of the acquired frame of the color image and the corresponding line of the acquired frame of the depth image on a same row.

9 . The apparatus of claim 6 , wherein the processor is configured to generate a frame by combining a frame of a left-eye image of the color image and a frame of a right-eye image of the color image with the acquired frame of the depth image.

10 . The apparatus of claim 9 , wherein the processor is configured to sequentially arrange a line of the frame of the left-eye image, a line of the acquired frame of the depth image that corresponds to the line of the frame of the left-eye image, a line of the frame of the right-eye image, and a line of the acquired frame of the depth image that corresponds to the line of the frame of the right-eye image.

11 . A method for processing a three-dimensional (3D) image, the method comprising:
acquiring a frame by combining a line of a color image with a line of a depth image; splitting a single line of the color image into a plurality of lines according to depth levels; performing a primary Fourier transform on the plurality of lines; generating a single added line by adding transformed lines obtained as a result of the performing the primary Fourier transform; and performing a secondary Fourier transform on the single added line.

12 . The method of claim 11 , further comprising generating a final line by adding at least one left-eye line and at least one right-eye line from among lines obtained as a result of the performing the secondary Fourier transform.

13 . An apparatus for processing a three-dimensional (3D) image, the apparatus comprising:
a controller; a first core; and a second core, wherein: the controller is configured to acquire a frame by combining a line of a color image with a line of a depth image and to split a single line of the color image into a plurality of lines according to depth levels, the first core is configured to perform a primary Fourier transform on the plurality of lines, the controller is further configured to generate a single added line by adding transformed lines obtained as a result of the performed primary Fourier transform, and the second core is configured to perform a secondary Fourier transform on the single added line.

14 . The apparatus of claim 13 , wherein the controller is further configured to generate a final line by adding at least one left-eye line and at least one right-eye line from among lines obtained as a result of the performed secondary Fourier transform.

15 . A non-transitory computer-readable recording medium having recorded thereon a computer program, which, when executed by a computer, performs the method of claim 1 .

16 . A method for processing a three-dimensional (3D) image, the method comprising:
acquiring a composite color image and a composite depth image; and generating a frame by combining the composite color image with the composite depth image, wherein the composite color image comprises a red image, a green image, and a blue image, and the composite depth image comprises a red depth image, a green depth image, and a blue depth image, and wherein the generating of the frame comprises combining a respective line of each of the red image, the green image, and the blue image with a corresponding line of the corresponding one from among the red depth image, the green depth image, and the blue depth image.

17 . The method of claim 16 , wherein:
the red image comprises a left-eye red image and a right-eye image, the green image comprises a left-eye green image and a right-eye green image, and the blue image comprises a left-eye blue image and a right-eye blue image; the red depth image comprises a left-eye red depth image and a right-eye depth image, the green depth image comprises a left-eye green depth image and a right-eye green depth image, and the blue depth image comprises a left-eye blue depth image and a right-eye blue depth image; and the combining comprises combining a respective line of the left-eye red image with a corresponding line of the left-eye red depth image, combining a respective line of the right-eye red image with a corresponding line of the right-eye red depth image, combining a respective line of the left-eye green image with a corresponding line of the left-eye green depth image, combining a respective line of the right-eye green image with a corresponding line of the right-eye green depth image, combining a respective line of the left-eye blue image with a corresponding line of the left-eye blue depth image, and combining a respective line of the right-eye blue image with a corresponding line of the right-eye blue depth image.

18 . The method of claim 16 , wherein the generating of the frame comprises arranging the corresponding line of each of the red depth image, the green depth image, and the blue depth image on a next row to a row on which the respective line of the corresponding one from among the red image, the green image, and the blue image is arranged.

19 . The

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Hojung
• Kim Yongkyu
• Song Hoon
• Lee Hongseok

Classifications

• G06T2207/10028

  Range image; Depth image; 3D point clouds · CPC title

• G06T7/262

  using transform domain methods, e.g. Fourier domain methods · CPC title

• G06T2207/20056

  Discrete and fast Fourier transform, [DFT, FFT] · CPC title

• H04N7/183

  for receiving images from a single remote source · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title