Method, device, and recording medium for processing image

Patent metadata

Field	Value
Publication number	US-10460425-B2
Application number	US-201715728864-A
Country	US
Kind code	B2
Filing date	Oct 10, 2017
Priority date	Oct 11, 2016
Publication date	Oct 29, 2019
Grant date	Oct 29, 2019

Abstract

A method of processing an image in a device, and the device thereof are provided. The method includes determining a distortion correction ratio of each of a plurality of vertices included in a source image, based on information about a lens through which the source image is projected, determining corrected location information of pixels located between the plurality of vertices, based on the distortion correction ratio of each of the plurality of vertices and interpolation ratios of the pixels, and rendering a distortion-corrected image including pixels determined as a result of performing interpolation on the plurality of vertices based on the corrected location information.

First claim

What is claimed is:

1. A method of processing an image in a device, the method comprising:
determining a distortion correction ratio of each of a plurality of vertices comprised in a source image, based on information about a lens through which the source image is projected;
determining corrected location information including depth values of the plurality of vertices, based on the distortion correction ratio of each of the plurality of vertices and a distance between a point of view and a display on which the source image is projected; and
rendering a distortion-corrected image comprising pixels determined based on the determined depth values.

2. The method of claim 1 , wherein the corrected location information comprises distortion correction ratios of the pixels, which are calculated as a result of performing interpolation on the distortion correction ratio of each of the plurality of vertices based on interpolation ratios of the pixels.

3. The method of claim 1 , further comprising:
determining distances of the pixels from a center of the source image based on distances between the center of the source image and the plurality of vertices and the interpolation ratios of the pixels,
wherein the rendering of the distortion-corrected image comprises determining changed distances of the pixels based on the distances of the pixels from the center of the source image and distortion correction ratios of the pixels.

4. The method of claim 1 , further comprising:
determining depth values of the plurality of vertices based on the distortion correction ratio of each of the plurality of vertices and a distance between a point of view and a display on which the source image is projected,
wherein the depth values of the pixels are calculated as a result of performing interpolation on the depth values of the plurality of vertices based on interpolation ratios of the pixels.

5. The method of claim 4 , wherein the rendering of the distortion-corrected image comprises rendering a distortion-corrected image comprising a plurality of vertices and pixels corrected based on the determined depth values.

6. The method of claim 1 ,
wherein the determining of the distortion correction ratio of each of the plurality of vertices comprises determining color-specific distortion correction ratios of the plurality of vertices, and
wherein the corrected location information of the pixels comprises color-specific distortion correction ratios of the pixels, which are calculated as a result of performing interpolation on the color-specific distortion correction ratios of the plurality of vertices based on the interpolation ratios.

7. The method of claim 6 , wherein the rendering of the distortion-corrected image comprises:
generating color-specific distortion-corrected images comprising pixels generated as a result of performing interpolation on the plurality of vertices based on the color-specific distortion correction ratios of the pixels, and
rendering a distortion-corrected image by combining the color-specific distortion-corrected images.

8. The method of claim 6 , further comprising:
determining color-specific depth values of the plurality of vertices based on the color-specific distortion correction ratios of the plurality of vertices and a distance between a point of view and a display on which the source image is projected,
wherein the corrected location information of the pixels comprises color-specific depth values of the pixels, which are calculated as a result of performing interpolation on the color-specific depth values of the plurality of vertices based on the interpolation ratios.

9. The method of claim 1 , further comprising:
outputting the distortion-corrected image,
wherein the distortion-corrected image is viewed through the lens by a user of the device.

10. A non-transitory computer-readable recording medium having recorded thereon a program for executing the method of claim 1 on a computer.

11. A device for processing an image, the device comprising:
at least one processor configured to:
determine a distortion correction ratio of each of a plurality of vertices comprised in a source image, based on information about a lens through which the source image is projected,
determine corrected location information including depth values of the plurality of vertices, based on the distortion correction ratio of each of the plurality of vertices and a distance between a point of view and a display on which the source image is projected, and
render a distortion-corrected image comprising pixels determined based on the determined depth values; and
a projector configured to output the distortion-corrected image.

12. The device of claim 11 , wherein the corrected location information comprises distortion correction ratios of the pixels, which are calculated as a result of performing interpolation on the distortion correction ratio of each of the plurality of vertices based on interpolation ratios of the pixels.

13. The device of claim 11 , wherein the at least one processor is further configured to:
determine distances of the pixels from a center of the source image based on distances between the center of the source image and the plurality of vertices and the interpolation ratios of the pixels, and
determine changed distances of the pixels based on the distances of the pixels from the center of the source image and distortion correction ratios of the pixels.

14. The device of claim 11 ,
wherein the at least one processor is further configured to determine depth values of the plurality of vertices based on the distortion correction ratio of each of the plurality of vertices and a distance between a point of view and a display on which the source image is projected, and
wherein the depth values of the pixels are calculated as a result of performing interpolation on the depth values of the plurality of vertices based on interpolation ratios of the pixels.

15. The device of claim 14 , wherein the at least one processor is further configured to render a distortion-corrected image comprising a plurality of vertices and pixels corrected based on the determined depth values.

16. The device of claim 11 ,
wherein the at least one processor is further configured to determine color-specific distortion correction ratios of the plurality of vertices, and
wherein the corrected location information of the pixels comprises color-specific distortion correction ratios of the pixels, which are calculated as a result of performing interpolation on the color-specific distortion correction ratios of the plurality of vertices based on the interpolation ratios.

17. The device of claim 16 , wherein the at least one processor is further configured to:
generate color-specific distortion-corrected images comprising pixels generated as a result of performing interpolation on the plurality of vertices based on the color-specific distortion correction ratios of the pixels, and
render a distortion-corrected image by combining the color-specific distortion-corrected images.

18. The device of claim 16 ,
wherein the at least one processor is further configured to determine color-specific depth values of the plurality of vertices based on the color-specific distortion correction ratios of the plurality of vertices and a distance between a point of view and a display on which the source image is projected, and
wherein the corrected location information of the pixels comprises color-specific depth values of the pixels, which are calculated as a result of performing interpola

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Jin-Bong
• Kim Do-Wan
• Jeong Jae-Yun
• Kim Yong-Gyoo
• Lee Jae-Kyeong

Classifications

• G06T7/536

  from perspective effects, e.g. by using vanishing points · CPC title

• G02B2027/011

  comprising device for correcting geometrical aberrations, distortion · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B27/017

  Head mounted · CPC title

• G06T2207/20221

  Image fusion; Image merging · CPC title