Method, apparatus, and recording medium for processing image

Patent metadata

Field	Value
Publication number	US-11348306-B2
Application number	US-202016888036-A
Country	US
Kind code	B2
Filing date	May 29, 2020
Priority date	May 2, 2016
Publication date	May 31, 2022
Grant date	May 31, 2022

Abstract

A method of processing an image by a device obtaining one or more images including captured images of objects in a target space, generating metadata including information about mapping between the one or more images and a three-dimensional (3D) mesh model used to generate a virtual reality (VR) image of the target space, and transmitting the one or more images and the metadata to a terminal.

First claim

What is claimed is:

1. A method, performed by a terminal, of processing an image, the method comprising:
obtaining a plurality of circular images captured at a camera, which are not stitched, and metadata regarding the plurality of circular images;
obtaining parameters regarding lens shading compensation information and overlapped region information for the plurality of circular images from the metadata;
identifying overlapped regions between the plurality of circular images based on the overlapped region information;
stitching the plurality of circular images based on the obtained parameters by blending the overlapped regions according to a plurality of preset weight values included in the metadata; and
rendering a stitched image,
wherein the parameters comprise a resolution of a 3D mesh model and information specifying a type of the 3D mesh model.

2. The method of claim 1 , wherein the parameters comprise an angle at which the plurality of circular images are captured.

3. The method of claim 1 , further comprising:
obtaining quality correction information from the metadata; and
correcting the plurality of circular images based on the quality correction information.

4. The method of claim 1 , wherein the overlapped regions comprise a first overlapped region and a second overlapped region, and
wherein the overlapped regions are blended by summing a first pixel value of the first overlapped region with a corresponding second pixel value of the second overlapped region according to the plurality of preset weight values.

5. The method of claim 1 , wherein the plurality of preset weight values comprises a first preset weight value applied to a first pixel value of a first circular image of the plurality of circular images, and a second preset weight value applied to a second pixel value of a second circular image of the plurality of circular images.

6. A method, performed by a device, of processing an image, the method comprising:
obtaining a plurality of circular images captured at a camera and metadata including parameters regarding camera location information, lens shading compensation information and overlapped region information for the plurality of circular images; and
transmitting the plurality of circular images which are not stitched and the metadata, to a terminal,
wherein the plurality of circular images are stitched based on the obtained parameters by blending overlapped regions identified based on the overlapped region information according to a plurality of preset weight values included in the metadata, and
the plurality of stitched circular images are rendered at the terminal, and
wherein the parameters comprise a resolution of a 3D mesh model and information specifying a type of the 3D mesh model.

7. The method of claim 6 , wherein the parameters comprise an angle at which the plurality of circular images are captured.

8. The method of claim 6 , wherein quality correction information is obtained from the metadata, and
the plurality of circular images are corrected based on the quality correction information.

9. A terminal of processing an image, the terminal comprising:
a transceiver and
at least one processor configured to:
obtain, via the transceiver, a plurality of circular images captured at a camera, which are not stitched, and metadata regarding the plurality of circular images,
obtain parameters regarding lens shading compensation information and overlapped region information for the plurality of circular images from the metadata,
identify overlapped regions between the plurality of circular images based on the overlapped region information;
stitch the plurality of circular images based on the obtained parameters by blending the overlapped regions according to a plurality of preset weight values included in the metadata, and
render a stitched image,
wherein the parameters comprise a resolution of a 3D mesh model and information specifying a type of the 3D mesh model.

10. The terminal of claim 9 , wherein the parameters comprise an angle at which the plurality of circular images are captured.

11. The terminal of claim 9 , wherein the at least one processor is further configured to obtain quality correction information from the metadata and correct the plurality of circular images based on the quality correction information.

12. A device of processing an image, the device comprising:
a transceiver and
at least one processor configured to:
obtain a plurality of circular images captured at a camera and metadata including parameters regarding lens shading compensation information and overlapped region information for the plurality of circular images, and
transmit, via the transceiver, the plurality of circular images which are not stitched and the metadata, to a terminal,
wherein the plurality of circular images are stitched based on the obtained parameters by blending the overlapped regions identified based on the overlapped region information according to a plurality of preset weight values included in the metadata, and
a stitched image is rendered at the terminal,
wherein the parameters comprise a resolution of a 3D mesh model and information specifying a type of the 3D mesh model.

13. The device of claim 12 , wherein the parameters comprise an angle at which the plurality of circular images are captured.

14. The device of claim 12 , wherein quality correction information is obtained from the metadata, and
the plurality of circular images are corrected based on the quality correction information.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Jeong Jae-Yun
• Kim Do-Wan
• Kim Yong-Gyoo
• Lee Gun-Hee
• Lee Jae-Kyeong
• Lee Jin-Bong
• Choi Dai-Woong
• Choi Hyun-Soo

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• H04N21/816

  involving special video data, e.g 3D video · CPC title

• H04N21/2365

  Multiplexing of several video streams · CPC title

• H04N21/4318

  by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00) · CPC title

• G06T15/503

  Blending, e.g. for anti-aliasing · CPC title