Electronic device for performing image compression and operating method of electronic device

Patent metadata

Field	Value
Publication number	US-11477443-B2
Application number	US-201917057760-A
Country	US
Kind code	B2
Filing date	Jun 10, 2019
Priority date	Jun 19, 2018
Publication date	Oct 18, 2022
Grant date	Oct 18, 2022

Abstract

Various embodiments provide an electronic device and a method for controlling an operation of the electronic device. An electronic device according to various embodiments of the present invention may comprise: a lens unit; an image sensor; a memory used for intra-prediction of an image captured using the image sensor, and storing direction modes differently configured according to characteristics of a partial area of the lens unit; and a processor, wherein the processor: acquires a raw image corresponding to an external object by using the image sensor; divides the raw image into multiple blocks; selects a block, on which intra-prediction is to be performed, from among the multiple blocks; determines a direction mode to be used for intra-prediction of the selected block on the basis of a distortion parameter of a partial area of the lens unit corresponding to the selected block; performs the intra-prediction on the selected block on the basis of the determined direction mode; and generates a compressed image corresponding to the raw image on the basis of a result of the intra-prediction. In addition, various embodiments are possible.

First claim

The invention claimed is:

1. An electronic device comprising:
a lens unit;
an image sensor;
a memory configured to store a direction mode used for intra-prediction of an image captured using the image sensor and differently configured depending on a characteristic of a portion of the lens unit; and
a processor, wherein the processor is configured to:
obtain a raw image corresponding to an external object using the image sensor;
divide the raw image into a plurality of blocks;
select a block to be subjected to intra-prediction from among the plurality of blocks;
determine a direction mode to be used for intra-prediction of the selected block based on a distortion parameter of a portion of the lens unit corresponding to the selected block;
perform the intra-prediction on the selected block based on the determined direction mode; and
generate a compressed image corresponding to the raw image based on a result of the intra-prediction, and
wherein the direction mode is configured such that a curvature of a line included in the direction mode varies depending on a distance between a center of the lens unit and a center of the portion of the lens unit.

2. The electronic device of claim 1 , wherein the processor is configured to:
determine the portion of the lens unit corresponding to the selected block based on information about a relative position between the selected block and a center of the raw image;
select a direction mode corresponding to the determined portion; and
perform the intra-prediction on the selected block based on the selected direction mode.

3. The electronic device of claim 1 , wherein the processor is configured to:
select one direction from among a plurality of directions included in the determined direction mode based on a difference between a pixel value corresponding to a base pixel among pixels included in the selected block and a pixel value corresponding to a reference pixel present around the base pixel; and
perform the intra-prediction on the selected block using the selected direction.

4. The electronic device of claim 1 , wherein the direction mode is configured such that a curvature of a line included in the direction mode varies depending on the distortion parameter.

5. The electronic device of claim 1 , wherein the lens unit comprises a telephoto lens, and
a curvature of a line included in the direction mode is configured to increase when a distance between a center of the lens unit and a center of the portion of the lens unit increases.

6. The electronic device of claim 1 , further comprising:
a communication module configured to transmit the compressed image to an external electronic device,
wherein the electronic device is configured to receive, using the communication module, an image generated by the external electronic device that performs image processing on the compressed image.

7. An electronic device comprising:
a lens unit;
an image sensor configured to be disposed such that an image circle, formed on a surface of the image sensor when light corresponding to an external object passes through the lens unit, partially comprises a portion of the image sensor and does not comprise another portion of the image sensor; and
a processor, wherein the processor is configured to:
obtain an image corresponding to the external object using the image sensor;
determine a portion of the image corresponding to the image circle;
generate compressed image data by dividing the image into a plurality of blocks and compressing the plurality of blocks, a block at least partially included in the image circle among the plurality of blocks being compressed as part of the compressed image data and a block not included in the image circle among the plurality of blocks not being included in the compressed image data in part of the compressing; and
transmit the compressed image data to an external processor, wherein the processor is further configured to:
determine a distortion parameter based on a first block at least partially included in the image circle and a center of the image circle;
determine a direction mode to be used for intra-prediction of the first block based on the distortion parameter; and
perform the intra-prediction on the first block based on the determined direction mode, wherein the direction mode is configured such that a curvature of a line included in the direction mode varies depending on a distance between a center of the lens unit and a center of the portion of the lens unit.

8. The electronic device of claim 7 , wherein the processor is configured to perform the intra-prediction using a specified intra-prediction angular mode and the distortion parameter.

9. The electronic device of claim 7 , wherein the processor is configured to determine the distortion parameter based on an angle formed between at least two apexes of the first block and the center.

10. The electronic device of claim 7 , wherein the distortion parameter is determined based on a distance between the first block and the center of the image circle.

11. The electronic device of claim 10 , wherein the distortion parameter is used to change a curvature of a prediction direction used for the intra-prediction.

12. The electronic device of claim 7 , wherein the lens unit comprises a lens having a field of view of 120 degrees or greater.

13. The electronic device of claim 7 , further comprising a communication module configured to transmit the compressed image to an external electronic device.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Sungoh
• Kim Youngjo
• Park Hyunhee
• Lee Arang
• Chun Hyungju
• Choi Jongbum
• Han Changsu
• Yeom Donghyun

Classifications

• H04N23/684

  performed by controlling the image sensor readout, e.g. by controlling the integration time · CPC title

• H04N25/61

  the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4" · CPC title

• H04N23/6812

  based on additional sensors, e.g. acceleration sensors · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N19/167 Primary

  Position within a video image, e.g. region of interest [ROI] · CPC title