Resizer Method And Apparatus Thereof

Patent metadata

Field	Value
Publication number	US-2020294193-A1
Application number	US-202016809806-A
Country	US
Kind code	A1
Filing date	Mar 5, 2020
Priority date	Mar 15, 2019
Publication date	Sep 17, 2020
Grant date	—

Abstract

Various examples pertaining to utilization of a resizer in image processing are described. A processor of an apparatus receives image data of a captured image from an image sensor. The processor processes the image data through a pipeline in which the image data is resized before further processing is performed to provide processed data of a processed image used in preview or video recording.

First claim

What is claimed is:

1 . A method, comprising:
receiving image data of a captured image from an image sensor; and processing the image data through a pipeline in which the image data is resized before further processing is performed to provide processed data of a processed image used in preview or video recording.

2 . The method of claim 1 , wherein the processing of the image data through the pipeline comprises processing the image data through the pipeline in which resizing by a resizer is performed before demosaicing by a demosaicing module (DM) to provide the processed data.

3 . The method of claim 1 , wherein the processing of the image data through the pipeline comprises processing the image data sequentially through a first resizer, a demosaicing module (DM), and a second resizer, and wherein the first resizer resizes the image data to provide resized data with a resized pixel count lower than a sensor pixel count of the image data from the image sensor.

4 . The method of claim 1 , wherein a sensor pixel count of the image sensor is higher than a resized pixel count of the image data after the resizing which is higher than a pixel count of the processed data.

5 . The method of claim 1 , wherein the receiving of the image data from the image sensor comprises receiving respective image data of a respective captured image from one of a plurality of image sensors each having a respective pixel count, and wherein the processing of the image data through the pipeline comprises resizing the respective image data by a respective ratio corresponding to the respective pixel count of the one of the plurality of image sensors.

6 . The method of claim 1 , wherein the processing of the image data through the pipeline in which the image data is resized comprises resizing the image data using a resizer by a ratio which is variable based on one or more of:
a pixel count of the image sensor; a field of view (FOV) of the preview; a capacity of an image signal processor (ISP) in processing the image data; and a system power capacity concern.

7 . A method, comprising:
receiving image data of a captured image from an image sensor; resizing the image data by a resizer to provide resized data; and demosaicing the resized data by a demosaicing module (DM) before further processing to provide processed data of a processed image used in preview or video recording.

8 . The method of claim 7 , wherein the resizing of the image data comprises providing the resized data with a resized pixel count lower than a sensor pixel count of the image data from the image sensor.

9 . The method of claim 7 , wherein a sensor pixel count of the image sensor is higher than a resized pixel count of the resized data which is higher than a pixel count of the processed data.

10 . The method of claim 7 , wherein the receiving of the image data from the image sensor comprises receiving respective image data of a respective captured image from one of a plurality of image sensors each having a respective pixel count, and wherein the resizing of the image data comprises resizing the respective image data by a respective ratio corresponding to the respective pixel count of the one of the plurality of image sensors.

11 . The method of claim 7 , wherein the resizing of the image data comprises resizing the image data by a ratio which is variable based on one or more of:
a pixel count of the image sensor; a field of view (FOV) of the preview; a capacity of an image signal processor (ISP) in processing the image data; and a system power capacity concern.

12 . An apparatus, comprising:
at least one image sensor configured to capture an image to provide image data; and a processor coupled to receive the image data from the image sensor, the processor comprising an image signal processing (ISP) pipeline through which the image data is processed to provide processed data of a processed image used in preview or video recording such that the image data is resized before further processing is performed in the ISP pipeline to provide the processed data.

13 . The apparatus of claim 12 , wherein, in processing the image data through the ISP pipeline, the processor is configured to process the image data through the ISP pipeline in which resizing by a resizer is performed before demosaicing by a demosaicing module (DM) to provide the processed data.

14 . The apparatus of claim 12 , wherein the ISP pipeline comprises a resizer and a demosaicing module (DM), wherein the resizer resizes the image data to provide resized data with a resized pixel count lower than a sensor pixel count of the image data from the image sensor, and wherein the DM performs demosaicing on the resized data.

15 . The apparatus of claim 12 , wherein a sensor pixel count of the image sensor is higher than a resized pixel count of the resized data which is higher than a pixel count of the processed data.

16 . The apparatus of claim 12 , wherein the at least one image sensor comprises a plurality of image sensors each having a respective pixel count and configured to capture a respective image to provide respective image data, and wherein a resizer of the processor is configured to resize the respective image data from one of the plurality of image sensors by a respective ratio corresponding to the respective pixel count of the one of the plurality of image sensors.

17 . The apparatus of claim 12 , wherein a resizer of the processor is configured to resize the image data by a ratio which is variable based on one or more of:
a pixel count of the image sensor; a field of view (FOV) of the preview; a capacity of an image signal processor (ISP) in processing the image data; and a power capacity concern of the apparatus.

Assignees

• Mediatek Inc

Inventors

• Chang Jing-Ying
• Tseng Ying-Yu
• Ju Chi-Cheng
• Chen Ying-Jui
• Wu Tung-Hai

Classifications

• G06T3/4015 Primary

  Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns · CPC title

• G06T1/20

  Processor architectures; Processor configuration, e.g. pipelining · CPC title

• G06T3/40 Primary

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06F9/3867

  using instruction pipelines · CPC title