Method and apparatus, electronic device, computer-readable storage medium, and computer program product for obtaining color image based on fusing narrow band images

Patent metadata

Field	Value
Publication number	US-12452504-B2
Application number	US-202318329676-A
Country	US
Kind code	B2
Filing date	Jun 6, 2023
Priority date	Jan 30, 2022
Publication date	Oct 21, 2025
Grant date	Oct 21, 2025

Abstract

This application provides an image processing method and apparatus that can: acquire a target object through each narrow-band filter to obtain a narrow-band channel image including the target object; and fuse multiple narrow-band channel images in one-to-one correspondence with the multiple narrow-band filters to obtain a color image including a contour of the target object.

First claim

What is claimed is:

1. An image processing method, performed by an electronic device, the electronic device comprising multiple narrow-band filters and at least one wide-band filter,
the method comprising:
acquiring a target object through each of the narrow-band filters to obtain a narrow-band channel image comprising the target object, the narrow band filters comprising at least three filters with each narrow-band filter configured to output a respective channel of infrared color, and the at least one wide-band filter is configured to output a grey narrow-band channel image without a narrow band filtering effect;
fusing multiple narrow-band channel images in one-to-one correspondence with the multiple narrow-band filters to obtain a color image comprising a contour of the target object;
acquiring the target object through the at least one wide-band filter to obtain a grayscale wide-band channel image comprising the target object, the grayscale wide-band channel image having no wavelength differentiation; and
performing image enhancement processing on the color image comprising the contour of the target object based on the grayscale wide-band channel image to obtain the enhanced color image that also comprises the contour of the target object.

2. The method according to claim 1 , wherein
the electronic device comprises a photosensitive chip, and the multiple narrow-band filters are regularly arranged on the photosensitive chip in a matrix form;
the acquiring a target object through each of the narrow-band filters to obtain a narrow-band channel image comprising the target object comprises:
performing image acquisition processing on the target object through the photosensitive chip to obtain an image comprising the target object;
performing channel splitting processing on the image comprising the target object based on each of the narrow-band filters in the photosensitive chip to obtain an intermediate channel image corresponding to each of the narrow-band filters; and
interpolating the intermediate channel image corresponding to each of the narrow-band filters to obtain the narrow-band channel image corresponding to each of the narrow-band filters.

3. The method according to claim 2 , wherein the performing channel splitting comprises:
performing the following processing on any one of the narrow-band filters in the photosensitive chip:
determining a position of the narrow-band filter in the photosensitive chip;
performing pixel extraction processing on the image comprising the target object based on the position of the narrow-band filter in the photosensitive chip to obtain pixels of the narrow-band filter; and
arranging the pixels of the narrow-band filter based on arrangement of the narrow-band filter in the photosensitive chip to obtain the intermediate channel image corresponding to the narrow-band filter.

4. The method according to claim 1 , wherein
the multiple narrow-band channel images have the same size; the multiple narrow-band channel images are obtained by performing channel splitting processing on the image comprising the target object;
the fusing comprises:
performing the following processing on any pixel in the image comprising the target object:
determining a pixel value of the pixel corresponding to each of the multiple narrow-band channel images;
synthesizing the pixel values of the pixels corresponding to the multiple narrow-band channel images to obtain multi-channel pixel values of the pixels; and
stitching the multi-channel pixel values of the multiple pixels to obtain the color image comprising the contour of the target object.

5. The method according to claim 1 , wherein the fusing comprises:
determining partial narrow-band filters from the multiple narrow-band filters; and
fusing narrow-band channel images corresponding to the partial narrow-band filters to obtain the color image comprising the contour of the target object.

6. The method according to claim 5 , wherein the determining comprises:
displaying filtering indexes of the multiple narrow-band filters; and
taking, in response to a selection operation for the filtering indexes, narrow-band filters corresponding to selected filtering indexes as the partial narrow-band filters.

7. The method according to claim 5 , wherein the determining comprises:
obtaining frequencies in which the multiple narrow-band filters are used; and
sorting the multiple narrow-band filters in descending order based on the frequencies in which the multiple narrow-band filters are used, and taking multiple narrow-band filters ranked first in a descending sorting result as the partial narrow-band filters.

8. The method according to claim 1 , wherein the electronic device comprises at least four narrow-band filters, and the fusing comprises:
determining any three narrow-band filters from the multiple narrow-band filters;
synthesizing narrow-band channel images corresponding to the any three narrow-band filters to obtain candidate color images;
performing edge detection processing on each of the candidate color images to obtain edge features of each of the candidate color images; and
taking a candidate color image with the most edge features as the color image comprising the contour of the target object.

9. The method according to claim 1 , wherein
the acquiring comprises:
acquiring a pathological tissue through each of the narrow-band filters to obtain a narrow-band channel pathological image comprising the pathological tissue; and
the fusing comprises:
fusing multiple narrow-band channel pathological images in one-to-one correspondence with the multiple narrow-band filters to obtain a color pathological image comprising a contour of the pathological tissue.

10. An electronic device, comprising:
a housing, configured to form a partially enclosed space;
at least one memory configured to store program code;
multiple narrow-band filters and at least one wide band filter, located on a photosensitive chip inside the housing and configured to: acquire an optical signal, the photosensitive chip being configured to output a photosensitive signal,
wherein the multiple narrow-band filters comprising at least three filters with each narrow-band filter being configured to output a respective channel of infrared color, and
wherein the at least one wide-band filter is configured to output a grey narrow-band channel image without a narrow-band filtering effect; and

at least one processor, located inside the housing and configured to read the program code and operate as instructed by the program code, the program code comprising:
receiving code configured to cause the at least one processor to receive the photosensitive signal which is outputted by the photosensitive chip and is an optical signal of a target object acquired by the multiple narrow-band filters, generate a narrow-band channel image comprising the target object based on the photosensitive signal,
fusing code configured to cause the at least one processor to fuse multiple narrow-band channel images in one-to-one correspondence with the multiple narrow-band filters to obtain a color image comprising a contour of the target object,
grayscale wide band channel image acquiring code configured to cause the at least one processor to acquire the target object through the at least one wide-band filter to obtain a grayscale wide-band channel image comprising the target object, the grayscale wide-band channel image having no wavelength differentiation; and
enhanced color image obtaining code configured to cause the at least one processor to perform image enhancement processing on the color image comprising the contour of the target object based on the grayscale wide-

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Liao Jun
• Yao Jianhua

Classifications

• H04N23/55 Primary

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06V10/803

  of input or preprocessed data · CPC title

• G06T3/4015

  Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns · CPC title

• G06T3/4038

  Image mosaicing, e.g. composing plane images from plane sub-images · CPC title