Imaging method and apparatus, and computer-readable medium

Patent metadata

Field	Value
Publication number	US-12579618-B2
Application number	US-202218560355-A
Country	US
Kind code	B2
Filing date	May 13, 2022
Priority date	May 13, 2021
Publication date	Mar 17, 2026
Grant date	Mar 17, 2026

Abstract

Provided are an imaging method and apparatus, and a medium. The method includes: for a target field of view, performing photographing and quantification at a first resolution, to obtain a first image that has a first bit width; for the target field of view, performing photographing and differential processing at a second resolution, to obtain a second image that has a second bit width, wherein the differential processing includes: for a pixel point obtained by photographing at the second resolution, quantifying the difference between the pixel point and a neighboring pixel point of the pixel point, to obtain a quantified difference a value of a corresponding pixel point in the second image; and fusing the first image with the second image, to obtain a third image, wherein the first resolution is lower than the second resolution, and the first bit width is higher than the second bit width.

First claim

What is claimed is:

1 . A method for imaging, comprising:
for a target field of view, performing photographing and quantification at a first resolution, so as to obtain a first image that has a first bit width; for the target field of view, performing photographing and differential processing at a second resolution, so as to obtain a second image that has a second bit width, wherein the differential processing includes: for a pixel point which is obtained by means of photographing at the second resolution, quantifying the difference between the pixel point and a neighboring or adjacent pixel point of the pixel point, so as to obtain a quantified difference as a value of a corresponding pixel point in the second image; and fusing the first image with the second image, so as to obtain a third image, wherein the first resolution is lower than the second resolution, and the first bit width is higher than the second bit width, wherein the fusing the first image with the second image, so as to obtain the third image further comprises: determining a region of interest of the target field of view in the second image using an image recognition method; obtaining a region in a first image that corresponds to the region of interest; and fusing the corresponding region of the first image with the region of interest of the second image to obtain the third image.

2 . The method according to claim 1 , further comprising: encoding the second image for transmission before the fusing, and decoding the second image for fusion after the transmission.

3 . The method according to claim 2 , wherein the second image is encoded using run-length encoding, and wherein a bit sequence of the second image is encoded into a counting sequence L recording the number of repetitions of repeated data and a data sequence D recording the repeated data itself.

4 . The method according to claim 3 , wherein Huffman encoding is used to record the counting sequence L, and fixed-length coding is used to record the data sequence D.

5 . The method according to claim 1 , wherein the fusing the first image and the second image comprises: fusing the first image and the second image using a convolutional neural network.

6 . The method according to claim 1 , wherein the determining the region of interest of the target field of view in the second image using the image recognition method comprises: determining the region of interest by combining images captured for the target field of view within a specific time range or previously stored images captured for the target field of view.

7 . The method according to claim 1 , further comprising using deep learning to train the image recognition method based on a selected target, spatial conditions when photographing and manual annotations.

8 . The method according to claim 1 , wherein the fusing the region of interest with the corresponding region to obtain the third image further comprises: fusing the region of interest with the corresponding region to obtain the third image only when the region of interest includes a specific object.

9 . The method according to claim 1 , further comprising outputting the third image after fusion or outputting an updated complete image after updating the complete image with the third image.

10 . An apparatus for imaging, comprising:
an image capturing component, configured to: a storage medium storing instructions; and one or more computer devices which, when reading the instructions, executes a method for imaging comprising steps of: for a target field of view, performing photographing and quantification at a first resolution, so as to obtain a first image that has a first bit width; and for the target field of view, performing photographing and differential processing at a second resolution, so as to obtain a second image that has a second bit width, wherein the differential processing includes: for a pixel point which is obtained by means of photographing at the second resolution, quantifying the difference between the pixel point and a neighboring or adjacent pixel point of the pixel point, so as to obtain a quantified difference as a value of a corresponding pixel point in the second image; and fusing the first image with the second image, so as to obtain a third image, wherein the first resolution is lower than the second resolution, and the first bit width is higher than the second bit width, wherein the one or more computer devices which, when reading the instructions, executes the fusing the first image with the second image, so as to obtain the third image, by: determining a region of interest of the target field of view in the second image using an image recognition method; obtaining a region corresponding to the region of interest in the first image; and fusing the corresponding region of the first image with the region of interest of the second image to obtain the third image.

11 . The apparatus according to claim 10 , further wherein the one or more computer devices which, when reading the instructions, further executes:
encoding the second image before the fusing, transmitting the encoded second image to the data processing component; and decoding the encoded second image for fusion after receiving the encoded second image.

12 . The apparatus according to claim 11 , wherein,
wherein the one or more computer devices which, when reading the instructions, executes the encoding the second image by encoding the second image using run-length encoding, and wherein a bit sequence of the second image is encoded into a counting sequence L recording the number of repetitions of repeated data and a data sequence D recording the repeated data itself.

13 . The apparatus according to claim 12 , wherein,
the one or more computer devices which, when reading the instructions, executes the encoding the second image by recording the counting sequence L using Huffman encoding and record the data sequence D using fixed-length encoding.

14 . The apparatus according to claim 10 , wherein the one or more computer devices which, when reading the instructions, executes the fusing the first image and the second image by fusing the first image and the second image using a convolutional neural network.

15 . The apparatus according to claim 10 , wherein the one or more computer devices which, when reading the instructions, executes the determining the region of interest of the target field of view in the second image using the image recognition method by determining the region of interest by combining images captured for the target field of view within a specific time range or previously stored images captured for the target field of view.

16 . The apparatus according to claim 10 , wherein the one or more computer devices which, when reading the instructions, further executes using deep learning to train the image recognition method based on a selected target, spatial conditions when photographing and manual annotations.

17 . A non-transitory computer-readable medium having program codes recorded thereon, which, when executed by a computer, performs the method for imaging, wherein the method comprises:
for a target field of view, performing photographing and quantification at a first resolution, so as to obtain a first image that has a first bit width; for the target field of view, performing photographing and differential processing at a second resolution, so as to obtain a second image that has a second bit width, wherein the differential processing includes: for a pixel point which is obtained by means of p

Assignees

• Nanjing University

Inventors

• Hu Xuemei
• Qiu Chenxi
• Wang Kai
• Yue Tao
• Yan Feng
• Pan Hongbing

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G06V10/25

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• H04N19/93

  Run-length coding · CPC title

• H04N19/85

  using pre-processing or post-processing specially adapted for video compression · CPC title

• G06T2207/20221

  Image fusion; Image merging · CPC title