Image processing method and apparatus, display device, and computer readable storage medium

Patent metadata

Field	Value
Publication number	US-11200649-B2
Application number	US-201816465810-A
Country	US
Kind code	B2
Filing date	Nov 19, 2018
Priority date	Mar 30, 2018
Publication date	Dec 14, 2021
Grant date	Dec 14, 2021

Abstract

An image processing method provided by embodiments of the present disclosure includes acquiring, two adjacent frames of original images from a video image data stream; extracting a feature element that produces smear from the two adjacent frames of the original images; generating a reconstructed image frame that does not comprise the feature element by using the two adjacent frames of the original images and the feature element; and inserting the reconstructed image frame between the two adjacent frames of the original images.

First claim

What is claimed is:

1. An image processing method, comprising:
acquiring multiple frames of original images from a video image data stream;
extracting a feature element that produces smear from the multiple frames of original images;
generating a reconstructed image frame that does not comprise the feature element by using the multiple frames of original images and the feature element; and
inserting the reconstructed image frame between two adjacent frames in the multiple frames of original images,
wherein the extracting the feature element that produces the smear from the multiple frames of original images comprises:
performing two subtraction logic operations on an original image of a preceding frame F (n−1) and an original image of a subsequent frame F (n+1) by subtracting one from the other to obtain F (a) and F (b) , respectively;
performing a logic operation of adding F (a) and F (b) to obtain F (c) ; and
performing morphological dilation and erosion operation processes on F (c) to obtain the feature element F′ (n) which produces the smear.

2. The image processing method according to claim 1 , wherein the multiple frames of original images are two adjacent frames of original images.

3. The image processing method according to claim 1 , wherein the feature element comprises a moving object and its moving trajectory.

4. The image processing method according to claim 1 , further comprises:
performing a sharpening and filtering process on the multiple frames of original images prior to the extracting the feature element that produces the smear from the multiple frames of original images.

5. The image processing method according to claim 1 , wherein the dilation operation process is to perform an operation of “widening” or “thickening” in an image, and the erosion operation process is to perform an operation of “shrinking” or “thinning” in the image.

6. The image processing method according to claim 1 , wherein the generating the reconstructed image frame that does not comprise the feature element by using the multiple frames of original images and the feature element comprises:
performing a logic operation of subtracting F′ (n) from F (n−1) to obtain F′ (n−1) ;
performing a logic operation of subtracting F′ (n) from F (n+1) to obtain F′ (n+1) ; and
comparing data of F′ (n−1) with that of F′ (n+1) to obtain the reconstructed image frame F (n) .

7. The image processing method according to claim 6 , wherein the comparing the data of F′ (n−1) with that of F′ (n+1) to obtain the reconstructed image frame F (n) comprises:
comparing brightness of each pixel in F′ (n−1) with that of each corresponding pixel in F′ (n+1) to retain data of the pixels with low brightness and remove data of the pixels with high brightness; and
generating the reconstructed image frame F (n) by using the retained data of the pixels.

8. The image processing method according to claim 1 , wherein the inserting the reconstructed image frame between the two adjacent frames in the multiple frames of original images comprises:
inserting the reconstructed image frame between the two adjacent frames in the multiple frames of original images after performing a frequency doubling process on the video image data stream.

9. A display device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor; wherein the processor implements an image processing method while executing the program,
the image processing method comprising:
acquiring multiple frames of original images from a video image data stream;
extracting a feature element that produces smear from the multiple frames of original images;
generating a reconstructed image frame that does not comprise the feature element by using the multiple frames of original images and the feature element; and
inserting the reconstructed image frame between two adjacent frames in the multiple frames of original images,
wherein the extracting the feature element that produces the smear from the multiple frames of original images comprises:
performing two subtraction logic operations on an original image of a preceding frame F (n−1) and an original image of a subsequent frame F (n+1) by subtracting one from the other to obtain F (a) and F (b) , respectively;
performing a logic operation of adding F (a) and F (b) to obtain F (c) ; and
performing morphological dilation and erosion operation processes on F (c) to obtain the feature element F′ (n) which produces the smear.

10. The display device according to claim 9 , wherein the display device is a virtual reality head-mounted device.

11. A non-transitory computer readable storage medium having stored a computer program thereon, wherein steps in the image processing method according to claim 1 are implemented when the program is executed by a processor.

12. The display device according to claim 9 , wherein the multiple frames of original images are two adjacent frames of original images.

13. The display device according to claim 9 , wherein the feature element comprises a moving object and its moving trajectory.

14. The display device according to claim 9 , wherein the processor is configured to further implement:
performing a sharpening and filtering process on the multiple frames of original images prior to the extracting the feature element that produces the smear from the multiple frames of original images.

15. The display device according to claim 9 , wherein the dilation operation process is to perform an operation of “widening” or “thickening” in an image, and the erosion operation process is to perform an operation of “shrinking” or “thinning” in the image.

16. The display device according to claim 9 , wherein the generating the reconstructed image frame that does not comprise the feature element by using the multiple frames of original images and the feature element comprises:
performing a logic operation of subtracting F′ (n) from F (n−1) to obtain F′ (n−1) ;
performing a logic operation of subtracting F′ (n) from F (n+1) to obtain F′ (n+1) ; and
comparing data of F′ (n−1) with that of F′ (n+1) to obtain the reconstructed image frame F (n) .

17. The display device according to claim 16 , wherein the comparing the data of F′ (n−1) with that of F′ (n+1) to obtain the reconstructed image frame F (n) comprises:
comparing brightness of each pixel in F′ (n−1) with that of each corresponding pixel in F′ (n+1) to retain data of the pixels with low brightness and remove data of the pixels with high brightness; and
generating the reconstructed image frame F (n) by using the retained data of the pixels.

18. The display device according to claim 9 , wherein the inserting the reconstructed image frame between the two adjacent frames in the multiple frames of original images comprises:
inserting the reconstructed image frame between the two adjacent frames in the multiple frames of original images after performing a frequency doubling process on the video image data stream.

Assignees

• Ordos Yuansheng Optoelectronics Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Bi Haifeng
• Wang Xin
• Fang Yan
• Li Wenke
• Bao Yufeng
• Liu Bailing
• Zhao Shun
• Chen Lifeng

Classifications

• H04N7/0127 Primary

  by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter · CPC title

• G06T5/50 Primary

  using two or more images, e.g. averaging or subtraction · CPC title

• H04N5/211 Primary

  Ghost signal cancellation (H04N23/81 takes precedence) · CPC title

• G06T2207/30241

  Trajectory · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title