Image processing method, image display method and image display system

Patent metadata

Field	Value
Publication number	US-11800079-B2
Application number	US-202117359506-A
Country	US
Kind code	B2
Filing date	Jun 26, 2021
Priority date	Nov 19, 2020
Publication date	Oct 24, 2023
Grant date	Oct 24, 2023

Abstract

An image processing method includes determining a display mode; processing, according to an image processing manner corresponding to the display mode, original image data to obtain target image data; and transmitting the target image data to an image display terminal, so that the image display terminal performs image display according to a scanning display manner corresponding to the display mode, a resolution of the target image data is less than or equal to that of the original image data, and the target image data carries indication information of the display mode.

First claim

What we claim is:

1. An image processing method, comprising:
determining a display mode, wherein a display mode matched with a type of a running application is determined according to the type of the application, or a display mode selected by a user operation is determined in response to the user operation;
processing, according to an image processing manner corresponding to the display mode, original image data to obtain target image data, wherein a resolution of the target image data is less than or equal to that of the original image data, and the target image data carries indication information of the display mode, the indication information is added to a data header of the target image data; and
transmitting the target image data to an image display terminal for the image display terminal to parse the indication information of the display mode from the data header of the target image data, and to determine the display mode according to the indication information, thus to allow the image display terminal to perform image display according to a scanning display manner corresponding to the display mode,
wherein the display mode is one of the following modes: a normal display mode, a two-dimensional display mode, a three-dimensional display mode, and a stereoscopic light field display mode,
wherein allowing the image display terminal to perform image display according to a scanning display manner corresponding to the display mode comprises:
in a case that the display mode is a normal display mode, displaying an image to be displayed on the display according to a relationship between a resolution of the display at the image display terminal and a resolution of the image to be displayed corresponding to the target image data;
in a case that the display mode is a two-dimensional display mode, displaying a gaze image in the image to be displayed in a gaze area of the display and displaying a non-gaze image in the image to be displayed in a non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data;
in a case that the display mode is a three-dimensional display mode, displaying gaze images corresponding to a left eye image and a right eye image in a fusion manner in the gaze area of the display and displaying the non-gaze image in the image to be displayed in the non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data; and
in a case that the display mode is a stereoscopic light field display mode, displaying gaze images corresponding to a plurality of unit images in the fusion manner or a time-division multiplexing manner in the gaze area of the display and displaying the non-gaze image in the image to be displayed in the non-gaze area of the display by reducing the resolution according to the relationship between the resolution of the display at the image display terminal and the resolution of the image to be displayed corresponding to the target image data.

2. The image processing method according to claim 1 , wherein, in the normal display mode, there is no need to perform Multi-Resolution Rendering (MRS) on the original image data, and in the two-dimensional display mode, the original image data is processed in the MRS manner.

3. The image processing method according to claim 2 , wherein before processing the original image data, the method further comprises: starting a single-person mode or a multi-person mode according to a quantity of persons who are watching at the same time at the image display terminal and eye gaze parameters of each person; and
processing, according to the image processing manner corresponding to the display mode, the original image data to obtain the target image data comprises: processing the original image data according to the image processing manner in the single-person mode or the multi-person mode corresponding to the display mode to obtain the target image data.

4. The image processing method according to claim 3 , wherein starting the single-person mode or the multi-person mode according to the quantity of persons who are watching at the same time at the image display terminal and eye gaze parameters of each person comprises:
in a case that the quantity of persons who are watching at the same time at the image display terminal is one, or the quantity of persons who are watching at the same time at the image display terminal is more than one and the eye gaze parameters of the plurality of persons indicate a same gaze area, starting the single-person mode; and
in a case that the quantity of persons who are watching at the same time at the image display terminal is more than one and the eye gaze parameters of the plurality of persons indicate at least two gaze areas, starting the multi-person mode.

5. The image processing method according to claim 3 , wherein the display mode is a normal display mode, and the resolution of the target image data obtained according to the image processing manner in the single-person mode or the multi-person mode corresponding to the normal display mode is the same as that of the original image data.

6. The image processing method according to claim 3 , wherein the display mode is a two-dimensional display mode; and
processing the original image data according to the image processing manner in the single-person mode or the multi-person mode corresponding to the display mode to obtain the target image data comprises:
dividing an original image corresponding to the original image data into at least one gaze area and a plurality of non-gaze areas according to the eye gaze parameters collected at the image display terminal, sampling the at least one gaze area using an original resolution to obtain at least one gaze image, and sampling the plurality of non-gaze areas using a compressed resolution to obtain a plurality of corresponding non-gaze images; and
splicing the at least one gaze image and the plurality of non-gaze images to obtain the target image data.

7. The image processing method according to claim 6 , wherein processing the original image data according to the image processing manner in the multi-person mode corresponding to the display mode to obtain the target image data further comprises:
segmenting the at least one gaze image to form a plurality of rectangular gaze sub-images; and
rearranging the plurality of gaze sub-images and the plurality of non-gaze images to subsequently obtain the target image data.

8. The image processing method according to claim 3 , wherein the display mode is a three-dimensional display mode, and the original image data comprises a left eye image and a right eye image; and
processing the original image data according to the image processing manner in the single-person mode or the multi-person mode corresponding to the display mode to obtain the target image data comprises:
dividing, according to the eye gaze parameters collected at the image display terminal, the left eye image into at least one first gaze area and a plurality of first non-gaze areas, dividing the right eye image into at least one second gaze area and a plurality of second non-gaze areas, sampling the at least one first gaze area and the at least one second gaze area using an original resolution to obtain at least one first gaze image and at least one second gaze image, and sampling the plurality of first non-gaze areas and the plurality of second non-gaze areas using a compressed resolution to obtain a plurality of first no

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Zheng Chao
• Miao Jinghua
• Wang Xuefeng
• Fan Qingwen
• Hao Shuai
• Zhang Hao
• Chen Lili
• Peng Jinbao
• Li Wenyu

Classifications

• H04N13/139 Primary

  Format conversion, e.g. of frame-rate or size · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/344

  with head-mounted left-right displays · CPC title

• H04N13/383 Primary

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title

• H04N13/122 Primary

  Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues (H04N13/128 takes precedence) · CPC title