Electronic apparatus for displaying 3D image and operating method thereof

Patent metadata

Field	Value
Publication number	US-12456442-B2
Application number	US-202318137847-A
Country	US
Kind code	B2
Filing date	Apr 21, 2023
Priority date	Apr 12, 2022
Publication date	Oct 28, 2025
Grant date	Oct 28, 2025

Abstract

An electronic apparatus and an operating method thereof are provided. The electronic apparatus includes a display panel, a memory, and a processor. The processor obtains an input image including a first area and a second area, generates a calibration map that allocates, to the first area, a first calibration value for representing a first depth value and allocates, to the second area, a second calibration value for representing a second depth value, applies the calibration map to the input image to generate an output image including a first output area and a second output area, and displays the output image on the display panel. The first output area has a depth value obtained by converting the first depth value so as to correspond to the display panel. The second output area has a depth value obtained by converting the second depth value so as to correspond to the display panel.

First claim

The invention claimed is:

1. An electronic apparatus comprising:
a display panel comprising:
a base panel; and
a layer panel spaced apart from the base panel by a reference distance;

a memory storing at least one instruction; and
at least one processor configured to execute the at least one instruction to:
obtain an input image comprising a first area and a second area;
generate a calibration map that allocates, to the first area, a first calibration value for representing a first depth value, and allocates, to the second area, a second calibration value for representing a second depth value;
apply the calibration map to the input image to generate an output image comprising a first output area corresponding to the first area and a second output area corresponding to the second area; and
display the generated output image on the display panel,
wherein the first output area has a depth value obtained by adjusting the first depth value so as to correspond to the display panel, and the second output area has a depth value obtained by adjusting the second depth value so as to correspond to the display panel,

wherein the at least one processor is further configured to execute the at least one instruction to generate the output image through an artificial intelligence model that performs factorization, and
wherein the at least one processor is further configured to execute the at least one instruction to train the artificial intelligence model to perform the factorization based on a result of comparing the input image with a training image generated based on the output image and training distance information, wherein the training distance information is based on the reference distance.

2. The electronic apparatus of claim 1 , wherein the display panel comprises:
wherein the output image comprises a base image and a layer image, and
wherein the at least one processor is further configured to generate the base image to be displayed on the base panel and the layer image to be displayed on the layer panel by applying the calibration map to the input image.

3. The electronic apparatus of claim 2 , wherein the layer image comprises a first layer area corresponding to the first output area and a second layer area corresponding to the second output area, and
wherein the first layer area has a depth value obtained by adjusting the first depth value according to the reference distance, and the second layer area has a depth value obtained by adjusting the second depth value according to the reference distance.

4. The electronic apparatus of claim 1 , wherein the input image comprises images having a plurality of views that are different from each other.

5. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to execute the at least one instruction to generate the output image through a sub-image generating module that comprises the artificial intelligence model.

6. The electronic apparatus of claim 1 ,
wherein the training distance information comprises a training distance selected between a first reference distance and a second reference distance greater than the first reference distance, and
wherein the reference distance is a value between the first reference distance and the second reference distance.

7. The electronic apparatus of claim 6 , wherein the at least one processor is further configured to execute the at least one instruction to:
train the artificial intelligence model to determine a degree of warping of the images having a plurality of views included in the input image, based on the training distance information, and
generate the training distance information so that a training distance corresponding to each of the first area and the second area is equal.

8. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to execute the at least one instruction to:
obtain gaze information of a user viewing an interest area in the display panel;
based on the interest area corresponding to the first area, generate the calibration map that allocates the first calibration value to the first area and allocates the second calibration value to the second area; and
generate the output image by applying the calibration map to the input image.

9. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to execute the at least one instruction to:
obtain gaze information of a user viewing an interest area in the display panel;
based on the interest area corresponding to the second area, generate the calibration map that allocates the first calibration value to the first area, allocates the second calibration value to an area of the second area corresponding to a non-interest area, and allocates, to the interest area corresponding to the second area, a third calibration value for representing a third depth value that is different from the second depth value; and
generate the output image by applying the calibration map to the input image,
wherein the output image comprises the first output area corresponding to the first area, a first sub-output area of the second area corresponding to the interest area, and a second sub-output area of the second area corresponding to the non-interest area, and
wherein the first output area has a depth value obtained by adjusting the first depth value to correspond to the display panel, the second sub-output area has a depth value obtained by adjusting the second depth value to correspond to the display panel, and the first sub-output area has a depth value obtained by adjusting the third depth value to correspond to the display panel.

10. An operating method of an electronic apparatus including a display panel, the operating method comprising:
obtaining an input image comprising a first area and a second area;
generating a calibration map that allocates, to the first area, a first calibration value for representing a first depth value, and allocates, to the second area, a second calibration value for representing a second depth value;
applying the calibration map to the input image and generating an output image comprising a first output area corresponding to the first area and a second output area corresponding to the second area; and;
displaying the generated output image on the display panel,
wherein the first output area has a depth value obtained by adjusting the first depth value so as to correspond to the display panel, and the second output area has a depth value obtained by adjusting the second depth value so as to correspond to the display panel,
wherein the display panel comprises a base panel and a layer panel spaced apart from the base panel by a reference distance,
wherein the generating the output image comprises generating the output image through an artificial intelligence model that performs factorization, and
wherein the operating method further comprises training the artificial intelligence model by generating a training image based on the output image and training distance information, and training the artificial intelligence model to perform factorization based on a result of comparing the training image with the input image, wherein the training distance information is based on the reference distance.

11. The operating method of claim 10 , wherein the output image comprises a base image and a layer image, and
wherein the generating the output image comprises:
generating the base image to be displayed on the base panel by applying the calibration map to the input image; and
generating the layer image to be displayed on the layer panel by applying the calibration map to the input image, wherein th

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lim Kyungmin
• Yoon Youngjin
• Jin Bora
• Park Cheolseong
• Lee Yeoul
• Lee Jaesung
• Lee Jihye

Classifications

• G06V10/25

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06V10/761

  Proximity, similarity or dissimilarity measures · CPC title

• G06T2207/20081

  Training; Learning · CPC title

• G06T7/50

  Depth or shape recovery · CPC title