Electronic device for displaying 3D image and operation method thereof

Patent metadata

Field	Value
Publication number	US-12587630-B2
Application number	US-202519072291-A
Country	US
Kind code	B2
Filing date	Mar 6, 2025
Priority date	Sep 29, 2022
Publication date	Mar 24, 2026
Grant date	Mar 24, 2026

Abstract

An electronic device may include a base panel, an optical layer, a front panel, a user tracking sensor configured to obtain a viewing angle of a user, a memory, and a processor(s) configured to execute at least one instruction stored in the memory, wherein the processor(s) may be configured to obtain an input image including a plurality of view images, generate a base image by decomposing the input image by using a base image generation model, generate a front image corresponding to a viewing angle of the user by decomposing the input image by using a front image generation model, based on view characteristic information of the base panel which corresponds to the viewing angle of the user, view characteristic information of the front panel which corresponds to the viewing angle of the user, and characteristic information of the optical layer, and provide the image to the user by displaying the base image on the base panel and displaying the front image on the front panel.

First claim

The invention claimed is:

1 . An electronic device for displaying an image, the electronic device comprising:
a base panel; an optical layer provided on the base panel; a front panel provided on the optical layer; a user tracking sensor configured to obtain a viewing angle of a user viewing the image; a memory storing at least one instruction; and at least one processor, comprising processing circuitry, configured to execute the at least one instruction stored in the memory, wherein the at least one processor is, individually and/or collectively, configured to: obtain an input image comprising a plurality of view images respectively corresponding to a plurality of different viewing angles, generate a base image at least by decomposing the input image using at least a base image generation model, generate a front image corresponding to a viewing angle of the user at least by decomposing the input image using at least a front image generation model, based on view characteristic information of the base panel which corresponds to the viewing angle of the user, view characteristic information of the front panel which corresponds to the viewing angle of the user, and characteristic information of the optical layer, and provide the image to the user by displaying the base image via the base panel and displaying the front image via the front panel.

2 . The electronic device of claim 1 , wherein the viewing angle of the user corresponds to any one of the plurality of different viewing angles,
the base panel comprises a plurality of pieces of base characteristic information respectively corresponding to the plurality of different viewing angles and comprising at least one piece of information of gamma, a color, a contrast ratio, luminance, and/or a gray of an image displayed on the base panel, the view characteristic information of the base panel comprises base characteristic information corresponding to the viewing angle of the user from among the plurality of pieces of base characteristic information, the front panel comprises a plurality of pieces of front characteristic information respectively corresponding to the plurality of different viewing angles and comprising at least one piece of information of gamma, a color, a contrast ratio, luminance, and/or a gray of an image displayed on the front panel, and the view characteristic information of the front panel comprises front characteristic information corresponding to the viewing angle of the user among the plurality of pieces of front characteristic information.

3 . The electronic device of claim 1 , wherein the characteristic information of the optical layer comprises at least one piece of information among a refractive index of the optical layer, a focal length, a shape of the optical layer, and/or a size of the optical layer.

4 . The electronic device of claim 2 , wherein the front image generation model comprises
a first front image generation model and a second front image generation model, and the at least one processor is configured to generate an intermediate front image, based on the view characteristic information of the base panel, at least by applying the input image, the view characteristic information of the base panel, and the characteristic information of the optical layer to the first front image generation model, and generate the front image at least by applying the intermediate front image and the view characteristic information of the front panel to the second front image generation model.

5 . The electronic device of claim 4 , wherein the at least one processor is configured to
generate the front image at least by applying the intermediate front image, the view characteristic information of the front panel, and the characteristic information of the optical layer to the second front image generation model.

6 . The electronic device of claim 4 , wherein the intermediate front image comprises an image corresponding to an intermediate image that is the base image provided via the optical layer to the user having the obtained viewing angle of the user, the base image to be displayed on the base panel.

7 . The electronic device of claim 4 , wherein, when base characteristic information that is among the plurality of pieces of different base characteristic information and corresponds to a reference viewing angle is reference base characteristic information, wherein the reference viewing angle is a viewing angle of a user who views the image at a front of the electronic device, and
front characteristic information that is among the plurality of pieces of different front characteristic information and corresponds to the reference viewing angle is reference front characteristic information, the front image is an image generated based on a difference between the view characteristic information of the base panel corresponding to the obtained viewing angle of the user and the reference base characteristic information and a difference between the view characteristic information of the front panel corresponding to the obtained viewing angle of the user and the reference front characteristic information.

8 . The electronic device of any claim 4 , wherein the first front image generation model comprises a first artificial intelligence model trained to infer the intermediate front image, based on the input image, the view characteristic information of the base panel, and the characteristic information of the optical layer, and
the first artificial intelligence model comprises an artificial intelligence model trained to generate an intermediate front image for training by applying, to the first artificial intelligence model, an input image for training, view characteristic information for training of the base panel corresponding to a viewing angle for training, and characteristic information for training of the optical layer, generate a reference intermediate front image based on the view characteristic information for training of the base panel, by applying, to a first simulation model, the input image for training, the view characteristic information for training of the base panel, and the characteristic information for training of the optical layer, and infer, based on a first loss function according to a difference between the intermediate front image for training and the reference intermediate front image, the intermediate front image for training based on the view characteristic information for training of the base panel.

9 . The electronic device of claim 8 , wherein the second front image generation model comprises a second artificial intelligence model trained to infer the front image, based on the intermediate front image and the view characteristic information of the front panel, and
the second artificial intelligence model comprises an artificial intelligence model trained to generate a front image for training by applying, to the second artificial intelligence model, the intermediate front image for training and view characteristic information for training of the front panel corresponding to the viewing angle for training, generate a reference front image based on a difference between the view characteristic information for training of the base panel and the reference base characteristic information and a difference between the view characteristic information for training of the front panel and the reference front characteristic information, by applying, to a second simulation model, the intermediate front image for training and the view characteristic information for training of the front panel, and infer, based on a second loss function according to a difference between the front image for training and the reference front image

Assignees

• Samsung Electronics Co Ltd

Inventors

• Park Jaesung
• Moon Youngsu
• Choi Junghwa

Classifications

• H04N13/302 Primary

  for viewing without the aid of special glasses, i.e. using autostereoscopic displays · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06N3/08

  Learning methods · CPC title

• G06N3/00

  Computing arrangements based on biological models · CPC title

• H04N13/366 Primary

  using viewer tracking · CPC title