Electronic apparatus and controlling method thereof

Patent metadata

Field	Value
Publication number	US-12229998-B2
Application number	US-202217583605-A
Country	US
Kind code	B2
Filing date	Jan 25, 2022
Priority date	Apr 22, 2021
Publication date	Feb 18, 2025
Grant date	Feb 18, 2025

Abstract

An electronic apparatus is disclosed. The electronic apparatus includes: a memory storing a first pattern image and a second pattern image, a communication interface comprising communication circuitry configured to communicate with an external terminal apparatus, a projection part including a projection lens, and a processor configured to: control the projection part to project the first pattern image on a screen member comprising a reflector located on a projection surface, and based on receiving a first photographed image which photographed the screen member from the external terminal apparatus through the communication interface, acquire transformation information based on the first photographed image and the first pattern image, control the projection part to project the second pattern image on the projection surface, and based on receiving a second photographed image which photographed the projection surface from the external terminal apparatus through the communication interface, perform color calibration based on the characteristic of the projection surface based on the second photographed image, the second pattern image, and the transformation information.

First claim

What is claimed is:

1. An electronic apparatus comprising:
memory storing a first pattern image and a second pattern image;
a communication interface comprising communication circuitry configured to communicate with an external terminal apparatus;
a projector; and
at least one processor configured to:
control the projector to project the first pattern image on a screen member overlaid onto at least a portion of a projection surface, wherein the screen member comprises a white reflector which is separate from the projection surface,
receive a first photographed image which includes the screen member on which the first pattern image is projected from the external terminal apparatus through the communication interface,
acquire color space transformation information based on the first photographed image and color space information corresponding to the first pattern image,
control the projector to project the second pattern image on the projection surface without the screen member being overlaid,
receive a second photographed image which includes the projection surface without the screen member being overlaid on which the second pattern image is projected from the external terminal apparatus through the communication interface, and
perform color calibration of an image to be projected on the projection surface according to a characteristic of the projection surface based on the second photographed image, color space information corresponding to the second pattern image, and the color space transformation information.

2. The electronic apparatus of claim 1 ,
wherein the at least one processor is configured to:
acquire the color space transformation information based on red, green blue (RGB) information corresponding to the first photographed image and XYZ color space information corresponding to the first pattern image.

3. The electronic apparatus of claim 1 ,
wherein the color space transformation information comprises a color space transformation matrix transforming RGB information into XYZ color space information.

4. The electronic apparatus of claim 1 ,
wherein the at least one processor is configured to:
transform RGB information corresponding to the second photographed image into XYZ color space information based on the color space transformation information,
acquire a color difference between the XYZ color space information corresponding to the second photographed image and XYZ color space information corresponding to the second pattern image, and
perform the color calibration based on the acquired color difference.

5. The electronic apparatus of claim 4 ,
wherein the at least one processor is configured to:
change at least one of a gain value or an offset value related to an RGB signal based on the acquired color difference.

6. The electronic apparatus of claim 1 ,
wherein the at least one processor is configured to:
based on identifying that a predetermined object related to the screen member is included in the first photographed image, acquire the color space transformation information based on the first photographed image, and
based on identifying that a predetermined object related to the screen member is not included in the first photographed image, control the projector to project a user interface (UI) including information that the screen member is not recognized.

7. The electronic apparatus of claim 1 ,
wherein the first pattern image includes at least one of a white pattern image, a red pattern image, a green pattern image, or a blue pattern image, and
the second pattern image includes a white pattern image.

8. The electronic apparatus of claim 7 ,
wherein the at least one processor is configured to:
control the projector to project the white pattern image included in the first pattern image first, and project remaining pattern images sequentially.

9. A method of controlling an electronic apparatus storing a first pattern image and a second pattern image and communicating with an external terminal apparatus, the method comprising:
projecting the first pattern image on a screen member overlaid onto at least a portion of a projection surface, wherein the screen member comprises a white reflector which is separate from the projection surface;
receiving a first photographed image which includes the screen member on which the first pattern image is projected from the external terminal apparatus;
acquiring color space transformation information based on the first photographed image and color space information corresponding to the first pattern image;
projecting the second pattern image on the projection surface without the screen member being overlaid;
receiving a second photographed image which includes the projection surface without the screen member being overlaid on which the second pattern image is projected from the external terminal apparatus; and
performing color calibration of an image to be projected on the projection surface according to a characteristic of the projection surface based on the second photographed image, color space information corresponding to the second pattern image, and the color space transformation information.

10. The method of claim 9 ,
wherein the acquiring the transformation information comprises:
acquiring the color space transformation information based on red green blue (RGB) information corresponding to the first photographed image and XYZ color space information corresponding to the first pattern image.

11. The method of claim 9 ,
wherein the color space transformation information is a color space transformation matrix transforming RGB information into XYZ color space information.

12. The method of claim 9 ,
wherein the performing the color calibration comprises:
transforming RGB information corresponding to the second photographed image into XYZ color space information based on the color space transformation information,
acquiring a color difference between the XYZ color space information corresponding to the second photographed image and XYZ color space information corresponding to the second pattern image, and
performing the color calibration based on the acquired color difference.

13. The method of claim 12 ,
wherein the performing the color calibration comprises:
changing at least one of a gain value or an offset value related to an RGB signal based on the acquired color difference.

14. The method of claim 9 , further comprising:
based on identifying that a predetermined object related to the screen member is included in the first photographed image, acquiring the color space transformation information based on the first photographed image, and
based on identifying that a predetermined object related to the screen member is not included in the first photographed image, projecting a user interface (UI) including information that the screen member is not recognized.

15. The method of claim 9 ,
wherein the first pattern image includes at least one of a white pattern image, a red pattern image, a green pattern image, or a blue pattern image, and
the second pattern image includes a white pattern image.

16. The method of claim 15 ,
wherein the projecting the first pattern image comprises:
projecting the white pattern image included in the first pattern image first, and projecting remaining pattern images sequentially.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Park Jaesung
• Kim Jiman
• Woo Junhee
• Jung Seongwoon
• Choi Junghwa

Classifications

• H04N9/67

  for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85) · CPC title

• H04N9/3111

  for displaying the colours sequentially, e.g. by using sequentially activated light sources (sequential projection in colour photography G03B33/08) · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06V10/56

  relating to colour · CPC title