Closed loop driving of a highlighter type projector

Patent metadata

Field	Value
Publication number	US-2021281807-A1
Application number	US-201917053903-A
Country	US
Kind code	A1
Filing date	May 7, 2019
Priority date	May 8, 2018
Publication date	Sep 9, 2021
Grant date	—

Abstract

A method for driving a projection system and a projection system including a phase modulator and at least one amplitude modulator. The phase modulator is configured to generate a highlight image incident on the amplitude modulator, the projector system further includes at least one image sensor configured to receive at least a portion of an illumination pattern substantially equivalent to the illumination pattern incident on the amplitude modulator, and the image sensor is being used to provide feedback to the controller of the projection system to improve the highlights projected by the projection system.

First claim

1 - 44 . (canceled)

45 . A method of driving a projector system comprising a light source, a phase modulator and at least one amplitude modulator, the phase modulator being configured to generate a highlight image incident on the amplitude modulator, the projector system further comprising at least one image sensor configured to receive at least a portion of an illumination pattern substantially equivalent to an illumination pattern incident on the amplitude modulator, the method comprising the steps of:
1) receiving an input image, 2) generating a target highlight image, a target image and light source power control signals from the input image,
a) generating a phase pattern for driving the phase modulator from the target highlight image,
b) generating a predicted illumination profile image from the target highlight image,
c) generating an amplitude pattern for driving the amplitude modulator from the predicted illumination profile image and the target image,
3) receiving an image from the image sensor to provide feedback to at least one of the method steps 2), 2b), 2c) for driving the projector system.

46 . The method according to claim 45 , wherein the at least one image sensor is running at a multiple of the frame frequency of the input image.

47 . The method according to claim 45 , wherein the projector system further comprises a second amplitude modulator and wherein the step of generating a target highlight image, a target image and power control signals from the input image, further comprising the at least one first amplitude modulator generating a target base image.

48 . The method according to claim 45 , wherein one of the at least one image sensor comprises an addressable area and one of the at least one image sensor comprises an active area, and wherein the addressable area is configured to provide real-time calibration patterns and the active area is configured to provide periodic calibration patterns,
wherein the step of generating the predicted illumination profile image from the target highlight image further comprises as input the real-time calibration patterns and the periodic calibration patterns.

49 . The method according to claim 48 , wherein calibration patterns are generated in the addressable area.

50 . The method according to claim 45 , wherein one of the at least one image sensors comprises an active area, and wherein the image sensor is configured to acquire a real-time illumination profile image within the active area, said real-time illumination profile image comprising slowly varying content between frame n and n+1, and wherein a step of generating a target highlight image, a target image and light source power control signals from the input image for frame n+1 further uses input from the slowly varying content of the real-time illumination profile image acquired during frame n of the input image.

51 . The method according to claim 45 , further comprising motion detection means, wherein the motion detection means are configured to determine which part of the input image frame is static between two consecutive frames and which part is dynamic.

52 . The method according to claim 51 , further comprising means to decide on a pixel or region basis which part of the image is static or slowly varying and which part of the image is dynamic, wherein in regions or for the pixels of the input image where the content is static, the predicted illumination profile is compared to the actual illumination profile
when the actual illumination profile is higher than the predicted illumination profile, the target image is attenuated by the ratio of the actual illumination profile to the predicted illumination profile, when the actual illumination profile is lower than the predicted illumination profile, but still sufficient, the target image is multiplied by the same ratio of the actual illumination profile to the predicted illumination profile, when the actual illumination profile is lower than the predicted illumination profile, and is too faint, the target highlight is increased to deliver sufficient brightness, while at the same time the target image is multiplied by the same ratio of the actual illumination profile to the predicted illumination profile.

53 . The method according to claim 50 , wherein the step of generating a target highlight image, a target image and light source power control signals from the input image from the input image for frame n further uses input from the predicted illumination profile image.

54 . The method according to claim 45 , wherein a step of generating an amplitude pattern for driving the amplitude modulator for frame n+1 from the predicted illumination profile image and the target image further uses as input the actual illumination profile image of the previous frame n or sub-frame when the image sensor is driven at a multiple frequency of the amplitude modulator.

55 . The method according to claim 47 , further comprising generating a base pattern when receiving as additional input the target base image.

56 . The method according to claim 45 , wherein a portion of the light from the light source is processed by the phase modulator to generate a highlight image on the amplitude modulator and another portion of the light is uniformly distributed on the amplitude modulator to provide a base image.

57 . The method according to claim 45 , wherein the at least a portion of the illumination pattern substantially equivalent to the illumination pattern incident on the amplitude modulator is a scaled down version,

58 . The method according to claim 45 , wherein the image sensor is positioned in the path of optical elements that generate a highlight.

59 . A method for monitoring the light levels provided by at least one laser source in a projector system, said at least one laser source being driven by power control signals, the projector system comprising a phase modulator and at least one amplitude modulator, the phase modulator being configured to generate a highlight image incident on the amplitude modulator, the projector system further comprising at least one image sensor configured to receive at least a portion of an illumination pattern substantially equivalent to an illumination pattern incident on the amplitude modulator, the image sensor comprising at least one of an active area and an addressable area, the method comprising the steps of:
comparing the light intensity within at least one of the active area and the addressable area with a threshold, reducing the power or shutting down the laser source with the power control signals when the measured light intensity is higher than the threshold.

60 . A projector system comprising:
a phase modulator and at least one amplitude modulator, the phase modulator being configured to generate a highlight image incident on the amplitude modulator, the projector system further comprising at least one image sensor configured to receive at least a portion of an illumination pattern substantially equivalent to an illumination pattern incident on the amplitude modulator, the phase modulator, amplitude modulator and image sensor being controlled by a driver, and further comprising a feedback loop for providing the output of the image sensor to the driver.

61 . The projector system according to claim 60 , wherein the phase modulator and the amplitude modulator are arranged on an optical path; the phase modulator steering a light beam to an intermediate image, said image sensor and amplitude modulator receiving light from said intermediate image such th

Assignees

• Barco Nv

Inventors

• Maes Dirk
• Gerets Peter
• Damberg Gerwin

Classifications

• H04N9/3194

  including sensor feedback · CPC title

• H04N9/3161

  using laser light sources (using laser beams scanning the display screen H04N9/3129) · CPC title

• H04N9/3155

  for controlling the light source (light source control per se H05B35/00 – H05B47/00; control of an illumination source for displays in general G09G3/3406) · CPC title

• H04N9/3126 Primary

  for spatial light modulators in series · CPC title

• H04N9/3182

  Colour adjustment, e.g. white balance, shading or gamut (white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607) · CPC title