Method and system for mitigating image flicker from strobed lighting systems

Patent metadata

Field	Value
Publication number	US-12200369-B2
Application number	US-202017640007-A
Country	US
Kind code	B2
Filing date	Sep 3, 2020
Priority date	Sep 3, 2019
Publication date	Jan 14, 2025
Grant date	Jan 14, 2025

Abstract

Aspects of the present invention relate to an image correction system ( 300 ) for mitigating image flicker from strobed lighting systems. The image correction system ( 300 ) comprises one or more controllers ( 120 ) comprising input means ( 122 ), processing means ( 121 ) and output means ( 122 ). The input means ( 122 ) is configured to receive, from a first imaging apparatus ( 111 ) comprising a first pixel array configured to operate with at least a first exposure time, first image data ( 141 ) indicative of an environment. The input means ( 122 ) are configured to receive, from a second imaging apparatus ( 112 ) comprising a second pixel array configured to operate with at least a second exposure time different to the first exposure time, second image data ( 142 ) indicative of at least a portion of the environment. The processing means ( 121 ) are configured to identify strobed lighting regions of the first image data ( 141 ) and strobed lighting regions of the second image data ( 142 ); and to determine corrected image data for mitigating image flicker of the strobed lighting regions of the first image data ( 141 ) in dependence on a correspondence between the strobed lighting regions of the first image data ( 141 ) and the strobed lighting regions of the second image data ( 142 ). The output means ( 122 ) is configured to output a signal indicative of the corrected image data.

First claim

The invention claimed is:

1. An image correction system for mitigating image flicker from strobed lighting systems, the image correction system comprising one or more controllers, the one or more controllers comprising:
input means configured to receive, from a first imaging apparatus comprising a first pixel array configured to operate with at least a first exposure time, first image data indicative of an environment;
the input means configured to receive, from a second imaging apparatus comprising a second pixel array configured to operate with at least a second exposure time different to the first exposure time and configured to adjust the exposure time of the second pixel array to at least a third exposure time, second image data indicative of at least a portion of the environment at each of the second and third exposure times;
processing means configured to identify a contrast between pixel values of corresponding regions of the second image data generated at the second and third exposure times, and to identify strobed lighting regions of the first image data and strobed lighting regions of the second image data in dependence on the identified contrast;
the processing means configured to determine corrected image data for mitigating image flicker of the strobed lighting regions of the first image data in dependence on a correspondence between the strobed lighting regions of the first image data and the strobed lighting regions of the second image data; and
output means configured to output a signal indicative of the corrected image data.

2. An image correction system according to claim 1 , comprising a display device configured to receive the signal indicative of the corrected image data and to display an indication of the signal.

3. An image correction system according to claim 2 , wherein the processing means is arranged to determine the corrected image data in real-time.

4. An image correction system according to claim 1 , comprising:
the first imaging apparatus comprising the first pixel array configured to generate the first image data; and
the second imaging apparatus comprising the second pixel array configured to generate the second image data.

5. An image correction system according to claim 1 , wherein the one or more controllers are configured to determine a strobe rate of the strobed lighting region.

6. An image correction system according to claim 5 , wherein:
the one or more controllers are configured to communicate an indication of the strobe rate to the second imaging apparatus, and to control the second imaging apparatus to adjust at least one of the second or third exposure time to align with the strobe rate; and
the second imaging apparatus is configured to communicate the second image data generated at the at least one adjusted exposure time to the one or more controllers and optionally wherein the one or more controllers are configured to determine the corrected image data by substituting at least some of the strobed lighting regions of the first image data with the corresponding strobed lighting regions of the second image data.

7. An image correction system according to claim 1 , wherein the one or more controllers are configured to identify a contrast between pixel values of corresponding regions of the first image data and the second image data, and to identify the strobed lighting regions in dependence thereon.

8. An image correction system according to claim 7 , wherein the one or more controllers are configured to determine a corrected pixel value for each of the strobed lighting regions in dependence on the identified contrast.

9. An image correction system according to claim 8 , wherein the one or more controllers are configured to determine the corrected image data by adjusting each strobed lighting region of the first image data to maintain the corrected pixel value.

10. An image correction system according to claim 1 , wherein the image correction system is associated with a vehicle, and wherein the first image data and second image data are indicative of objects in the environment proximal to the vehicle.

11. An image correction system according to claim 10 , wherein the first imaging apparatus and the second imaging apparatus each comprise one or more cameras associated with the vehicle.

12. An image correction system according to claim 11 , wherein the first imaging apparatus is associated with a rear view system of the vehicle.

13. An image correction system according to claim 12 comprising a display device configured to receive the signal indicative of the corrected image data and to display an indication of the signal.

14. An image correction system according to claim 13 , wherein the processing means is arranged to determine the corrected image data in real-time, wherein the display device comprises a rear view mirror replacement system or a door mirror replacement system.

15. An image correction system according to claim 11 , wherein the second imaging apparatus is associated with an existing vehicle system and is arranged to be utilised for one or more additional purposes besides image correction.

16. A vehicle comprising an image correction system according to claim 1 .

17. An image correction method for mitigating image flicker from strobed lighting systems, the image correction method comprising:
receiving first image data indicative of an environment taken with at least a first exposure time;
receiving second image data indicative of at least a portion of the environment taken with each of a second exposure time different to the first exposure time and a third exposure time;
identifying a contrast between pixel values of corresponding regions of the second image data generated at the second and third exposure times;
identifying strobed lighting regions of the first image data and the second image data in dependence on the identified contrast between pixel values of the second image data;
determining corrected image data for mitigating image flicker of the strobed lighting regions of the first image data in dependence on a correspondence between the strobed lighting regions of the first image data and the strobed lighting regions of the second image data; and
outputting a signal indicative of the corrected image data.

18. A non-transitory computer readable medium comprising computer readable instruction that, when executed by a processor, cause performance of the method of claim 17 .

Assignees

• Jaguar Land Rover Ltd

Inventors

• Close Joshua
• Pryke Alexander

Classifications

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• B60R2300/8046

  for replacing a rear-view mirror system · CPC title

• B60R2300/30

  characterised by the type of image processing · CPC title

• B60R2300/105

  using multiple cameras · CPC title