Reduction of LED headlight flickering in electronic mirror applications

Patent metadata

Field	Value
Publication number	US-9969332-B1
Application number	US-201514729332-A
Country	US
Kind code	B1
Filing date	Jun 3, 2015
Priority date	Jun 3, 2015
Publication date	May 15, 2018
Grant date	May 15, 2018

Abstract

An apparatus comprising a sensor and a processor. The sensor may be configured to generate a first video signal based on a targeted view from a vehicle. The processor may be configured to classify objects detected in the first video signal. The processor may be configured to generate a second video signal in response to (i) the classified objects and (ii) the first video signal. The second video signal may present a field of view configured to fit a shape of a display emulating a reflective view from a mirror. The second video signal may present a modified group of pixels of the first video signal to mask a flickering effect of the classified objects present in the first video signal when viewing the second video signal on the display.

First claim

The invention claimed is:

1. An apparatus comprising:
a sensor configured to generate a first video signal based on a targeted view from a vehicle; and
a processor configured to (A) classify objects detected in said first video signal to determine a location and a region of pixels to modify within a frame of the first video signal, (B) execute steps for modifying said region of pixels in said first video signal, said steps comprising (i) searching for a flickering effect in said frame, (ii) determining a correction for said sensor based on said flickering effect in said frame, (iii) determining whether said flickering effect has been masked and (iv) repeating steps (i)-(iii) if said flickering effect has not been masked, (C) perform said correction of said region of pixels in said first video signal by executing at least one of (i) determining average values of pixels based on said location of said region of pixels over consecutive frames of said first video signal, (ii) determining average values of pixels corresponding to a location of said object over consecutive frames of said first video signal and (iii) clipping values of said pixels of said first video signal based on a predetermined range and (D) generate a second video signal in response to (i) said classified objects and (ii) said first video signal, wherein said second video signal presents (i) a field of view configured to fit a shape of a display emulating a reflective view from a mirror and (ii) a modified version of said region of pixels of said first video signal to mask said flickering effect of said classified objects present in said first video signal when viewing said second video signal on said display.

2. The apparatus according to claim 1 , wherein (i) said classified objects comprise pulsed light sources and (ii) said region of pixels is less than all of said pixels in each frame of said first video signal.

3. The apparatus according to claim 2 , wherein at least one of said pulsed light sources comprise headlights.

4. The apparatus according to claim 1 , wherein (i) said display is implemented as an electronic mirror and (ii) said second video signal presents a reduced LED flickering.

5. The apparatus according to claim 1 , wherein said second video signal is a cropped version of said first video signal.

6. The apparatus according to claim 5 , wherein said second video signal presents one or more portions of said first video signal where each portion is cropped to fit a corresponding size and view for each display of said vehicle.

7. The apparatus according to claim 1 , wherein said pixels in said region are modified based on an average luminance over a number of said frames in said first video signal.

8. The apparatus according to claim 1 , further comprising an interface configured to receive status information about one or more components of said vehicle, wherein said second video signal is further generated in response to said status information.

9. The apparatus according to claim 1 , wherein said flickering effect is masked by at least one of (a) local dimming and (b) backlight changes of pixel regions of said display corresponding to said region of pixels.

10. The apparatus according to claim 1 , wherein said processor is configured to mask said flickering effect at said sensor by executing at least one of (i) configuring said sensor to perform a plurality of short exposures and determining an average for each pixel location over said plurality of short exposures, (ii) modifying a gain for said region of pixels corresponding to said objects, and (iii) configuring said sensor to increase a shortest exposure for said region of pixels corresponding to said objects.

11. The apparatus according to claim 1 , wherein said processor is further configured to (i) recognize said object in a frame of said first video signal, and (ii) determine said correction for said sensor based on characteristics of said object.

12. The apparatus according to claim 1 , wherein said correction for said sensor is at least one of (a) increasing a shortest exposure for said region of pixels in a multiple-exposure high-dynamic-range capture, (b) increasing an exposure for said region of pixels in a single-exposure capture and (c) modifying a gain for said region of pixels.

13. The apparatus according to claim 12 , wherein said exposure is determined using an iterative approximation method to find a minimal correction for masking said flickering effect.

14. The apparatus according to claim 1 , wherein said correction for said sensor is at least one of (a) increasing a shortest exposure for said frame in a multiple-exposure high-dynamic-range capture, (b) increasing an exposure for said frame in a single-exposure capture and (c) modifying a gain for said frame.

15. The apparatus according to claim 1 , wherein said flickering effect is caused by a duty cycle of a light source.

16. The apparatus according to claim 1 , wherein said classification of objects comprises (a) determining if a subset of said objects should be ignored based on a criteria indicating said subset of said objects is known to be intentionally flickering and (b) leaving said pixels unmodified for said intentionally flickering objects.

17. A method for reducing a flickering effect in a video, comprising the steps of:
generating a first video signal based on a targeted view from a vehicle;
classifying objects detected in said first video signal to determine a location and of a region of pixels to modify within a frame of the first video signal;
modifying said region of pixels in said first video signal, wherein said modifying comprises (i) searching for said flickering effect in said frame, (ii) determining a correction for a sensor based on said flickering effect in said frame, (iii) determining whether said flickering effect has been masked and (iv) repeating steps (i)-(iii) if said flickering effect has not been masked;
perform a correction of said region of pixels in said first video signal by executing at least one of (i) determining average values of pixels based on said location of said region of pixels over consecutive frames of said first video signal, (ii) determining average values of pixels corresponding to a location of said object over consecutive frames of said first video signal and (iii) clipping values of said pixels of said first video signal based on a predetermined range; and
generating a second video signal in response to (i) the classified objects and (ii) the first video signal, wherein said second video signal presents (a) a field of view configured to fit a shape of a display emulating a reflective view from a mirror and (b) said modified region of pixels of said first video signal to mask said flickering effect of said classified objects present in said first video signal when viewing said second signal on said display.

Assignees

• Ambarella Inc

Inventors

• Pertsel Shimon
• Day Christopher N
• Fink Alexander

Classifications

• B60R1/005 Primary

  specially adapted for viewing traffic-lights · CPC title

• G06V20/584 Primary

  of vehicle lights or traffic lights · CPC title

• G06V10/22

  by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition · CPC title

• G06K9/2027

  Physics · mapped topic

• G06K9/00825

  Physics · mapped topic