Parking assistance using a stereo camera and an added light source

Patent metadata

Field	Value
Publication number	US-11117570-B1
Application number	US-202016892465-A
Country	US
Kind code	B1
Filing date	Jun 4, 2020
Priority date	Jun 4, 2020
Publication date	Sep 14, 2021
Grant date	Sep 14, 2021

Abstract

An apparatus including a capture device, an illumination device and a processor. The capture device may be configured to generate pixel data corresponding to an exterior view from a vehicle. The illumination device may be configured to generate light for the exterior view. The processor may be configured to generate video frames from the pixel data, perform computer vision operations on the video frames to detect objects in the video frames and generate a control signal. The objects detected may provide data for a vehicle maneuver. The control signal may adjust characteristics of the light generated by the illumination device. The characteristics of the light may be adjusted in response to the objects detected by the processor. The light from the illumination device may facilitate detection of the objects by the processor.

First claim

The invention claimed is:

1. An apparatus comprising:
a capture device configured to generate pixel data corresponding to an exterior view from a vehicle;
an illumination device configured to generate light for said exterior view; and
a processor configured to (i) process the pixel data arranged as video frames, (ii) perform computer vision operations on said video frames to detect objects in said video frames and (iii) generate a control signal, wherein (a) said objects detected provide data for a vehicle maneuver, (b) said control signal adjusts characteristics of said light generated by said illumination device, (c) said characteristics of said light comprise a textured pattern of said light, (d) said characteristics of said light is adjusted in response to (A) said objects detected by said processor and (B) the vehicle maneuver comprises a parking maneuver performed by said vehicle, and (e) said computer vision operations comprise analyzing changes to individual shapes of said textured pattern of said light from said illumination device facilitating detection of said objects by said processor during the parking maneuver.

2. The apparatus according to claim 1 , wherein (i) said light is projected towards surfaces to a side of said vehicle and (ii) changes to said individual shapes of said textured pattern comprise round shaped dots projecting as oblong shaped dots on surfaces not perpendicular to said projection of said light.

3. The apparatus according to claim 2 , wherein (i) said capture device is located on a side of said vehicle and (ii) said exterior view from said vehicle comprises a field of view directed outwards from said side of said vehicle.

4. The apparatus according to claim 1 , wherein said light generated by said illumination device is in a visible spectrum.

5. The apparatus according to claim 1 , wherein said light generated by said illumination device is in an infrared spectrum.

6. The apparatus according to claim 1 , wherein said vehicle maneuver comprises parallel parking said vehicle.

7. The apparatus according to claim 1 , wherein (i) said vehicle maneuver is performed autonomously and (ii) said objects detected enable said vehicle to avoid said objects while performing said vehicle maneuver.

8. The apparatus according to claim 1 , wherein said light is generated in a direction that complies with regulations regarding illumination devices for vehicles.

9. The apparatus according to claim 1 , wherein said capture device comprises a stereo camera.

10. The apparatus according to claim 9 , wherein (i) said textured pattern of said light aids stereo processing performed by said processor in response to pairs of said pixel data captured by said stereo camera and (ii) said stereo processing performed by said processor is used to determine a distance of said stereo camera from said objects.

11. The apparatus according to claim 1 , wherein said individual shapes of said textured pattern of said light is configurable by said processor.

12. The apparatus according to claim 1 , wherein (i) said characteristics further comprise an amount of said light and (ii) said processor adjusts said light to a dim amount of lighting when said objects detected do not comprise an obstacle.

13. The apparatus according to claim 1 , wherein (i) said characteristics further comprise an amount of said light and (ii) said processor adjusts said light to a bright amount of lighting when said objects detected comprise an obstacle.

14. The apparatus according to claim 1 , wherein (i) said characteristics further comprise a color of said light and (ii) said processor adjusts said color in response to said objects detected.

15. The apparatus according to claim 1 , wherein (i) said characteristics further comprise a color of said light and (ii) said processor is further configured to adjust said color in response to said vehicle maneuver performed by said vehicle.

16. The apparatus according to claim 1 , wherein said light from said illumination device is configured to communicate to nearby people an intention of said vehicle to perform said vehicle maneuver by flashing.

17. The apparatus according to claim 1 , wherein said processor is further configured to (i) detect shadows that have been cast by said objects in response to said light, (ii) analyze said shadows to determine a location of each of said objects compared to said illumination device, and (iii) aggregate information from said analysis of said shadows with a location and size said detected objects.

18. The apparatus according to claim 1 , wherein (i) said illumination device is located above said capture device and (ii) said light generated by said illumination device is projected down towards a field of view of said capture device.

19. The apparatus according to claim 18 , wherein (i) said capture device is offset (a) to a right side or (b) to a left side of said illumination device and (ii) said offset enables said capture device to capture shadows cast by said objects in response to said light.

20. The apparatus according to claim 18 , wherein (a) said capture device is configured to capture an area from zero to five meters out from a side of said vehicle and (b) said light generated from said illumination device is configured to illuminate said area.

Assignees

• Ambarella Int Lp

Inventors

• Broggi Alberto

Classifications

• B60W30/06 Primary

  Automatic manoeuvring for parking · CPC title

• B62D15/0285 Primary

  Parking performed automatically · CPC title

• G06V20/59

  inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V10/82

  using neural networks · CPC title