Display control device and display system

Patent metadata

Field	Value
Publication number	US-11450040-B2
Application number	US-201816963904-A
Country	US
Kind code	B2
Filing date	Oct 1, 2018
Priority date	Jan 25, 2018
Publication date	Sep 20, 2022
Grant date	Sep 20, 2022

Abstract

A display control device includes a front image acquiring portion configured to acquire front images by a front camera that images a front of a vehicle traveling on a traveling lane, a lane line position calculation portion configured to calculate a position of a lane line separating the traveling lane and an adjacent lane adjacent to the traveling lane based on movement of the vehicle in a period from a point at which the front image is acquired by the front camera, a movement track calculation portion configured to calculate a movement track of the vehicle, a map creating portion configured to create a map, and a display control portion configured to display, a synthesized image in which a pseudo lane line image corresponding to the lane line is superimposed onto a rear side image acquired after the movement of the vehicle by a rear side camera based on the map.

First claim

The invention claimed is:

1. A display control device comprising:
a front image acquiring portion configured to acquire front images acquired in a chronological order by a front camera that images a front of a vehicle traveling on a traveling lane;
a lane line position calculation portion configured to calculate a position of a lane line separating the traveling lane and an adjacent lane adjacent to the traveling lane based on movement of the vehicle in a period from a point at which the front image is acquired by the front camera;
a movement track calculation portion configured to calculate a movement track of the vehicle based on a speed vector of the vehicle;
a map creating portion configured to create a map regarding the position of the lane line in a range capable of being imaged by the front camera and a range capable of being imaged by a rear camera that images a rear of the vehicle based on the position of the lane line calculated based on the front image, which is a calculation result of the lane line position calculation portion, and a direction and a distance of the vehicle and a change in a posture in the period from the point at which the front image is acquired, which is a calculation result of the movement track calculation portion; and
a display control portion configured to display, on a display portion, a synthesized image in which a pseudo lane line image corresponding to the lane line in the map regarding the position of the lane line is superimposed onto a rear side image acquired after the movement of the vehicle by the rear camera based on the map created by the map creating portion.

2. The display control device according to claim 1 , comprising:
a movement determination portion configured to determine whether or not the vehicle moves to the adjacent lane; wherein
the display control portion is configured to display, on the display portion, the synthesized image in which the pseudo lane line image with a striking color is superimposed onto the rear side image when the movement determination portion determines that the vehicle moves to the adjacent lane.

3. The display control device according to claim 1 , comprising:
a turning intention detection portion configured to detect a turning intention of a driver of the vehicle, wherein
the display control portion displays, on the display portion, the synthesized image in which the pseudo lane line image with the striking color is superimposed onto the rear side image when the turning intention detection portion detects the turning intention.

4. The display control device according to claim 1 , comprising:
a following vehicle determination portion configured to determine whether or not a following vehicle that travels on the adjacent lane to follow the vehicle exists, wherein
the display control portion displays, on the display portion, the synthesized image in which the pseudo lane line image with the striking color is superimposed onto the rear side image when the following vehicle determination portion determines that the following vehicle exists.

5. The display control device according to claim 1 , wherein
the display control portion displays, on the display portion, a pseudo lane line image corresponding to the lane line separating the adjacent lane and a next adjacent lane adjacent to the adjacent lane on a side opposite to the traveling lane with a color different from a pseudo lane line image corresponding to the lane line separating the traveling lane and the adjacent lane adjacent to the traveling lane based on the position of the lane line calculated by the lane line position calculation portion.

6. A display system comprising:
the display control device according to claim 1 ,
the display portion;
a vehicle speed sensor configured to detect a vehicle speed of the vehicle; and
a steering angle sensor configured to detect a steering angle of the vehicle.

7. The display control device according to claim 1 , wherein
the speed vector is calculated based on a rotation radius based on a steering angle output from a steering angle sensor and a speed output from a vehicle speed sensor.

8. The display control device according to claim 1 , wherein
the display control portion is configured to display the synthesized image on the display portion in a condition in which the lane line itself is blacked out due to exposure correction of the rear camera.

Assignees

• Clarion Co Ltd

Inventors

• Fukuda Daisuke

Classifications

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T11/23 Primary

  using straight lines or curves · CPC title

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• G01B21/22

  for measuring angles or tapers; for testing the alignment of axes · CPC title

• B60R2300/305

  merging camera image with lines or icons · CPC title