Display system, information presentation system, control method of display system, storage medium, and mobile body

Patent metadata

Field	Value
Publication number	US-10699486-B2
Application number	US-201816016695-A
Country	US
Kind code	B2
Filing date	Jun 25, 2018
Priority date	Jun 30, 2017
Publication date	Jun 30, 2020
Grant date	Jun 30, 2020

Abstract

A display system includes a projector that projects a virtual image onto a target space to allow a target person to visibly recognize the virtual image and a controller that controls display of the virtual image. When the projector projects a virtual image corresponding to a caution object, the controller selects at least one reference point from one or more candidate points existing around the caution object and associates the virtual image with the at least one reference point.

First claim

The invention claimed is:

1. A display system that projects a projected image onto a reflection member and displays the projected image reflected by the reflection member as a virtual image on a target space in front to allow a user that drives a vehicle to visually recognize the virtual image, the display system comprising:
a projector that projects the projected image;
a processor; and
a memory including a program that, when executed, causes the processor to perform operations including:
acquiring a captured image which includes a caution object and a distance from the vehicle to the caution object;
extracting a plurality of candidate points existing around the caution object in the captured image according to the distance from the vehicle to the caution object;
selecting at least one reference point from the plurality of candidate points existing around the caution object; and
projecting the projected image so that the virtual image is displayed at the at least one reference point,

wherein, in the target space in the front, portions of a plurality of white lines existing on a road surface are extracted as the plurality of candidate points, and one of the plurality of candidate points is selected as the at least one reference point, and the projected image is projected such that the virtual image is visually recognized on a virtual line connecting the caution object and the at least one reference point.

2. The display system according to claim 1 , wherein the at least one reference point is two reference points, and
wherein, two of the plurality of candidate points are selected as the at least one reference point, and the projected image is projected such that a first end of the virtual image is associated with a first one of the two reference points and a second end of the virtual image opposite to the first end of the virtual image is associated with a second one of the two reference points.

3. The display system according to claim 1 , wherein a mode of the display of the projected image is changed according to the distance from the vehicle to the caution object.

4. The display system according to claim 1 , wherein the at least one reference point, which exists around the caution object in the captured image, corresponds to a position of a physical object in the captured image.

5. The display system according to claim 4 , wherein a vertical distance from the vehicle to the position of the physical object is same as a vertical distance from the vehicle to the caution object.

6. The display system according to claim 1 , wherein each of the plurality of candidate points corresponds to a position of a physical object in the captured image.

7. An information presentation system comprising:
the display system according to claim 1 ; and
a detection system that detects the caution object.

8. A vehicle, comprising:
the display system according to claim 1 ; and
the reflection member that has light permeability and reflects light emitted from the projector to allow the user to visually recognize the virtual image.

9. A control method of a display system, the display system including a projector that projects a projected image onto a reflection member, displaying the projected image reflected by the reflection member as a virtual image on a target space in front to allow a user that drives a vehicle to visually recognize the virtual image, and further including a processor that controls display of the projected image, the control method comprising:
acquiring a captured image which includes a caution object and a distance from the vehicle to the caution object;
extracting a plurality of candidate points existing around the caution object in the captured image according to the distance from the vehicle to the caution object;
selecting at least one reference point from the plurality of candidate points existing around the caution object; and
projecting the projected image so that the virtual image is displayed at the at least one reference point,
wherein, in the target space in the front, portions of a plurality of white lines existing on a road surface are extracted as the plurality of candidate points, and one of the plurality of candidate points is selected as the at least one reference point, and the projected image is projected such that the virtual image is visually recognized on a virtual line connecting the caution object and the at least one reference point.

10. A non-transitory recording medium storing a program for causing a computer to execute the control method according to claim 9 .

11. A display system that projects a projected image onto a reflection member and displays the projected image reflected by the reflection member as a virtual image on a target space in front to allow a user that drives a vehicle to visually recognize the virtual image, the display system comprising:
a projector that projects the projected image;
a processor; and
a memory including a program that, when executed, causes the processor to perform operations including:
acquiring a captured image which includes a caution object and a distance from the vehicle to the caution object;
extracting a plurality of candidate points existing around the caution object in the captured image according to the distance from the vehicle to the caution object;
selecting at least one reference point from the plurality of candidate points existing around the caution object; and
projecting the projected image so that the virtual image is displayed at the at least one reference point,

wherein each of the plurality of candidate points corresponds to a position of a physical object in the captured image, and
the plurality of candidate points each exist on a virtual line connecting the caution object and the plurality of candidate points.

12. The display system according to claim 11 , wherein a vertical distance from the vehicle to the position of the physical object corresponding to each of the plurality of candidate points is same as a vertical distance from the vehicle to the caution object.

13. The display system according to claim 11 , wherein the at least one reference point corresponds to the position of the physical object of at least one of the plurality of candidate points in the captured image.

14. A display system that projects a projected image onto a reflection member and superimposes the projected image reflected by the reflection member as a virtual image on a target space in front to allow a target person to visually recognize the virtual image, the display system comprising:
a projector that projects the projected image; and
a processor that controls display of the projected image,
wherein,
when the projector projects the projected image corresponding to a caution object, the processor selects at least one reference point from one or more candidate points existing around the caution object and associates the virtual image with the at least one reference point,
the one or more candidate points are a plurality of candidate points,
in the target space in the front, the processor extracts portions of a plurality of white lines existing on a road surface as the plurality of candidate points, and selects one of the plurality of candidate points as the at least one reference point, and
when the projector projects the projected image, the processor associates the at least one reference point with the virtual image such that the virtual image is visually recognized on a virtual line connecting the caution object and the at least one reference point.

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Tanaka Akira
• Shibata Tadashi
• Nakano Nobuyuki
• Tsuji Masanaga
• Hayashi Shohei

Classifications

• G09G3/02 Primary

  by tracing or scanning a light beam on a screen · CPC title

• G06V20/588

  Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road · CPC title

• G06V20/582

  of traffic signs · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V40/10

  Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands · CPC title