Method for overlaying an image arising from a sensor on a synthetic image by automatic detection of the limit of visibility and associated viewing system

Patent metadata

Field	Value
Publication number	US-10008179-B2
Application number	US-201715786473-A
Country	US
Kind code	B2
Filing date	Oct 17, 2017
Priority date	Nov 3, 2016
Publication date	Jun 26, 2018
Grant date	Jun 26, 2018

Abstract

An on-board viewing system for aircraft of an image arising from an image sensor overlaid on a synthetic image of the outside landscape is provided. The method comprises the following steps: analysis, at a temporal frequency, of the sensed images so as to determine, in each image, a boundary between the information useful for piloting and the non-useful information, the useful information consisting of noteworthy elements, the temporal frequency being an order of magnitude lower than the video refresh frequency; determination of a transition zone in the vicinity of each boundary; display on the viewing screen, at the video refresh frequency, of the sensed images, each sensed image being displayed overlaid on a synthetic image of the landscape, the sensed image being opaque under the transition zone, totally transparent above the transition zone and of continuously variable transparency in the transition zone.

First claim

The invention claimed is:

1. A method of graphical representation in an on-board viewing system for aircraft of a first image (EVS) arising from an image sensor of the outside landscape overlaid on a second image (SVS) representing a synthetic image of the same outside landscape, the two images being displayed on a viewing screen of the viewing system, wherein the method comprises the following steps:
analysis, at a temporal frequency, of a first series of first images arising from the image sensor so as to determine, inside each image, a boundary (F) between the information useful for piloting and the information not useful for piloting, the useful information consisting of portions of terrain or of obstacles or of elements of interest that are noteworthy, the said temporal frequency being an order of magnitude lower than the video refresh frequency of the images displayed on the viewing screen, these first images being denoted analysed images;
determination of a transition zone (T) in the vicinity of each boundary of a determined width;
display on the viewing screen, at the video refresh frequency, of a second series of first images between two successive analysed images, each first image being displayed overlaid on a second image representing a synthetic image of the same outside landscape, the first image being opaque under the transition zone, totally transparent above the transition zone and of continuously variable transparency varying between opacity and total transparency in the transition zone.

2. The method of graphical representation according to claim 1 , wherein, between two first images displayed successively at the video refresh frequency, the position and the inclination of the boundary corresponding to the said images are slaved to the attitude of the aircraft in pitch, roll and yaw and to the variations of rotation of the image sensor.

3. The method of graphical representation according to claim 1 , wherein the transition between two boundaries that are computed successively at the temporal frequency is carried out by means of a morphosis.

4. The method of graphical representation according to claim 1 , wherein the transition zone is either centred on the boundary, or situated below the latter, or situated above the latter.

5. The method of graphical representation according to claim 1 , wherein the first images arising from the image sensor and the second synthetic images are in different colour ranges.

6. An on-board viewing system for aircraft comprising at least one image sensor of the outside landscape, a cartographic database, a graphics computer arranged so as to generate a synthetic image of the same outside landscape, a viewing screen displaying a first image arising from the image sensor overlaid on a second image representing the synthetic image, wherein the viewing system comprises:
means for image analysis, at a temporal frequency, of a first series of first images arising from the image sensor so as to determine, inside each image, a boundary between the information useful for piloting and the information not useful for piloting, the useful information consisting of portions of terrain or of obstacles or of elements of interest that are noteworthy, the said temporal frequency being an order of magnitude lower than the video refresh frequency of the images displayed on the viewing screen, these first images being denoted analysed images;
first means for computing a transition zone in the vicinity of each boundary of a determined width;
the graphics computer displaying, at the video refresh frequency, a second series of first images between two successive analysed images, each first image being displayed overlaid on a second image representing a synthetic image of the same outside landscape, the first image being opaque under the transition zone, totally transparent above the transition zone and of continuously variable transparency varying between opacity and total transparency in the transition zone.

7. The on-board viewing system for aircraft according to claim 6 , wherein, between two first images displayed successively at the video refresh frequency, the position and the inclination of the boundary corresponding to the said images are slaved to the attitude of the aircraft in pitch, roll and yaw and to the variations of rotation of the image sensor.

8. The on-board viewing system for aircraft according to claim 6 , wherein the transition between two boundaries that are computed successively at the temporal frequency is carried out by means of a morphosis.

9. The on-board viewing system for aircraft according to claim 6 , wherein the image sensor is an infrared camera or a light-intensifier-based device or a millimeter wave sensor.

10. The on-board viewing system for aircraft according to claim 6 , wherein the viewing screen is a screen of the instrument panel or a fixed head-up viewing device screen or a worn head-up viewing device screen or an on-windscreen projection device screen.

Assignees

• Thales Sa

Inventors

• Perrin Baptiste
• Ganille Thierry
• Lux Johanna

Classifications

• G02B2027/014

  comprising information/image processing systems · CPC title

• G09G5/02 Primary

  characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} · CPC title

• G02B27/01

  Head-up displays · CPC title

• G06T17/05

  Geographic models · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title