Visual perception enhancement of displayed color symbology

Patent metadata

Field	Value
Publication number	US-10126554-B2
Application number	US-201515535633-A
Country	US
Kind code	B2
Filing date	Dec 13, 2015
Priority date	Dec 14, 2014
Publication date	Nov 13, 2018
Grant date	Nov 13, 2018

Abstract

Method and system for enhancing visual perception of augmented reality presentation. The location and line-of-sight (LOS) of a user wearing a see-through head-mounted display (HMD) is detected. A future background environment to be viewed by the user through the HMD is predicted based on at least the detected location and detected LOS. At least one color-attribute of the future background environment at a background location corresponding to a user LOS is predicted. The predicted color-attribute is compared with at least one color-attribute of an intended foreground supplementary image to be projected on the HMD overlaid onto the future background environment at the background location. When an incompatibility condition is detected, at least one visual parameter of the supplementary image is adjusted to minimize the incompatibility condition, and the supplementary image is projected on the HMD at the background location with the adjusted visual parameter.

First claim

The invention claimed is:

1. A method for enhancing the visual perception of augmented reality presentation, the method comprising the procedures of:
detecting the location of a user, with a location measurement unit;
detecting the line-of-sight (LOS) of said user, with a line-of-sight detector;
predicting a future background environment to be viewed by said user through a see-through head-mounted display (HMD), based on at least the detected location and the detected LOS;
predicting at least one color-attribute of said future background environment at a background location corresponding to a LOS of said user;
comparing the predicted color-attribute of said future background environment at said background location with at least one color-attribute of an intended foreground supplementary image of a symbol, a text, or graphic or visual imagery, to be projected on said HMD overlaid onto the view of said future background environment at said background location; and
when an incompatibility condition is detected between said predicted color-attribute of said future background environment and said color-attribute of said intended foreground supplementary image, adjusting at least one visual parameter of said supplementary image in a manner that minimizes said incompatibility condition, and projecting said supplementary image with the adjusted visual parameter on said HMD at said background location.

2. The method of claim 1 , wherein said procedure of predicting at least one color-attribute of said future background environment at a background location is performed based on at least one data source selected from the list consisting of:
at least one current image of said background environment captured in real-time;
at least one previously captured image of said background environment; and
environmental information relating to said background environment.

3. The method of claim 1 , wherein said color-attribute is selected from the list consisting of:
brightness;
hue;
saturation;
chromaticity;
radiance;
luminance; and
any combination of the above.

4. The method of claim 1 , wherein said incompatibility condition is selected from the list consisting of:
insufficient contrast between said foreground supplementary image and said future background environment at said background location, as perceived by said user;
excess discrepancy between the color appearance of said foreground supplementary image when projected onto said future background environment, and the appearance of said intended color on a nominal achromatic background, as perceived by said user;
visual distortions in the appearance of said foreground supplementary image when projected onto said future background environment, as perceived by said user; and
non-uniform appearance of at least one color attribute of said foreground supplementary image when projected onto said future background environment, as perceived by said user.

5. The method of claim 1 , wherein said procedure of adjusting at least one visual parameter comprises at least one adjustment selected from the list consisting of:
altering at least one of: brightness; hue; and saturation, of the intended color of at least a portion of said supplementary image;
selecting a different color than said intended color for at least a portion of said supplementary image;
projecting a contour surrounding at least a portion of said supplementary image;
emphasizing or highlighting at least a portion of said supplementary image;
omitting at least a portion of said supplementary image altering the form or type of said supplementary image;
projecting at least a portion of said supplementary image at an alternate image location; and
any combination of the above.

6. The method of claim 1 , further comprising the procedure of: obtaining user color perception data,
wherein said incompatibility condition is determined in accordance with said user color perception data.

7. The method of claim 6 , wherein said user color perception data is obtained via at least one technique selected from the list consisting of:
an artificial intelligence technique, adapted to determine user color perception ability;
user feedback, based on a simulation of color scheme combinations, adapted to determine user color perception ability;
user feedback, based on perceptions of previously displayed supplementary imagery overlaid on background environment color combinations;
an analysis of physical features relating to the eyes or eyesight of said user.

8. The method of claim 1 , further comprising the procedure of defining at least one color-attribute adjustment function linking a visual alteration of a foreground supplementary image respective of a background environment at a background location with parameters relating to said visual alteration,
wherein said adjusting at least one visual parameter of said supplementary image in a manner that minimizes said incompatibility condition, is performed in accordance with said color-attribute adjustment function.

9. The method of claim 8 , wherein said parameters relating to said visual alteration comprises at least one parameter selected from the list consisting of:
the geographic location of said user;
the line-of-sight of said user;
the time or date;
the ambient lighting;
weather or climate conditions;
a qualitative indication of said visual alteration based on a user rating; and
a qualitative indication of said visual alteration based on image analysis by said processor.

10. A system for enhancing the visual perception of augmented reality presentation, the system comprising:
a see-through head-mounted display (HMD), worn by a user, said HMD configured to enable said user to view a background environment, and to display foreground imagery overlaid onto the view of said background environment;
a location measurement unit, configured to detect the location of said user;
a line-of-sight detector, configured to detect the line-of-sight (LOS) of said user; and
a processor, coupled with said HMD, with said location measurement unit and with said line-of-sight detector, said processor configured to predict a future background environment to be viewed by said user through said HMD, based on at least the detected location and the detected LOS, said processor further configured to predict at least one color-attribute of said future background environment at a background location corresponding to a LOS of said user, said processor further configured to compare the predicted color-attribute of said future background environment at said background location with at least one color-attribute of an intended foreground supplementary image of a symbol, a text, or graphic or visual imagery, to be projected on said HMD overlaid onto the view of said future background environment at said background location, and when an incompatibility condition is detected between said predicted color-attribute of said future background environment and said color-attribute of said intended foreground supplementary image, said processor is further configured to adjust at least one visual parameter of said supplementary image in a manner that minimizes said incompatibility condition, such that said supplementary image is projected with the adjusted visual parameter on said HMD at said background location.

11. The system of claim 10 , further comprising: at least one camera, coupled with said processor, said camera configured to capture current images of said background environment,
wherein said processor is configured to predict said at least one color-attribute of said future background environment at said background location based on at least one of said

Assignees

• Elbit Systems Ltd

Inventors

• Benesh Gil
• Ophir Yoav

Classifications

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B27/017 Primary

  Head mounted · CPC title

• G09G2320/0666

  for control of colour parameters, e.g. colour temperature · CPC title

• G09G2320/066

  for control of contrast · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title