Immersive display and method of operating immersive display for real-world object alert

Patent metadata

Field	Value
Publication number	US-10389992-B2
Application number	US-201514818119-A
Country	US
Kind code	B2
Filing date	Aug 4, 2015
Priority date	Aug 5, 2014
Publication date	Aug 20, 2019
Grant date	Aug 20, 2019

Abstract

An immersive display and a method of operating the immersive display to provide information relating to an object. The method includes receiving information from an input device of the immersive display or coupled to the immersive display, detecting an object based on the information received from the input device, and displaying a representation of the object on images displayed on a display of the immersive display such that attributes of the representation distinguish the representation from the images displayed on the display, wherein the representation is displayed at a location on the display that corresponds with a location of the object.

First claim

What is claimed is:

1. A method of operating an opaque immersive display to provide information relating to a real-world object, the method comprising:
displaying a primary visual data set comprising virtual reality images on a display of the immersive display;
receiving information from an input device of the immersive display or coupled to the immersive display;
determining at least one attribute of the real-world object, including at least a distance of the object to the immersive display or the input device coupled to the immersive display;
in response to determining that the distance of the real-world object is within a threshold distance, displaying a representation of the real-world object on the immersive display by superimposing the representation of the real-world object on the virtual reality images displayed on the display of the immersive display such that attributes of the representation distinguish the representation from the virtual reality displayed on the display;
continuing displaying the primary visual data set comprising virtual reality images absent display of the representation of the real-world object in response to determining that the distance of the real-world object is greater than the threshold distance; and
wherein the representation is displayed at a location on the display that corresponds with a location of the real-world object.

2. The method according to claim 1 , wherein determining attributes of the object comprises utilizing data generating by a forward looking infrared imaging device (“FLIR”).

3. The method according to claim 1 , wherein the threshold distance is dependent on the object.

4. The method according to claim 1 , wherein the threshold distance is dependent on a velocity of the object relative to the immersive display or the input device coupled to the immersive display.

5. The method according to claim 1 , wherein the threshold distance is dependent on direction of the object relative to an orientation of the immersive display or the input device coupled to the immersive display.

6. The method according to claim 1 , comprising identifying a direction of view of a user of the immersive display.

7. The method according to claim 1 , wherein displaying the representation of the object comprises displaying as a wireframe representation that is superimposed on the images displayed on the display.

8. The method according to claim 1 , wherein display attributes of the representation are dependent on distance of the object from the immersive display or the input device coupled to the immersive display.

9. The method according to claim 1 , wherein display attributes of the representation are dependent on a velocity of the object relative to the immersive display or the input device coupled to the immersive display.

10. The method according to claim 1 , comprising interrupting the images displayed on the display of the immersive display by discontinuing displaying the images and displaying an image of the object in response to detecting that the object is within a second threshold distance of the immersive display or the input device coupled to the immersive display.

11. A non-transitory computer-readable medium having stored thereon, computer-readable code executable by at least one processor of an immersive display to perform the method of claim 1 .

12. The method of claim 1 wherein the display is fully opaque.

13. An opaque immersive display comprising:
a body;
at least one input device coupled to the body for detecting objects in at least one region outside the body;
a display on the inside of the body for displaying a virtual image thereon; and
a processor coupled to the input device and to the display and operable to:
receive information from the at least one input device;
determine attributes of a real-world object including a distance of the real-world object to the immersive display or at least one input device coupled to the immersive display; and
in response to determining that the distance of the real-world object is within a threshold distance, display a representation of the real-world object on the virtual image displayed on the display by superimposing the representation of the real-world object on the virtual image such that attributes of the representation distinguish the representation of the real-world object from the virtual image displayed on the display;
in response to determining that the distance of the real-world object is outside the threshold distance, continue displaying the virtual image absent display of the representation of the real-world object,
wherein the representation is displayed at a location on the display that corresponds with a location of the real-world object.

14. The immersive display according to claim 13 , wherein the input device comprises a camera coupled to the body.

15. The immersive display according to claim 13 , comprising an internal cameral coupled to the processor, wherein the processor is operable to identify a direction of view of a user of the immersive display.

16. The immersive display according to claim 13 , wherein the processor is operable to modify display attributes of the representation of the object based on distance of the object from the input device.

17. The immersive display according to claim 13 , wherein the processor is operable to control the display to interrupt the virtual image displayed on the display of the immersive display by discontinuing displaying the virtual image and displaying an image of the object in response to detecting that the object is within a second threshold distance of the input device.

18. The immersive display of claim 13 , wherein the display is fully opaque.

19. The immersive display of claim 13 , wherein at least one of the at least one input devices is a forward looking infrared camera.

20. The immersive display of claim 13 , wherein at least one of the at least one input devices is a proximity sensor.

Assignees

• Utherverse Digital Inc
• Piccionelli Gregory A

Inventors

• Shuster Brian
• Piccionelli Gregory A
• Shuster Gary Stephen

Classifications

• H04N13/25

  using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor · CPC title

• H04N13/254

  in combination with electromagnetic radiation sources for illuminating objects · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• H04N13/366

  using viewer tracking · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title