Deteriorated video feed

Patent metadata

Field	Value
Publication number	US-12450836-B2
Application number	US-202217673593-A
Country	US
Kind code	B2
Filing date	Feb 16, 2022
Priority date	Mar 31, 2017
Publication date	Oct 21, 2025
Grant date	Oct 21, 2025

Abstract

A method and apparatus for creating a deteriorated video feed from actions of a user. The apparatus receives a video feed from one or more cameras, within an enclosed area comprising one or more tangible instruments of a system on which the user performs the actions, wherein the video feed provides images related to the actions performed by the user interacting with the system through the one or more tangible instruments. The apparatus captures one or more visual-perception inhibitors affecting the user, wherein the one or more visual-perception inhibitors affect the user while performing the actions in the system. The apparatus comprises a video processing module for deteriorating the video feed by selectively modifying images from the video feed into a deteriorated video feed considering the captured one or more visual-perception inhibitors.

First claim

What is claimed is:

1. A video processing apparatus for recreating a view of an enclosed area from the perspective of a user located within the area and having variably affected vision during a session, the video processing apparatus comprising:
a video input port for receiving a first video feed from one or more cameras located within the enclosed area during the session, the one or more cameras configured within the enclosed area to capture information within a field of view of the user, the first video feed being independent of the variably affected vision of the user;
an input module comprising one or more sensors located within the enclosed area for:
capturing physiology data from the user during the session; and

one or more processors configured to:
determine one or more visual-perception inhibitors affecting the vision of the user during the session based on changes in the physiology data that negatively affects the vision of the user and inhibits the user from interpreting the information within the field of view of the user as captured by the one or more cameras;
detect a variation separating a first period of the session during which the vision of the user is unaffected and a second period of the session during which the vision of the user is negatively affected by the one or more visual-perception inhibitors;
selectively modify images from the first video feed corresponding to the second period of the session as a function of the one or more visual-perception inhibitors to generate a second video feed, the second video feed being deteriorated according to the negatively affected vision of the user to represent what the user sees while the vision of the user is negatively affected; and
provide the second video feed for display to another user.

2. The video processing apparatus of claim 1 further comprising a display module for displaying the second video feed and a storage for storing the second video feed.

3. The video processing apparatus of claim 1 wherein the one or more visual-perception inhibitors comprise at least one of:
dizziness of the user;
a partial blackout of the user;
a higher than normal g-force on the user;
fatigue;
workload;
stress;
tunnel vision;
a restricted field of view as a result of the user wearing glasses or contact lenses; or
a restricted field of view or blurriness as a result of a prior eye defect or age.

4. The video processing apparatus of claim 1 wherein the one or more cameras have a video-feed angle of view and wherein the one or more processors are further configured for cropping the images considering an effective visual field of the user, the effective visual field being within the video-feed angle of view, wherein the effective visual field of the user is a possible field of view of the user or an actual field of view of the user.

5. The video processing apparatus of claim 4 further comprising a tangible or virtual toggle switch for switching the effective visual field of the user between the possible visual field of the user and the actual visual field of the user.

6. The video processing apparatus of claim 1 , wherein generating the second video feed comprises at least one of:
making the images or parts of the images blurry;
making text within the images blurry;
making the images shake; or
increasing or decreasing the contrast of the images.

7. The video processing apparatus of claim 1 , wherein the one or more sensors comprise a measurement device and wherein at least one of the one or more visual-perception inhibitors is automatically measured from the user using the measurement device.

8. The video processing apparatus of claim 7 , wherein the measurement device measures an eye-level of the user and wherein generating the second video feed comprises rotating the video feed in response to changes in the eye-level of the user.

9. The video processing apparatus of claim 1 , wherein the system is an interactive flight simulator and the enclosed area is a cockpit of the flight simulator.

10. The video processing apparatus of claim 1 , wherein the system is an interactive hospital operating room simulator.

11. The video processing apparatus of claim 1 , wherein the system is an interactive paramedic vehicle simulator or an interactive paramedic-related scene simulator.

12. The video processing apparatus of claim 1 , wherein the one or more sensors are further for automatically capturing movements of the user and moving at least one of the one or more cameras in response to the captured movements.

13. The video processing apparatus of claim 1 , wherein the another user that the second video feed is provided for display to is an instructor.

14. A method for recreating a view of an enclosed area from the perspective of a user located within the area and having variably affected vision during a session, the method comprising:
receiving a first video feed, through a video input port, from one or more cameras located within the enclosed area, the one or more cameras configured within the enclosed area to capture information within a field of view of the user, the first video feed being independent of the variably affected vision of the user;
capturing physiology data from the user during the session using one or more sensors located in the enclosed area;
determining one or more visual-perception inhibitors affecting the vision of the user during the session based on changes in the physiology data that negatively affects the vision of the user and inhibits the user from interpreting the information within the field of view of the user as captured by the one or more cameras;
detecting a variation separating a first period of the session during which the vision of the user is unaffected and a second period of the session during which the vision of the user is negatively affected by the one or more visual-perception inhibitors;
selectively modifying images from the first video feed corresponding to the second period of the session as a function of the one or more visual-perception inhibitors to generate a second video feed, the second video feed being deteriorated according to the negatively affected vision of the user to represent what the user sees while the vision of the user is negatively affected; and
providing the second video feed for display to another user.

15. The method of claim 14 , further comprising displaying the second video feed on a display module.

16. The method of claim 14 , wherein the one or more cameras have a video-feed angle of view and wherein generating the second video feed comprises cropping the images considering an effective visual field of the user, the effective visual field being within the video-feed angle of view, wherein the effective visual field of the user is a possible field of view of the user or an actual field of view of the user.

17. The method of claim 14 , wherein at least one of the one or more visual-perception inhibitors is automatically measured from the user using a measurement device of the one or more sensors.

18. The method of claim 14 , wherein the system is a flight simulator.

19. The method of claim 14 , wherein at least one of the one or more cameras is located on a head of the user.

20. The method of claim 14 , further comprising capturing movements of the user using the one or more sensors and moving at least one of the one or more cameras in response to the captured movements.

Assignees

• Cae Inc

Inventors

• Ireland Alexander
• Russ Jack
• Bowness David

Classifications

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T15/205

  Image-based rendering · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06T7/97

  Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85) · CPC title