Vehicle operator training system

Patent metadata

Field	Value
Publication number	US-10699596-B2
Application number	US-201715445761-A
Country	US
Kind code	B2
Filing date	Feb 28, 2017
Priority date	Feb 29, 2016
Publication date	Jun 30, 2020
Grant date	Jun 30, 2020

Abstract

Examples of the disclosure are directed to an automated vehicle that can function as a vehicle operator training system. A vehicle that combines sensors, actuators, infotainment, and/or communication functions may have the capability to provide a fully autonomous training experience in a real world environment. The vehicle can administer, monitor, and communicate with a vehicle operator for competency training and/or verification for a specific vehicle feature, sub-feature, situation maneuver, and/or objective.

First claim

The invention claimed is:

1. A method of providing vehicle operator training in a vehicle including one or more feedback mechanisms, one or more sensors, and one or more actuators, the method comprising:
based on first information from the one or more sensors, determining whether the surroundings of the vehicle include one or more elements necessary for a first training program;
in response to determining the surroundings of the vehicle include the one or more elements necessary for the first training program, invoking the first training program including a plurality of training steps;
providing, via the one or more feedback mechanisms, feedback instructing an operator of the vehicle to carry out a first training step associated with the first training program;
monitoring second information from the one or more sensors and the one or more actuators for a plurality of criteria associated with the first training step of the first training program;
in accordance with the second information meeting a first criterion of the plurality of criteria, the first criterion indicative of the operator of the vehicle successfully completing the first training step, providing, via the one or more feedback mechanisms, first feedback associated with the first criterion;
in accordance with the second information meeting a second criterion of the plurality of criteria, the second criterion indicative of a first failure of the operator of the vehicle to complete the first training step, providing, via the one or more feedback mechanisms, second feedback associated with the second criterion; and
in accordance with the second information previously meeting the second criterion and in accordance with the second information meeting a third criterion of the plurality of criteria, the third criterion indicative of a second failure of the operator of the vehicle failing to complete the first training step, manipulating the one or more actuators to automatically maneuver the vehicle according to a response associated with the third criterion.

2. The method of claim 1 , wherein the first and second information from the one or more sensors include one or more of location information from a GPS sensor and nearby object information from a camera, LIDAR, or proximity sensor.

3. The method of claim 2 , wherein the nearby object information includes information about one or more nearby vehicles.

4. The method of claim 1 , wherein providing the first and second feedback includes one or more of presenting a user interface on a display device of the vehicle, providing haptic feedback on a steering wheel of the vehicle, and playing audio on a speaker of the vehicle.

5. The method of claim 1 , wherein manipulating one or more actuators includes manipulating one or more of brakes, gas pedal, and a steering wheel of the vehicle.

6. The method of claim 1 , wherein monitoring for the plurality of criteria includes one or more of determining whether a location of the vehicle is within a threshold distance of a target location associated with the first training step, determining whether a steering angle of a steering wheel of the vehicle is within a threshold of a target steering angle associated with the first training step, and determining whether a gas or brake pedal is depressed as specified by the first training step.

7. The method of claim 1 , wherein the response associated with the third criterion includes automatically maneuvering the vehicle into a target location associated with the first training step.

8. A computer-readable storage medium storing instructions which, when executed by one or more processors of a vehicle including one or more feedback mechanisms, one or more sensors, and one or more actuators, cause the vehicle to perform a method of providing vehicle operator training in the vehicle, the method comprising:
based on first information from the one or more sensors, determining whether the surroundings of the vehicle is include one or more elements necessary for a first training program;
in response to determining the surroundings of the vehicle include the one or more elements necessary for the first training program, invoking the first training program including a plurality of training steps;
providing, via the one or more feedback mechanisms, feedback instructing an operator of the vehicle to carry out a first training step associated with the first training program;
monitoring second information from the one or more sensors and the one or more actuators for a plurality of criteria associated with the first training step of the first training program;
in accordance with the second information meeting a first criterion of the plurality of criteria, the first criterion indicative of the operator of the vehicle successfully completing the first training step, providing, via the one or more feedback mechanisms, first feedback associated with the first criterion;
in accordance with the second information meeting a second criterion of the plurality of criteria, the second criterion indicative of a first failure of the operator of the vehicle to complete the first training step, providing, via the one or more feedback mechanisms, second feedback associated with the second criterion; and
in accordance with the second information previously meeting the second criterion and in accordance with the second information meeting a third criterion of the plurality of criteria, the third criterion indicative of a second failure of the operator of the vehicle failing to complete the first training step, manipulating the one or more actuators to automatically maneuver the vehicle according to a response associated with the third criterion.

9. A vehicle, comprising:
one or more processors;
one or more feedback mechanisms;
one or more sensors;
one or more actuators; and
a memory storing instructions, which, when executed by the one or more processors, cause the vehicle to perform a method of providing vehicle operator training in the vehicle, the method comprising:
based on first information from the one or more sensors, determining whether the surroundings of the vehicle is include one or more elements necessary for a first training program;
in response to determining the surroundings of the vehicle include the one or more elements necessary for the first training program, invoking the first training program including a plurality of training steps;
providing, via the one or more feedback mechanisms, feedback instructing an operator of the vehicle to carry out a first training step associated with the first training program;
monitoring second information from the one or more sensors and the one or more actuators for a plurality of criteria associated with the first training step of the first training program;
in accordance with the second information meeting a first criterion of the plurality of criteria, the first criterion indicative of the operator of the vehicle successfully completing the first training step, providing, via the one or more feedback mechanisms, first feedback associated with the first criterion;
in accordance with the second information meeting a second criterion of the plurality of criteria, the second criterion indicative of a first failure of the operator of the vehicle to complete the first training step, providing, via the one or more feedback mechanisms, second feedback associated with the second criterion; and
in accordance with the second information previously meeting the second criterion and in accordance with the second information meeting a third criterion of the plurality of criteria, the third criterion indicative of a second failure of the operator of the vehicle failing to complete the first training step, manipulating the o

Assignees

• Faraday&Future Inc

Inventors

• Fischer Evan Roger
• Fernando Jana Mahen

Classifications

• G09B19/16 Primary

  Control of vehicles or other craft (simulators G09B9/02) · CPC title

• G09B9/02 Primary

  for teaching control of vehicles or other craft · CPC title