Method and system for human-like driving lane planning in autonomous driving vehicles

Patent metadata

Field	Value
Publication number	US-11273836-B2
Application number	US-201715845294-A
Country	US
Kind code	B2
Filing date	Dec 18, 2017
Priority date	Dec 18, 2017
Publication date	Mar 15, 2022
Grant date	Mar 15, 2022

Abstract

The present teaching relates to method, system, medium, and implementation of lane planning in an autonomous vehicle. Sensor data are received that capture ground images of a road the autonomous vehicle is on. Based on the sensor data, a current lane of the road that autonomous vehicle is currently occupying is detected. Lane control for the autonomous vehicle is planned based on the detected current lane and self-aware capability parameters in accordance with a driving lane control model. The self-aware capability parameters are used to predict operational capability of the autonomous vehicle with respect to a current location of the autonomous vehicle. The driving lane control model is generated based on recorded human driving data to achieve human-like lane control behavior in different scenarios.

First claim

We claim:

1. A method, comprising:
receiving a plurality of driving lane control models, each driving lane control model from the plurality of driving lane control models derived based on recorded human driving data associated with a plurality of people under a plurality of different driving conditions;
receiving a set of visual images derived from real time sensor data and representing a surface of a road on which an autonomous vehicle is positioned;
detecting, on-the-fly and based on the set of visual images and at least one machine learning based lane detection model, marks on the road, the marks representing a lane of the road in which the autonomous vehicle is positioned;
selecting a driving lane control model from the plurality of driving lane control models based on a current driving condition associated with a current location of the autonomous vehicle, the current driving condition determined based on self-aware capability parameters of the autonomous vehicle, the self-aware capability parameters at least one of indicative or predictive of an operational capability of the autonomous vehicle when in the current location; and
planning lane control for the autonomous vehicle, via the selected driving lane control model, to generate a lane plan for human-like lane control behavior under the current driving condition, based on the lane in which the autonomous vehicle is positioned and the self-aware capability parameters.

2. The method of claim 1 , wherein the lane plan includes at least one of a lane following plan or a lane changing plan.

3. The method of claim 1 , wherein the self-aware capability parameters include intrinsic capability parameters and extrinsic capability parameters, the intrinsic capability parameters specifying conditions internal to the autonomous vehicle that limit the operational capability of the autonomous vehicle, and the extrinsic capability parameters specifying conditions external to the autonomous vehicle that impact the operational capability of the autonomous vehicle.

4. The method of claim 1 , further comprising dynamically updating the self-aware capability parameters to reflect a scenario currently associated with the autonomous vehicle.

5. The method of claim 1 , further comprising dynamically updating the recorded human driving data such that the lane control model is adaptive.

6. The method of claim 1 , wherein the selected driving lane control model characterizes driving lane control behavior of the plurality of people when in the current driving condition.

7. The method of claim 1 , wherein the set of visual images is a first set of visual images, the method further comprising:
analyzing a second set of visual images derived from the real time sensor data, to detect a presence of a passenger within the autonomous vehicle; and
determining, in response to detecting the presence of the passenger, a membership of the passenger in the plurality of people.

8. A machine readable, non-transitory medium storing instructions to cause a machine to:
receive a plurality of driving lane control models, each driving lane control model from the plurality of driving lane control models derived based on recorded human driving data associated with a plurality of people under a plurality of different driving conditions;
receive a set of visual images derived from real time sensor data and representing a surface of a road on which an autonomous vehicle is positioned;
detect, on-the-fly and based on the set of visual images and at least one machine learning based lane detection model, marks on the road, the marks representing a lane of the road in which the autonomous vehicle is positioned;
select a driving lane control model from the plurality of driving lane control models based on a current driving condition associated with a current location of the autonomous vehicle, the current driving condition determined based on self-aware capability parameters of the autonomous vehicle, the self-aware capability parameters at least one of indicative or predictive of an operational capability of the autonomous vehicle when in the current location; and
plan lane control for the autonomous vehicle, via the selected driving lane control model, to generate a lane plan for human-like lane control behavior under the current driving condition, based on the lane in which the autonomous vehicle is positioned and the self-aware capability parameters.

9. The medium of claim 8 , wherein the lane plan includes at least one of a lane following plan or a lane changing plan.

10. The medium of claim 8 , wherein the self-aware capability parameters include intrinsic capability parameters and extrinsic capability parameters, the intrinsic capability parameters specifying conditions internal to the autonomous vehicle that limit the operational capability of the autonomous vehicle, and the extrinsic capability parameters specifying conditions external to the autonomous vehicle that impact the operational capability of the autonomous vehicle.

11. The medium of claim 8 , further comprising dynamically updating the self-aware capability parameters to reflect a scenario currently associated with the autonomous vehicle.

12. The medium of claim 8 , further comprising dynamically updating the recorded human driving data such that the lane control model is adaptive.

13. The medium of claim 8 , wherein the selected driving lane control model characterizes driving lane control behavior of the plurality of people when in the current driving condition.

14. The medium of claim 8 , wherein the set of visual images is a first set of visual images, the medium further storing instructions to cause the machine to:
analyze a second set of visual images derived from the real time sensor data, to detect a presence of a passenger within the autonomous vehicle; and
determine, in response to detecting the presence of the passenger, a membership of the passenger in the plurality of people.

15. A system, comprising:
a driving lane detector implemented by a processor and configured to:
receive a set of visual images derived from real time sensor data and representing a surface of a road on which an autonomous vehicle is positioned, and
detect, on-the-fly and based on the set of visual images and at least one machine learning based lane detection model, marks on the road, the marks representing a lane of the road in which the autonomous vehicle is positioned;

a driving lane planning unit implemented by the processor and configured to:
receive a plurality of driving lane control models, each driving lane control model from the plurality of driving lane control models derived based on recorded human driving data associated with a plurality of people under a plurality of different driving conditions,
select a driving lane control model from the plurality of driving lane control models based on a current driving condition associated with a current location of the autonomous vehicle, the current driving condition determined based on self-aware capability parameters of the autonomous vehicle, the self-aware capability parameters at least one of indicative or predictive of an operational capability of the autonomous vehicle when in the current location, and
plan lane control for the autonomous vehicle, via the selected driving lane control model, to generate a lane plan for human-like lane control behavior under the current driving condition, based on the lane in which the autonomous vehicle is positioned and the self-aware capability parameters.

16. The system of claim 15 , wherein the lane plan includes at least one

Assignees

• Plusai Inc

Inventors

• Zheng Hao
• Liu David Wanqian
• Daly Jr Timothy Patrick

Classifications

• B60W60/001

  Planning or execution of driving tasks · CPC title

• G05D1/249

  from positioning sensors located off-board the vehicle, e.g. from cameras · CPC title

• G05D1/646

  Following a predefined trajectory, e.g. a line marked on the floor or a flight path · CPC title

• G05D1/81

  Handing over between on-board automatic and on-board manual control · CPC title

• G05D1/644

  Optimisation of travel parameters, e.g. of energy consumption, journey time or distance · CPC title