Multi-agent trajectory prediction

Patent metadata

Field	Value
Publication number	US-11816901-B2
Application number	US-202117187157-A
Country	US
Kind code	B2
Filing date	Feb 26, 2021
Priority date	Mar 4, 2020
Publication date	Nov 14, 2023
Grant date	Nov 14, 2023

Abstract

Methods and systems for training a trajectory prediction model and performing a vehicle maneuver include encoding a set of training data to generate encoded training vectors, where the training data includes trajectory information for agents over time. Trajectory scenarios are simulated based on the encoded training vectors, with each simulated trajectory scenario representing one or more agents with respective agent trajectories, to generate simulated training data. A predictive neural network model is trained using the simulated training data to generate predicted trajectory scenarios based on a detected scene.

First claim

What is claimed is:

1. A method for training a trajectory prediction model, comprising:
encoding a set of training data to generate encoded training vectors, where the training data includes trajectory information for road agents over time;
simulating a plurality of simulated trajectory scenarios based on the encoded training vectors, each simulated trajectory scenario representing one or more road agents with respective road agent trajectories, including simulating accelerating and lane change decisions for the one or more road agents, to generate simulated training data, wherein lane change simulations include evaluating the following inequalities:

a
~

c

-

a
c

+

p
⁢

{

(

a
~

n

-

a
n

)

+

(

a
~

o

-

a
o

)

}

>

Δ
⁢

a
th

-

Δ
⁢

a
bias

(

a
~

n

-

a
n

)

>

-

b
safe
n

,

(

a
~

c

-

a
c

)

>

-

b
safe
c

where a is a current acceleration, ã represents a new acceleration after lane change, p is a politeness factor, Δa th is a lane changing threshold, b safe is a deceleration, and Δa bias is a bias for a particular lane, and where subscripts/superscripts c, n, and o denote a current agent, new agents, and old agents, respectively; and
training a predictive neural network model using the simulated training data to generate predicted trajectory scenarios based on a detected scene.

2. The method of claim 1 , wherein the predictive neural network model includes an autoencoder section and a convolutional long-short term memory section with state pooling.

3. The method of claim 2 , wherein state pooling pools previous state information from a final layer of the convolutional long-short term memory section for all of the one or more road agents and initializes a next state with the previous state information.

4. The method of claim 1 , wherein at least one of the plurality of simulated trajectory scenarios includes multiple road agents.

5. The method of claim 4 , wherein the predictive model generates the predicted trajectory scenarios for all of the multiple road agents in each simulated trajectory scenario at once.

6. The method of claim 1 , wherein acceleration simulation may include generating an acceleration value as:

(

1
-

(

v

v
0

)

δ

-

(

s
*

(

ν
,

Δ
⁢
v

)

s

)

2

)

where s is a lead road agent of the one or more road agents, v is a velocity of a decision-making road agent, Δv is a velocity difference between the lead road agent and the decision-making road agent, \delta is an exponent that influences how acceleration decreases with velocity, s is an actual distance between the lead road agent and the decision-making road agent, and s* is a minimum gap between the lead road agent and the decision-making road agent, and v, is a reference velocity.

Assignees

• Nec Lab America Inc
• Nec Corp

Inventors

• Narayanan Sriram Nochur
• Liu Buyu
• Moslemi Ramin
• Pittaluga Francesco
• Chandraker Manmohan

Classifications

• G06N3/0475

  Generative networks · CPC title

• G06N3/09

  Supervised learning · CPC title

• G06N3/0442

  characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/0455

  Auto-encoder networks; Encoder-decoder networks · CPC title