4D temporal data structures for visualization of alternative mission plans over time

Patent metadata

Field	Value
Publication number	US-9976868-B2
Application number	US-201615059953-A
Country	US
Kind code	B2
Filing date	Mar 3, 2016
Priority date	Mar 3, 2016
Publication date	May 22, 2018
Grant date	May 22, 2018

Abstract

A non-transitory computer readable medium having computer executable instructions stored thereon is provided. The computer executable instructions include a mission definition file (MDF) that includes mission data that describes alternative routes generated by at least one mission planner for a vehicle. An MDF parser extracts the mission data for the alternative routes from the MDF and maps the mission data into a temporal data structure describing the alternative routes. The temporal data includes a route list to describe the alternative routes for the vehicle and a route segment list to describe an estimated time between each of the waypoints for each segment of the route list. A waypoint list describes a latitude, a longitude, and an altitude for each of the waypoints and a mission plan constructor generates a network topology of a mission plan depicting the alternative routes for the vehicle over time.

First claim

What is claimed is:

1. A non-transitory computer readable medium having computer executable instructions stored thereon, the computer executable instructions comprising:
a mission definition file (MDF) that includes mission data that describes at least one primary route and alternative routes generated by at least one mission planner for a vehicle;
a MDF parser to extract the mission data for the at least one primary route and the alternative routes from the mission definition file, the MDF parser maps the mission data into a temporal data structure describing the at least one primary route and the alternative routes;
the temporal data structure comprising:
a route list to describe the at least one primary route and the alternative routes for the vehicle, each alternative route defined by at least one segment to connect between waypoints;
a route segment list to describe an estimated time between each of the waypoints for each segment of the route list; and
a waypoint list to describe a latitude, a longitude, and an altitude for each of the waypoints for each segment of the route list;

a mission plan constructor to generate a network topology of a mission plan depicting the at least one primary route and the alternative routes for the vehicle over time by graphing list data from the temporal data structure for the alternative routes;
an automated module to determine, during a real-time mission associated with the at least one primary route, whether or not a planned action at a future time on at least one of the alternative routes satisfies a timing constraint for the mission plan; and
a graphical user interface that displays, during the real-time mission, a current position of the vehicle, the alternative routes for the vehicle, and an indication whether or not the planned action on the at least one of the alternative routes satisfies the timing constraint for the mission plan to facilitate selection of a respective one of the alternative routes.

2. The computer readable medium of claim 1 , the alternative routes include at least one alternative route identified as a primary route for a manned or unmanned vehicle.

3. The computer readable medium of claim 1 , wherein the route segment list further comprises a list of segments with each segment defined as two waypoints, each of the two waypoints having an estimated time of arrival field to denote the estimated time elapsed to travel between the two waypoints.

4. The computer readable medium of claim 1 , the temporal data structure further comprising a route leg list to specify portions of the network topology that represent specific activities of a mission plan that an operator wants to place additional attention toward or to perform additional analysis thereof.

5. The computer readable medium of claim 1 , the temporal data structure further comprising a route activities list that specifies vehicle actions that are planned to take place along each segment of the respective alternative route.

6. The computer readable medium of claim 1 , the temporal data structure further comprising a route action point list that specifies a delta time (DT), a time constraint (TC), a time specification (TS), an action command (CMD), or data (DATA) needed to execute a command (CMD) for a vehicle operating according to the network topology.

7. The computer readable medium of claim 6 , the temporal data structure further comprising an action point data list to specify additional data required to describe a specified activity in the action point list.

8. The computer readable medium of claim 6 , further comprising a state aggregator to update data feeds supplying at least one vehicle model and at least one environmental model to update data in the temporal data structure in real time, the data feeds include at least one of a tasking feed, a mission plan feed, a weather feed, a threat feed, a sensor feed, a tracks feed, and a communications feed.

9. The computer readable medium of claim 8 , further comprising a prediction engine to project the data feeds from the state aggregator and temporal data structure into a future visualization of the alternative routes.

10. The computer readable medium of claim 1 , the GUI further comprising a time input to adjust the temporal data structure to specify time projections of the alternative routes over time.

11. A system, comprising:
a memory to store computer-executable instructions; and
a processor to execute the computer-executable instructions from the memory, the computer-executable instructions comprising:
a mission definition file (MDF) that includes mission data that describes at least one primary route and alternative routes generated by at least one mission planner for a vehicle;
a MDF parser to extract the mission data for the at least one primary route and the alternative routes from the mission definition file, the MDF parser maps the mission data into a temporal data structure describing the at least one primary route and the alternative routes;
the temporal data structure comprising:
a route list to describe the alternative routes for the vehicle, each alternative route defined by at least one segment to connect between waypoints;
a route segment list to describe an estimated time between each of the waypoints for each segment of the route list; and
a waypoint list to describe a latitude, a longitude, and an altitude for each of the waypoints for each segment of the route list; and

a mission plan constructor to generate a network topology of a mission plan depicting the at least one primary route and the alternative routes for the vehicle over time by graphing list data from the temporal data structure for the alternative routes;
an automated module to determine, during a real-time mission associated with the at least one primary route, whether or not a planned action at a future time on at least one of the alternative routes satisfies a timing constraint for the mission plan; and
a graphical user interface (GUI) to display a visualization of the network topology generated by the mission plan constructor from the temporal data structure, wherein the at least one primary route and the alternative routes can be viewed concurrently in the visualization to enable determination of a what-if alternative mission plan scenario that satisfy the timing constraint for the mission plan for the one or more vehicles to facilitate selection of a respective one of the alternative routes.

12. The system of claim 11 , the GUI further comprising a time input to adjust the temporal data structure to specify time projections of the alternative routes over time.

13. The system of claim 11 , further comprising a replay analyzer to replay missions from saved temporal data structures after completion of a given mission, wherein the replay analyzer generates visualizations from the saved temporal data structures to enable simulated analysis of alternative routes that were not executed during the given mission.

14. The system of claim 11 , wherein the route segment list further comprises a list of segments with each segment defined as two waypoints, each of the two waypoints having an estimated time of arrival field to denote the estimated time elapsed to travel between the two waypoints.

15. The system of claim 11 , the temporal data structure further comprising a route leg list to specify portions of the network topology that represent specific activities of a mission plan that an operator wants to place additional attention toward or to perform additional analysis thereof.

16. The system of claim 11 , the temporal data structure

Assignees

• Parekh Devang R
• Cao Feng
• Fung Henry H
• Oddo Louis
• Parsons William
• Patel Miteshkumar K
• Northrop Grumman Systems Corp

Inventors

• Parekh Devang R
• Cao Feng
• Fung Henry H
• Oddo Louis
• Parsons William
• Patel Miteshkumar K

Classifications

• G08G5/003

  Physics · mapped topic

• G01C21/3667 Primary

  Display of a road map (G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635) · CPC title

• G01C21/3694

  Output thereof on a road map · CPC title

• G08G5/34

  for flight plan modification · CPC title

• G08G5/21

  located onboard the aircraft · CPC title