Method and device for supporting generation of scenarios for testing autonomous driving and/or advanced driver assistance system functionality

Patent metadata

Field	Value
Publication number	US-11945465-B2
Application number	US-202017607283-A
Country	US
Kind code	B2
Filing date	May 11, 2020
Priority date	May 27, 2019
Publication date	Apr 2, 2024
Grant date	Apr 2, 2024

Abstract

Method and device for supporting generation of scenarios for testing autonomous driving and/or advanced driver assistance system, AD/ADAS, functionality for real world vehicles. A device (101; 500) provides (301) a virtual environment (200) simulating an environment relevant for operation of vehicles having said AD/ADAS functionality and in which is operating: fully computer controlled movable virtual objects (230a-c), human controlled movable virtual objects (220) and at least one virtual AD/ADAS vehicle (210) operating according to said AD/ADAS functionality. The device allows (303) a user of the device (101; 500) to, via user interface (506), control said one or more human controlled movable virtual objects (220) during operation and thereby cause generation of scenarios that the virtual AD/ADAS vehicle (210) is subjected to.

First claim

We claim:

1. A method performed by a device, for supporting generation of scenarios for testing autonomous driving and/or advanced driver assistance system (AD/ADAS) functionality for one or more real world vehicles, wherein the method comprises:
providing a virtual environment simulating an environment relevant for operation of the one or more real world vehicles having said AD/ADAS functionality;

operating one or more fully computer controlled movable virtual objects, one or more human controlled movable virtual objects and at least one virtual AD/ADAS vehicle according to said AD/ADAS functionality in the virtual environment, wherein said one or more fully computer controlled movable virtual objects operates autonomously from a user;
controlling said one or more human controlled movable virtual objects during operation in the virtual environment via a user interface of the device by the user; and
generating scenarios that one or more of said at least one virtual AD/ADAS vehicle are subjected to and wherein the scenarios are resulted from at least one of said one or more human controlled movable virtual objects affecting one or more of said one or more fully computer controlled movable virtual objects, said at least one virtual AD/ADAS vehicle, and the virtual environment.

2. The method according to claim 1 , wherein the method further comprises:
initiating identification, based on data generated in relation to one or more of said at least one virtual AD/ADAS vehicle that a certain scenario has occurred.

3. The method according to claim 2 , wherein the identification is based on user input via the user interface.

4. The method according to claim 2 , wherein the method further comprises:
providing via the user interface and in response to the identification of said certain scenario, a notification directed to the user about participation in generation of said certain scenario.

5. The method according to claim 2 , wherein said data generated in relation to said one or more of said at least one virtual AD/ADAS vehicle comprise data generated external from said one or more of said at least one virtual AD/ADAS vehicle.

6. The method according to claim 2 , wherein the method further comprises:
storing data that enables at least part of said certain scenario to be re-created and thereby enable the same or another virtual AD/ADAS vehicle to be subjected to said at least part of said certain scenario at another occasion.

7. The method according to claim 1 , wherein said fully computer controlled movable virtual objects comprise one or more of said at least one virtual AD/ADAS vehicle.

8. The method according to claim 1 , wherein one or more of said at least one virtual AD/ADAS vehicle during operation in the virtual environment is provided with a respective identifier that enables the user to, via the user interface, identify said one or more of said at least one virtual AD/ADAS vehicle as being a certain virtual vehicle operating in the virtual environment.

9. The method according to claim 1 , wherein at least some of said one or more fully computer controlled movable virtual objects operate in the virtual environment with behavior that is unpredictable by implementation of said computer control.

10. The method according to claim 1 , wherein said at least one virtual AD/ADAS vehicle are multiple virtual AD/ADAS vehicles that operate in accordance with different implementations of said AD/ADAS functionality, respectively.

11. The method according to claim 1 , wherein said at least one virtual AD/ADAS vehicle are multiple virtual AD/ADAS vehicles configured to operate in accordance with different functionalities, respectively, of said AD/ADAS functionality.

12. The method according to claim 1 , wherein the method further comprises:
allowing the user to, via the user interface, determine at least part of the virtual environment and/or at least part of behavior and/or location of one or more of the computer controlled movable virtual objects operating in the virtual environment.

13. A non-transitory computer readable storage medium storing one or more instructions causing a computer to execute a method for supporting generation of scenarios for testing autonomous driving and/or advanced driver assistance system (AD/ADAS) functionality for one or more real world vehicles, wherein the method comprises:
providing a virtual environment simulating an environment relevant for operation of the one or more real world vehicles having said AD/ADAS functionality;
operating one or more fully computer controlled movable virtual objects, one or more human controlled movable virtual objects and at least one virtual AD/ADAS vehicle according to said AD/ADAS functionality in the virtual environment, wherein said one or more fully computer controlled movable virtual objects operates autonomously from a user;
controlling said one or more human controlled movable virtual objects during operation in the virtual environment via a user interface of the device by the user; and
generating scenarios that one or more of said at least one virtual AD/ADAS vehicle are subjected to and wherein the scenarios are resulted from at least one of said one or more human controlled movable virtual objects affecting one or more of said one or more fully computer controlled movable virtual objects, said at least one virtual AD/ADAS vehicle, and the virtual environment.

14. A device for supporting generation of scenarios for testing autonomous driving and/or advanced driver assistance system (AD/ADAS) functionality for one or more real world vehicles, comprising:
at least one processor,
wherein the device at least one processor is configured to:
provide a virtual environment simulating an environment relevant for operation of the one or more real world vehicles having said AD/ADAS functionality;
operate one or more fully computer controlled movable virtual objects, one or more human controlled movable virtual objects and at least one virtual AD/ADAS vehicle according to said AD/ADAS functionality in the virtual environment, wherein said one or more fully computer controlled movable virtual objects operates autonomously from a user;
control said one or more human controlled movable virtual objects during operation in the virtual environment via a user interface of the device by the user; and
generate scenarios that one or more of said at least one virtual AD/ADAS vehicle are subjected to and wherein the scenarios are resulted from at least one of said one or more human controlled movable virtual objects affecting one or more of said one or more fully computer controlled movable virtual objects, said at least one virtual AD/ADAS vehicle and the virtual environment.

Assignees

• Zenuity Ab

Inventors

• Liu Feng
• Vakilzadeh Majid Khorsand

Classifications

• B60W60/001 Primary

  Planning or execution of driving tasks · CPC title

• B60W40/09

  Driving style or behaviour · CPC title

• B60W50/045

  Monitoring control system parameters · CPC title

• G09B25/00 Primary

  Models for purposes not provided for in G09B23/00, e.g. full-sized devices for demonstration purposes (model vehicles, tracks therefor, models in the nature of toys A63H) · CPC title

• G09B9/006

  for locating or ranging of objects · CPC title