Allocation of non-monitoring periods during automated control of a device

Patent metadata

Field	Value
Publication number	US-12172659-B2
Application number	US-202117384037-A
Country	US
Kind code	B2
Filing date	Jul 23, 2021
Priority date	Jul 23, 2021
Publication date	Dec 24, 2024
Grant date	Dec 24, 2024

Abstract

A system for control of an automated device includes a control system configured to operate a device during an operating mode corresponding to a first state in which the control system automatically controls operation, the operating mode prescribing that a user monitor the device operation during automated control, and a scheduling module configured to, during the operating mode, receive a request for the user to temporarily stop monitoring in order to perform a task unrelated to the device operation, allocate a time period during which automated control is maintained and the user stops monitoring, the time period including a non-monitoring period having a duration based on a minimum amount of time for the task, and put the device into a temporary state at initiation of the allocated time period during which the user stops monitoring and automated control is maintained.

First claim

What is claimed is:

1. A system for control of an automated device, comprising:
a control system configured to operate a device during a monitoring mode, the monitoring mode corresponding to a first state in which the control system automatically controls device operation and a user is required to monitor the device operation during automated control;
a scheduling module configured to maintain a queue of one or more tasks, each task of the one or more tasks being unrelated to the device operation, the queue relating each task to a minimum amount of time for performing each task and transitioning from a temporary state to the first state, the scheduling module configured to perform, during the monitoring mode:
receiving a request for the user to temporarily stop monitoring in order to perform a task unrelated to the device operation;
determining conditions including a state of the user and a state of the device, and determining whether the conditions permit the user to temporarily stop monitoring the device;
selecting a task from the queue based on the conditions permitting allocation of a time period including the minimum amount of time, and presenting the selected task to the user; and
based on the user accepting the selected task, allocating the time period during which the device is in the temporary state, wherein the control system maintains automated control and permits the user to stop monitoring during the temporary state, the allocated time period including a non-monitoring period, the non-monitoring period including a period for performing the selected task and a transition period associated with a transition from the first state to the temporary state;

wherein the control system is configured to put the device into the temporary state at initiation of the allocated time period during which the user stops monitoring and automated control is maintained.

2. The system of claim 1 , wherein the scheduling module is configured to monitor the user during the allocated time period, and return the device to the first state based on at least one of: user input, user behavior indicating that the user has completed the selected task, and a condition of an environment around the device.

3. The system of claim 1 , wherein the device is a vehicle and the task is a non-driving related task (NDRT).

4. The system of claim 1 , wherein the request is generated based on at least one of: a user request during device operation, a user condition, a previously scheduled time period and a system suggestion based on a user history.

5. The system of claim 1 , wherein the allocated time period includes an evasive maneuver period having a duration based on an estimated time for the user to cease performing the selected task, take manual control and perform an evasive maneuver.

6. The system of claim 1 , wherein the scheduling module is configured to perform at least one of:
removing the selected task from the queue and returning to the first state based on explicitly or implicitly determining that the user has completed the selected task; and
based on the period for performing the selected task expiring and determining that the user has not completed the selected task, allocating a short monitoring period and putting the device into the monitoring mode during the short monitoring period, and subsequently returning the device to the temporary state based on the conditions permitting the user to stop monitoring.

7. The system of claim 1 , wherein the scheduling module is configured to maintain a plurality of tasks in the queue, each of the plurality of tasks having a respective allocated time period scheduled to begin at a respective time.

8. The system of claim 7 , wherein the scheduling module is configured to provide a plurality of allocated time periods in an order based on an importance or urgency of each allocated time period, the urgency indicated by a dynamic priority associated with each allocated time period in the queue, the dynamic priority determined during operation based on monitored conditions.

9. The system of claim 7 , wherein the scheduling module is configured to perform at least one of:
suggesting a task from the queue based on the conditions indicating that the user would benefit by performing the suggested task; and
predicting a task based on a history of user behavior, and adding the predicted task to the queue.

10. A method of controlling an automated device, comprising:
operating the device during a monitoring mode, the monitoring mode corresponding to a first state in which a control system automatically controls device operation and a user is required to monitor the device operation during automated control, wherein a scheduling module is configured to maintain a queue of one or more tasks, each task of the one or more tasks being unrelated to the device operation, the queue relating each task to a minimum amount of time for performing each task and transitioning from a temporary state to the first state;
during the operating mode, receiving a request for the user to temporarily stop monitoring in order to perform a task unrelated to the device operation;
determining conditions including a state of the user and a state of the device, and determining whether the conditions permit the user to temporarily stop monitoring the device;
selecting a task from the queue based on the conditions permitting allocation of a time period including the minimum amount of time, and presenting the selected task to the user;
based on the user accepting the selected task, allocating the time period during which the device is in a temporary state, wherein the control system maintains automated control and permits the user to stop monitoring during the temporary state, the allocated time period including a non-monitoring period, the non-monitoring period including a period for performing the selected task and a transition period associated with a transition from the first state to the temporary state; and
putting the device into a temporary state at initiation of the allocated time period.

11. The method of claim 10 , further comprising monitoring the user during the allocated time period, and returning the device to the first state based on at least one of: user input, user behavior indicating that the user has completed the selected task, and a condition of an environment around the device.

12. The method of claim 10 , wherein the device is a vehicle and the task is a non-driving related task (NDRT).

13. The method of claim 10 , wherein the allocated time period includes an evasive maneuver period having a duration based on an estimated time for the user to cease performing the task, take manual control and perform an evasive maneuver.

14. The method of claim 10 , further comprising at least one of:
removing the selected task from the queue and returning to the first state based on explicitly or implicitly determining that the user has completed the selected task; and
based on the period for performing the selected task expiring and determining that the user has not completed the selected task, allocating a short monitoring period and putting the device into the monitoring mode during the short monitoring period, and subsequently returning the device to the temporary state based on the conditions permitting the user to stop monitoring.

15. The method of claim 10 , further comprising maintaining a plurality of tasks in the queue, each of the plurality of tasks having a respective allocated time period scheduled to begin at a respective time.

16. The method of claim 10 , further comprising at least o

Assignees

• Gm Global Tech Operations Llc

Inventors

• Bustin Ronit
• Kamhi Gila
• Degani Asaf
• Goldman-Shenhar Claudia
• Bnaya Zahy
• Telpaz Ariel
• Friedland Yael Shmueli
• Tsimhoni Omer

Classifications

• B60W50/04

  Monitoring the functioning of the control system · CPC title

• B60W2050/0096

  Control during transition between modes · CPC title

• B60W2050/0002

  Automatic control, details of type of controller or control system architecture · CPC title

• B60W2050/007

  Switching between manual and automatic parameter input, and vice versa · CPC title

• B60W50/14

  Means for informing the driver, warning the driver or prompting a driver intervention · CPC title