System and method for tracking moving objects to avoid interference with vehicular door operations

Patent metadata

Field	Value
Publication number	US-11261642-B2
Application number	US-201716073761-A
Country	US
Kind code	B2
Filing date	Jan 24, 2017
Priority date	Jan 29, 2016
Publication date	Mar 1, 2022
Grant date	Mar 1, 2022

Abstract

A system that performs a method is disclosed. Image data from a first camera mounted on a vehicle is received, the vehicle including a first element configured to open into a first space external to the vehicle, and the image data indicative of motion of a first object during a first time period, the first object located outside of the first space. Whether the motion of the first object during the first time period indicates that the first object will interfere with operation of the first element during a second time period, after the first time period, is determined. In accordance with a determination that the motion of the first object indicates that the first object will interfere with the operation of the first element during the second time period, an action that avoids the interference is performed.

First claim

The invention claimed is:

1. A system comprising:
one or more processors; and
a memory including instructions, which when executed by the one or more processors, cause the one or more processors to perform a method comprising the steps of:
receiving image data from a first camera of a vehicle, the vehicle including a first element configured to open into a first space external to the vehicle, and the image data indicative of motion of a first object during a first time period, the first object located outside of the first space;
determining whether the motion of the first object during the first time period indicates that the first object will interfere with operation of the first element during a second time period, after the first time period; and
in accordance with a determination that the motion of the first object indicates that the first object will interfere with the operation of the first element during the second time period, performing an action that avoids the interference;

wherein determining whether the motion of the first object during the first time period indicates that the first object will interfere with the operation of the first element during the second time period comprises:
determining an estimated trajectory of the first object during the first time period;
in accordance with a determination that the estimated trajectory of the first object indicates that the first object will reach the first space during the second time period, determining that the first object will interfere with the operation of the first element;
in accordance with a determination that the estimated trajectory of the first object indicates that the first object will not reach the first space, determining that the first object will not interfere with the operation of the first element; and
in accordance with a determination that the second time period is greater than a predetermined threshold time after the first time period, forgoing determining that the first object will interfere with the operation of the first element.

2. The system of claim 1 , wherein the first element comprises a door configured to open into an interaction space external to the vehicle.

3. The system of claim 1 , wherein: during the first time period, the first element is open, interfering with the operation of the first element comprises colliding with the first element while the first element is open.

4. The system of claim 1 , wherein: during the first time period, the first element is closed, and interfering with the operation of the first element comprises preventing the first element from opening without colliding with the first object.

5. The system of claim 1 , wherein the first camera is additionally used as a side-view mirror replacement.

6. The system of claim 1 , wherein the first camera is substantially forward-facing on the vehicle.

7. The system of claim 1 , wherein the first camera is additionally used as a rear-view mirror replacement.

8. The system of claim 1 , wherein the action comprises automatically closing the first element.

9. The system of claim 1 , wherein the action comprises automatically preventing the opening of the first element.

10. The system of claim 1 , wherein the action comprises automatically moving the vehicle to a new location, the new location based on the motion of the first object during the first time period, and data from a GPS receiver indicative of a current location of the vehicle.

11. The system of claim 1 , wherein the action comprises providing an alert to a driver or a passenger of the vehicle.

12. The system of claim 1 , wherein the action comprises providing an alert to the first object.

13. The system of claim 1 , wherein the method further comprises: after the first time period, determining that the first object will no longer interfere with the operation of the first element; and in response to determining that the first object will no longer interfere with the operation of the first element, canceling the action.

14. The system of claim 1 , wherein the method further comprises: after the first time period, determining that the first object will no longer interfere with the operation of the first element; and in response to determining that the first object will no longer interfere with the operation of the first element, reversing the action.

15. The system of claim 1 , wherein: the vehicle includes a second element, different from the first element, configured to open into a second space external to the vehicle, different from the first space, determining that the motion of the first object indicates that the first object will interfere with the operation of the first element comprises determining that the motion of the first object indicates that the first object will not interfere with the operation of the second element, and performing the action comprises performing the action with respect to the first element but not the second element.

16. The system of claim 1 , wherein: the method further comprises receiving image data indicative of motion of a second object during the first time period, the second object located outside of the second space, the vehicle includes a second element, different from the first element, configured to open into a second space external to the vehicle, different from the first space, and performing the action comprises, in accordance with a determination that the second object will interfere with operation of the second element during a third time period, after the first time period: performing a first action with respect to the first element that avoids the interference of the first object with the operation of the first element; and performing a second action, different from the first action, with respect to the second element that avoids the interference of the second object with the operation of the second element.

17. A non-transitory computer-readable medium including instructions, which when executed by one or more processors, cause the one or more processors to perform a method comprising the steps of:
receiving image data from a first camera of a vehicle, the vehicle including a first element configured to open into a first space external to the vehicle, and the image data indicative of motion of a first object during a first time period, the first object located outside of the first space;
determining whether the motion of the first object during the first time period indicates that the first object will interfere with operation of the first element during a second time period, after the first time period; and
in accordance with a determination that the motion of the first object indicates that the first object will interfere with the operation of the first element during the second time period, performing an action that avoids the interference;

wherein determining whether the motion of the first object during the first time period indicates that the first object will interfere with the operation of the first element during the second time period comprises:
determining an estimated trajectory of the first object during the first time period;
in accordance with a determination that the estimated trajectory of the first object indicates that the first object will reach the first space during the second time period, determining that the first object will interfere with the operation of the first element;
in accordance with a determination that the estimated trajectory of the first object indicates that the first object will not reach the first space, determining that the first object will not interfere with

Assignees

• Faraday & Future Inc

Inventors

• Jeromin Oliver Max
• Bae Hong S

Classifications

• E05Y2900/531

  Doors · CPC title

• E05Y2400/40

  Control units therefor · CPC title

• E05F15/40 Primary

  Safety devices, e.g. detection of obstructions or end positions · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• E05F2015/767

  using cameras · CPC title