Real-time analysis and augmented pathway projection for vehicle passengers

Patent metadata

Field	Value
Publication number	US-10343593-B2
Application number	US-201715729224-A
Country	US
Kind code	B2
Filing date	Oct 10, 2017
Priority date	Oct 10, 2017
Publication date	Jul 9, 2019
Grant date	Jul 9, 2019

Abstract

A method of augmented projection for vehicle passengers includes sensing that the passenger is within, or about to enter, a drop zone, and sensing one or more static obstacles within the drop zone. The method further includes highlighting at least one of the static obstacles with a projector mounted on the vehicle.

First claim

The invention claimed is:

1. A method of augmented projection for a vehicle having at least one sensor and a controller, comprising:
sensing that a passenger of the vehicle is within a drop zone; and
wherein, if the passenger is within the drop zone, the controller is configured for:
sensing one or more static obstacles within the drop zone; and
highlighting at least one of the sensed static obstacles with a projector mounted on the vehicle, wherein highlighting includes casting light from the projector directly onto at least one of the sensed static obstacles.

2. The method of claim 1 , wherein the controller is further configured for:
sensing that the passenger is about to enter the drop zone.

3. The method of claim 1 wherein the controller is further configured for:
sensing one or more dynamic obstacles within the drop zone; and
highlighting the dynamic obstacles with the projector mounted on the vehicle.

4. The method of claim 3 , wherein the controller is further configured for:
determining a predicted pathway of the sensed dynamic obstacles within the drop zone; and
highlighting the predicted pathway of the dynamic obstacles with the projector mounted on the vehicle.

5. The method of claim 4 , wherein the controller is further configured for:
projecting a suggested pathway for the passenger, wherein the suggested pathway avoids the static obstacles and avoids the predicted pathway of the dynamic obstacles.

6. The method of claim 1 , wherein the controller is further configured for:
sensing proximity of the passenger to the one or more static obstacles within the drop zone,
wherein highlighting the static obstacles with the projector mounted on the vehicle includes a low-intensity projection and a high-intensity projection, occurring when the passenger is proximal to at least one of the static obstacles.

7. The method of claim 1 , wherein the controller is further configured for:
projecting a suggested pathway for the passenger, wherein the suggested pathway avoids the static obstacles.

8. The method of claim 1 , wherein the controller is further configured for:
assigning a first severity level to a first static object, wherein highlighting the static obstacles includes a first projection type for the first severity level; and
assigning a second severity level to a second object wherein highlighting the static obstacles includes a second projection type, different from the first projection type, for the second severity level.

9. The method of claim 1 , wherein sensing one or more static obstacles within the drop zone includes three-dimensional sensing.

10. The method of claim 1 , wherein the controller is further configured for:
sensing location of the passenger within the drop zone;
determining proximity of the passenger to the one or more static obstacles;
comparing the determined proximity of the passenger to a minimum distance; and
sounding an audio alert when the passenger is less than the minimum distance from one of the static obstacles.

11. A method of augmented projection for a vehicle, comprising:
sensing that a passenger of the vehicle is one of within a drop zone and about to enter the drop zone;
sensing one or more static obstacles within the drop zone;
highlighting the static obstacles with a projector mounted on the vehicle;
sensing one or more dynamic obstacles within the drop zone; and
highlighting the dynamic obstacles with the projector mounted on the vehicle,
wherein the sensing and highlighting are executed by a control system operatively connected to one or more sensors and to the projector of the vehicle.

12. The method of claim 11 , further comprising:
projecting a suggested pathway for the passenger, wherein the suggested pathway avoids the static obstacles and avoids the dynamic obstacles.

13. The method of claim 12 , further comprising:
sensing proximity of the passenger to the one or more static obstacles within the drop zone,
wherein highlighting the static obstacles, with the projector mounted on the vehicle, includes a low-intensity projection, occurring when the passenger is distal from at least one of the static obstacles, and a high-intensity projection, occurring when the passenger is proximal to at least one of the static obstacles.

14. The method of claim 12 , further comprising:
assigning a first severity level to a first static object, wherein highlighting the static obstacles includes a first projection type for the first severity level; and
assigning a second severity level to a second object wherein highlighting the static obstacles includes a second projection type, different from the first projection type, for the second severity level.

15. An apparatus for augmented projection from a vehicle, comprising:
one or more sensors configured to:
determine whether a passenger is within a drop zone, and whether one or more dynamic obstacles within the drop zone;
determine a location of one or more static obstacles within the drop zone;

a projector configured to highlight at least one of the sensed static obstacles within the drop zone, and to highlight the dynamic obstacles within the drop zone; and
a controller configured to determine a predicted pathway of the sensed dynamic obstacles within the drop zone, wherein the projector is further configured to highlight the predicted pathway of the dynamic obstacles moving through the drop zone.

16. The apparatus of claim 15 ,
wherein the controller is further configured to determine a suggested pathway through the drop zone for the passenger, wherein the suggested pathway avoids the static obstacles and avoids the predicted pathway of the dynamic obstacles; and
wherein the projector is further configured to project the suggested pathway.

Assignees

• Gm Global Tech Operations Llc

Inventors

• Kamhi Gila
• Shmueli Friedland Yael
• Degani Asaf
• Nistel Kobi

Classifications

• B60Q2400/50

  Projected symbol or information, e.g. onto the road or car body · CPC title

• G01C21/3461

  Preferred or disfavoured areas, e.g. dangerous zones, toll or emission zones, intersections, manoeuvre types or segments such as motorways, toll roads or ferries · CPC title

• B60Q2400/40

  Welcome lights, i.e. specific or existing exterior lamps to assist leaving or approaching the vehicle · CPC title

• B60Q9/008 Primary

  for anti-collision purposes · CPC title

• F21W2102/40

  the light being emitted to facilitate access to the vehicle · CPC title