System and method for providing augmented reality notification

Patent metadata

Field	Value
Publication number	US-9905128-B2
Application number	US-201715685875-A
Country	US
Kind code	B2
Filing date	Aug 24, 2017
Priority date	Jul 17, 2014
Publication date	Feb 27, 2018
Grant date	Feb 27, 2018

Abstract

A system and a method for providing augmented reality (AR) notification are provided. The system includes a recognizing unit configured to recognize a ground region, which is a region corresponding to the ground, on an AR driving image and a controller configured to add a display element to the ground region and to control a notification output associated with driving through the display element.

First claim

What is claimed is:

1. A system for providing a notification on an image for driving guidance, the system comprising:
a recognizing unit configured to recognize a ground region, which is a region corresponding to the ground, on the image; and
a controller configured to add a display element to the ground region and to control a notification output associated with driving through the display element,
wherein the recognizing unit recognizes a driving state as a normal driving state or a speeding driving state based on a current driving speed of a vehicle and/or an attribute of a road on which the vehicle is being driven based on a link information of the road, and
wherein the controller adjusts at least one of a color and a pattern which is applied to the ground region based on the recognized driving state and/or attribute, and the ground region is visually changed.

2. The system of claim 1 , wherein the recognizing unit detects the horizon from the image and recognizes the ground region relative to the horizon.

3. The system of claim 1 , wherein the recognizing unit detects a line from the image and recognizes the ground region relative to a vanishing point of the line.

4. The system of claim 1 , wherein the recognizing unit identifies a caution section of the road and/or a global positioning system (GPS) shadow section of the road based on the recognized attribute, and
wherein the caution section includes at least one of a school zone and a senior zone, and the GPS shadow section includes at least one of an underground section and a tunnel section.

5. The system of claim 1 , wherein the recognizing unit recognizes the driving state as the speeding driving state when the current driving speed of the vehicle exceeds a speed limit of the road.

6. The system of claim 5 , wherein the controller changes the color of the ground region to red when the speeding driving state is recognized.

7. The system of claim 1 , wherein the recognizing unit identifies that the vehicle is in a caution section of the road based on the recognized attribute.

8. The system of claim 7 , wherein the controller changes the color of the ground region to yellow when the recognizing unit identifies that the vehicle is in the caution section.

9. The system of claim 1 , wherein the recognizing unit identifies that the vehicle is in a global positioning system (GPS) shadow section of the road based on the recognized attribute.

10. The system of claim 9 , wherein the controller applies a gray horizontal stripe pattern to the ground region when the recognizing unit identifies that the vehicle is in the GPS shadow section, the gray horizontal stripe pattern being not moved.

11. The system of claim 1 , wherein the controller adjusts the at least one of the color and the pattern differently in accordance with the recognized driving state and/or attribute.

12. The system of claim 1 , wherein the controller adjusts the pattern which is applied to the ground region based on the driving speed such that the pattern is visually moved in a driving direction of the vehicle in accordance with the driving speed.

13. The system of claim 12 , wherein the controller adjusts the pattern which is moving in accordance with the driving speed to stop when the vehicle is driven in a GPS shadow section where the vehicle GPS functionality is unstable.

14. The system of claim 1 , further comprising:
a sensing unit configured to sense a turn point which is located in a certain distance ahead,
wherein the controller exposes destination information on a position of the turn point on the image.

15. The system of claim 14 , wherein the controller expresses a rotation direction at the turn point and a remaining distance to the turn point on the position of the turn point.

16. The system of claim 14 , wherein the controller expresses an effect in which the destination information is inversely expanded according to a remaining distance to the turn point and disappears at a time point when the vehicle passes through the turn point.

17. A method for providing a notification on an image for driving guidance, implemented with a computer, the method comprising:
recognizing a ground region, which is a region corresponding to the ground, on the image; and
adding a display element to the ground region and expressing notification associated with driving through the display element,
wherein the recognizing comprises recognizing a driving state as a normal driving state or a speeding driving state based on a current driving speed of a vehicle and/or an attribute of a road on which the vehicle is being driven based on a link information of the road, and
wherein the adjusting comprises adjusting at least one of a color and a pattern which is applied to the ground region based on the recognized driving state and/or attribute, and the ground region is visually changed.

18. The method of claim 17 , wherein the recognizing of the ground region comprises:
detecting the horizon from the image; and
recognizing the ground region relative to the horizon.

19. The method of claim 17 , wherein the recognizing comprises identifying a caution section of the road and/or a global positioning system (GPS) shadow section of the road based on the recognized attribute, and
wherein the caution section includes at least one of a school zone and a senior zone, and the GPS shadow section includes at least one of an underground section and a tunnel section.

20. A non-transitory computer-readable medium to control a computer system, storing an instruction for controlling provision of a notification on an image for driving guidance, comprising:
recognizing a ground region, which is a region corresponding to the ground, on the image; and
adding a display element to the ground region and expressing notification associated with driving through the display element,
wherein the recognizing comprises recognizing a driving state as a normal driving state or a speeding driving state based on a current driving speed of a vehicle and/or an attribute of a road on which the vehicle is being driven based on a link information of the road, and
wherein the adjusting comprises adjusting at least one of a color and a pattern which is applied to the ground region based on the recognized driving state and/or attribute, and the ground region is visually changed.

Assignees

• Thinkware Corp

Inventors

• Yoon Min Ji
• Jeong Ye Seul
• Shin Youn Joo
• Heo Won Jun

Classifications

• G08G1/0962 Primary

  having an indicator mounted inside the vehicle, e.g. giving voice messages · CPC title

• G06Q50/10

  Services · CPC title

• G06Q50/40 Primary

  Business processes related to the transportation industry (shipping G06Q10/083) · CPC title

• B62D41/00

  Fittings for identifying vehicles in case of collision; Fittings for marking or recording collision areas · CPC title

• H04N5/262

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title