System and method for providing augmented reality notification

Patent metadata

Field	Value
Publication number	US-9773412-B2
Application number	US-201514799237-A
Country	US
Kind code	B2
Filing date	Jul 14, 2015
Priority date	Jul 17, 2014
Publication date	Sep 26, 2017
Grant date	Sep 26, 2017

Abstract

A system and a method for providing augmented reality (AR) notification are provided. The system includes a recognizing unit configured to recognize a ground region, which is a region corresponding to the ground, on an AR driving image and a controller configured to add a display element to the ground region and to control a notification output associated with driving through the display element.

First claim

What is claimed is:

1. A system for providing augmented reality (AR) notification, the system comprising:
a recognizing unit configured to recognize a ground region, which is a region corresponding to the ground, on an AR driving image; and
a controller configured to add a display element to the ground region and to control a notification output associated with driving through the display element,
wherein the recognizing unit recognizes a driving state associated with a current driving speed of a vehicle, and
wherein the display element comprises a pattern applied to the ground region and the controller adjusts the pattern which is applied to the ground region based on the driving state independently of a user-selected route, wherein the pattern of only the ground region of the AR driving image is visually changed, and wherein the controller adjusts the pattern based on the current driving speed such that the pattern is visually moved in a driving direction of the vehicle in accordance with the current driving speed.

2. The system of claim 1 , wherein the recognizing unit detects a horizon from the driving image and recognizes the ground region relative to the horizon.

3. The system of claim 1 , wherein the recognizing unit detects a line from the driving image and recognizes the ground region relative to a vanishing point of the line.

4. The system of claim 1 , wherein the display element maintains transparency for the driving image.

5. The system of claim 1 , wherein the recognizing unit compares a current driving speed of a vehicle with the speed limit of a road on which the vehicle is being driven to recognize whether the vehicle is speeding, and
wherein when the current driving speed is in a speeding driving state which is over the speed limit, the controller expresses the ground region with a red color.

6. The system of claim 1 , wherein the recognizing unit recognizes attributes of a road on which a vehicle is being driven relative to a current position of the vehicle, and
wherein when the vehicle enters a zone designated as a caution section, the controller expresses the ground region with a yellow color.

7. The system of claim 1 , wherein the controller adjusts the pattern which is moving in accordance with the driving speed to stop when the vehicle is driven in a global positioning system (GPS) shadow section where the GPS functionality of the vehicle is unstable.

8. The system of claim 1 , further comprising:
a sensing unit configured to sense a turn point which is located in a certain distance ahead,
wherein the controller exposes destination information on a position of the turn point on the driving image.

9. The system of claim 8 , wherein the controller expresses a rotation direction at the turn point and a remaining distance to the turn point on the position of the turn point.

10. The system of claim 8 , wherein the controller expresses an effect in which the destination information is inversely expanded according to a remaining distance to the turn point and disappears at a time point when a vehicle passes through the turn point.

11. A method for providing augmented reality (AR) notification, implemented with a computer, the method comprising:
recognizing a ground region, which is a region corresponding to the ground, on an AR driving image; and
adding a display element to the ground region and expressing notification associated with driving through the display element,
wherein the recognizing recognizes a driving state associated with a current driving speed of a vehicle, and
wherein adding the display element comprises adjusting a pattern which is applied to the ground region based on the driving state independently of a user-selected route, wherein the pattern of only the ground region of the AR driving image is visually changed, and wherein the pattern is adjusted based on the current driving speed such that the pattern is visually moved in a driving direction of the vehicle in accordance with the current driving speed.

12. The method of claim 11 , wherein the recognizing of the ground region comprises:
detecting a horizon from the driving image; and
recognizing the ground region relative to the horizon.

13. The method of claim 11 , further comprising:
sensing a turn point which is located in a certain distance ahead,
wherein the expressing of the notification comprises:
exposing destination information on a position of the turn point on the driving image.

14. The method of claim 13 , wherein the expressing of the notification comprises:
expressing destination information, including a rotation direction at the turn point and a remaining distance to the turn point, on the position of the turn point; and
expressing an effect in which the destination information is inversely expanded according to a remaining distance to the turn point and disappears at a time point when a vehicle passes through the turn point.

15. A non-transitory computer-readable medium to control a computer system, storing an instruction for controlling provision of notification, comprising:
recognizing a ground region, which is a region corresponding to the ground, on an augmented reality (AR) driving image; and
adding a display element to the ground region and expressing notification associated with driving through the display element,
wherein the recognizing recognizes a driving state associated with a current driving speed of a vehicle, and
wherein adding the display element comprises adjusting a pattern which is applied to the ground region based on the driving state independently of a user-selected route, wherein the pattern of only the ground region of the AR driving image is visually changed, and wherein the pattern is adjusted based on the current driving speed such that the pattern is visually moved in a driving direction of the vehicle in accordance with the current driving speed.

Assignees

• Thinkware Corp

Inventors

• Yoon Min Ji
• Jeong Ye Seul
• Shin Youn Joo
• Heo Won Jun

Classifications

• G08G1/0962 Primary

  having an indicator mounted inside the vehicle, e.g. giving voice messages · CPC title

• G06Q50/10

  Services · CPC title

• G06Q50/40 Primary

  Business processes related to the transportation industry (shipping G06Q10/083) · CPC title

• B62D41/00

  Fittings for identifying vehicles in case of collision; Fittings for marking or recording collision areas · CPC title

• H04N5/262

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title