Mobile apparatus and vehicle

Patent metadata

Field	Value
Publication number	US-12092475-B2
Application number	US-202217677765-A
Country	US
Kind code	B2
Filing date	Feb 22, 2022
Priority date	May 27, 2021
Publication date	Sep 17, 2024
Grant date	Sep 17, 2024

Abstract

A mobile apparatus performing an augmented reality function and a navigation function includes an input device, a location receiver for obtaining a current location, an image obtaining device, a display device provided to display surrounding image obtained from the image obtaining device in response to execution of an augmented reality mode, and a controller provided to search for a route from the current location to a destination, destination information and map information obtained by the location receiver, identify a moving situation according to route information corresponding to the searched route, obtain location information of an inflection point at which the moving situation is changed according to information on the identified moving situation, and control the display device to display an object image of the inflection point on the surrounding image displayed on the display device based on the location information of the inflection point and the current location information.

First claim

What is claimed is:

1. A mobile apparatus comprising:
an input device configured to receive a user input;
a location receiver configured to receive current location information for obtaining a current location;
an image obtaining device configured to obtain an image of a surrounding environment;
a display device configured to display the surrounding image obtained from the image obtaining device in response to execution of an augmented reality mode; and
a controller configured to search for a route from the current location to a destination when destination information is received from the user input during the execution of the augmented reality mode, identify a moving situation according to route information corresponding to the searched route, obtain location information of an inflection point at which the moving situation is changed according to information on the identified moving situation, obtain a distance from the current location to the inflection point according to the current location information and the location information of the inflection point, determine an object image of the inflection point based on the obtained distance, a first reference distance, and a second reference distance, and control the display device to display the object image of the inflection point on the surrounding image displayed on the display device according to the location information of the inflection point and the current location information,
wherein the controller is configured to change the second reference distance to a third reference distance when the controller concludes that there is a plurality of the inflection points within a preset distance according to the route information, and
wherein the first reference distance is longer than the second reference distance, and the third reference distance is longer than the second reference distance and shorter than the first reference distance.

2. The mobile apparatus of claim 1 ,
wherein the controller is configured to change display information of the object image of the inflection point according to obtained distance information, and
wherein the display information of the object image of the inflection point includes at least one of shape information and color information of the object image.

3. The mobile apparatus of claim 2 , wherein when the controller concludes that the distance to the inflection point is greater than or equal to the first reference distance, the controller is configured to identify a direction of the destination according to the current location information, the destination information, and map information, and to control the display device to display the object image oriented from the current location to the direction of the destination on the surrounding image displayed on the display device.

4. The mobile apparatus of claim 2 ,
wherein when the controller concludes that the distance to the inflection point is less than the first reference distance and greater than or equal to the second reference distance, the controller is configured to determine the object image of the inflection point as an object image of a long-distance inflection point.

5. The mobile apparatus of claim 4 ,
wherein when the controller concludes that the distance to the inflection point is less than the second reference distance, the controller is configured to determine the object image of the inflection point as an object image of a short-distance inflection point.

6. The mobile apparatus of claim 5 , wherein the controller, according to the information on the identified moving situation, is configured to control the display device:
to display the object image of the short-distance inflection point in a first color when the controller concludes that the moving situation is a route maintenance situation,
to display the object image of the short-distance inflection point in a second color when the controller concludes that the moving situation is a congestion situation or an accident situation, and
to display the object image of the short-distance inflection point in a third color when the controller concludes that the moving situation is a route change situation.

7. The mobile apparatus of claim 5 ,
wherein the controller is configured to control the display device to display traffic information when the controller concludes that a display position of the oriented object image coincides with a display position of the object image of the short-distance inflection point and does not coincide with a display position of the object image of the long-distance inflection point.

8. The mobile apparatus of claim 5 ,
wherein the controller is configured to control the display device to display traffic information and alternative route information when the controller concludes that a display position of the oriented object image does not coincide with a display position of the object image of the short-distance inflection point and does not coincide with a display position of the object image of the long-distance inflection point.

9. The mobile apparatus of claim 4 ,
wherein according to the information on the identified moving situation, the controller is configured to control the display device:
to display the object image of the long-distance inflection point in a first color when the controller concludes that the moving situation is a smooth situation,
to display the object image of the long-distance inflection point in a second color when the controller concludes that the moving situation is a congestion situation or an accident situation, and
to display the object image of the long-distance inflection point in a third color when the controller concludes that the moving situation is a route change situation.

10. The mobile apparatus of claim 9 ,
wherein when traffic information is received by the controller, the controller is configured to determine whether a route change is necessary according to the received traffic information, the destination information, the current location information, the route information, and map information.

11. The mobile apparatus of claim 1 ,
wherein the controller is configured to determine whether a distance to the destination is less than or equal to a predetermined distance according to the destination information, the current location information, the route information, and map information,
wherein the controller is configured to recognize a destination image corresponding to the destination information from the surrounding image when the controller concludes that the distance to the destination is less than or equal to the predetermined distance, and
wherein the controller is configured to control the display device to overlap and display an emphasized object image on the recognized destination image.

12. The mobile apparatus of claim 11 ,
wherein the controller is configured to determine whether the distance to the destination is less than or equal to the predetermined distance according to the destination information, the current location information, the route information, and the map information,
wherein the controller is configured to recognize the destination image corresponding to the destination information from the surrounding image when the controller concludes that the distance to the destination is less than or equal to the predetermined distance, and
wherein the controller is configured to control transparency of the recognized destination image and remaining images to be different from each other.

13. The mobile apparatus of claim 11 , wherein the controller is configured to:
recognize a ground image adjacent to the destination image f

Assignees

• Hyundai Motor Co Ltd
• Kia Corp

Inventors

• Kim Soobin
• Woo Jae Yul
• Woo Seunghyun
• An Rowoon

Classifications

• G08G1/096844

  where the complete route is dynamically recomputed based on new data · CPC title

• G01C21/3691

  Retrieval, searching and output of information related to real-time traffic, weather, or environmental conditions (arrangements for giving variable traffic instructions G08G1/09) · CPC title

• G01C21/3602

  Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera · CPC title

• H04W4/024

  Guidance services · CPC title

• G08G1/096883

  where input information is obtained using a mobile device, e.g. a mobile phone, a PDA · CPC title