Content visualizing method and device

Patent metadata

Field	Value
Publication number	US-11650069-B2
Application number	US-201815946767-A
Country	US
Kind code	B2
Filing date	Apr 6, 2018
Priority date	Dec 13, 2017
Publication date	May 16, 2023
Grant date	May 16, 2023

Abstract

Provided are a content visualizing device and method that changes positions and shapes of route guidance content and driving related content based on a distance to an adjacent object, a current driving state, and an occurrence of a driving related event.

First claim

What is claimed is:

1. A content visualizing method, comprising:
generating route guidance content based on position information of a vehicle and road information;
displaying, through a projection plane of a head-up display (HUD), the generated route guidance content between an indication start point at a first distance from the vehicle and an indication end point at a second distance further from the vehicle; and
deforming the displaced route guidance content along a road alignment in response to the first distance being less than or equal to a threshold, the indication start point being a point at which the displayed route guidance content indicates the vehicle is to begin to perform an action:
determining a focus of the user by tracking a gaze of the user and estimating a distance to a point that the gaze of the user reaches;
determining the estimated distance to be a depth, corresponding to the focus of the user, in the projection plane; and
displaying the deformed route guidance content to the depth in the projection plane;
further adjusting the depth and the adjusting comprises:
detecting an event based on driving related information from a plurality of events;
selecting a first driving related content from among the driving related information based on the detected event;
moving the selected first driving related content from a first depth to a second depth, the second depth being different from the first depth; and
moving the selected first driving related content from the second depth to the first depth, in response to the detected event being terminated.

2. The content visualizing method of claim 1 , wherein the deforming of the route guidance content comprises bending the route guidance content along the road alignment and a proceeding direction of the vehicle from a position of the vehicle to an indication end point, in response to the vehicle passing the indication start point and approaching the indication end point.

3. The content visualizing method of claim 1 , wherein the displaying comprises disposing the route guidance content on a ground surface between the indication start point and an indication end point.

4. The content visualizing method of claim 1 , wherein the deforming comprises increasing a height of the route guidance content from the ground surface, in response to the distance from the vehicle to the indication start point being less than or equal to a threshold.

5. The content visualizing method of claim 1 , wherein the deforming comprises:
deforming the route guidance content, in response to error information calculated from a position of the vehicle and route guidance information being less than or equal to a threshold error; and
terminating deformation of the route guidance content and generating new route guidance content, in response to the error information exceeding the threshold error.

6. The content visualizing method of claim 1 , wherein the deforming comprises
setting the indication start point to be a point a first distance from the vehicle, and setting an indication end point to be a point a second distance from the vehicle, in response to the route guidance content indicating a straight advance from a position of the vehicle, wherein the second distance is greater than the first distance.

7. The content visualizing method of claim 1 , wherein the deforming comprises determining the indication start point and an indication end point along a center of a lane region to which the vehicle is to proceed based on the route guidance content.

8. The content visualizing method of claim 1 , further comprising:
displaying driving direction content together with the route guidance content, in response to the vehicle departing from a route corresponding to the route guidance content.

9. The content visualizing method of claim 1 , wherein the deforming of the route guidance content comprises displaying summary content corresponding to the route guidance content at a depth less than a distance to a preceding object, in response to the route guidance content being occluded by the preceding object.

10. The content visualizing method of claim 1 , wherein the generating of the route guidance content comprises generating the route guidance content, in response to acquisition of route guidance information.

11. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to implement a method comprising:
generating route guidance content based on position information of a vehicle and road information;
displaying, through a projection plane of a head-up display (HUD), the generated route guidance content between an indication start point at a first distance from the vehicle and an indication end point at a second distance further from the vehicle; and
deforming the displaced route guidance content along a road alignment in response to the first distance being less than or equal to a threshold, the indication start point being a point at which the displayed route guidance content indicates the vehicle is to begin to perform an action:
determining a focus of the user by tracking a gaze of the user and estimating a distance to a point that the gaze of the user reaches;
determining the estimated distance to be a depth, corresponding to the focus of the user, in the projection plane; and
displaying the deformed route guidance content to the depth in the projection plane;
further adjusting the depth and the adjusting comprises:
detecting an event based on driving related information from a plurality of events;
selecting a first driving related content from among the driving related information based on the detected event;
moving the selected first driving related content from a first depth to a second depth, the second depth being different from the first depth; and
moving the selected first driving related content from the second depth to the first depth, in response to the detected event being terminated.

12. A content visualizing method, comprising:
collecting driving related information from a vehicle;
displaying, through a projection plane of a head-up display (HUD), driving related contents based on the driving related information in front of the vehicle between an indication start point at a first distance from the vehicle and an indication end point at a second distance further from the vehicle;
adjusting a depth of a first driving related content of the displayed driving related contents in response to an event being detected based on the driving related information,
wherein the adjusting comprises:
detecting the event based on the driving related information from a plurality of events;
selecting the first driving related content from among the driving related contents based on the detected event;
moving the selected first driving related content from a first depth to a second depth, the second depth being different from the first depth; and
moving the selected first driving related content from the second depth to the first depth, in response to the detected event being terminated;

determining a focus of the user by tracking a gaze of the user and estimating a distance to a point that the gaze of the user reaches;
determining the estimated distance to be a depth, corresponding to the focus of the user, in the projection plane; and
displaying a second driving related content, of the displayed driving related contents, to the depth in the projection plane.

13. The content visualizing method of claim 12 , wherein the displaying of the driving related contents comprises:
displaying at least a portion

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Heesae
• Lee Keechang

Classifications

• B60K35/235

  with means for detecting the driver's gaze direction or eye points · CPC title

• B60K35/233

  controlling the size or position in display areas of virtual images depending on the condition of the vehicle or the driver · CPC title

• B60K35/211

  producing three-dimensional [3D] effects, e.g. stereoscopic images · CPC title

• G01C21/365 Primary

  Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself · CPC title

• G02B2027/0181

  Adaptation to the pilot/driver · CPC title