Vehicle control device and vehicle control method thereof

Patent metadata

Field	Value
Publication number	US-10214145-B2
Application number	US-201514950690-A
Country	US
Kind code	B2
Filing date	Nov 24, 2015
Priority date	Jul 22, 2015
Publication date	Feb 26, 2019
Grant date	Feb 26, 2019

Abstract

A vehicle control device including a camera configured to photograph an image around a vehicle; a display unit configured to display the image received from the camera; at least one sound sensor arranged on the vehicle and configured to sense a sound generated inside or outside the vehicle; at least one sound output unit arranged on the vehicle and configured to output sound inside or outside the vehicle; and a controller configured to sense a situation of the vehicle based on the sensed sound generated inside or outside the vehicle, and control at least one of the sound sensor, sound output unit and the display unit to output information based on the sensed situation of the vehicle.

First claim

What is claimed is:

1. A vehicle control device, comprising:
a camera configured to photograph an image around a vehicle;
a display unit configured to display the image received from the camera;
at least one sound sensor arranged on the vehicle and configured to sense a sound generated inside or outside the vehicle;
at least one sound output unit arranged on the vehicle and configured to output sound inside or outside the vehicle;
an eye sensing unit configured to sense a user's viewing angle; and
a controller configured to control at least one of the sound sensor, sound output unit and the display unit to output information based on the sensed sound generated inside or outside the vehicle,
wherein the controller is further configured to:
control the camera to capture an image of a sound generating source based on a location of the sound generating source generating the sound in response to a predetermined condition being satisfied,
display the image received from the camera on the display unit when the sound generating source is located out of the user's viewing angle, and
not display the image received from the camera on the display unit when the sound generating source is located in the user's viewing angle.

2. The vehicle control device of claim 1 , wherein the controller is further configured to:
detect the location of the sound generating source generating the sound, and
control the sound output unit to output notification information towards the sound generating source, based on the detected location of the sound generating source.

3. The vehicle control device of claim 2 , wherein the controller is further configured to control the sound sensor and the sound output unit such that a sound generated inside the vehicle is output toward the sound generating source located outside the vehicle.

4. The vehicle control device of claim 2 , wherein, in response to the detected location of the sound generating source being within a predetermined distance from the vehicle, the controller is further configured to control the sound output unit to output the notification information toward the sound generating source.

5. The vehicle control device of claim 2 , wherein, in response to the detected location of the sound generating source not being within the predetermined distance from the vehicle, the controller is further configured to control the sound output unit not to output the notification information is not output toward the sound generating source.

6. The vehicle control device of claim 1 , wherein the at least one sound output unit includes a plurality of sound output units arranged to be spaced apart from each other, and
wherein the controller is further configured to control a sound output unit among the plurality of sound output units disposed at a location corresponding to the location of the sound generating source to output notification information related to the sensed sound generated inside or outside the vehicle.

7. The vehicle control device of claim 1 , wherein the controller is further configured to detect an accident risk degree and relative distance information related to at least one graphic object included in the image, based on sound information respectively corresponding to sound received from a sound generating source indicating by the at least one graphic object.

8. The vehicle control device of claim 7 , wherein the controller is further configured to simultaneously display the accident risk degree and relative distance information related to the at least one graphic object on an area around the area in which the at least one graphic object is displayed.

9. The vehicle control device of claim 7 , wherein the controller is further configured to:
receive a touch input applied to a first graphic object among the at least one graphic object, and
control the sound output unit to output notification information toward a sound generating source corresponding to the first graphic object.

10. The vehicle control device of claim 1 , wherein the controller is further configured to:
sense an opening/closing state of a window mounted in the vehicle, and
in response to a change from the closing state of the window to the opening state of the window being sensed when the sound output unit and the sound sensor are activated, change the state of the activated sound output unit and the activated sound sensor to a non-activation state.

11. The vehicle control device of claim 1 , wherein the controller is further configured to:
sense a situation information of the vehicle based on the sensed sound generated inside or outside of the vehicle; and
display information related to the situation information on the display unit such that a driver recognizes the situation information.

12. The vehicle control device of claim 11 , wherein the situation information includes at least one of component state information of the vehicle, level information of a noise outside the vehicle, type information of a sound generating source, obstacle information, and state information of a road surface.

13. The vehicle control device of claim 12 , wherein, in response to any sound sensed by the sound sensor not being sensed for a predetermined time, the controller is further configured to control the sound output unit to perform a function of reproducing a music or generate a white noise.

14. The vehicle control device of claim 12 , wherein, in response to the sound information corresponding to predetermined sound information, the controller is further configured to display driving guidance information related to driving of the vehicle on the display unit.

15. The vehicle control device of claim 1 , wherein, the controller is further configured to:
detect an obstacle exists around the vehicle, and
control a sound sensitivity of the sound sensor.

16. A method of controlling a vehicle control device, the method comprising:
capturing, via a camera arranged on a vehicle, an image around a vehicle;
displaying, via a display unit, the image received from the camera;
capturing, via a camera arranged on a vehicle, an image around a vehicle;
displaying, via a display unit, the image received from the camera;
sensing, via at least one sound sensor arranged on the vehicle, a sound generated inside or outside the vehicle;
outputting, via at least one sound output unit arranged on the vehicle, sound inside or outside the vehicle;
sensing, via an eye sensing unit, a user's viewing angle; and
controlling, via the controller, at least one of the sound sensor, sound output unit and the display unit to output information based on the sensed sound generated inside or outside the vehicle,
wherein the control method further comprises:
in response to a predetermined condition being satisfied, controlling the camera to capture an image of the sound generating source based on the location of the sound generating source generating the sound;
displaying the image received from the camera on the display unit when the sound generating source is located out of the user's viewing angle; and
not displaying the image received from the camera on the display unit when the sound generating source is located in the user's viewing angle.

17. The method of claim 16 , further comprising:
detecting a location of a sound generating source generating the sound; and
controlling the sound output unit to output notification information towards the sound generating source, based on the detected location of the sound generating source.

18. The method of claim 17 , further comp

Assignees

• Lg Electronics Inc

Inventors

• Jaegal Chan
• Chang Sukjin
• Kim Minjae

Classifications

• B60W2050/146

  Display means · CPC title

• B60R1/00

  Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles · CPC title

• H04M19/04

  the ringing-current being generated at the substations · CPC title

• B60R2300/307

  virtually distinguishing relevant parts of a scene from the background of the scene · CPC title

• B60Q9/008 Primary

  for anti-collision purposes · CPC title