Dialogue system, vehicle and method for controlling the vehicle

Patent metadata

Field	Value
Publication number	US-10733994-B2
Application number	US-201816208152-A
Country	US
Kind code	B2
Filing date	Dec 3, 2018
Priority date	Jun 27, 2018
Publication date	Aug 4, 2020
Grant date	Aug 4, 2020

Abstract

A dialogue system, a vehicle and a method for controlling the vehicle is provided. The vehicle monitors at least one of vehicle state information and driving environment information, generates a vehicle use pattern based on the monitored information; generates and storing notification event information corresponding to the vehicle use pattern; determines whether the monitored information corresponds to any one of event information; when it is determined that the monitored information corresponds to any one of event information, determines notification timing of the any one of notification event information; when the current time is notification timing of the any one of notification event information, outputs guide information on the notification event information; generates a control command corresponding to the notification event information; and executes a function corresponding the notification event information based on the control command.

First claim

What is claimed is:

1. A dialogue system communicating with a device comprising:
a speech input processor, when a user's speech is input, configured to recognize an input speech;
a storage configured to store a plurality of notification event information;
a context information processor configured to:
when at least one of device state information or driving environment information is received, recognize a context based on the at least one of the device state information or the driving environment information;
determine whether at least one of the context or the input speech corresponds to any notification event information of the plurality of notification event information; and
verify notification timing regarding the any notification event information of the plurality of notification event information when the at least one of the context or the input speech corresponds to the any notification event information of the plurality of the notification event information;

a dialogue manager, when a current time is the notification timing, configured to determine guide information regarding the any notification event information of the plurality of notification event information as an action; and
a result processor configured to output an utterance corresponding to the action.

2. The dialogue system of claim 1 , wherein the context information processor is configured to:
generate a device use pattern based on the at least one of the device state information or the driving environment information;
generate notification event information corresponding to the device use pattern; and
store the notification event information in the storage.

3. The dialogue system of claim 2 , wherein the context information processor is configured to:
generate update information regarding at least one function of a plurality of functions performed in the device based on the device use pattern;
generate new function information regarding a function added to the device; and
generate the notification event information based on the update information and the new function information.

4. The dialogue system of claim 1 , wherein:
the notification event information comprises a notification event name, the notification timing and guide information of the notification event information, and
the notification timing comprises a point of time that a function corresponding to the any notification event information of the plurality of notification event information is executed.

5. A vehicle comprising:
a detector configured to detect vehicle state information and driving environment information;
a storage configured to store a plurality of notification event information;
a dialogue system configured to:
determine whether at least one of the vehicle state information or the driving environment information corresponds to any notification event information of the plurality of notification event information;
confirm notification timing regarding the any notification event information of the plurality of notification event information when the at least one of the vehicle state information or the driving environment information corresponds to the any notification event information of the plurality of notification event information;
determine guide information regarding the any notification event information of the plurality of the notification event information as an action when a current time is the notification timing;
output an utterance corresponding to the action; and selectively generate a control command corresponding to the any notification event information of the plurality of the notification event information; and

a vehicle controller, when the control command is received, configured to control at least one function of a plurality of functions based on the control command.

6. The vehicle of claim 5 , wherein the vehicle further comprises:
a speech input device configured to receive a user's speech, wherein the dialogue system is configured to:
recognize an input speech when the user's speech is input, and
determine whether the input speech corresponds to the any notification event information of the plurality of notification event information.

7. The vehicle of claim 6 , wherein the dialogue system is configured to:
generate an utterance pattern based on the input speech;
generate a vehicle use pattern based on the at least one of the vehicle state information or the driving environment information; and
generate the notification event information based on at least one of the vehicle use pattern or the utterance pattern.

8. The vehicle of claim 7 , wherein the dialogue system is configured to:
generate update information regarding the at least one function of the plurality of functions performed in the vehicle based on the at least one of the vehicle use pattern or the utterance pattern;
generate new function information regarding a function added to the vehicle; and
generate the notification event information based on the update information and the new function information, and
the vehicle controller is configured to:
update at least one function of the plurality of functions based on the update information; and
add the new function information as a function of the vehicle.

9. The vehicle of claim 5 , wherein the vehicle further comprises:
a communication device configured to communicate with a mobile device,
wherein the dialogue system is configured to:
receive state information of the mobile device; and
determine whether the state information of the mobile device corresponds to the any notification event information of the plurality of notification event information.

10. The vehicle of claim 9 , wherein the dialogue system is configured to:
generate a use pattern of the mobile device when communicating with the mobile device; and
generate the notification event information based on the use pattern of the mobile device.

11. The vehicle of claim 9 , wherein the vehicle further comprises:
the speech input device configured to receive a user's speech, wherein, when a response speech about the utterance is input through the speech input device, the dialogue system is configured to control a transmission execution of control command or a stop transmission of control command corresponding to notification event of the mobile device, based on the response speech.

12. The vehicle of claim 9 , wherein:
the dialogue system is configured to generate a control command corresponding to the notification event of the mobile device, and
when the control command is received, the vehicle controller is configured to control the communication device to transmit the control command to the mobile device.

13. The vehicle of claim 5 , wherein
the plurality of functions comprises at least two of a window opening/closing function, a radio on/off function, a radio channel changing function, an air conditioner on/off function, an air conditioner temperature control function, a seat heating on/off function, a steering wheel heating wire on/off function, an audio on/off function, an audio genre change function, a volume adjustment function, or a communication connection function with the mobile device.

14. The vehicle of claim 5 , wherein the vehicle further comprises:
a communication device configured to communicate with an external server,
wherein, when firmware update information is received through the external server, the dialogue system is configured to acquire the notification event information based on the firmware update information, and
the vehicle controller is configured to control a firmware update based on t

Assignees

• Hyundai Motor Co Ltd
• Kia Motors Corp

Inventors

• Kim Seona
• Seok Donghee
• Shin Dongsoo
• Lee Jeong-Eom
• Kim Ga Hee
• Park Jung Mi
• Ro Heejin
• Kim Kye Yoon

Classifications

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• G10L2015/225

  Feedback of the input speech · CPC title

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title