Dialogue system, vehicle and method for controlling the vehicle

Patent metadata

Field	Value
Publication number	US-2019378515-A1
Application number	US-201816191738-A
Country	US
Kind code	A1
Filing date	Nov 15, 2018
Priority date	Jun 12, 2018
Publication date	Dec 12, 2019
Grant date	—

Abstract

A dialogue system, a vehicle and a method for controlling the vehicle is disclosed. The method for controlling the vehicle includes: acquiring an utterance and a speech pattern by recognizing a speech when a speech of a plurality of speakers is input through a speech input device; classifying dialogue contents for each speaker based on the acquired utterance and speech pattern; acquiring a relationship between the speakers based on the acquired utterance; understanding an intention and a context for each speaker based on the acquired relationship between the speakers and the acquired dialogue content for each speaker determining an action corresponding to the acquired relationship and the acquired intention and context for each speaker, and outputting an utterance corresponding to the determined action; generating a control command corresponding to the determined action; and controlling a load based on the generated control command.

First claim

What is claimed is:

1 . A dialogue system comprising:
a speech input processor configured to:
when a speech of a plurality of speakers is input, acquire an utterance and a speech pattern by recognizing the input speech, and
classify dialogue contents for each speaker of the plurality of speakers based on the acquired utterance and speech pattern;
a context information processor configured to:
acquire a relationship between speakers of the plurality of speakers based on the acquired utterance, and
determine an intention and a context for each speaker of the plurality of speakers based on the acquired relationship between the speakers of the plurality of speakers and the classified dialogue contents for each speaker of the plurality of speakers;
a storage configured to store the relationship between the speakers of the plurality of speakers and the speech pattern for each speaker of the plurality of speakers; a dialogue manager configured to determine an action corresponding to the acquired relationship and the intention and context for each speaker of the plurality of speakers; and a result processor configured to output an utterance corresponding to the determined action.

2 . The dialogue system of claim 1 , wherein
when receiving contact information from a mobile device, the context information processor is configured to: acquire at least one of a name, a title, or a phone number of a speaker who has a dialogue with a user, based on the received contact information, and acquire the relationship between the speakers of the plurality of speakers based on the acquired at least one of the name, the title, or the phone number of the speaker having the dialogue with the user.

3 . The dialogue system of claim 1 , wherein:
the context information processor is configured to determine a priority between the speakers of the plurality of speakers based on the acquired relationship of the speakers of the plurality of speakers, the storage is configured to store function control information for each speaker of the plurality of speakers, the dialogue manager is configured to determine an action corresponding to the determined priority and the stored function control information, and the result processor is configured to generate a control command controlling a function based on the determined priority and the stored function control information for each speaker of the plurality of speakers, and to output the generated control command to a device.

4 . The dialogue system of claim 1 , further comprising:
a pre-utterance determiner configured to determine a pre-utterance context, wherein the context information processor is configured to determine a priority between the speakers of the plurality of speakers based on the acquired relationship between the speakers of the plurality of speakers and recognize a speaker of the plurality of speakers having a highest priority based on the determined priority; and the dialogue manager is configured to determine an action corresponding to the speaker having the highest priority and the pre-utterance context.

5 . A vehicle comprising:
a plurality of loads; a speech input device configured to receive a speech; a dialogue system configured to:
acquire an utterance and a speech pattern by recognizing a speech input through the speech input device,
classify dialogue contents for each speaker of a plurality of speakers based on the acquired utterance and the speech pattern,
acquire a relationship between speakers of the plurality of speakers based on the acquired utterance,
determine an intention and a context for each speaker of the plurality of speakers based on the acquired relationship between the speakers of the plurality of speakers and the classified dialogue contents for each speaker of the plurality of speakers,
determine an action corresponding to the acquired relationship between the speakers of the plurality of speakers, and the acquired intention and the context of each speaker of the plurality of speakers,
output an utterance corresponding to the determined action, and
generate a control command corresponding to the determined action; and
a vehicle controller configured to control at least one load among the plurality of loads, based on the received control command, when the control command is received.

6 . The vehicle of claim 5 , further comprising:
a communication device configured to communicate with a mobile device, wherein the dialogue system is configured to:
acquire at least one of a name, a title, or a phone number of a speaker who has a dialogue with a user, based on contact information when receiving the contact information from the mobile device,
acquire a relationship between speakers of the plurality of speakers based on the acquired at least one of the name, the title, or the phone number of the speaker having the dialogue with the user, and
store at least one information of a name, a title, or a phone number for each speaker of the plurality of speakers, the relationship between the speakers of the plurality of speakers, and a speech pattern for each speaker of the plurality of speakers.

7 . The vehicle of claim 6 , wherein, the dialogue system is configured to:
receive function control information for controlling functions of the vehicle from a mobile device of the plurality of speakers, store the received function control information for each speaker of the plurality of speakers in a storage, determine a priority between speakers of the plurality of speakers based on the relationship between the speakers of the plurality of speakers, determine an action corresponding to the determined priority and the stored function control information, generate a control command controlling at least one function based on the determined priority and the stored function control information, and output the generated control command to at least one load among the plurality of loads.

8 . The vehicle of claim 7 , wherein,
the dialogue system is configured to recognize a speech when the speech is input through the speech input device, and recognize a speaker by comparing the recognized speech pattern of the speech with a speech pattern stored in the storage.

9 . The vehicle of claim 7 , wherein,
the function control information comprises seat angle information for each seat of a plurality of seats, information of a horizontal position of each seat in front side and a rear side, a wind volume and a wind direction of air conditioner information, seat heating wire on/off information, seat heating wire temperature information, seat ventilation on/off information, and lumber support information.

10 . The vehicle of claim 9 , further comprising:
an information except for the speech input device, wherein the dialogue system is configured to store a seat location for a speaker input through the information except for the speech input device.

11 . The vehicle of claim 9 , wherein
the dialogue system is configured to recognize an utterance position based on a time at which a signal of a speech reaches the speech input device, identify a seat location corresponding to the recognized utterance position, recognize a speech pattern of a speech reaching at the speech input device, match the recognized speech pattern of the speech with the identified seat location, and store information of the matching the recognized speech pattern of the speech with the identified seat location.

12 . The vehicle of claim 11 , further comprising:
a detector provided in the plurality of seats and configured to detect the seat angle information of the plurality of seats and the horizontal p

Assignees

• Hyundai Motor Co Ltd
• Kia Motors Corp

Inventors

• Kim Kye Yoon
• Seok Donghee
• Shin Dongsoo
• Lee Jeong-Eom
• Kim Ga Hee
• Kim Seona
• Park Jung Mi
• Ro Heejin

Classifications

• G06F40/35 Primary

  Discourse or dialogue representation · CPC title

• G10L17/22 Primary

  Interactive procedures; Man-machine interfaces · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L17/00 Primary

  Speaker identification or verification techniques · CPC title