Vehicle and method of controlling the same

Patent metadata

Field	Value
Publication number	US-10915768-B2
Application number	US-201916561326-A
Country	US
Kind code	B2
Filing date	Sep 5, 2019
Priority date	Nov 13, 2018
Publication date	Feb 9, 2021
Grant date	Feb 9, 2021

Abstract

A vehicle includes: a user interface including a display and a speaker; a capturer configured to capture a passenger's image; and a controller configured to obtain emotion information representing the passenger's emotion based on the image, to determine content corresponding to the emotion information, to control the user interface to output the determined content, to obtain circumstance information representing the passenger's circumstances based on the image after the determined content is output, to modify the determined content based on the circumstance information, and to control the user interface to output the modified content.

First claim

What is claimed is:

1. A vehicle comprising:
a user interface including a display and a speaker;
a camera configured to capture an image of a passenger;
a sensing device configured to measure bio-signals of the passenger; and
a processor configured to:
obtain emotion information representing emotion of the passenger based on the image;
determine a content corresponding to the emotion information;
control the user interface to output the determined content;
obtain circumstance information representing circumstances of the passenger based on the image after the determined content is output;
modify the determined content based on the circumstance information; and
control the user interface to output the modified content,

wherein the processor is further configured to:
obtain the emotion information based on the image or the bio-signals of the passenger; and
obtain the circumstance information based on the image or the bio-signals of the passenger after the determined content is output, and

wherein the processor is further configured to compare at least one of the image with physical information by age to determine an age of the passenger, wherein the physical information comprises heart rate information.

2. The vehicle according to claim 1 , wherein the processor is further configured to:
obtain the circumstance information based on the captured image or the measured bio-signals for a predetermined time after the determined content is output; and
modify the determined content when a circumstance represented by the circumstance information corresponds to a predetermined circumstance.

3. The vehicle according to claim 2 , wherein the predetermined circumstance comprises at least one of a circumstance in which a degree of negativity of the emotion of the passenger represented by the emotion information is equal to or greater than a threshold level, a circumstance in which the passenger utters crying, a circumstance in which the passenger utters a protection request word, or a circumstance in which the passenger is sleepy.

4. The vehicle according to claim 2 , wherein the processor is further configured to modify at least one of a playback speed, playback music, a playback interval, an output size, a movement of a character, a shape of the character, a color of the character, a face of the character, or a voice of the character of the determined content.

5. The vehicle according to claim 4 , wherein the processor is further configured to:
determine the playback interval, in which a degree of positivity of the emotion of the passenger is less than a threshold level among at least one playback interval of the determined content, based on the emotion information; and
modify the determined content to increase the playback speed of the playback interval.

6. The vehicle according to claim 4 , wherein the processor is further configured to determine the playback interval, in which a degree of positivity of the emotion of the passenger is less than a threshold level among at least one playback interval of the determined content, based on the emotion information.

7. The vehicle according to claim 6 , wherein the processor is further configured to modify the determined content to play so that the playback music or the playback image in the playback interval is repeatedly played.

8. The vehicle according to claim 6 , wherein the processor is further configured to:
modify the determined content to increase the output size of the playback music in the playback interval; or
modify the determined content to increase an image size of the playback image in the playback interval.

9. The vehicle according to claim 6 , wherein the processor is further configured to modify the determined content so that the movement of the character, the shape of the character, or the color of the character in the playback interval is reflected in the character of a current playback interval.

10. The vehicle according to claim 4 , wherein the processor is further configured to modify the determined content so that the face of the character is modified into a face of the passenger or a face of a guardian, or the voice of the character is modified into a voice of the passenger or a voice of the guardian.

11. The vehicle according to claim 1 , wherein the processor is further configured to:
determine an age corresponding content group that includes at least one content corresponding to the age; and
determine the content having a highest association with the emotion represented by the emotion information among the at least one content included in the age corresponding content group as the content corresponding to the emotion information.

12. The vehicle according to claim 11 , wherein the processor is further configured to:
obtain the emotion information for a predetermined time after the determined content is output based on the image captured or the bio-signals measured for the predetermined time after the determined content is output;
compare the emotion information for the predetermined time after the determined content is output and the emotion information prior to an output of the determined content; and
update an association between the emotion represented by the emotion information and the determined content.

13. The vehicle according to claim 12 , wherein the processor is further configured to:
increase, when a degree of positivity of the emotion information for the predetermined time after the output of the determined content is greater than the degree of positivity of the emotion information prior to the output of the determined content, the association between the determined content and the emotion represented by the emotion information;
decrease, when a degree of positivity of the emotion information for the predetermined time after the output of the determined content is lower than the degree of positivity of the emotion information prior to the output of the determined content, the association between the determined content and the emotion represented by the emotion information; and
determine, when the association of the emotion represented by the emotion information of the determined content is lower than the association of the emotion represented by the emotion information of the other contents including the age corresponding content group, the other contents as the content corresponding to the emotion information.

14. A method of controlling a vehicle that includes a user interface including a display and a speaker, the method comprising:
capturing, by a camera, an image of the passenger;
measuring, by a sensing device, bio-signals of the passenger;
obtaining, by a processor, emotion information representing emotion of the passenger based on the image;
determining, by the processor, content corresponding to the emotion information;
controlling, by the processor, the user interface to output the determined content;
obtaining, by the processor, circumstance information representing circumstances of the passenger based on the image after the determined content is output;
modifying, by the processor, the determined content based on the circumstance information;
controlling, by the processor, the user interface to output the modified content;
obtaining, by the processor, the emotion information based on the image or the bio-signals;
obtaining, by the processor, the circumstance information based on the image or the bio-signals after the determined content is output; and
comparing, by the processor, at least one of the image with physical information by age to determine an age of the passenger, wherein the physical info

Assignees

• Hyundai Motor Co Ltd
• Kia Motors Corp

Inventors

• Han Jimin
• Youn Seok-Young
• Lee Jia
• Kim Kye Yoon
• Woo Seunghyun

Classifications

• B60K35/60

  Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10) · CPC title

• B60K35/26

  using acoustic output · CPC title

• B60K35/81

  for controlling displays · CPC title

• B60K35/10

  Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor · CPC title

• B60K35/22

  Display screens · CPC title