Information processing device, information processing method, and storage medium storing information processing program

Patent metadata

Field	Value
Publication number	US-11577745-B2
Application number	US-202117143321-A
Country	US
Kind code	B2
Filing date	Jan 7, 2021
Priority date	Jan 31, 2020
Publication date	Feb 14, 2023
Grant date	Feb 14, 2023

Abstract

An information processing device acquires question information. The information processing device acquires vehicle state information representing a state of the vehicle. The information processing device acquires answer information in response to the question information, the answer information including an image for display. The information processing device, in a case in which the vehicle state information represents that the vehicle is traveling, stores the answer information in a storage. The information processing device, in a case in which the information processing device acquires vehicle state information representing that the vehicle is stopped, outputs the answer information stored in the storage.

First claim

What is claimed is:

1. An information processing device configured to output answer information in response to question information from an occupant of a vehicle, the information processing device comprising:
a memory; and
a processor coupled to the memory, wherein the processor is configured to:
acquire question information;
acquire vehicle state information representing a state of the vehicle;
acquire answer information in response to the question information, the answer information including an image for display, wherein the answer information is acquired at least by using machine learning with training data that use text information pertaining to multiple phrases associated with a particular question of the acquired question information as inputs and an intent label pertaining to an answer to the question as outputs, wherein the intent label includes a degree of confidence associated with a probability that exceeds a certain threshold value;
in a case in which the vehicle state info (nation represents that the vehicle is traveling, store the answer information in a storage; and
in a case in which the processor acquires vehicle state information representing that the vehicle is stopped, output the answer information stored in the storage to the occupant.

2. The information processing device of claim 1 , wherein, in a case in which the processor acquires the vehicle state information representing that the vehicle is stopped after acquiring the vehicle state information representing that the vehicle is traveling, the processor is configured to output the answer information stored in the storage.

3. The information processing device of claim 1 , wherein, in a case in which the vehicle state information represents that the vehicle is stopped, the processor is configured to output the answer information.

4. The information processing device of claim 1 , wherein, in a case in which the processor acquires the vehicle state information representing that the vehicle is stopped after acquiring the vehicle state information representing that the vehicle is traveling, the processor is configured to output the answer information after outputting notification information representing a notification about the answer information.

5. The information processing device of claim 4 , wherein the processor is configured to determine whether the answer information is stored in the storage, and is configured to output the notification information in a case in which the answer information is stored in the storage.

6. An information processing method executed by an information processing device including a memory and a processor coupled to the memory and configured to output answer information in response to question information from an occupant of a vehicle, the method comprising:
acquiring question information;
acquiring vehicle state information representing a traveling state of the vehicle;
acquiring answer information in response to the question information, the answer information including an image for display, wherein the answer information is acquired at least by using machine learning with training data that use text information pertaining to multiple phrases associated with a particular question of the acquired question information as inputs and an intent label pertaining to an answer to the question as outputs, wherein the intent label includes a degree of confidence associated with a probability that exceeds a certain threshold value;
in a case in which the acquired vehicle state information represents that the vehicle is traveling, storing the acquired answer information in a storage; and
in a case in which the processor acquires vehicle state information representing that the vehicle is stopped, outputting the answer information stored in the storage to the occupant.

7. A non-transitory computer-readable storage medium storing an information processing program executable by a computer of an information processing device including a memory and a processor coupled to the memory and configured to output answer information in response to question information from an occupant of a vehicle, the program, when executed by the computer, causing the computer to perform a method comprising:
acquiring question information;
acquiring vehicle state information representing a traveling state of the vehicle;
acquiring answer information in response to the question information, the answer information including an image for display, wherein the answer information is acquired at least by using machine learning with training data that use text information pertaining to multiple phrases associated with a particular question of the acquired question information as inputs and an intent label pertaining to an answer to the question as outputs, wherein the intent label includes a degree of confidence associated with a probability that exceeds a certain threshold value;
in a case in which the acquired vehicle state information represents that the vehicle is traveling, storing the acquired answer information in a storage; and
in a case in which the processor acquires vehicle state information representing that the vehicle is stopped, outputting the answer information stored in the storage to the occupant.

Assignees

• Toyota Motor Co Ltd

Inventors

• Nakano Keiko
• Maeda Eiichi
• Kubo Chikage
• Nishizawa Hiroyuki

Classifications

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• B60W50/14 Primary

  Means for informing the driver, warning the driver or prompting a driver intervention · CPC title

• B60W2050/146

  Display means · CPC title

• G06N20/00

  Machine learning · CPC title

• G06F16/3329

  Natural language query formulation · CPC title