Electronic device and control method therefor

Patent metadata

Field	Value
Publication number	US-2022059088-A1
Application number	US-202017299061-A
Country	US
Kind code	A1
Filing date	Jan 7, 2020
Priority date	Mar 7, 2019
Publication date	Feb 24, 2022
Grant date	—

Abstract

An electronic device is disclosed. The electronic device of the present disclosure comprises a microphone, a memory including at least one command, and a processor which is connected to the microphone and the memory and controls the electronic device, wherein the processor, by executing the at least one command extracts a keyword from a user voice received as an input when the user voice is input through the microphone, acquires context information at the time when the user voice is input, acquires an object related to the user voice and knowledge information relating to the object, on the basis of the extracted keyword and the context information, and updates a stored knowledge database on the basis of the knowledge information relating to the object. In particular, at least a part of a method for providing a response to a user query by an electronic device may use an artificial intelligence model learned in accordance with at least one of machine learning, a neural network, and a deep-learning algorithm.

First claim

What is claimed is:

1 . An electronic device comprising:
a microphone; a memory configured to include at least one command; and a processor connected to the microphone and the memory, and configured to control the electronic device, wherein the processor, by executing the at least one command, is further configured to:
based on a user voice being input through the microphone, extract a keyword from the input user voice,
obtain context information at a point in time when the user voice is input,
obtain an object related to the user voice and knowledge information relating to the object, based on the extracted keyword and the context information, and
update a knowledge database stored in the memory based on the object and the knowledge information relating to the object.

2 . The electronic device of claim 1 , wherein the knowledge database is configured to store a relationship among knowledge information in an ontology format.

3 . The electronic device of claim 2 , wherein the processor is further configured to:
identify whether an entity relating to the obtained object is present in the knowledge database; and based on the entity relating to the object being present, update the knowledge database by adding, to the entity, the knowledge information relating to the object.

4 . The electronic device of claim 2 , wherein the processor is further configured to, based on an entity relating to the object not being present, generate a new entity corresponding to the object and update the knowledge database.

5 . The electronic device of claim 1 ,
wherein the memory further comprises an artificial intelligence (AI) model trained based on at least one of a user interaction input to the electronic device, a user's search history, sensing information sensed by the electronic device, or user information received from an external device, and wherein the processor is further configured to obtain the object related to the user voice and the knowledge information relating to the object by inputting the extracted keyword to the AI model.

6 . The electronic device of claim 1 , wherein the processor is further configured to, based on a user query being input, obtain a response to the user query using the updated knowledge database, and output the obtained response.

7 . The electronic device of claim 1 , further comprising:
a communication interface, wherein the processor is further configured to transmit the updated knowledge database to an external server through the communication interface and receive knowledge database of another user from the external server.

8 . The electronic device of claim 1 , wherein the processor is further configured to obtain at least one of time information, location information, weather information, or schedule information of a point in time when the user voice is input as the context information.

9 . The electronic device of claim 8 , further comprising:
a global positioning system (GPS) sensor, wherein the processor is further configured to:
obtain location information sensed by the GPS sensor at the point in time when the user voice is input as the context information, and
obtain an object related to a place where the user voice is input based on at least one of the extracted keyword, the obtained location information, or prestored schedule information.

10 . The electronic device of claim 8 , further comprising:
a communication interface, wherein the processor is further configured to:
obtain, from an external server, weather information of a point in time when the user voice is input through the communication interface as the context information, and
obtain preference information of a user relating to the object as the knowledge information based on the extracted keyword and the obtained weather information.

11 . A method of controlling of an electronic device, the method comprising:
based on a user voice being input, extracting a keyword from the input user voice; obtaining context information at a point in time when the user voice is input; obtaining an object related to the user voice and knowledge information relating to the object, based on the extracted keyword and the context information; and updating a prestored knowledge database based on the object and the knowledge information relating to the object.

12 . The method of claim 11 , wherein the knowledge database is configured to store a relationship among knowledge information in an ontology format.

13 . The method of claim 12 , wherein the updating comprises:
identifying whether an entity relating to the obtained object is present in the knowledge database; and based on the entity relating to the object being present, updating the knowledge database by adding, to the entity, the knowledge information relating to the object.

14 . The method of claim 12 , wherein the updating comprises, based on the entity relating to the object not being present, generating a new entity corresponding to the object and updating the knowledge database.

15 . The method of claim 11 , further comprising:
training a prestored artificial intelligence (AI) model based on at least one of a user interaction input to the electronic device, a user's search history, sensing information sensed by the electronic device, or user information received from an external device, wherein the obtaining the object and knowledge information relating to the object comprises obtaining the object related to the user voice and the knowledge information relating to the object by inputting the extracted keyword to the AI model.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Jaehun
• Lee Yunsu
• Hwang Taeho
• Lee Hyonsok
• Jeong Mirae

Classifications

• G06N3/0442

  characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] · CPC title

• G06N5/022

  Knowledge engineering; Knowledge acquisition · CPC title

• G06N3/006

  based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO] · CPC title

• G06N3/08

  Learning methods · CPC title

• G06N3/04

  Architecture, e.g. interconnection topology · CPC title