Electronic device and control method therefor

Patent metadata

Field	Value
Publication number	US-2022019615-A1
Application number	US-201917414802-A
Country	US
Kind code	A1
Filing date	Dec 24, 2019
Priority date	Jan 18, 2019
Publication date	Jan 20, 2022
Grant date	—

Abstract

An electronic device is disclosed. The electronic device comprises: a memory including at least one command; and a processor connected to the memory to control the electronic device, wherein by executing the at least one command, the processor obtains an image according to a user's interaction with the electronic device, obtains information about the user's intention according to information about an object obtained from the image and context information obtained during the interaction, and obtains information concerning the obtained object from a knowledge base stored in the memory, according to the information about the user's intention, wherein the knowledge base includes device information about a plurality of electronic devices used during the user's activity, object information about a plurality of objects obtained according to the activity, and intention information corresponding to correlative information, and the processor obtains, from the knowledge base, information concerning the obtained object according to the intention information corresponding to the obtained object.

First claim

What is claimed is:

1 . An electronic device comprising:
a memory comprising at least one instruction; and a processor configured to be connected to the memory to control the electronic device, wherein the processor, by executing the at least one instruction, is configured to: obtain an image based on a user's interaction on the electronic device; obtain intent information of the user based on an object obtained from the image and context information during the interaction; and obtain information related to the obtained object from a knowledge base stored in the memory based on the intent information of the user, wherein the knowledge base comprises device information on a plurality of electronic devices on which user's activities are performed, object information on a plurality of objects obtained based on the activities, and intent information corresponding to pieces of information related to each other, and wherein the processor is configured to obtain information related to the obtained object based on the intent information corresponding to the obtained object from the knowledge base.

2 . The device according to claim 1 , wherein the knowledge base comprises data in which the device information on the plurality of electronic devices on which the user's activities are performed, the object information on the plurality of objects obtained based on the activities, and an edge representing a relationship between pieces of information related to each other among the device information and the object information are stored as a graph, and
wherein the edge comprises the intent information corresponding to the pieces of information related to each other.

3 . The device according to claim 2 , wherein the processor is configured to:
based on a user's activity being performed on the electronic device, obtain intent information corresponding to device information on the electronic device on which the activity is performed and object information on at least one object obtained based on the user's activity; determine common intent information among the intent information corresponding to the device information and the object information; and generate the knowledge base based on the device information, the object information, and the common intent information, and wherein an edge representing a relationship between the device information and the object information and an edge representing a relationship between pieces of the object information comprise the common intent information.

4 . The device according to claim 1 , wherein the processor is configured to update the knowledge base based on information newly obtained based on a user's activity on the electronic device.

5 . The device according to claim 1 , further comprising:
a communication interface comprising circuitry, wherein the processor is configured to, based on information newly obtained based on the user's activities performed on the plurality of electronic devices being received via the communication interface, update the knowledge base based on the received information.

6 . The device according to claim 1 , further comprising:
a communication interface comprising circuitry, wherein the processor is configured to transmit the information included in the knowledge base to the plurality of electronic devices via the communication interface.

7 . The device according to claim 1 , wherein the processor is configured to:
determine information corresponding to the obtained object from the knowledge base; and obtain information having a relationship corresponding to the intent information of the user among information related to the determined information from the knowledge base as the information related to the obtained object.

8 . The device according to claim 1 , further comprising:
a display, wherein the processor is configured to display the information related to the obtained object on the display.

9 . The device according to claim 1 , further comprising:
a camera, wherein the processor is configured to obtain the image through the camera based on the user's interaction.

10 . A method for controlling an electronic device, the method comprising:
obtaining an image based on a user's interaction on the electronic device; obtaining intent information of the user based on an object obtained from the image and context information during the interaction; and obtaining information related to the obtained object from a pre-stored knowledge base based on the intent information of the user, wherein the knowledge base comprises device information on a plurality of electronic devices on which user's activities are performed, object information on a plurality of objects obtained based on the activities, and intent information corresponding to pieces of information related to each other, and wherein the obtaining the information related to the obtained object comprises obtaining information related to the obtained object based on the intent information corresponding to the obtained object from the knowledge base.

11 . The method according to claim 10 , wherein the knowledge base comprises data in which the device information on the plurality of electronic devices on which the user's activities are performed, the object information on the plurality of objects obtained based on the activities, and an edge representing a relationship between pieces of information related to each other among the device information and the object information are stored as a graph, and
wherein the edge comprises the intent information corresponding to the pieces of information related to each other.

12 . The method according to claim 11 , further comprising:
based on a user's activity being performed on the electronic device, obtaining intent information corresponding to device information on the electronic device on which the activity is performed and object information on at least one object obtained based on the user's activity, determining common intent information among the intent information corresponding to the device information and the object information, and generating the knowledge base based on the device information, the object information, and the common intent information, wherein an edge representing a relationship between the device information and the object information and an edge representing a relationship between pieces of the object information comprise the common intent information.

13 . The method according to claim 10 , further comprising:
updating the knowledge base based on information newly obtained based on a user's activity on the electronic device.

14 . The method according to claim 10 , further comprising:
based on information newly obtained based on the user's activities performed on the plurality of electronic devices being received, updating the knowledge base based on the received information.

15 . The method according to claim 10 , further comprising:
transmitting the information included in the knowledge base to the plurality of electronic devices.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Park Jungho
• Lee Yunsu
• Lee Jaehun
• Jeong Mirae
• Kang Jiyoung
• Kwak Sejin

Classifications

• G02B27/017

  Head mounted · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06N3/08

  Learning methods · CPC title

• H04L67/535

  Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34) · CPC title

• G06N20/00

  Machine learning · CPC title