Electronic apparatus and method for controlling electronic apparatus

Patent metadata

Field	Value
Publication number	US-12436795-B2
Application number	US-202318191360-A
Country	US
Kind code	B2
Filing date	Mar 28, 2023
Priority date	Oct 12, 2020
Publication date	Oct 7, 2025
Grant date	Oct 7, 2025

Abstract

An electronic apparatus is provided. The electronic apparatus includes a microphone, a memory configured to store at least one instruction, and a processor configured to execute the at least one instruction, and the processor may be configured to, by executing the at least one instruction, obtain a first command set corresponding to a first user voice input through the microphone and execute the obtained first command set on a host operating system, based on a user command different from the first user voice being input while the first command set is executed, identify whether it is possible to execute the first command set on a virtual machine through a bridge module, and based on a result of the identification, execute a command on the virtual machine through the bridge module and execute an operation corresponding to the user command on the host operating system.

First claim

What is claimed is:

1. An electronic apparatus comprising:
a microphone;
a memory configured to store at least one instruction; and
at least one processor configured to execute the at least one instruction,
wherein the at least one processor is further configured to:
by executing the at least one instruction, obtain a first command set corresponding to a first user voice input through the microphone and execute the obtained first command set on a host operating system,
based on a user command different from the first user voice being input while the first command set is executed, identify whether it is possible to execute the first command set on a virtual machine through a bridge module, and
based on a result of identification, execute a command that is not executed on the host operating system from the first command set on the virtual machine through the bridge module and execute an operation corresponding to the user command on the host operating system.

2. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
load a first model trained to output a command set corresponding to a user voice input through the microphone stored in the memory;
obtain the first command set by inputting the first user voice input through the microphone to the first model on the host operating system; and
based on the user command being a second user voice different from the first user voice input through the microphone, obtain a second command set by inputting the second user voice to the first model.

3. The electronic apparatus of claim 2 , wherein the at least one processor is further configured to:
identify whether there is a command that is being executed on the virtual machine through the bridge module;
based on identifying that there is a command that is being executed on the virtual machine, identify that the first command set is not executable on the virtual machine; and
based on execution of a command that is being executed on the virtual machine being completed, execute a command that is not executed on the host operating system from the first command set.

4. The electronic apparatus of claim 2 ,
wherein the first command set and the second command set are commands executed through a first application, and
wherein the at least one processor is further configured to:
identify whether the first application is executable on the host operating system and the virtual machine simultaneously through the bridge module, and
based on whether the first application is executable on the host operating system and the virtual machine simultaneously, decide to execute each of the command that is not executed on the host operating system from the first command set and the second command set on one of the host operating system or the virtual machine.

5. The electronic apparatus of claim 4 , wherein the at least one processor is further configured to, based on identifying that the first application is executable on the host operating system and the virtual machine simultaneously, decide to execute a command that is not executed on the host operating system from the first command set on the virtual machine through the bridge module.

6. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to:
based on occurrence of an event requiring a user input while a command that is not executed on the host operating system from the first command set is executed on the virtual machine, provide a message indicating the event; and
based on information corresponding to the event being input from a user, control to provide the information regarding the event to the virtual machine.

7. The electronic apparatus of claim 6 , wherein the at least one processor is further configured to:
based on occurrence of an event requiring user authentication from the event while a command that is not executed on the host operating system from the first command set is executed on the virtual machine, control to provide a message requesting the user authentication on the host operating system, and
based on information for authenticating the user being input from the user, control to provide the information for authenticating the user on the virtual machine.

8. The electronic apparatus of claim 2 ,
wherein the bridge module includes a second model trained to output a score representing a degree of urgency of command execution, and
wherein the at least one processor is further configured to:
based on a second user voice being input through the microphone while the first command set is executed, obtain a score corresponding to the second command set by inputting the second user voice to the second model through the bridge module, and
execute the second command set on the host operating system based on the obtained score.

9. The electronic apparatus of claim 8 , wherein the at least one processor is further configured to:
based on the obtained score exceeding a threshold value, execute the second command set on the host operating system and execute a command that is not executed on the host operating system from the first command set on the virtual machine, and
based on the obtained score being equal to or lower than the threshold value, execute the second command set after execution of the first command is completed on the host operating system.

10. The electronic apparatus of claim 1 , wherein the at least one processor is further configured to, based on execution of a command that is not executed on the host operating system from the first command set being completed on the virtual machine, update state information of an application corresponding to the first command set on the host operating system.

11. A method of controlling an electronic apparatus including a microphone, the method comprising:
obtaining a first command set corresponding to a first user voice input through the microphone on a host operating system;
based on a user command different from the first user voice being input while the first command set is executed, identifying whether it is possible to execute the first command set on a virtual machine through a bridge module; and
based on a result of the identification, executing a command that is not executed on the host operating system from the first command set on the virtual machine through the bridge module and executing an operation corresponding to the user command on the host operating system.

12. The method of claim 11 , wherein the obtaining of the first command set comprises:
loading a first model trained to output a command set corresponding to a user voice input through the microphone stored in a memory;
obtaining the first command set by inputting the first user voice input through the microphone to the first model on the host operating system; and
based on the user command being a second user voice different from the first user voice input through the microphone, obtaining a second command set by inputting the second user voice to the first model.

13. The method of claim 11 , wherein the identifying of whether it is possible to execute the first command set comprises:
identifying whether there is a command that is being executed on the virtual machine through the bridge module;
based on identifying that there is a command that is being executed on the virtual machine, identifying that the first command set is not executable on the virtual machine; and
based on execution of a command that is being executed on the virtual machine being completed, executing a command that is not executed on the host operating system from the first command set.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Choi Hyungjun
• Jeon Heesik
• Kim Hyoungsu
• RYU Jongyoub
• Son Yusun
• Yang Dojun

Classifications

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06N3/04

  Architecture, e.g. interconnection topology · CPC title

• G06F9/45533 Primary

  Hypervisors; Virtual machine monitors · CPC title

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• G06N3/08

  Learning methods · CPC title