Method for providing user interface and wearable electronic device for supporting the same

Patent metadata

Field	Value
Publication number	US-2024303949-A1
Application number	US-202418583166-A
Country	US
Kind code	A1
Filing date	Feb 21, 2024
Priority date	Mar 10, 2023
Publication date	Sep 12, 2024
Grant date	—

Abstract

According to an embodiment, a wearable electronic device may include a display, memory, and a processor. The memory may store instructions that, when executed by the processor, cause the wearable electronic device to display a first execution screen of a first application in a 3D virtual space. A first guide representing a first virtual plane for guiding a location at which an object can be placed and a second guide representing a second virtual plane for guiding a location at which an object can be placed may be provided in the 3D virtual space, wherein the second virtual plane is facing in a direction different from the first virtual plane. The memory may store instructions that, when executed by the processor, cause the wearable electronic device to, based on a user input for moving a first object included in the first execution screen, display at least one guide of the first guide or the second guide to enable relocation of the first object to the first virtual plane or the second virtual plane.

First claim

What is claimed is:

1 . A wearable electronic device comprising:
a display; memory; and a processor operatively connected to the display and the memory, wherein the memory stores instructions that, when executed by the processor, cause the wearable electronic device to: display a first execution screen of a first application in a 3D virtual space, wherein a first guide representing a first virtual plane for guiding to a location on the first virtual plane at which an object can be placed and a second guide representing a second virtual plane for guiding to location on the second virtual plane at which an object can be placed are provided in the 3D virtual space, wherein the second virtual plane is facing in a direction different from the first virtual plane, and based on a user input for moving a first object included in the first execution screen, display at least one guide of the first guide or the second guide to enable relocation of the first object to the first virtual plane or the second virtual plane.

2 . The wearable electronic device of claim 1 , wherein the first virtual plane and the second virtual plane are disposed orthogonal with respect to each other within the 3D virtual space.

3 . The wearable electronic device of claim 1 , wherein the first virtual plane and the second virtual plane are disposed such that an angle between the first virtual plane and the second virtual plane is one among 45° to 90° or one among 90° to 180°.

4 . The wearable electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the wearable electronic device to:
obtain depth information about a real space surrounding the wearable electronic device while the wearable electronic device operates in a VST (video see-through) mode, based on the depth information, recognize a thing having at least one real surface and disposed in the real space, detect the at least one real surface of the thing using a designated algorithm or an artificial intelligence mode, and provide the at least one guide of the first guide or the second guide, the at least one guide having a size corresponding to a size of the at least one real surface.

5 . The wearable electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the wearable electronic device to:
based on a location of the first object obtained while the first object is moved, identify whether a first distance between the first virtual plane and the first object or a second distance between the second virtual plane and the first object is equal to or less than a designated distance, and based on the first distance or the second distance being equal to or less than the designated distance, display, through the display, a guide representing a region to which the first object can be placed in the first virtual plane or the second virtual place from the location of the first object.

6 . The wearable electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the wearable electronic device to:
obtain a user input for moving a second object placed in the first virtual plan in a first direction parallel to the first virtual plane from the first virtual plane, based on the second object being moved into an outside of the first virtual plane by the user input, increase sizes of the first virtual plane and the second virtual plane in the first direction, and place the first object on the at least one first grid having the increased size.

7 . The wearable electronic device of claims 1 , wherein the instructions, when executed by the processor, cause the wearable electronic device to:
based on the user input for moving the first object into the first virtual plane, identify whether a size of the first virtual plane is equal to or greater than a first size required to add the first object on the first virtual plane, based on the size of the first virtual plane being equal to or greater than the first size, place the first object on the first virtual plane without increasing the size of the first virtual plane, based on the size of the first virtual plane being less than the first size, increase the size of the first virtual plane, and place the first object on the first virtual plane having the increased size.

8 . The wearable electronic device of claim 1 , wherein the instructions, when executed by the processor, cause the wearable electronic device to:
based on a user input for executing a second application, display a second execution screen of the second application in the 3D virtual space, wherein a third guide representing a virtual surface for guiding a location at which an object can be placed is provided in the 3D virtual space while the second execution screen is displayed.

9 . The wearable electronic device of claim 8 , wherein the instructions, when executed by the processor, cause the wearable electronic device to:
based on a user input for moving a third object included in the second execution screen, display a panel in which the object can be placed within the virtual surface and movable by a user input.

10 . The wearable electronic device of claim 1 , wherein the third guide is located in a position farther than a position of the first guide and a position of the second guide with respect to a position corresponding to a user in the 3D virtual space.

11 . A method comprising:
displaying a first execution screen of a first application in a 3D virtual space, wherein a first guide representing a first virtual plane for guiding to a location the first virtual plane at which an object can be placed and a second guide representing a second virtual plane for guiding to a location the second virtual plane at which an object can be placed are provided in the 3D virtual space, wherein the second virtual plane is facing in a direction different from the first virtual plane; and based on a user input for moving a first object included in the first execution screen, displaying at least one guide of the first guide or the second guide to enable relocation of the first object to the first virtual plane or the second virtual plane.

12 . The method of claim 11 , wherein the first virtual plane and the second virtual plane are disposed orthogonal with respect to each other within the 3D virtual space.

13 . The method of claim 11 , wherein the first virtual plane and the second virtual plane are disposed such that an angle between the first virtual plane and the second virtual plane is one among 45° to 90° or one among 90° to 180°.

14 . The method of claim 11 , further comprising:
obtaining depth information about a real space surrounding the wearable electronic device while the wearable electronic device operates in a VST (video see-through) mode; based on the depth information, recognizing a thing having at least one real surface and disposed in the real space; detecting the at least one real surface of the thing using a designated algorithm or an artificial intelligence mode; and providing the at least one guide of the first guide or the second guide, the at least one guide having a size corresponding to a size of the at least one real surface.

15 . The method of claim 11 , further comprising:
based on a location of the first object obtained while the first object is moved, identifying whether a first distance between the first virtual plane and the first object or a second distance between the second virtual plane and the first object is equal to or less than a designated distance; and based on the first distance or the second distance bei

Assignees

• Samsung Electronics Co Ltd

Inventors

• Choi Jinha
• Kim Sungman
• Shin Boosun
• Lee Chaekyung
• Cho Minkyung
• Kim Sanggeon
• Woo Minseoung

Classifications

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/0487

  using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F1/1686

  the I/O peripheral being an integrated camera · CPC title