Electronic device and method for controlling display of a plurality of objects on wearable display device

Patent metadata

Field	Value
Publication number	US-12086373-B2
Application number	US-202117507214-A
Country	US
Kind code	B2
Filing date	Oct 21, 2021
Priority date	Oct 22, 2020
Publication date	Sep 10, 2024
Grant date	Sep 10, 2024

Abstract

Various embodiments of the disclosure disclose a method and apparatus, where an electronic device may include a communication module, a touch display, a memory, and a processor operatively connected to the communication module and the memory, wherein the processor may be configured to display a plurality of objects on the touch display, receive a touch input for the plurality of objects through the touch display while being connected to a wearable display device through the communication module, identify a direction corresponding to the touch input, identify a display angle and display distance of the wearable display device, determine an arrangement position of the plurality of objects included in the electronic device based on at least one of the identified direction, the display angle, or the display distance, and control displaying of the plurality of objects on the wearable display device based on the determination result. Various embodiments are possible.

First claim

What is claimed is:

1. An electronic device comprising:
a communication module;
a touch display;
a memory; and
a processor operatively connected to the communication module and the memory,
wherein the processor is configured to:
obtain an image captured by a camera of a wearable display device from the wearable display device, while being connected to the wearable display device through the communication module,
recognize a target object by analyzing the obtained image,
detect a user interaction including touching the touch display and subsequently dragging downward and upward, the user interaction for displaying a plurality of objects associated with the target object on the wearable display device,
identify, in response to detecting the user interaction, the plurality of objects associated with the target object,
receive sensing information and location information from the wearable display device,
calculate, based on the obtained image, the sensing information, and the location information, a distance between the wearable display device and the target object, a direction from the target object to the wearable display device, and an angle between the wearable display device and the target object,
determine arrangement positions of the plurality of objects to be displayed on the wearable display device based on the calculated direction, the calculated angle, and the calculated distance, and
control displaying of the plurality of objects on the wearable display device based on the determined arrangement positions of the plurality of objects,

wherein when the target object is a desk, the processor is further configured to:
identify, among the plurality of objects, a first application icon of a first document application and a second application icon of a second document application, and
when a level of association between the desk and the first document application is higher than a level of association between the desk and the second document application, determine an arrangement position of the first application icon closer to the desk than an arrangement position of the second application icon.

2. The electronic device of claim 1 , wherein the processor is configured to control arranging the plurality of objects in a space displayed on the wearable display device.

3. The electronic device of claim 1 , wherein the processor is configured to determine the arrangement positions of the plurality of objects based on a speed of the user interaction.

4. The electronic device of claim 1 , wherein the processor is further configured to determine a number of the plurality of objects based on a time of the user interaction.

5. The electronic device of claim 1 , wherein the processor is configured to:
identify an attribute of an object included in the plurality of objects, and
determine the arrangement positions of the plurality of objects to be displayed on the wearable display device based further on the identified object attribute, and
wherein the identified object attribute includes at least one of time, history, a file, or an application.

6. The electronic device of claim 5 , wherein the determined arrangement positions of the plurality of objects includes positions in a direction within a display distance of the wearable display device according to time attributes of the plurality of objects.

7. The electronic device of claim 6 , wherein the display distance includes a first display distance that is fixed with respect to a position of the electronic device, a second display distance that is fixed with respect to a user wearing the wearable display device, and a third display distance that is fixed with respect to an absolute position.

8. The electronic device of claim 5 , wherein the determined arrangement positions of the plurality of objects includes:
different arrangement positions of the plurality of objects in a depth direction of a display distance of the wearable display device according to history attributes or file attributes of the plurality of objects, or
different arrangement positions of the plurality of objects in at least one of a horizontal direction, a vertical direction, or a depth direction on the display angle of the wearable display device according to application attributes of the plurality of objects.

9. The electronic device of claim 1 , wherein the processor is further configured to:
transmit arrangement information including the determined arrangement positions and object information corresponding to the plurality of objects to the wearable display device, and
control the wearable display device to display the plurality of objects based on the arrangement information.

10. An operation method of an electronic device, the method comprising:
obtaining an image captured by a camera of a wearable display device from the wearable display device, while being connected to the wearable display device through a communication module of the electronic device;
recognizing a target object by analyzing the obtained image;
detecting a user interaction including touching a touch display of the electronic device and subsequently dragging downward and upward, the user interaction for displaying a plurality of objects on the wearable display device;
identifying, in response to detecting the user interaction, the plurality of objects associated with the target object;
receiving sensing information and location information from the wearable display device;
calculating, based on the obtained image, the sensing information, and the location information, a distance between the wearable display device and the target object, a direction from the target to the wearable display device, and an angle between the wearable display device and the target object;
determining arrangement positions of the plurality of objects to be displayed on the wearable display device based on the calculated direction, the calculated angle, and the calculated distance; and
controlling displaying of the plurality of objects on the wearable display device based on the determined arrangement positions of the plurality of objects,
wherein when the target object is a desk, the processor is further configured to:
identifying, among the plurality of objects, a first application icon of a first document application and a second application icon of a second document application, and
when a level of association between the desk and the first document application is higher than a level of association between the desk and the second document application, determining an arrangement position of the first application icon closer to the desk than an arrangement position of the second application icon.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Choi Inyoung
• Myung Insik
• Lee Seungjoon
• Jung Shinjae
• Han Hoon

Classifications

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G02B27/017

  Head mounted · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title