Electronic device for displaying visual object based on location of external electronic device and method thereof

Patent metadata

Field	Value
Publication number	US-12499645-B2
Application number	US-202318458522-A
Country	US
Kind code	B2
Filing date	Aug 30, 2023
Priority date	Dec 9, 2022
Publication date	Dec 16, 2025
Grant date	Dec 16, 2025

Abstract

According to an embodiment, a processor of a wearable device is configured to identify, based on an image output from a camera, an external electronic device. The processor, based on the identification, is configured to request outputting of an optical signal to the external electronic device through a communication circuit. The processor is configured to identify, in a portion of the image where the external electronic device is displayed, a position of the optical signal output from the external electronic device. The processor is configured to control a display to display a visual object having an extended shape based on the identified position in the display.

First claim

What is claimed is:

1 . A wearable device, comprising:
a camera; communication circuitry; a display; at least one processor comprising processing circuitry; and memory comprising one or more storage media storing instructions, when executed individually and/or collectively by the at least one processor, cause the wearable device to: identify, based on an image obtained from the camera, an external electronic device; identify a state of the external electronic device among a first state in which a first light emitting component disposed on a first side of the external electronic device is exposed to the wearable device and a second state in which a second light emitting component disposed on a second side of the external electronic device, opposite to the first side of the external electronic device, is exposed to the wearable device; based on the state of the external electronic device being the first state:
transmit, to the external electronic device, a first signal for activating the first light emitting component, and
in response to identifying a position of a first optical signal output from the first the light emitting component, display a first visual object representing the external electronic device, and a second visual object extending from the first visual object to indicate a direction according to an orientation of the external electronic device; and
based on the state of the external electronic device being the second state,
transmit, to the external electronic device, a second signal for activating the second light emitting component, and
in response to identifying a position of a second optical signal output from the second light emitting component, display a third visual object representing the external electronic device, and a fourth visual object extending from the third visual object to indicate the direction according to the orientation of the external electronic device.

2 . A wearable device of claim 1 , further comprising a sensor;
wherein a wavelength band of the first optical signal is different from a wavelength band of the second optical signal; wherein the first optical signal is identified using the sensor; and wherein the second optical signal is identified using the camera.

3 . The wearable device of claim 1 ,
wherein the external electronic device is a foldable device; and wherein the instructions, when executed by the at least one processor, cause the wearable device to: receive, via the communication circuitry, state information associated a form of the external electronic device; and identify, based on the state information, the state of the external electronic device.

4 . The wearable device of claim 3 , comprising a first housing and a second housing;
wherein the state information includes information on whether the external electronic device is folded, and information on an angle between the first housing and the second housing.

5 . The wearable device of claim 4 , wherein the instructions, when executed by the at least one processor individually or collectively, cause the wearable device to:
based on identifying the external electronic device being folded, identify the state of the external electronic device being the first state; and based on identifying the external electronic device being unfolded, identify the state of the external electronic device being the second state.

6 . The wearable device of claim 3 , wherein the first visual object and the third visual object are obtained based on the state information.

7 . The wearable device of claim 1 , wherein the instructions, when executed individually and/or collectively by the at least one processor, cause the wearable device to:
receive, from the external electronic device, motion data representing a motion of the external electronic device; and change, based on the motion data, a representation of one of a first virtual object and a second virtual object,
wherein the first virtual object includes the first visual object and the second visual object, and
wherein the second virtual object includes the third visual object and the fourth visual object.

8 . The wearable device of claim 1 , wherein the second visual object is obtained based on the first visual object, and
wherein the fourth visual object is obtained based on the third visual object.

9 . A method executed by a wearable device, comprising:
identifying, based on an image obtained from a camera, an external electronic device; identifying a state of the external electronic device among a first state in which a first light emitting component disposed on a first side of the external electronic device is exposed to the wearable device and a second state in which a second light emitting component disposed on a second side of the external electronic device, opposite to the first side of the external electronic device, is exposed to the wearable device; based on the state of the external electronic device being the first state:
transmitting, to the external electronic device, a first signal for activating the first light emitting component, and
in response to identifying a position of a first optical signal output from the first the light emitting component, displaying a first visual object representing the external electronic device, and a second visual object extending from the first visual object to indicate a direction according to an orientation of the external electronic device; and
based on the state of the external electronic device being the second state,
transmitting, to the external electronic device, a second signal for activating the second light emitting component, and
in response to identifying a position of a second optical signal output from the second light emitting component, displaying a third visual object representing the external electronic device, and a fourth visual object extending from the third visual object to indicate the direction according to the orientation of the external electronic device.

10 . The method of claim 9 , wherein a wavelength band of the first optical signal is different from a wavelength band of the second optical signal;
wherein the first optical signal is identified using the sensor; and wherein the second optical signal is identified using the camera.

11 . The method of claim 9 ,
wherein the external electronic device is a foldable device; and wherein the method comprises: receiving, via the communication circuitry, state information associated a form of the external electronic device; and identifying, based on the state information, the state of the external electronic device.

12 . The method of claim 11 , wherein the state information includes information on whether the external electronic device is folded, information on an angle between the first housing and the second housing.

13 . The method of claim 12 , comprising:
based on identifying the external electronic device being folded, identifying the state of the external electronic device being the first state; and based on identifying the external electronic device being unfolded, identifying the state of the external electronic device being the second state.

14 . The method of claim 11 , wherein the first visual object and the third visual object are obtained based on the state information.

15 . The method of claim 9 , comprising:
receiving, from the external electronic device, motion data representing a motion of the external electronic device; and changing, based on the motion data, a representation of one of a first virtual object and a second virtual object,

Assignees

• Samsung Electronics Co Ltd

Inventors

• Kim Sungoh
• Kim Kihwan
• Kim Harksang
• Yeom Donghyun
• Woo Hyuntaek
• Lee Sanghun
• Lee Jungjik
• Choi Sungsoo
• Kim Daehee
• Kim Beomsu

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• G06T2219/2021

  Shape modification · CPC title