Method for wireless connection in augmented reality environment and electronic device therefor

Patent metadata

Field	Value
Publication number	US-2022155861-A1
Application number	US-202117520946-A
Country	US
Kind code	A1
Filing date	Nov 8, 2021
Priority date	Nov 17, 2020
Publication date	May 19, 2022
Grant date	—

Abstract

There is disclosed an augmented reality (AR) glasses device including: a camera, a transparent display, a communication circuit, a memory storing images of a plurality of external electronic devices, and a processor. The processor may be configured to control the AR glasses device to: acquire an image including an image of at least one external electronic device, acquire running application information of the at least one external electronic device, identify a first external electronic device corresponding to a gaze from among the at least one external electronic device from the acquired image, determine whether a specified application is running in the first external electronic device based on the running application information, and connect to the first external electronic device using a communication circuit, based on the specified application running.

First claim

What is claimed is:

1 . An augmented reality (AR) glasses device comprising:
a camera; a transparent display; a communication circuit; a memory storing images of a plurality of external electronic devices; and a processor connected to the camera, the transparent display, the communication circuit, and the memory, wherein the processor is configured to control the AR glasses device to: acquire an image including an image of at least one external electronic device using the camera; acquire running application information of the at least one external electronic device using the communication circuit; identify a first external electronic device corresponding to a gaze from among the at least one external electronic device from the acquired image; determine whether a specified application is running in the first external electronic device based on the running application information; and connect to the first external electronic device using the communication circuit, based on the specified application running.

2 . The AR glasses device of claim 1 , wherein the processor is configured to identify the first external electronic device corresponding to the gaze of the user from among the at least one external electronic device based on a center of the acquired image or an image size of the first external electronic device in the acquired image.

3 . The AR glasses device of claim 1 , further comprising an eye-tracking sensor, wherein the processor is configured to identify the first external electronic device corresponding to the gaze using the eye-tracking sensor.

4 . The AR glasses device of claim 1 , wherein the processor is configured to identify the first external electronic device by comparing the acquired image with the images in the memory.

5 . The AR glasses device of claim 4 , wherein the processor is configured to control the AR glasses device to display running application information associated with the first external electronic device using the transparent display.

6 . The AR glasses device of claim 1 , wherein the processor is configured to control the AR glasses device to connect to the first external electronic device based on receiving an input for selecting the first external electronic device, wherein
the input includes at least one of an input to a button of the AR glasses device, an input to a controller connected to the AR glasses device, a voice input, or a gesture input.

7 . The AR glasses device of claim 1 , wherein the processor is configured to output content of the AR glasses device using the first external electronic device, based on the connection to the first external electronic device.

8 . The AR glasses device of claim 7 , wherein the processor is configured to:
output the content through a second external electronic device, before the connection to the first external electronic device; and connect to the first external electronic device based on the gaze during the output of the content through the second external electronic device.

9 . The AR glasses device of claim 8 , wherein the specified application includes an application supporting the output of the content.

10 . The AR glasses device of claim 8 , wherein the content includes audio content, and
the processor is configured to control the AR glasses device to: provide a preview of the audio content by playing the audio content through the first external electronic device, based on being connected to the first external electronic device; and release the connection to the second external electronic device based on the gaze to the first external electronic device being maintained for a specified time or longer after the connection to the first external electronic device.

11 . A method for operating an AR glasses device, comprising:
acquiring an image corresponding to a gaze direction and including an image of at least one external electronic device using a camera of the AR glasses device; acquiring running application information of the at least one external electronic device using a communication circuit of the AR glasses device; identifying a first external electronic device corresponding to a gaze from among the at least one external electronic device from the acquired image; determining whether a specified application is running in the first external electronic device based on the running application information; and connect to the first external electronic device using the communication circuit, based on the specified application running.

12 . The method of claim 11 , wherein the identifying of the first external electronic device includes identifying the first external electronic device corresponding to the gaze from among the at least one external electronic device based on a center of the acquired image or an image size of the first external electronic device in the acquired image.

13 . The method of claim 11 , wherein the identifying of the first external electronic device includes identifying the first external electronic device corresponding to the gaze using an eye-tracking sensor of the AR glasses device.

14 . The method of claim 11 , wherein the identifying of the first external electronic device includes identifying the first external electronic device by comparing the acquired image with images of a plurality of external electronic devices stored in a memory of the AR glasses device.

15 . The method of claim 14 , further comprising displaying running application information associated with the first external electronic device.

16 . The method of claim 11 , wherein the connecting to the first external electronic device includes connecting to the first external electronic device based on receiving an input for selecting the first external electronic device, wherein
the input includes at least one of an input to a button of the AR glasses device, an input to a controller connected to the AR glasses device, a voice input, or a gesture input.

17 . The method of claim 11 , further comprising outputting content of the AR glasses device using the first external electronic device, based on the connection to the first external electronic device.

18 . The method of claim 17 , further comprising outputting the content through a second external electronic device, before the connection to the first external electronic device, wherein the connecting to the first external electronic device includes connecting to the first external electronic device based on the gaze during the output of the content through the second external electronic device.

19 . The method of claim 18 , wherein the specified application includes an application supporting the output of the content.

20 . The method of claim 19 , wherein the content includes audio content, and
the method further comprises: providing a preview of the audio content by playing the audio content through the first external electronic device, based on being connected to the first external electronic device; and releasing the connection to the second external electronic device based on the gaze to the first external electronic device being maintained for a specified time or longer after the connection to the first external electronic device.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Myung Insik
• Jung Shinjae
• Choi Inyoung
• Han Hoon

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title