Glasses-type wearable device providing augmented reality guide and method for controlling the same

Patent metadata

Field	Value
Publication number	US-12039096-B2
Application number	US-202217867077-A
Country	US
Kind code	B2
Filing date	Jul 18, 2022
Priority date	Jul 19, 2021
Publication date	Jul 16, 2024
Grant date	Jul 16, 2024

Abstract

A glasses-type wearable device providing an augmented reality guide and a method for controlling the same is provided. The glasses-type wearable device includes a communication circuit, a camera, and a processor configured to receive a second surrounding-image of an external electronic device connected with the glasses-type wearable device from the external electronic device through the communication module while obtaining a first surrounding-image of the glasses-type wearable device using the camera, identify a first task being performed by a user of the glasses-type wearable device using the first surrounding-image and a second task being performed by a user of the external electronic device using the second surrounding-image, identify a difference between a current progress status of the first task and second task, and control the communication circuit to provide an AR guide corresponding to the second task to the external electronic device, based on the identified difference in progress status.

First claim

The invention claimed is:

1. A glasses-type wearable device comprising:
a communication circuit;
at least one camera;
at least one processor, and
memory, wherein the memory stores instructions that, when executed by the at least one processor, cause the glasses-type wearable device to:
receive a second surrounding image of an external electronic device operably connected with the glasses-type wearable device, obtained by the external electronic device through the communication circuit while obtaining a first surrounding image of the glasses-type wearable device using the at least one camera,
identify a first task being performed by a user of the glasses-type wearable device using the first surrounding image and a second task being performed by a user of the external electronic device using the second surrounding image,
identify a difference between a current progress status of the first task and a current progress status of the second task, and
control the communication circuit to provide an augmented reality (AR) guide corresponding to the second task to the external electronic device, based on the identified difference.

2. The glasses-type wearable device of claim 1 ,
wherein the memory is configured to store information about an operation comprising the first task and the second task, and
wherein the operation is divided into a plurality of tasks and stored in the memory.

3. The glasses-type wearable device of claim 1 , further comprising a display,
wherein the instructions, when executed by the processor, cause the glasses-type wearable device to control the display to represent an image for the second task, as a virtual object, through the glasses-type wearable device.

4. The glasses-type wearable device of claim 1 , wherein the instructions that cause the glasses-type wearable device to control the communication circuit to transmit a request for transmitting information about the AR guide to a server storing the information about the AR guide to allow the information about the AR guide to be transmitted from the server to the external electronic device.

5. The glasses-type wearable device of claim 1 , wherein the AR guide comprises a pilot image for the second task.

6. The glasses-type wearable device of claim 5 , wherein the pilot image is provided to the external electronic device differently depending on a task performing level corresponding to the external electronic device.

7. The glasses-type wearable device of claim 6 , wherein the instructions that cause the glasses-type wearable device to receive information about the task performing level corresponding to the external electronic device from the external electronic device through the communication circuit.

8. A method comprising:
receiving a second surrounding image of an external electronic device operably connected with a glasses-type wearable device, obtained by the external electronic device, from the external electronic device through a communication circuit of the glasses-type wearable device while obtaining a first surrounding image of the glasses-type wearable device using at least one camera of the glasses-type wearable device;
identifying a first task being performed by a user of the glasses-type wearable device using the first surrounding image and a second task being performed by a user of the external electronic device using the second surrounding image;
identifying a difference between a current progress status of the first task and a current progress status of the second task; and
controlling the communication circuit to provide an augmented reality (AR) guide corresponding to the second task to the external electronic device, based on the identified difference.

9. The method of claim 8 ,
storing, in memory of the glasses-type wearable device, information about an operation comprising the first task and the second task, and
wherein the operation is divided into a plurality of tasks and stored in the memory.

10. The method of claim 8 , further comprising:
controlling a display to of the glasses-type wearable device represent an image for the second task, as a virtual object, through the glasses-type wearable device.

11. The method of claim 8 , further comprising controlling the communication circuit to transmit a request for transmitting information about the AR guide to a server storing the information about the AR guide to allow the information about the AR guide to be transmitted from the server to the external electronic device.

12. The method of claim 8 , wherein the AR guide comprises a pilot image for the second task.

13. The method of claim 12 , wherein the pilot image is provided to the external electronic device differently depending on a task performing level corresponding to the external electronic device.

14. The method of claim 13 , further comprising receiving information about the task performing level corresponding to the external electronic device from the external electronic device through the communication circuit.

15. The method of claim 14 , wherein the task performing level is one of beginner, intermediate or advanced.

16. The method of claim 14 , wherein the pilot image is displayed corresponding to a next task without performing a current task according to the task performing level of a task corresponding to the external electronic device.

17. The method of claim 14 , further comprising displaying a status bar comprising an indicator of each task in a sequence of tasks being performed by the user of the glasses-type wearable device and the user of the external electronic device.

18. A computer-readable non-volatile recording medium storing instructions configured to perform one or more operations by a processor, the one or more operations comprising:
receiving, through a communication circuit of a glasses-type wearable device, a second surrounding image of an external electronic device operably connected with the glasses-type wearable device, obtained by the external electronic device, from the external electronic device while obtaining a first surrounding image of the glasses-type wearable device using at least one camera of the glasses-type wearable device;
identifying a first task being performed by a user of the glasses-type wearable device using the first surrounding image and a second task being performed by a user of the external electronic device using the second surrounding image;
identifying a difference between a current progress status of the first task and a current progress status of the second task; and
controlling the communication circuit to provide an augmented reality (AR) guide corresponding to the second task to the external electronic device, based on the identified difference.

Assignees

• Samsung Electronics Co Ltd

Inventors

• Shin Boosun
• Kim Sungman
• Kim Leebin
• Kim Jieun
• Kim Hyunjung
• Lee Boram
• Jung Jaemin
• Han Ahreum

Classifications

• G02B27/017

  Head mounted · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G06T2219/2021

  Shape modification · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title