Electronic device, augmented reality device for providing augmented reality service, and method of operating same

Patent metadata

Field	Value
Publication number	US-2020168177-A1
Application number	US-201916682595-A
Country	US
Kind code	A1
Filing date	Nov 13, 2019
Priority date	Nov 26, 2018
Publication date	May 28, 2020
Grant date	—

Abstract

An electronic device is provided. The electronic device comprises a touchscreen, a communication module, and at least one processor operatively connected with the touchscreen and the communication module. The at least one processor is configured to establish a communication connection with an augmented reality (AR) device using the communication module, transmit data for display of a first content to the AR device using the communication module, display a first user interface for controlling the first content on the touchscreen, transmit data for display of the first content varied by a first input received through the first user interface to the AR device using the communication module, transmit data for display of a second content different from the first content to the AR device using the communication module, display a second user interface for controlling the second content on the touchscreen, and transmit data for display of the second content varied by a second input received through the second user interface to the AR device using the communication module. Other various embodiments are possible as well.

First claim

What is claimed is:

1 . An electronic device, comprising:
a touchscreen; a communication module; and at least one processor operatively connected with the touchscreen and the communication module, wherein the at least one processor is configured to:
establish a communication connection with an augmented reality (AR) device using the communication module,
transmit data for display of a first content to the AR device using the communication module,
display a first user interface for controlling the first content on the touchscreen,
transmit data for display of the first content varied by a first input received through the first user interface to the AR device using the communication module,
transmit data for display of a second content different from the first content to the AR device using the communication module,
display a second user interface for controlling the second content on the touchscreen, and
transmit data for display of the second content varied by a second input received through the second user interface to the AR device using the communication module.

2 . The electronic device of claim 1 , wherein the at least one processor, as at least part of displaying the second user interface for controlling the second content on the touchscreen, is further configured to:
change a focused content from the first content to the second content, and display the second user interface for controlling the second content based on the change in the focused content.

3 . The electronic device of claim 2 , wherein the at least one processor, as at least part of changing the focused content from the first content to the second content, is further configured to:
detect the focus change event from the first content to the second content, and change the focused content from the first content to the second content in response to detection of the focus change event, or detect a display position change event set to change a position of display of the first content or a position of display of the second content, and change the focused content from the first content to the second content in response to detection of the position change event.

4 . The electronic device of claim 1 ,
wherein the at least one processor, as at least part of transmitting the data for display of the first content to the AR device, is further configured to transmit information about position of display of the first content along with the data for display of the first content to the AR device, and wherein the at least one processor, as at least part of transmitting the data for display of the second content to the AR device, is further configured to transmit information about position of display of the second content along with the data for display of the second content to the AR device.

5 . The electronic device of claim 4 , wherein at least one of the information about the position of display of the first content or information about the position of display of the second content is information indicating at least one of a plurality of display areas set relative to the electronic device.

6 . The electronic device of claim 5 , wherein the plurality of display areas set relative to the electronic device include a plurality of display areas each of which corresponds to one of a plurality of different directions relative to the electronic device.

7 . The electronic device of claim 5 , wherein the plurality of display areas set relative to the electronic device include a plurality of display areas positioned in a first direction relative to the electronic device.

8 . The electronic device of claim 7 , wherein the plurality of display areas positioned in the first direction are distinguished by at least one of depth position information or sorting order information.

9 . The electronic device of claim 4 , wherein the at least one processor is further configured to, based on at least one of the information about the position of display of the first content or the information about the position of display of the second content being changed, transmit at least one of information about the changed position of display of the first content or the changed position of display of the second content to the AR device using the communication module.

10 . The electronic device of claim 1 , wherein the at least one processor is further configured to display third content different from the first content and the second content on the touchscreen while transmitting the first content and the second content to the AR device.

11 . The electronic device of claim 10 ,
wherein the first content is associated with a first application executed on the electronic device, and the third content is associated with a second application different from the first application, or wherein the first content and the third content are associated with one application executed on the electronic device.

12 . The electronic device of claim 10 ,
wherein the at least one processor, as at least part of displaying the third content on the touchscreen, is further configured to:
display an execution screen of a first application,
obtain an enlarge command for the execution screen of the first application, and
display a first portion of the enlarged execution screen of the first application, as the third content, on the touchscreen based on the enlarge command, and
wherein the at least one processor, as at least part of transmitting the data for display of the second content to the AR device, is further configured to transmit data for display of a second portion of the enlarged execution screen of the first application, as the data for display of the second content, to the AR device using the communication module.

13 . An augmented reality (AR) device, comprising:
at least one sensor; a display device configured to display an image while transmitting at least part of light incident from an outside; a communication module; and at least one processor operatively connected with the least one sensor, the display, and the communication module, wherein the at least one processor is configured to:
identify a position of an electronic device relative to the AR device based on sensing data obtained through the at least one sensor,
establish a communication connection with the electronic device using the communication module,
receive data for display of at least one content from the electronic device using the communication module,
identify a position of display of the at least one content on the display device based on the position of the electronic device, and
display the at least one content in the identified position of display on the display device.

14 . The AR device of claim 13 , wherein the at least one processor, as at least part of identifying the position of the electronic device relative to the AR device, is further configured to:
compare the sensing data obtained through the at least one sensor with association information between at least one piece of sensing data and at least one position, and identify the position of the electronic device relative to the AR device based on a result of the comparison.

15 . The AR device of claim 13 , wherein the at least one processor, as at least part of identifying the position of the electronic device relative to the AR device, is further configured to:
receive information including at least one of a size, shape, or identification information about the electronic device from the electronic device using the communication module, obtain a captured image of the electronic device through the at leas

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Jueun
• Moon Choonkyoung
• Jung Shinjae

Classifications

• G09G2370/20

  Details of the management of multiple sources of image data · CPC title

• G09G2370/06

  Consumer Electronics Control, i.e. control of another device by a display or vice versa · CPC title

• G09G5/14 Primary

  Display of multiple viewports · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F2203/04803

  Split screen, i.e. subdividing the display area or the window area into separate subareas · CPC title