Screen sharing method and electronic device therefor

Patent metadata

Field	Value
Publication number	US-2024020084-A1
Application number	US-202318374267-A
Country	US
Kind code	A1
Filing date	Sep 28, 2023
Priority date	Apr 6, 2021
Publication date	Jan 18, 2024
Grant date	—

Abstract

An electronic device includes a communication circuit, a display, a memory, and a processor operatively connected to the communication circuit, the display, and the memory. The memory is configured to store one or more instructions which, when executed, allow the processor to: establish a communication connection, for screen sharing, with an external electronic device via the communication circuit; determine a first area, which is shared with the external electronic device, in a screen output on the display; identify a second area, which is selected based on a user input, in the screen; and transmit, to the external electronic device, image data of a third screen in which a first screen corresponding to the first area and a second screen corresponding to the second area are synthesized.

First claim

What is claimed is:

1 . An electronic device comprising:
communication circuitry; a display; a memory; and a processor operationally connected to the communication circuitry, the display, and the memory, wherein the memory stores one or more instructions: that, when executed, cause the processor to: establish a communication connection for screen sharing with an external electronic device through the communication circuitry; determine a first region shared with the external electronic device on a screen that is output on the display; identify a second region selected on the screen based on a user input; and transmit, to the external electronic device, image data about a third screen obtained by combining a first screen corresponding to the first region and a second screen corresponding to the second region.

2 . The electronic device of claim I, wherein the instructions cause the processor to:
identify a type of an object included in the second region; and determine a layout of the third screen, based on the type of the object, and wherein the layout includes a width to height ratio of the second region and a position of the second screen relative to the first screen on the third screen.

3 . The electronic device of claim 2 , wherein the instructions cause the processor to:
determine the width to height ratio of the second region as a ratio in which a vertical length is greater than a horizontal length, when it is determined that the type of the object is a person.

4 . The electronic device of claim 2 , wherein the instructions cause the processor to:
identify a width to height ratio of the object; determine the width to height ratio of the second region as a ratio in which a vertical length is greater than a horizontal length, when it is determined that a vertical length of the object is greater than a horizontal length of the object; and determine the width to height ratio of the second region as a ratio in which a horizontal length is greater than a vertical length, when it is determined that the horizontal length of the object is greater than the vertical length of the object.

5 . The electronic device of claim 2 , wherein the instructions cause the processor to:
determine to locate the second screen on a left or right side of the first screen on the third screen, when it is determined that a vertical length of the second region is greater than a horizontal length of the second region; and determine the position of the second screen relative to the first screen on the third screen depending on a width to height ratio of the first region, when it is determined that the horizontal length of the second region is greater than the vertical length of the second region.

6 . The electronic device of claim 5 , wherein the instructions cause the processor to:
determine to locate the second screen on an upper or lower side of the first screen on the third screen, when it is determined that the horizontal length of the second region is greater than the vertical length of the second region and a horizontal length of the first region is greater than a vertical length of the first region; and determine to locate the second screen on the left or right side of the first screen the third screen, when it is determined that the horizontal length of the second region is greater than the vertical length of the second region and the vertical length of the first region is greater than the horizontal length of the first region.

7 . The electronic device of claim 1 , wherein the instructions cause the processor to:
identify a type of an object included in the second region; determine whether a background of the object changes on the second screen as time passes, when it is determined that the type of the object is text; and form the third screen by combining a fourth screen obtained by adjusting the background of the object on the second screen with the first screen.

8 . The electronic device of claim 1 , wherein the instructions cause the processor to:
recognize an object included in the second region; track a position of the recognized object on the screen; and determine a region including the object, the position of which is tracked, as the second region.

9 . The electronic device of claim 8 , wherein the instructions cause the processor to:
form the third screen by combining the second screen at a time point when the position of the object was most recently recognized with the first screen, when the position of the object is not recognized on the screen.

10 . The electronic device of claim 1 , wherein the instructions cause the processor to:
receive a user input for selection of at least one region of the screen and recognize at least one object included in the selected at least one region; display at least one image corresponding to a region including the recognized. at least one object the display; and receive a user input for selection of a first image among the at least one image and identify the second region including a first object corresponding to the selected first image.

11 . A method for sharing, by an electronic device, a screen with an external electronic device, the method comprising:
establishing a communication connection for screen sharing with the external electronic device through communication circuitry of the electronic device; determining a first region shared with the external electronic device on a screen that is output on a display of the electronic device; identifying a second region selected on the screen based on a user input; and transmitting, to the external electronic device, image data about a third screen obtained by combining a first screen corresponding to the first region and a second screen corresponding to the second region.

12 . The method of claim 11 , further comprising:
identifying a type of an object included in the second region; and determining a layout of the third screen, based on the type of the object, and wherein the layout includes a width to height ratio of the second region and a position of the second screen relative to the first screen on the third screen.

13 . The method of claim 12 , further comprising:
determining the width to height ratio of the second region as a ratio in which a vertical length is greater than a horizontal length, when it is determined that the type of the object is a person.

14 . The method of claim 12 , further comprising:
identifying a width to height ratio of the object; determining the width to height ratio of the second region as a ratio in which a vertical length is greater than a horizontal length, when it is determined that a vertical length of the object is greater than a horizontal length of the object; and determining the width to height ratio of the second region as a ratio in which a horizontal length is greater than a vertical length, when it is determined that the horizontal length of the object is greater than the vertical length of the object.

15 . The method of claim 12 , further comprising:
determining to locate the second screen on a left or right side of the first screen on the third screen, when it is determined that a vertical length of the second region is greater than a horizontal length of the second region; and determining the position of the second screen relative to the first screen on the third screen depending on a width to height ratio of the first region, when it is determined that the horizontal length of the second region is greater than the vertical length of the second region.

16 . The method of claim

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Miyoung
• Kang Donggoo
• Kim Hyunjin
• Bae Jooyoon

Classifications

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F2203/04803

  Split screen, i.e. subdividing the display area or the window area into separate subareas · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F3/1454 Primary

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title