Screen sharing method and electronic device therefor

Patent metadata

Field	Value
Publication number	US-12430091-B2
Application number	US-202318374267-A
Country	US
Kind code	B2
Filing date	Sep 28, 2023
Priority date	Apr 6, 2021
Publication date	Sep 30, 2025
Grant date	Sep 30, 2025

Abstract

An electronic device includes a communication circuit, a display, a memory, and a processor operatively connected to the communication circuit, the display, and the memory. The memory is configured to store one or more instructions which, when executed, allow the processor to: establish a communication connection, for screen sharing, with an external electronic device via the communication circuit; determine a first area, which is shared with the external electronic device, in a screen output on the display; identify a second area, which is selected based on a user input, in the screen; and transmit, to the external electronic device, image data of a third screen in which a first screen corresponding to the first area and a second screen corresponding to the second area are synthesized.

First claim

What is claimed is:

1. An electronic device comprising:
communication circuitry;
a display;
memory; and
a processor operationally connected to the communication circuitry, the display, and the memory,
wherein the memory stores one or more instructions that, when executed by the processor, cause the electronic device to:
establish a communication connection for screen sharing with an external electronic device through the communication circuitry;
determine a first region shared with the external electronic device on a screen that is output on the display;
identify a second region selected on the first region based on a user input; and
transmit, to the external electronic device, image data about a third screen obtained by combining a first screen corresponding to the first region and a second screen corresponding to the second region,
wherein the second region includes a part of the first region,
wherein an enlargement magnification of the first region is different from an enlargement magnification of the second region,
wherein a layout of the third screen is determined based on an object included in the second region,
wherein the layout includes a width to height ratio of the second region, and
wherein the instructions that, when executed by the processor, cause the electronic device to:
identify the object included in the second region;
identify a width to height ratio of the object;
determine a width to height ratio of the second region as a ratio in which a vertical length is greater than a horizontal length, when it is determined that a vertical length of the object is greater than a horizontal length of the object; and
determine the width to height ratio of the second region as a ratio in which a horizontal length is greater than a vertical length, when it is determined that the horizontal length of the object is greater than the vertical length of the object.

2. The electronic device of claim 1 ,
wherein the layout further includes a position of the second screen relative to the first screen on the third screen.

3. The electronic device of claim 2 , wherein the instructions that, when executed by the processor, cause the electronic device to:
identify a type of the object included in the second region; and
determine the width to height ratio of the second region as a ratio in which a vertical length is greater than a horizontal length, when it is determined that the type of the object is a person.

4. The electronic device of claim 2 , wherein the instructions that, when executed by the processor, cause the electronic device to:
determine to locate the second screen on a left or right side of the first screen on the third screen, when it is determined that a vertical length of the second region is greater than a horizontal length of the second region; and
determine the position of the second screen relative to the first screen on the third screen depending on a width to height ratio of the first region, when it is determined that the horizontal length of the second region is greater than the vertical length of the second region.

5. The electronic device of claim 4 , wherein the instructions that, when executed by the processor, cause the electronic device to:
determine to locate the second screen on an upper or lower side of the first screen on the third screen, when it is determined that the horizontal length of the second region is greater than the vertical length of the second region and a horizontal length of the first region is greater than a vertical length of the first region; and
determine to locate the second screen on the left or right side of the first screen on the third screen, when it is determined that the horizontal length of the second region is greater than the vertical length of the second region and the vertical length of the first region is greater than the horizontal length of the first region.

6. The electronic device of claim 1 , wherein the instructions that, when executed by the processor, cause the electronic device to:
identify a type of the object included in the second region;
determine whether a background of the object changes on the second screen as time passes, when it is determined that the type of the object is text; and
form the third screen by combining a fourth screen obtained by adjusting the background of the object on the second screen with the first screen.

7. The electronic device of claim 1 , wherein the instructions that, when executed by the processor, cause the electronic device to:
identify the object included in the second region;
track a position of the identified object on the screen; and
determine a region including the object, the position of which is tracked, as the second region.

8. The electronic device of claim 7 , wherein the instructions that, when executed by the processor, cause the electronic device to:
form the third screen by combining the second screen at a time point when the position of the object was most recently identified with the first screen, when the position of the object is not identified on the screen.

9. The electronic device of claim 1 , wherein the instructions that, when executed by the processor, cause the electronic device to:
receive a user input for selection of at least one region of the first screen and identify at least one object included in the selected at least one region;
display at least one image corresponding to a region including the identified at least one object on the display; and
receive a user input for selection of a first image among the at least one image and identify the second region including a first object corresponding to the selected first image.

10. A method for sharing, by an electronic device, a screen with an external electronic device, the method comprising:
establishing a communication connection for screen sharing with the external electronic device through communication circuitry of the electronic device;
determining a first region shared with the external electronic device on a screen that is output on a display of the electronic device;
identifying a second region selected on the first region based on a user input; and
transmitting, to the external electronic device, image data about a third screen obtained by combining a first screen corresponding to the first region and a second screen corresponding to the second region,
wherein the second region includes a part of the first region,
wherein an enlargement magnification of the first region is different from an enlargement magnification of the second region,
wherein the combining the first screen corresponding to the first region and the second screen corresponding to the second region comprising determining a layout of the third screen, based on an object included in the second region,
wherein the layout includes a width to height ratio of the second region, and
wherein the determining the layout of the third screen comprising:
identifying the object included in the second region;
identifying a width to height ratio of the object;
determining a width to height ratio of the second region as a ratio in which a vertical length is greater than a horizontal length, when it is determined that a vertical length of the object is greater than a horizontal length of the object; and
determining the width to height ratio of the second region as a ratio in which a horizontal length is greater than a vertical length, when it is determined that the horizontal length of the object is greater than the vertical length of the object.

11. The method of claim 10 ,
wherein the layout further includes a position of the second screen relative to the first screen on the th

Assignees

• Samsung Electronics Co Ltd

Inventors

• Lee Miyoung
• Kang Donggoo
• Kim Hyunjin
• Bae Jooyoon

Classifications

• G06T2207/30196

  Human being; Person · CPC title

• G06T2207/20092

  Interactive image processing based on input by user · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T7/60

  Analysis of geometric attributes · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title