Electronic device and screen capturing method thereof

Patent metadata

Field	Value
Publication number	US-11188359-B2
Application number	US-202017027033-A
Country	US
Kind code	B2
Filing date	Sep 21, 2020
Priority date	Sep 20, 2019
Publication date	Nov 30, 2021
Grant date	Nov 30, 2021

Abstract

A method for intelligent screen capture in an electronic device includes: receiving, by the electronic device, a user input for capturing a screenshot of contents displayed on a screen of the electronic device; dividing, by the electronic device, the screen of the electronic device into a plurality of blocks, each of the plurality of blocks including inter-related contents displayed on the screen of the electronic device; identifying, by the electronic device, at least one block from the plurality of blocks based on a plurality of parameters; and displaying, by the electronic device, a guide user interface for capturing the screenshot of the at least one block.

First claim

The invention claimed is:

1. A method for controlling an electronic device, the method comprising:
receiving, by the electronic device, a user input for capturing a screenshot of contents displayed on a screen of the electronic device, the user input being provided by a user of the electronic device;
recognizing, by the electronic device, the contents displayed on the screen, wherein each individual content is recognized as one from among an image, a text string, and an icon;
identifying, by the electronic device, the contents having a semantic relationship based on the recognizing;
dividing, by the electronic device, the screen into a plurality of blocks based on the identified semantic relationship;
obtaining a rank for each block based on a plurality of parameters;
identifying, by the electronic device, at least one block to be captured as the screenshot, from the plurality of blocks based the obtained rank of the each block; and
displaying, by the electronic device, a guide user interface for capturing the screenshot of the at least one block.

2. The method as claimed in claim 1 , wherein the identifying the at least one block further comprises:
mapping, by the electronic device, each block from the plurality of blocks based on the plurality of parameters to obtain the rank of the each block; and
selecting, by the electronic device, a block having a highest rank from the plurality of blocks as the at least one block to be captured as the screenshot.

3. The method as claimed in claim 1 , wherein the plurality of parameters comprises at least one of a layout of the plurality of blocks, an application type, a type of content, an application identification (ID), a screen ID, or user-specific parameters including at least one of a history of user action specific to a contents type, a current location of the user, or a browsing pattern or history of the user.

4. The method as claimed in claim 1 , further comprising:
obtaining a screen identification (ID) of the contents displayed on the screen, based on the dividing the screen.

5. The method as claimed in claim 4 , wherein the obtaining the screen ID of the contents further comprises:
extracting, by the electronic device, a screen pattern based on the divided screen of the electronic device;
identifying, by the electronic device, whether the extracted screen pattern matches at least one stored screen pattern stored in the electronic device; and
performing, by the electronic device, one of:
assigning the screen ID to the contents displayed on the screen based on the identifying that the extracted screen pattern matches the at least one stored screen pattern, or
assigning a new screen ID to the contents displayed on the screen based on the identifying that the extracted screen pattern does not match the at least one stored screen pattern, and storing the new screen ID in the electronic device.

6. The method as claimed in claim 5 , wherein the identifying whether the extracted screen pattern matches the at least one stored screen pattern further comprises:
identifying, by the electronic device, at least one static block associated with the extracted screen pattern, by comparing the extracted screen with the at least one stored screen pattern;
arranging, by the electronic device, the extracted screen pattern based on a block distance score calculation;
calculating, by the electronic device, a block-wise difference score between the extracted screen pattern and each of the at least one stored screen pattern for the at least one static block and at least one dynamic block, respectively;
calculating, by the electronic device, a pattern difference score based on the block-wise difference score calculated for the at least one stored screen pattern and the block-wise difference score calculated for the at least one dynamic block;
identifying, by the electronic device, whether the pattern difference score is higher than a threshold; and
performing, by the electronic device, one of:
identifying that the extracted screen pattern matches the at least one stored screen pattern based on the identifying that the pattern difference score is higher than the threshold, or
identifying that the extracted screen pattern does not match the at least one stored screen pattern based on the identifying that the pattern difference score is lower than the threshold.

7. The method as claimed in claim 1 , further comprising:
capturing the screenshot of the at least one block;
identifying, by the electronic device, whether at least one suggestion for at least one another block is received via a user selection input from the user through the electronic device; and
performing, by the electronic device, one of:
sharing the screenshot of the at least one block with at least one another user based on the identifying that the at least one suggestion for the at least one another block is not received from the user of the electronic device, or
sharing the screenshot of the at least one another block with the at least one another user based on the identifying that the at least one suggestion for the at least one another block is received from the user of the electronic device.

8. The method as claimed in claim 1 , wherein the at least one block is highlighted to capture the screenshot.

9. The method as claimed in claim 2 , wherein the rank is modified based on at least one action associated with the user of the electronic device, and
wherein the at least one action comprises at least one of a zoom-in action, a zoom-out action, or a scrolling action.

10. The method as claimed in claim 1 , wherein the plurality of blocks comprises at least one of at least one image block, at least one icon block, or at least one text block.

11. The method as claimed in claim 1 , further comprising:
capturing the screenshot of the at least one block;
storing the screenshot of the at least one block in the electronic device; and
using the screenshot to perform at least one action,
wherein the at least one action comprises at least one of editing on the screenshot of the at least one block or sharing the screenshot of the at least one block with at least one another user.

12. The method as claimed in claim 1 , wherein the semantic relationship of the contents is identified by at least one of a position or a proximity of the contents, respectively.

13. An electronic device comprising:
a memory;
a display; and
a processor coupled to the memory and configured to:
receive a user input for capturing a screenshot of contents displayed on a screen of the electronic device,
recognize the contents displayed on the screen, wherein each individual content is recognized as one from among an image, a text string, and an icon,
identify the contents having a semantic relationship based on the recognizing,
divide the screen into a plurality of blocks based on the identified semantic relationship,
obtain a rank for each block based on a plurality of parameters,
identify at least one block to be captured as the screenshot, from the plurality of blocks based on the obtained rank of the each block, and
control the display to display a guide user interface for capturing the screenshot of the at least one block.

14. The electronic device as claimed in claim 13 , wherein the processor is further configured to:
map each block from the plurality of blocks based on the plurality of parameters to obtain the rank of the each block; and
select a block having a highest rank from the plurality of blocks as the at least one block to be captured as the screenshot.

15. The electronic device as c

Assignees

• Samsung Electronics Co Ltd

Inventors

• Thota Siva Prasad
• Purre Naresh
• Mohanty Debi Prasanna
• MOHARANA Sukumar
• Munjal Rachit Sindhi
• Goyal Manoj
• Nagaraju Divija
• Singh Kriti
• Garg Deepak
• Batra Chirag

Classifications

• G06F3/04842 Primary

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06V30/19133

  Interactive pattern learning with a human teacher · CPC title

• G06V10/267

  by performing operations on regions, e.g. growing, shrinking or watersheds · CPC title

• G06V30/19173

  Classification techniques · CPC title

• G06V10/75

  Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries · CPC title