Systems and methods for screenshot linking

Patent metadata

Field	Value
Publication number	US-2020372069-A1
Application number	US-202016989573-A
Country	US
Kind code	A1
Filing date	Aug 10, 2020
Priority date	Jul 15, 2015
Publication date	Nov 26, 2020
Grant date	—

Abstract

Systems and methods of the present disclosure are directed to analyzing screenshots A system can include a computing device including a processor coupled to a memory and a display screen configured to display content. The system can include an application stored on the memory and executable by the processor. The application can include a screenshot receiver configured to access, from storage to which a screenshot of the content displayed on the display screen captured using a screenshot function of the computing device is stored, the screenshot including an image and a predetermined marker. The application can include a marker detector configured to detect the predetermined marker included in the screenshot. The application can include a link identifier configured to identify, using the predetermined marker, a link to a resource mapped to the image included in the screenshot, the resource accessible by the computing device via the link.

First claim

1 - 24 . (canceled)

25 . A method for processing image data comprising:
receiving a set of image data generated from a screenshot of a display device at a processor; processing the set of image data with the processor in response to instructions fetched from a memory device to identify a plurality of visual elements in the set of image data that have a pre-existing association with an application software program; detecting the set of image data included in the screenshot from storage in a central database of sets of image data and associated metadata using the processor; identifying a link to the associated metadata using the processor; and accessing the associated metadata via the link using the processor.

26 . The method of claim 25 , wherein a remote processor from which the screenshot is generated is accessible by the software application programs executing on the remote processor.

27 . The method of claim 25 , wherein the set of image data includes a visual marker added to the set of image data included in the screenshot.

28 . The method of claim 25 , wherein the set of image data includes metadata uniquely identifying the set of image data included in the screenshot.

29 . The method of claim 25 , wherein the set of image data includes a code comprising a string of characters.

30 . The method of claim 25 , further comprising:
comparing the set of image data to a plurality of reference markers; determining a match between the set of image data and one of the plurality of reference markers; and selecting the link based on the one of the plurality of reference markers.

31 . The method of claim 25 , wherein accessing the associated metadata via the link comprises accessing the associated metadata responsive to selection of the link from a notification including the link.

32 . The method of claim 25 , wherein the link comprises a deep link corresponding to a resource within an application software program.

33 . A system for analyzing screenshots to identify links to resources comprising:
a processor coupled to a memory and a display screen configured to display content; an application stored in the memory and executable by the processor, the application including: a screenshot receiver configured to access, from a storage device, the screenshot including a set of image data; and a link identifier configured to identify a link to a resource mapped to the image data, the resource accessible by the processor via the link.

34 . The system of claim 33 , wherein the storage device to which the screenshot is stored is accessible by multiple applications executing on the processor.

35 . The system of claim 33 , wherein a predetermined marker within the set of image data includes a visual marker added to the set of image data included in the screenshot.

36 . The system of claim 33 , wherein a predetermined marker within the set of image data includes metadata uniquely identifying the set of image data.

37 . The system of claim 33 , wherein a predetermined marker within the set of image data includes a code comprising a string of characters.

38 . The system of claim 33 , further comprising a screenshot linking server configured to:
receive a predetermined marker from the processor; compare the predetermined marker to a plurality of reference markers; determine a match between the predetermined marker and one of the plurality of reference markers; and select the link based on the one of the plurality of reference markers.

39 . The system of claim 33 , wherein the application is a first application and wherein the link comprises a deep link corresponding to a resource within a second application executable on the processor.

40 . A method for analyzing screenshots to identify links to resources, comprising:
accessing a screenshot including a set of image data using a processor; extracting data corresponding to the set of image data included in the screenshot using the processor; generating a fingerprint identifying the set of image data using the processor, wherein the fingerprint is generated based on the data corresponding to the set of image data; identifying a link to a resource mapped to the fingerprint of the set of image data using the processor; and accessing the resource via the link.

41 . The method of claim 40 , further comprising identifying the set of image data from the screenshot by performing image entropy analysis on the screenshot to determine a portion of the screenshot that corresponds to the set of image data.

42 . The method of claim 40 , wherein the link comprises a deep link corresponding to a resource within a second application.

43 . The method of claim 40 , wherein identifying the link to the resource mapped to the fingerprint of the set of image data further comprises identifying the link responsive to determining a match between the fingerprint and a plurality of reference fingerprints based on a comparison of the fingerprint of the image to a plurality of reference fingerprints.

Assignees

• Rewardstyle Inc

Inventors

• Pearlman Jason Ellis
• Mablekos Elias Jason
• Cummins Andrew

Classifications

• G06F16/5866 Primary

  using information manually generated, e.g. tags, keywords, comments, manually generated location and time information · CPC title

• G06F16/9566 Primary

  URL specific, e.g. using aliases, detecting broken or misspelled links · CPC title

• G06V10/462

  Salient features, e.g. scale invariant feature transforms [SIFT] · CPC title

• G06V10/40

  Extraction of image or video features · CPC title

• G06F16/51

  Indexing; Data structures therefor; Storage structures · CPC title