Dynamically enabling an interactive element within a non-interactive view of a screen sharing session

Patent metadata

Field	Value
Publication number	US-10649608-B2
Application number	US-201715716088-A
Country	US
Kind code	B2
Filing date	Sep 26, 2017
Priority date	Feb 20, 2014
Publication date	May 12, 2020
Grant date	May 12, 2020

Abstract

A non-interactive screen sharing session executing within a computing device can be identified. The device can be communicatively linked to different computing devices of the screen sharing session. The contents of the remote screen buffer can be analyzed to determine a graphical representation of a Uniform Resource Locator (URL) within the contents prior to presenting the contents of the buffer within the device. A visible information item can be extracted and a non-visible reference can be established from the representation. An area surrounding the representation including a position and dimensions of the representation within the contents can be determined. The representation of the URL can be replaced with an interactive element in real-time. The element can include the visible and non-visible reference. The contents of the buffer can be presented within an interface associated with the session of the device, responsive to the replacing.

First claim

What is claimed is:

1. A computer program product comprising a computer readable storage medium having computer usable program code embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the computer usable program code enabled upon execution in memory of a computer to perform a method comprising:
establishing a non-interactive screen sharing session between a Web browser executing in memory of a receiving computing device and a sending computing device;
identifying a screen buffer for the Web browser containing a graphical representation of a Uniform Resource Locator (URL) disposed within the contents prior to presenting the contents of the screen buffer within the Web browser executing in the memory of the computing device;
extracting from the graphical representation of the URL, a text form of the URL using optical character recognition of an image of the URL and then regular expression matching the text form of the URL against known URL expressions;
determining an area surrounding the graphical representation comprising of a position and dimensions of the graphical representation within the contents utilizing feature detection and edge detection;
replacing the graphical representation of the URL in the screen buffer with an interactive element in real-time, wherein the interactive element including the text form of the URL that when selected transmits a request by the Web browser to retrieve a Web page at the URL;
responsive to the replacing, presenting the contents of the screen buffer within the Web browser; and,
on condition that the graphical representation of the URL is not determined during the extracting, manually selecting the graphical representation of the URL using a selection tool upon the contents of the screen buffer once presented in the Web browser and then performing the extracting, replacing and presenting.

2. The computer program product of claim 1 , wherein the method further comprises:
associating the interactive element with an application executing within the computing device, wherein the application is external to the session.

3. The computer program product of claim 1 , wherein the method further comprises:
programmatically interpreting or accessing a resource associated with the interactive element within an application.

4. The computer program product of claim 1 , wherein the method further comprises: presenting at least one interface option within the Web browser responsive to selecting the interactive element.

5. The computer program product of claim 1 , wherein the non-interactive screen sharing session is at least one of a slide show presentation or a whiteboard presentation.

6. The computer program product of claim 1 , wherein the interactive element is an image associated with the URL that is associated with a networked resource, a phone number, or an email address.

7. The computer program product of claim 1 , wherein the method further comprises: determining a change in at least one of the position and dimension of the area surrounding the graphical representation of the URL; and dynamically updating the interactive element within the screen buffer correspondingly.

8. A system for providing interactivity for a view only teleconference comprising:
a computer with memory and at least one processor;
a collaboration engine comprising computer program instructions executing in the memory by the processor of the computer, the instructions performing a method comprising:
establishing a non-interactive screen sharing session between a Web browser executing in memory of a receiving computing device and a sending computing device;
identifying a screen buffer for the Web browser containing a graphical representation of a Uniform Resource Locator (URL) disposed within the contents prior to presenting the contents of the screen buffer within the Web browser executing in the memory of the computing device;
extracting from the graphical representation of the URL, a text form of the URL using optical character recognition of an image of the URL and then regular expression matching the text form of the URL against known URL expressions;
determining an area surrounding the graphical representation comprising of a position and dimensions of the graphical representation within the contents utilizing feature detection and edge detection;
replacing the graphical representation of the URL in the screen buffer with an interactive element in real-time, wherein the interactive element including the text form of the URL that when selected transmits a request by the Web browser to retrieve a Web page at the URL;
responsive to the replacing, presenting the contents of the screen buffer within the Web browser; and,
on condition that the graphical representation of the URL is not determined during the extracting, manually selecting the graphical representation of the URL using a selection tool upon the contents of the screen buffer once presented in the Web browser and then performing the extracting, replacing and presenting.

9. The system of claim 8 , wherein the method further comprises:
associating the interactive element with an application executing within the computing device, wherein the application is external to the session.

10. The system of claim 8 , wherein the method further comprises:
programmatically interpreting or accessing a resource associated with the interactive element within an application.

11. The system of claim 8 , wherein the method further comprises: presenting at least one interface option within the Web browser responsive to selecting the interactive element.

12. The system of claim 8 , wherein the non-interactive screen sharing session is at least one of a slide show presentation or a whiteboard presentation.

13. The system of claim 8 , wherein the interactive element is an image associated with the URL that is associated with a networked resource, a phone number, or an email address.

14. The system of claim 8 , wherein the method further comprises: determining a change in at least one of the position and dimension of the area surrounding the graphical representation of the URL; and dynamically updating the interactive element within the screen buffer correspondingly.

15. A method for providing interactivity for a “view only” teleconference session comprising:
establishing a non-interactive screen sharing session between a Web browser executing in memory of a receiving computing device and a sending computing device;
identifying a screen buffer for the Web browser containing a graphical representation of a Uniform Resource Locator (URL) disposed within the contents prior to presenting the contents of the screen buffer within the Web browser executing in the memory of the computing device;
extracting from the graphical representation of the URL, a text form of the URL using optical character recognition of an image of the URL and then regular expression matching the text form of the URL against known URL expressions;
determining an area surrounding the graphical representation comprising of a position and dimensions of the graphical representation within the contents utilizing feature detection and edge detection;
replacing the graphical representation of the URL in the screen buffer with an interactive element in real-time, wherein the interactive element including the text form of the URL that when selected transmits a request by the Web browser to retrieve a Web page at the URL;
responsive to the replacing, presenting the contents of the screen buffer within the Web browser; and,
on condition that the graph

Assignees

• IBM

Inventors

• Duong Quang T
• Gordon David M
• Schmidt David L
• Will Scott A

Classifications

• G06F16/9566

  URL specific, e.g. using aliases, detecting broken or misspelled links · CPC title

• G06F9/54

  Interprogram communication · CPC title

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• H04L67/141

  Setup of application sessions (admission control or resource allocation in data switching networks H04L47/70) · CPC title

• G06F9/452

  Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131) · CPC title