Dynamically enabling an interactive element within a non-interactive view of a screen sharing session

Patent metadata

Field	Value
Publication number	US-9798944-B2
Application number	US-201414185344-A
Country	US
Kind code	B2
Filing date	Feb 20, 2014
Priority date	Feb 20, 2014
Publication date	Oct 24, 2017
Grant date	Oct 24, 2017

Abstract

A non-interactive screen sharing session executing within a computing device can be identified. The device can be communicatively linked to different computing devices of the screen sharing session. The contents of the remote screen buffer can be analyzed to determine a graphical representation of a Uniform Resource Locator (URL) within the contents prior to presenting the contents of the buffer within the device. A visible information item can be extracted and a non-visible reference can be established from the representation. An area surrounding the representation including a position and dimensions of the representation within the contents can be determined. The representation of the URL can be replaced with an interactive element in real-time. The element can include the visible and non-visible reference. The contents of the buffer can be presented within an interface associated with the session of the device, responsive to the replacing.

First claim

What is claimed is:

1. A computer program product comprising a computer readable storage medium having computer usable program code embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the computer usable program code enabled upon execution in memory of a computer to perform a method comprising:
establishing a non-interactive screen sharing session between a Web browser executing in memory of a receiving computing device and a sending computing device;
identifying a screen buffer for the Web browser;
analyzing the contents of the screen buffer to determine a graphical representation of a Uniform Resource Locator (URL) disposed within the contents prior to presenting the contents of the screen buffer within the Web browser executing in the memory of the computing device;
processing the graphical representation in the screen buffer so as to extract visible information and a non-visible reference the combination forming the URL;
determining an area surrounding the graphical representation comprising of a position and dimensions of the graphical representation within the contents utilizing feature detection and edge detection;
replacing the graphical representation of the URL in the screen buffer with an interactive element in real-time, wherein the interactive element when selected transmits a request by the Web browser to retrieve a Web page at the URL;
responsive to the replacing, presenting the contents of the screen buffer within the Web browser; and,
on condition that the graphical representation of the URL is not determined during the analyzing, presenting the contents of the screen buffer within the Web browser and a manual option to select the graphical representation, the manual option being a selection tool, a user manually selecting the graphical representation of the URL using the selection tool upon the contents of the screen buffer once presented in the Web browser and then performing the processing, determining, replacing and presenting.

2. The computer program product of claim 1 , wherein the method further comprises:
associating the interactive element with an application executing within the computing device, wherein the application is external to the session.

3. The computer program product of claim 1 , wherein the method further comprises:
programmatically interpreting or accessing a resource associated with the interactive element within an application.

4. The computer program product of claim 1 , wherein the method further comprises:
presenting at least one interface option within the Web browser responsive to selecting the interface element.

5. The computer program product of claim 1 , wherein the method further comprises:
replacing the visible information with a previously determined text.

6. The computer program product of claim 1 , wherein the non-interactive screen sharing session is at least one of a slide show presentation or a whiteboard presentation.

7. The computer program product of claim 1 , wherein the interactive element is an image associated with the URL that is associated with a networked resource, a phone number, or an email address.

8. The computer program product of claim 1 , wherein the method further comprises:
determining a change in at least one of the position and dimension of the area surrounding the graphical representation of the URL; and
dynamically updating the interactive element within the remote screen buffer correspondingly.

9. A system for providing interactivity for a view only teleconference comprising:
a computer with memory and at least one processor;
a collaboration engine comprising computer program instructions executing in the memory by the processor of the computer, the instructions performing a method comprising:
establishing a non-interactive screen sharing session between a Web browser executing in memory of a receiving computing device and a sending computing device;
identifying a screen buffer for the Web browser
analyzing the contents of the screen buffer to determine a graphical representation of a Uniform Resource Locator (URL) disposed within the contents prior to presenting the contents of the screen buffer within the Web browser executing in the memory of the computing device;
processing the graphical representation in the screen buffer so as to extract visible information and a non-visible reference the combination forming the URL;
determining an area surrounding the graphical representation comprising of a position and dimensions of the graphical representation within the contents utilizing feature detection and edge detection;
replacing the graphical representation of the URL in the screen buffer with an interactive element in real-time, wherein the interactive element when selected transmits a request by the Web browser to retrieve a Web page at the URL;
responsive to the replacing, presenting the contents of the screen buffer within the Web browser; and,
on condition that the graphical representation of the URL is not determined during the analyzing, presenting the contents of the screen buffer within the Web browser and a manual option to select the graphical representation, the manual option being a selection tool, a user manually selecting the graphical representation of the URL using the selection tool upon the contents of the screen buffer once presented in the Web browser and then performing the processing, determining, replacing and presenting.

10. The system of claim 9 , wherein the method further comprises:
associating the interactive element with an application executing within the computing device, wherein the application is external to the session.

11. The system of claim 9 , wherein the method further comprises:
programmatically interpreting or accessing a resource associated with the interactive element within an application.

12. The system of claim 9 , wherein the method further comprises:
presenting at least one interface option within the Web browser responsive to selecting the interface element.

13. The system of claim 9 , wherein the method further comprises:
replacing the visible information with a previously determined text.

14. The system of claim 9 , wherein the non-interactive screen sharing session is at least one of a slide show presentation or a whiteboard presentation.

15. The system of claim 9 , wherein the interactive element is an image associated with the URL that is associated with a networked resource, a phone number, or an email address.

16. The system of claim 9 , wherein the method further comprises:
determining a change in at least one of the position and dimension of the area surrounding the graphical representation of the URL; and
dynamically updating the interactive element within the remote screen buffer correspondingly.

Assignees

• IBM

Inventors

• Duong Quang T
• Gordon David M
• Schmidt David L
• Will Scott A

Classifications

• H04L67/14 Primary

  Session management (for real-time applications in data packet communications networks H04L65/1066) · CPC title

• G06F3/048

  Interaction techniques based on graphical user interfaces [GUI] · CPC title

• H04L67/141

  Setup of application sessions (admission control or resource allocation in data switching networks H04L47/70) · CPC title

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• G06F16/9566

  URL specific, e.g. using aliases, detecting broken or misspelled links · CPC title