Gesture-based whiteboard

Patent metadata

Field	Value
Publication number	US-11245871-B1
Application number	US-202117140984-A
Country	US
Kind code	B1
Filing date	Jan 4, 2021
Priority date	Jan 4, 2021
Publication date	Feb 8, 2022
Grant date	Feb 8, 2022

Abstract

A video of a user is received. An image of the video is analyzed to identify a marking object in the image with a color value within a first range. A location associated with the marking object is marked. The marked location is provided to one or more other users via a collaboration medium.

First claim

What is claimed is:

1. A method, comprising:
receiving a video capturing a user facing a camera;
analyzing an image of the video to identify a marking object in the image with a color value within a first range, wherein the marking object is held by the user in between the user and the camera;
detecting a drawing gesture performed by the user using the marking object in a space between the user and the camera;
marking a location associated with the marking object; and
providing the marked location to one or more other users via a collaboration medium.

2. The method of claim 1 , comprising:
mirroring the marked location prior to providing the marked location to the one or more other users via the collaboration medium.

3. The method of claim 1 , further comprising:
analyzing the image of the video to identify a start indicator gesture prior to identifying the marking object in the image.

4. The method of claim 3 , wherein analyzing the image of the video to identify the start indicator gesture prior includes identifying an indicator object that is different from the marking object.

5. The method of claim 1 , further comprising:
analyzing the image of the video to identify a stop indicator gesture.

6. The method of claim 5 , wherein the stop indictor gesture corresponds to a first gesture or an open palm gesture.

7. The method of claim 1 , wherein marking the location associated with the marking object includes:
detecting movement of a camera capturing the video of the user; and
adjusting the image of the video based on the detected movement of the camera.

8. The method of claim 1 , wherein marking the location associated with the marking object includes:
detecting a background of the image of the video; and
adjusting the image of the video by masking the background of the image of the video.

9. The method of claim 1 , wherein marking the location associated with the marking object includes removing noise in the image of the video or optimized lighting conditions of the image of the video.

10. The method of claim 1 , wherein providing the marked location to the one or more other users via the collaboration medium includes:
creating an update to reflect the marked location; and
transmitting the update to a cloud service provider, wherein the cloud service provider is configured to distribute the update to the one or more other users and create a collaboration record based on the update.

11. The method of claim 1 , wherein providing the marked location to the one or more other users via the collaboration medium includes determining an edit state of a virtual shared whiteboard, and wherein the edit state of the virtual shared whiteboard includes at least a start state and a pause state.

12. The method of claim 1 , wherein a property of the marking object is determined by identifying the color value associated with the marking object.

13. The method of claim 1 , wherein a property of the marking object is determined by identifying one or more whiteboard actions associated with the marking object, wherein the one or more whiteboard actions include a drawing action, an erasing action, a highlighting action, or a selection action.

14. The method of claim 1 , wherein a property of the marking object is determined by identifying a size or shape associated with the marking object.

15. The method of claim 1 , wherein the marked location is associated with a drawing, erasing, highlighting, copying, pasting, duplicating, zooming, panning, or cropping action.

16. A system, comprising:
one or more processors;
a video camera; and
a memory coupled to the one or more processors, wherein the memory is configured to provide the one or more processors with instructions which when executed cause the one or more processors to:
receive a video capturing a user facing the video camera;
analyze an image of the video to identify a marking object in the image with a color value within a first range, wherein the marking object is held by the user in between the user and the video camera;
detect a drawing gesture performed by the user using the marking object in a space between the user and the video camera;
mark a location associated with the marking object; and
provide the marked location to one or more other users via a collaboration medium.

17. The system of claim 16 , wherein a property of the marking object is determined by identifying the color value associated with the marking object.

18. The system of claim 16 , wherein a property of the marking object is determined by identifying one or more whiteboard actions associated with the marking object, wherein the one or more whiteboard actions include a drawing action, an erasing action, a highlighting action, or a selection action.

19. The system of claim 16 , wherein a property of the marking object is determined by identifying a size or shape associated with the marking object.

20. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
receiving a video capturing a user facing a camera;
analyzing an image of the video to identify a marking object in the image with a color value within a first range, wherein the marking object is held by the user in between the user and the camera;
detecting a drawing gesture performed by the user using the marking object in a space between the user and the camera;
marking a location associated with the marking object; and
providing the marked location to one or more other users via a collaboration medium.

Assignees

• Servicenow Inc

Inventors

• Gandhi Bhairavi
• Upadhya Prashant
• Pal Soumen
• Dey Avishek

Classifications

• G06F3/1454

  involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• H04N7/152

  Multipoint control units therefor · CPC title

• H04N5/272

  Means for inserting a foreground image in a background image, i.e. inlay, outlay · CPC title

• G06V40/28 Primary

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title