Augmented reality captcha

Patent metadata

Field	Value
Publication number	US-10339334-B2
Application number	US-201715605473-A
Country	US
Kind code	B2
Filing date	May 25, 2017
Priority date	May 25, 2017
Publication date	Jul 2, 2019
Grant date	Jul 2, 2019

Abstract

Aspects of the embodiments are directed to an augmented reality Completely Automated Public Turing test to tell Computers and Humans Apart (“captcha”). Upon determining that a user, operating a user device, is attempting to access a website, a host server can cause a camera on the user device to activate and begin streaming and image feed to the host device across a network. The host device can determine an appropriate augmentation to the image feed that is germane to the context and/or environment of what is being displayed in the image feed. The augmentation can be displayed to the user on a display of the user device. The augmentation can also include a prompt instructing the user how to interact with the augmentation. The host server can determine whether to grant the user access based on the user's interaction with the augmentation.

First claim

What is claimed is:

1. A method for authorizing a user to access a network location, the method comprising:
receiving an indication that a user is attempting to access the network location;
receiving a streaming image feed from a camera associated with a device being used by the user to attempt to access the network location;
determining from the streaming image feed an environment in which the user is located;
determining from the environment, an interactive image overlay;
augmenting the streaming image feed with the interactive image overlay;
receiving an augmented image feed from the camera, the augmented image feed comprising image data indicating that the user is interacting virtually with the interactive image overlay;
verifying that the user interaction with the interactive image overlay is a correct interaction for the interactive image overlay for passing a challenge-response test; and
providing access to the user to the network location.

2. The method of claim 1 , further comprising:
after receiving the indication that the user is attempting to access the network location, activating the camera associated with the user device to begin the streaming image feed; and
causing the device to transmit the streaming image feed to a web server managing the network location.

3. The method of claim 1 , further comprising:
after receiving the streaming image feed, verifying that the streaming image feed is authentic.

4. The method of claim 1 , wherein determining the interactive image overlay comprises:
determining the interactive image overlay based on one or more of a time, date, location, or event information.

5. The method of claim 4 , wherein the location, time, and date can be determined based on one or more of image metadata, time and date information stored on a server managing the network location, or time and date information associated with the location of the user.

6. The method of claim 4 , wherein the event information is based at least on a determination of an event associated with the location, date, and time.

7. The method of claim 1 , wherein the interactive image overlay comprises:
an image that is relevant for the determined environment; and
a prompt for the user to interact with the image.

8. The method of claim 7 , wherein the prompt comprises instructions as to how the user can successfully interact with the image.

9. The method of claim 1 , wherein verifying that the user interaction with the interactive image overlay is a correct interaction for the interactive image overlay comprises processing the augmented streaming image feed using one or more of image processing, gesture recognition, hand movement recognition, or object recognition on the augmented streaming image feed; and
using the processed augmented streaming image feed to determine that a user interaction conforms to a predetermined user interaction.

10. The method of claim 1 , wherein verifying that the user interaction with the interactive image overlay is a correct interaction for the interactive image overlay comprises:
receiving an indication of a gesture motion of the device; and
determining that the gesture conforms to a gesture associated with the interactive image overlay determined for the environment.

11. A method performed on a user device that includes a camera system, the method comprising:
transmitting to a host server a request to access a network location;
receiving, from the host server, an instruction to activate the camera system;
transmitting to the host server a real-time image stream captured by the camera system;
receiving, from the host server, an augmentation to the real-time image stream;
displaying the augmentation on a display of the user device, the augmentation displayed with the real-time image stream as part of a challenge-response test;
capturing a user interaction with the augmentation as a user response to the challenge-response test;
transmitting the captured user interaction with the augmentation to the host server as an augmented real-time image stream for processing the user response to the challenge-response test; and
receiving access to the network location when the response to the challenge-response test is correct.

12. The method of claim 11 , further comprising:
receiving, with the augmentation, a prompt indicating how the user should interact with the augmentation; and
displaying the prompt on the user device with the augmentation.

13. A non-transitory computer-readable medium having program instructions stored therein, wherein the program instructions are executable by a computer system to perform operations comprising:
receiving an indication that a user is attempting to access the network location;
receiving a streaming image feed from a camera associated with a device being used by the user to attempt to access the network location;
determining from the streaming image feed an environment in which the user is located;
determining from the environment, an interactive image overlay;
augmenting the streaming image feed with the interactive image overlay;
receiving an augmented image feed from the camera, the augmented image feed comprising image data indicating that the user is interacting virtually with the interactive image overlay;
verifying that the user interaction with the interactive image overlay is a correct interaction for the interactive image overlay for passing a challenge-response test; and
providing access to the user to the network location.

14. The non-transitory computer-readable medium of claim 13 , the operations further comprising:
after receiving the indication that the user is attempting to access the network location, activating the camera associated with the user device to begin the streaming image feed; and
causing the device to transmit the streaming image feed to a web server managing the network location.

15. The non-transitory computer-readable medium of claim 14 , the operations further comprising:
after receiving the streaming image feed, verifying that the streaming image feed is authentic.

16. The non-transitory computer-readable medium of claim 13 , the operations further comprising:
determining the interactive image overlay based on one or more of a time, date, location, or event information.

17. The non-transitory computer-readable medium of claim 16 , wherein the location, time, and date can be determined based on one or more of image metadata, time and date information stored on a server managing the network location, or time and date information associated with the location of the user.

18. The non-transitory computer-readable medium of claim 16 , wherein the event information is based at least on a determination of an event associated with the location, date, and time.

19. The non-transitory computer-readable medium of claim 13 , wherein the interactive image overlay comprises:
an image that is relevant for the determined environment; and
a prompt for the user to interact with the image.

20. The non-transitory computer-readable medium of claim 19 , wherein the prompt comprises instructions as to how the user can successfully interact with the image.

21. The non-transitory computer-readable medium of claim 13 , wherein verifying that the user interaction with the interactive image overlay is a correct interaction for the interactive image overlay comprises processing the augmented streaming image feed using one or more of image processing, gesture recognition, ha

Assignees

• Ca Inc

Inventors

• Sawant Yashwant Ramkishan
• Kaladgi Mohammed Mujeeb
• Jameel Junaid Ahmed
• Banisetti Sandeep

Classifications

• G06F2221/2133

  Verifying human interaction, e.g., Captcha · CPC title

• G06F21/34

  involving the use of external additional devices, e.g. dongles or smart cards · CPC title

• H04L63/08 Primary

  for authentication of entities (cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32) · CPC title

• G06F21/316

  by observing the pattern of computer usage, e.g. typical user behaviour · CPC title

• H04L63/083

  using passwords (cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226) · CPC title