Touchscreen image mapping for augmented reality devices

Patent metadata

Field	Value
Publication number	US-10325101-B2
Application number	US-201514883983-A
Country	US
Kind code	B2
Filing date	Oct 15, 2015
Priority date	Jul 27, 2015
Publication date	Jun 18, 2019
Grant date	Jun 18, 2019

Abstract

As disclosed herein a method, executed by a computer, includes receiving, from an augmented reality device, a pairing request, negotiating with the augmented reality device to generate a new encryption key and a mapping plan for presenting optically readable codes, that correspond to one or more images, on a touch sensitive display device. The method further includes presenting, on the touch sensitive display device, the optically readable codes, and receiving a user selection from the touch sensitive display device. The optical codes are overlayed by the wearers of an augmented reality system with an un-encrypted or otherwise modified form of the optical code. A computer system, and a computer program product corresponding to the above method are also disclosed herein.

First claim

What is claimed:

1. A method for use with a touchscreen computer device, the method comprising:
receiving, by the touchscreen computer device and from an augmented reality device, a pairing request;
responsive to the receipt of the pairing request, negotiating with the augmented reality device to: (i) generate a mapping plan for mapping a plurality of QR (quick response) codes respective to a plurality of alphanumeric characters, and (ii) generate an encryption key, said encryption key used for decrypting the plurality of QR codes to reveal a plurality of alphanumeric characters that correspond to the plurality of QR codes;
displaying, on a touchscreen of the touchscreen display device, the plurality of QR codes as keys of a touchscreen keyboard based, at least in part, upon the mapping plan;
decrypting, by the augmented reality device, the plurality of QR codes of the touchscreen keyboard using the encryption key to reveal the plurality of alphanumeric characters as keys of the touchscreen keyboard that correspond to the plurality of QR codes as keys of the touchscreen keyboard;
generating, on a viewing portion of the augmented reality device, overlay images of the plurality of alphanumeric characters with the alphanumeric characters overlaying the respectively corresponding QR codes as keys of the touchscreen keyboard;
responsive to the decryption of the plurality of QR codes of the touchscreen keyboard, receiving user input in the form of a plurality of keystrokes applied to various ones of the alphanumeric keys of the touchscreen keyboard; and
translating the user input into data corresponding to the alphanumeric keys of the touchscreen keyboard struck during the plurality of keystrokes based upon the mapping plan.

2. The method of claim 1 , wherein the plurality of keystrokes corresponds to a password.

3. The method of claim 2 , wherein the password is a password for unlocking the touchscreen computer device.

4. The method of claim 1 , wherein each QR code of the plurality of QR codes represents a binary number.

5. The method of claim 1 , wherein the mapping plan further includes keyboard key placement data including information indicative of a placement of each QR code within the touchscreen keyboard.

6. A method for use with an augmented reality device including an augmented reality display capable of transmitting real world views and computer generated overlays, the method comprising:
receiving at a touchscreen device, from the augmented reality device, a pairing request;
responsive to the receipt of the pairing request, negotiating with the augmented reality device to: (i) generate a mapping plan for mapping a plurality of QR (quick response) codes respective to a plurality of alphanumeric characters, and (ii) generate an encryption key, said encryption key used for decrypting the plurality of QR codes to reveal a plurality of alphanumeric characters that correspond to the plurality of QR codes;
receiving, by the augmented reality device, a first real world view data set corresponding to a first real world view of a user of the augmented reality device, with the first real world view including a touchscreen keyboard display on a touchscreen of the touchscreen display device, with the touchscreen keyboard including the plurality of QR codes as keys of the touchscreen keyboard;
decrypting, by the augmented reality device through use of the encryption key, the plurality of QR codes as keys of the touchscreen keyboard to reveal that each given QR code key of the plurality of QR codes as keys of the touchscreen is an alphanumeric character; and
responsive to the decryption of the plurality of OR codes as keys of the touchscreen keyboard, generating, on a viewing portion of the augmented reality device, overlay images of the plurality of alphanumeric characters with the alphanumeric characters overlaying the respectively corresponding QR codes of the keys of the touchscreen keyboard.

7. A method for use with a touchscreen computer device and an augmented reality device including an augmented reality display capable of transmitting real world views and computer generated overlays, the method comprising:
receiving, by the touchscreen computer device and from the augmented reality device, a pairing request to communicatively connect the computer device with the augmented reality device;
responsive to the receipt of the pairing request, negotiating, by the touchscreen computer device and with the augmented reality device, to generate: (i) a mapping plan for mapping a plurality of QR (quick response) codes, and (ii) an encryption key, said encryption key used for decrypting the plurality of QR codes into a human understandable form and format;
displaying, on a touchscreen of the touchscreen computer device, the plurality of QR codes as keys of a touchscreen keyboard based, at least in part, upon the mapping plan;
reading, by the augmented reality device, the plurality of QR codes as keys of a touchscreen keyboard;
decrypting, by the augmented reality device through use of the encryption key, the plurality of QR codes as keys of the touchscreen keyboard into the human understandable form and format;
responsive to the decryption, displaying, to a user through the augmented reality device and overlaid on the touchscreen computer device, the decrypted keys of the touchscreen keyboard that is in the human understandable form and format; and
providing, by the user of the augmented reality device and on the touchscreen computer device, a plurality of keystrokes to the decrypted keys of the touchscreen keyboard.

8. The method of claim 7 wherein the plurality of keystrokes provided by the user of the augmented reality device corresponds to entering a password to unlock the capabilities of the touchscreen computer device.

9. The method of claim 7 wherein the human understandable form and format includes alphanumeric characters.

10. The method of claim 7 wherein the human understandable form and format includes images of animals.

Assignees

• IBM

Inventors

• Dow Eli M
• Fitzsimmons Thomas D
• Harvey Joseph D
• Rohde Douglas E

Classifications

• G06F21/602 Primary

  Providing cryptographic facilities or services · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G06F3/0412

  Digitisers structurally integrated in a display · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G06F21/31

  User authentication · CPC title