Augmented reality device display of image recognition analysis matches

Patent metadata

Field	Value
Publication number	US-9646419-B2
Application number	US-201514596373-A
Country	US
Kind code	B2
Filing date	Jan 14, 2015
Priority date	Jan 14, 2015
Publication date	May 9, 2017
Grant date	May 9, 2017

Abstract

Aspects provide for notifications of image recognition analysis matches to streamed image data on augmented reality device displays. Data identifies one or more visual appearance attributes of a target object that are discernible within image data acquired by a camera. Image data captured by a camera is analyzed to determine an occurrence of the visual appearance attribute(s) within a stream of images of captured image data. In response to the analyzing determining an occurrence of the visual appearance attribute(s) within the stream of captured images, the method drives a display screen of the augmented reality device to distinguish a possible location of the target object within surroundings of a user of the augmented reality display device that are displayed to the user by the display screen.

First claim

What is claimed is:

1. A method for presenting notifications of image recognition analysis matches to streamed image data on an augmented reality device display, the method comprising:
receiving, at an augmented reality device, data that identifies at least one visual appearance attribute of a target object, wherein the at least one visual appearance attribute is discernible within image data acquired by a camera of the augmented reality display device;
analyzing image data captured by the camera to determine an occurrence of the at least one visual appearance attribute of the target object within a stream of images of the captured image data, wherein the analyzing the stream of images is performed by an image recognition application executing on a processor of the augmented reality display device that detects the occurrence of the at least one visual appearance attribute within the captured image data stream of images;
in response to the analyzing of the image data determining an occurrence of the at least one visual appearance attribute of the target object within the stream of captured images, driving a display screen of the augmented reality device to distinguish a possible location of the target object within surroundings of a user of the augmented reality display device that are displayed to the user by the display screen, and generating an alert that comprises a time of acquisition of the stream of captured images and a geographic location of the augmented reality device at the time of acquisition of the stream of captured images; and
generating a confidence rating of the alert to have a low confidence value as a function of determining that the target object is unlikely to be located at a present location of the augmented reality display device in view of a distance to a location of another augmented reality display device at a time of a generation of another alert by the another augmented reality display device generated in response to an occurrence of at least one visual appearance attribute of the target object within a stream of images of image data captured by a camera of the another augmented reality display device.

2. The method of claim 1 , wherein the step of receiving the data that identifies the at least one visual appearance attribute of the target object comprises:
continually receiving a stream of data; and
updating the at least one visual appearance attribute with a new attribute from the stream of data in response to a data broadcast of the new attribute with an alert generated by another augmented reality device, wherein the alert is generated by the another augmented reality device in response to a determination that the at least one visual appearance attribute is discernible within image data acquired by a camera of the another augmented reality device.

3. The method of claim 1 , wherein the display screen elements is one of a spectacle lens worn by the user, and a window of a vehicle occupied by the user; and
wherein the display screen is semi-transparent and deployed for the user to view the surroundings of the user through it and to distinguish the possible location of the target object within the surroundings of the user by highlighting an object viewed through the semi-transparent display screen.

4. The method of claim 1 , further comprising:
determining a location of the target object as a function of a viewing angle of the camera and a current global positioning coordinate of the device.

5. The method of claim 1 , further comprising:
communicating the alert to at least one of a centralized database and another augmented reality device.

6. The method of claim 1 , further comprising:
generating the confidence rating of the alert as a function of at least one of a number of at least one visual appearance attributes of the target object determined to occur within the stream of captured images, and an importance of the at least one visual attribute of the target object determined to occur within the stream of captured images.

7. The method of claim 6 , further comprising:
generating the confidence rating of the alert to have a high confidence value as a function of determining that two or more of the at least one visual appearance attribute of the target object occur within the stream of captured images, or that one of the at least one visual attributes of the target object determined to occur within the stream of captured images has a high importance.

8. The method of claim 1 , further comprising:
integrating computer readable program code into a computer readable storage medium; and
wherein a processor that is in circuit communication with a computer readable memory and the computer readable storage medium executes instructions of the program code integrated on the computer readable storage medium via the computer readable memory and thereby performs the steps of receiving the data that identifies the at least one visual appearance attribute of the target object, analyzing the image data captured by the camera to determine the occurrence of the at least one visual appearance attribute of the target object within the stream of images of the captured image data, driving the display screen of the augmented reality device to distinguish the possible location of the target object within the surroundings of the user of the augmented reality display device displayed to the user by the display screen and generating the alert in response to the analyzing the image data determining the occurrence of the at least one visual appearance attribute of the target object within the stream of captured images, and generating the confidence rating of the alert.

9. A system, comprising:
a processor;
a computer readable memory in circuit communication with the processor;
a computer readable storage medium in circuit communication with the processor;
a camera in circuit communication with the processor; and
a display screen in circuit communication with the processor;
wherein the processor executes program instructions stored on the computer readable storage medium via the computer readable memory and thereby:
receives data that identifies at least one visual appearance attribute of a target object, wherein the at least one visual appearance attribute is discernible within image data acquired by the camera;
analyzes, via executing an image recognition application, image data captured by the camera to determine an occurrence of the at least one visual appearance attribute of the target object within a stream of images of the captured image data, by detecting the occurrence of the at least one visual appearance attribute within the captured image data stream of images;
in response determining an occurrence of the at least one visual appearance attribute of the target object within the stream of captured images, drives the display screen to distinguish a possible location of the target object within surroundings of a user of the system that are displayed to the user by the display screen, and generates an alert that comprises a time of acquisition of the stream of captured images and a geographic location of the augmented reality device at the time of acquisition of the stream of captured images; and
generates a confidence rating of the alert to have a low confidence value as a function of determining that the target object is unlikely to be located at a present location of the augmented reality display device in view of a distance to a location of another augmented reality display device at a time of a generation of another alert by the another augmented reality display device generated in response to an occurrence of at least one visual appearance attribute of the target object within a stream of images of image

Assignees

• IBM

Inventors

• Bostick James E
• Ganci Jr John M
• Rakshit Sarbajit K
• Trim Craig M

Classifications

• G02B27/0172

  characterised by optical features · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title

• G02B2027/0138

  comprising image capture systems, e.g. camera · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title