Vertex change detection for enhanced document capture

Patent metadata

Field	Value
Publication number	US-11910079-B2
Application number	US-202117391179-A
Country	US
Kind code	B2
Filing date	Aug 2, 2021
Priority date	Aug 2, 2021
Publication date	Feb 20, 2024
Grant date	Feb 20, 2024

Abstract

Aspects of the present disclosure relate to object-based image capture. Embodiments include identifying a reference point corresponding to an object in an image of a series of images. Embodiments include comparing a position of the reference point in the image to positions of one or more corresponding reference points in one or more previous images in the series of images. Embodiments include determining a total number of images in the series of images. Embodiments include selecting, based on the comparing and the total number of images in the series of images, between: capturing the image; or declining to capture the image.

First claim

What is claimed is:

1. A method for object-based image capture, comprising:
receiving a series of images;
receiving data from an accelerometer associated with a device;
determining that an acceleration value indicated in the data from the accelerometer is beyond a threshold value;
declining to capture an image of the series of images and removing the image and one or more previous images in the series of images based on the determining that the acceleration value is beyond the threshold value;
receiving an additional series of images;
receiving additional data from the accelerometer associated with the device;
determining that no additional acceleration value indicated in the additional data from the accelerometer is beyond the threshold value;
determining not to remove an additional image in the additional series of images and one or more previous additional images in the additional series of images based on the determining that no additional acceleration value indicated in the additional data from the accelerometer is beyond the threshold value;
identifying a reference point corresponding to an object in the additional image;
comparing a position of the reference point in the additional image to positions of one or more corresponding reference points in the one or more previous additional images;
determining a total number of images in the additional series of images; and
selecting, based on the comparing, the total number of images in the additional series of images, and the additional data from the accelerometer, between:
capturing the additional image; or
declining to capture the additional image.

2. The method of claim 1 , further comprising:
determining, based on the comparing, that one of the one or more corresponding reference points in one of the one or more previous additional images in the additional series of images is more than a threshold distance from the reference point in the additional image;
removing the one or more previous images from the additional series of images; and
declining to capture the additional image.

3. The method of claim 2 , further comprising generating a notification based on the determining that the one of the one or more corresponding reference points in the one of the one or more previous images in the additional series of images is more than a threshold distance from the reference point in the additional image or based on the determining that the additional acceleration value indicated in the additional data from the accelerometer is beyond a threshold.

4. The method of claim 1 , further comprising identifying one or more additional reference points corresponding to the object in the additional image, wherein the reference point and the one or more additional reference points correspond to corners of the object.

5. The method of claim 4 , wherein the selecting is further based on positions of the one or more additional reference points in the additional image.

6. The method of claim 1 , wherein the selecting is further based on a comparison of the total number of images in the additional series of images to a threshold.

7. A system, comprising one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the system to perform a method for object-based image capture, the method comprising:
receiving a series of images;
receiving data from an accelerometer associated with a device;
determining that an acceleration value indicated in the data from the accelerometer is beyond a threshold value;
declining to capture an image of the series of images and removing the image and one or more previous images in the series of images based on the determining that the acceleration value is beyond the threshold value;
receiving an additional series of images;
receiving additional data from the accelerometer associated with the device;
determining that no additional acceleration value indicated in the additional data from the accelerometer is beyond the threshold value;
determining not to remove an additional image in the additional series of images and one or more previous additional images in the additional series of images based on the determining that no additional acceleration value indicated in the additional data from the accelerometer is beyond the threshold value;
identifying a reference point corresponding to an object in the additional image;
comparing a position of the reference point in the additional image to positions of one or more corresponding reference points in the one or more previous additional images;
determining a total number of images in the additional series of images; and
selecting, based on the comparing, the total number of images in the additional series of images, and the additional data from the accelerometer, between:
capturing the additional image; or
declining to capture the additional image.

8. The system of claim 7 , wherein the method further comprises:
determining, based on the comparing, that one of the one or more corresponding reference points in one of the one or more previous images in the additional series of images is more than a threshold distance from the reference point in the additional image;
removing the one or more previous images from the additional series of images; and
declining to capture the additional image.

9. The system of claim 8 , wherein the method further comprises generating a notification based on the determining that the one of the one or more corresponding reference points in the one of the one or more previous images in the additional series of images is more than a threshold distance from the reference point in the additional image or based on the determining that the additional acceleration value indicated in the additional data from the accelerometer is beyond a threshold.

10. The system of claim 7 , wherein the method further comprises identifying one or more additional reference points corresponding to the object in the additional image, wherein the reference point and the one or more additional reference points correspond to corners of the object.

11. The system of claim 10 , wherein the selecting is further based on positions of the one or more additional reference points in the additional image.

Assignees

• Intuit Inc

Inventors

• Hall Jason

Classifications

• H04N23/61 Primary

  based on recognised objects · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06F18/251

  of input or preprocessed data · CPC title

• G06T7/0002

  Inspection of images, e.g. flaw detection · CPC title

• G06T7/248

  involving reference images or patches · CPC title