Methods and systems to adaptively detect object borders from electronic device images

Patent metadata

Field	Value
Publication number	US-9639768-B2
Application number	US-201414564546-A
Country	US
Kind code	B2
Filing date	Dec 9, 2014
Priority date	Dec 9, 2014
Publication date	May 2, 2017
Grant date	May 2, 2017

Abstract

A method of automatically identifying a border in a captured image may include capturing an image of a target by an image sensor of an electronic device, and, by one or more processors, processing the image to automatically detect a border of the target in the image by applying an automatic border detection method to the image. The method may include presenting the image of the target to a user via a display of the electronic device so that the presented image comprises a visual depiction of the detected border, receiving an adjustment of the border from the user, determining whether to update the default parameters based on the received adjustment, in response to determining to update the default parameters, determining one or more updated parameters for the automatic border detection method that are based on, at least in part, the received adjustment, and saving the updated parameters.

First claim

What is claimed is:

1. A method of automatically identifying a border in a captured image, the method comprising:
by an image sensor of a mobile electronic device, capturing an image of a target;
by one or more processors:
processing the image to automatically detect a border of the target in the image by applying an automatic border detection method to the image, wherein the automatic border detection method uses one or more default parameters,
presenting the image of the target to a user via a display of the mobile electronic device so that the presented image comprises a visual depiction of the detected border,
receiving, via a user interface, an adjustment of the border from the user,
determining whether to update the default parameters based on the received adjustment by:
determining a difference between one or more border coordinates associated with the received adjustment and one or more border coordinates associated with the default parameters, and

in response to the difference exceeding a threshold value:
determining one or more updated parameters that minimize the difference, and
replacing the default parameters with the updated parameters, and

saving the updated parameters.

2. The method of claim 1 , further comprising:
altering at least a portion of the image that is within the user-adjusted border; and
presenting the altered image to a user via the display of the mobile electronic device.

3. The method of claim 2 , wherein altering at least a portion of the image that is within the user-adjusted border comprises performing one or more of the following operations on the portion:
cropping; and
geometric correction.

4. The method of claim 1 , further comprising:
in response to the difference not exceeding a threshold value, not updating the default parameters.

5. The method of claim 1 , further comprising:
receiving a subsequent image of a subsequent target;
determining whether the subsequent image was received during a same session as the image; and
in response to determining that the subsequent image was received during the same session as the image:
processing the subsequent image to automatically determine a second border of the subsequent target in the image by applying the automatic border detection method to the image, wherein the automatic border detection method uses at least one or more of the updated parameters.

6. The method of claim 5 , further comprising:
presenting the subsequent image of the target to a user via the display of the mobile electronic device so that the presented subsequent image comprises a visual depiction of the second border,
receiving, via the user interface, an adjustment of the second border from the user,
altering at least a portion of the subsequent image that is within the second border, and
presenting the altered subsequent image to a user via the display of the mobile electronic device.

7. The method of claim 5 , wherein determining whether the subsequent image was received during a same session as the image comprises:
determining whether the subsequent image is captured within a time period from a time that the image is captured and at a same location as the image was captured; and
in response to determining that the subsequent image is received within the time period and at the same location, determining that the subsequent image is received in the same session.

8. The method of claim 1 , further comprising:
receiving a subsequent image of a subsequent target;
determining whether the subsequent image was received during a same session as the image; and
in response to determining that the subsequent image was not received during the same session as the image, processing the subsequent image to automatically determine a second border of the subsequent target in the subsequent image by applying the automatic border detection method to the subsequent image, wherein the automatic border detection method uses one or more of the default parameters.

9. The method of claim 8 , further comprising:
presenting the subsequent image of the target to a user via the display of the mobile electronic device so that the presented subsequent image comprises a visual depiction of the second border,
receiving, via the user interface, an adjustment of the second border from the user,
altering at least a portion of the subsequent image that is within the second border, and
presenting the altered subsequent image to a user via the display of the mobile electronic device.

10. A system of automatically identifying a border in a captured image, the system comprising:
a mobile electronic device comprising an image sensor; and
a computer-readable storage medium in communication with the mobile electronic device, wherein the computer-readable storage medium comprises one or more programming instructions that, when executed, cause the mobile electronic device to:
capture, by the image sensor, an image of a target,
process the image to automatically detect a border of the target in the image by applying an automatic border detection method to the image, wherein the automatic border detection method uses one or more default parameters,
present the image of the target to a user via a display of the mobile electronic device so that the presented image comprises a visual depiction of the detected border,
receive, via a user interface, an adjustment of the border from the user,
determine whether to update the default parameters based on the received adjustment by:
determining a difference between one or more border coordinates associated with the received adjustment and one or more border coordinates associated with the default parameters, and
in response to the difference exceeding a threshold value:
determining one or more updated parameters that minimize the difference, and
replacing the default parameters with the updated parameters, and

save the updated parameters.

11. The system of claim 10 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:
alter at least a portion of the image that is within the user-adjusted border; and
present the altered image to a user via the display of the mobile electronic device.

12. The system of claim 11 , wherein the one or more programming instructions that, when executed, cause the mobile electronic device to alter at least a portion of the image that is within an updated border comprise one or more programming instructions that, when executed, cause the mobile electronic device to perform one or more of the following operations on the portion:
cropping; and
geometric correction.

13. The system of claim 10 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:
in response to the difference not exceeding a threshold value, not update the default parameters.

14. The system of claim 10 , wherein the computer-readable storage medium further comprises one or more programming instructions that, when executed, cause the mobile electronic device to:
receive a subsequent image of a subsequent target;
determine whether the subsequent image was received during a same session as the image; and
in response to determining that the subsequent image was received during the same session as the image:
process the subsequent image to automatically determine a second border of the subsequent target in the image by applying the automatic border detection method to the image, wherein the automatic bo

Assignees

• Xerox Corp

Inventors

• Bala Raja
• Fu Lina

Classifications

• G06V20/62

  Text, e.g. of license plates, overlay texts or captions on TV images · CPC title

• G06V30/40 Primary

  Document-oriented image-based pattern recognition · CPC title

• G06V10/987

  with the intervention of an operator · CPC title

• G06K9/00442

  Physics · mapped topic

• G06K9/033

  Physics · mapped topic