Ledger document processing device, ledger document processing method and storage medium

Patent metadata

Field	Value
Publication number	US-11010603-B2
Application number	US-201815905966-A
Country	US
Kind code	B2
Filing date	Feb 27, 2018
Priority date	Mar 21, 2017
Publication date	May 18, 2021
Grant date	May 18, 2021

Abstract

A ledger document processing device including a display section which displays a live view image captured by an imaging section while waiting for a ledger document to be captured, and a processor which actualizes functions including judging whether a pixel-count size of an area corresponding to the ledger document in an image to be captured and stored in response to an imaging instruction is equal to or larger than a reference pixel-count size while waiting for the ledger document to be captured, notifying a user of a judgment result, and storing in a storage section the image captured by the imaging section in response to the imaging instruction.

First claim

What is claimed is:

1. A ledger document processing device comprising:
a display configured to display images captured by a camera at a predetermined frame rate while waiting for a ledger document to be captured; and
a processor configured to:
judge, for at least one of the images captured by the camera, whether a pixel-count size of an area corresponding to the ledger document in the at least one of the images captured by the camera, is equal to or larger than a reference pixel-count size;
in response to judging that the pixel-count size of the area corresponding to the ledger document in the at least one of the images captured by the camera is equal to or larger than the reference pixel-count size, control the display to provide a predetermined notification of a first type; and
after the predetermined notification of the first type is provided, receive an imaging instruction, control the camera to capture a ledger document image of the ledger document, and store in a storage the ledger document image captured by the camera in response to the imaging instruction,

wherein the processor is configured to control the display to display:
the at least one of the images captured by the camera; and
an indication, superimposed on the at least one of the images captured by the camera, for providing a guide for size adjustment of the ledger document in the at least one of the images captured by the camera by movement of the camera relative to the ledger document to adjust the pixel-count size of the area corresponding to the ledger document in the at least one of the images captured by the camera to be equal to or larger than the reference pixel-count size.

2. The ledger document processing device according to claim 1 ,
wherein the processor is configured to:
judge, for each of the images captured by the camera, whether the pixel-count size of the area corresponding to the ledger document in the each of the images captured by the camera, is equal to or larger than the reference pixel-count size; and
in response to judging that the pixel-count size of the area corresponding to the ledger document in the each of the images captured by the camera is equal to or larger than the reference pixel-count size, control the display to provide the predetermined notification of the first type.

3. The ledger document processing device according to claim 1 ,
wherein the indication is an indication of a minimum size required for the pixel-count size of the area corresponding to the ledger document in the at least one of the images captured by the camera to be equal to or larger than the reference pixel-count size.

4. The ledger document processing device according to claim 3 ,
wherein the indication is a guide frame circumscribed on an area equal to or larger than the reference pixel-count size.

5. The ledger document processing device according to claim 3 ,
wherein the processor is configured to control the display to display the indication while adjusting a display position of the indication in accordance with a position of the ledger document in the at least one of the images captured by the camera.

6. The ledger document processing device according to claim 1 ,
wherein the processor is configured to:
in response to judging that the pixel-count size of the area corresponding to the ledger document in the each of the images captured by the camera is not equal to or larger than the reference pixel-count size, control the display to provide a predetermined notification of a second type.

7. The ledger document processing device according to claim 1 ,
wherein the processor is further configured to:
read a barcode on the ledger document from the ledger document image captured;
acquire identification information indicated by the barcode read; and
store the ledger document image in the storage in association with the identification information.

8. A ledger document processing method comprising:
controlling, by a processor, a display to display images captured by a camera at a predetermined frame rate while waiting for a ledger document to be captured;
judging, by the processor, for at least one of the images captured by the camera, whether a pixel-count size of an area corresponding to the ledger document in the at least one of the images captured by the camera, is equal to or larger than a reference pixel-count size;
in response to judging that the pixel-count size of the area corresponding to the ledger document in the at least one of the images captured by the camera is equal to or larger than the reference pixel-count size, controlling, by the processor, the display to provide a predetermined notification of a first type; and
after the predetermined notification of the first type is provided, receiving, by the processor, an imaging instruction, controlling, by the processor, the camera to capture a ledger document image of the ledger document, and storing, by the processor, in a storage the ledger document image captured by the camera in response to the imaging instruction,
wherein the ledger document processing method further comprises:
controlling, by the processor, the display to display:
the at least one of the images captured by the camera; and
an indication, superimposed on the at least one of the images captured by the camera, for providing a guide for size adjustment of the ledger document in the at least one of the images captured by the camera by movement of the camera relative to the ledger document to adjust the pixel-count size of the area corresponding to the ledger document in the at least one of the images captured by the camera to be equal to or larger than the reference pixel-count size.

9. The ledger document processing method according to claim 8 , further comprising:
judging, for each of the images captured by the camera, whether the pixel-count size of the area corresponding to the ledger document in the each of the images captured by the camera, is equal to or larger than the reference pixel-count size; and
in response to judging that the pixel-count size of the area corresponding to the ledger document in the each of the images captured by the camera is equal to or larger than the reference pixel-count size, controlling the display to provide the predetermined notification of the first type.

10. The ledger document processing method according to claim 8 ,
wherein the indication is an indication of a minimum size required for the pixel-count size of the area corresponding to the ledger document in the at least one of the images captured by the camera to be equal to or larger than the reference pixel-count size.

11. The ledger document processing method according to claim 10 ,
wherein the indication is a guide frame circumscribed on an area equal to or larger than the reference pixel-count size.

12. The ledger document processing method according to claim 10 , further comprising:
controlling, by the processor, the display to display the indication while adjusting a display position of the indication in accordance with a position of the ledger document in the at least one of the images captured by the camera.

13. The ledger document processing method according to claim 8 , further comprising:
in response to judging that the pixel-count size of the area corresponding to the ledger document in the each of the images captured by the camera is not equal to or larger than the reference pixel-count size, controlling, by the processor, the display to provide a predetermined notification of a second type.

14. The ledger document processing method according to claim 8 , further comprising:
readi

Assignees

• Casio Computer Co Ltd

Inventors

• Shimizu Nobuhiro
• Oe Ryo

Classifications

• G06V30/412 Primary

  Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables · CPC title

• G06V30/414

  Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• G06V10/235

  based on user input or interaction · CPC title