Terminal device, method for acquiring drawing target, and computer-readable recording medium

Patent metadata

Field	Value
Publication number	US-10225480-B2
Application number	US-201514710778-A
Country	US
Kind code	B2
Filing date	May 13, 2015
Priority date	May 16, 2014
Publication date	Mar 5, 2019
Grant date	Mar 5, 2019

Abstract

A terminal device, comprising: a capturing unit capturing a subject; a light emitting unit; a display unit, a processor, and a storage unit containing a program that causes the processor to execute a process of acquiring a drawing target drawn by a user from a captured image of the subject including the drawing target and causing the drawing target to be displayed on a screen of the display unit, the program causes the processor to execute; controlling the light emitting unit to emit the light when the capturing unit captures the subject according to the user's operation, acquiring the captured image that is obtained by capturing the subject irradiated with the light emitted from the light emitting unit, performing image correction corresponding to a brightness distribution of the light emitted from the light emitting unit on the captured image, and extracting the drawing target from the captured image acquired.

First claim

What is claimed is:

1. A terminal device including a camera, a light source, and a display, the terminal device comprising:
memory storing computer-readable instructions; and
one or more processors configured to execute the computer-readable instructions such that the one or more processors are configured to,
display a finder screen with a mark image on the display,
the mark image being configured to be used by a user, when a subject that is a sheet is captured with the camera, for adjusting a distance between the camera and the subject so as to become a predetermined distance by moving a captured image of a predetermined frame formed on the subject closer to the mark image, the predetermined frame being for indicating a region in which the user draws a drawing target,
the subject including a plurality of visual markers located on the subject at positions corresponding to corners of the predetermined frame,

detect sides of the predetermined frame using the visual markers,
detect a position of the predetermined frame relative to the mark image by determining one or more distances between one or more of the sides of the predetermined frame and one or more corresponding sides of the mark image,
control the camera and the light source when capturing the subject to obtain a captured image of the subject based on the detected position of the predetermined frame, the captured image of the subject being generated by a capturing process in a condition where light is emitted from the light source to a capturing area of the subject,
generate a corrected image by executing an image correction operation on the captured image of the subject,
the image correction operation being a process to suppress influence of brightness on the captured image of the subject based on a brightness distribution at a time when,
the light is incident on the subject, and
a distance of the subject from the camera is set to the predetermined distance, and

extract a drawing target included in the captured image of the predetermined frame from the corrected image for displaying the drawing target.

2. The terminal device according to claim 1 , wherein the mark image is a frame image.

3. The terminal device according to claim 2 , wherein the one or more processors are configured to execute the computer-readable instructions such that the one or more processors are configured to generate the corrected image by executing the image correction operation on the captured image of the subject in response to recognizing the predetermined frame in the captured image of the subject.

4. The terminal device according to claim 3 , wherein the one or more processors are configured to execute the computer-readable instructions such that the one or more processors are configured to,
determine whether or not a shape of the recognized predetermined frame satisfies a first shape condition, and
generate an acquired image by storing the captured image when the shape of the predetermined frame recognized satisfies the first shape condition.

5. The terminal device according to claim 1 , wherein the brightness distribution is a brightness distribution of a standard image that is a captured image of a sheet in which the drawing target is not formed.

6. A method for acquiring drawing target with a terminal device, the terminal device including a camera, a light source, a display, a processor, and storage, the method comprising:
displaying a finder screen with a mark image on the display, the mark image being used by a user, when a subject that is a sheet is captured with the camera, for adjusting a distance between the camera and the subject so as to become a predetermined distance by moving a captured image of a predetermined frame formed on the subject closer to the mark image, the predetermined frame being for indicating a region in which the user draws a drawing target,
the subject including a plurality of visual markers located on the subject at positions corresponding to corners of the predetermined frame,

detecting sides of the predetermined frame using the visual markers,
detecting a position of the predetermined frame relative to the mark image by determining one or more distances between one or more of the sides of the predetermined frame and one or more corresponding sides of the mark image,
controlling the camera and the light source when capturing the subject to obtain a captured image of the subject based on the detected position of the predetermined frame, the captured image of the subject being generated by a capturing process in a condition where light is emitted from the light source to a capturing area of the subject,
generating a corrected image by executing an image correction operation on the captured image of the subject,
the image correction operation being a process to suppress influence of brightness on the captured image of the subject based on a brightness distribution at a time when,
the light is incident on the subject, and
a distance of the subject from the camera is set to a predetermined distance, and

extracting a drawing target included in the captured image of the predetermined frame from the corrected image for displaying the drawing target.

7. The method according to claim 6 , wherein the mark image is a frame image.

8. The method according to claim 7 , further comprising:
generating the corrected image by executing the image correction operation on the captured image of the subject in response to recognizing the predetermined frame in the captured image of the subject.

9. The method according to claim 8 , further comprising:
determining whether or not a shape of the recognized predetermined frame satisfies a first shape condition; and
generating an acquired image by storing the captured image of the subject when the shape of the predetermined frame recognized satisfies the first shape condition.

10. The method according to claim 6 , wherein the brightness distribution is a brightness distribution of a standard image that is a captured image of a sheet in which the drawing target is not formed.

11. A non-transitory computer-readable recording medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations for controlling a terminal device, the terminal device including a camera, a light source, a display, a processor, and storage, the operations for controlling the terminal device including:
displaying a finder screen with a mark image on the display, the mark image being configured to be used by a user, when a subject that is a sheet is captured with the camera, for adjusting a distance between the camera and the subject so as to become a predetermined distance by moving a captured image of a predetermined frame formed on the subject closer to the mark image, the predetermined frame being for indicating a region in which the user draws a drawing target,
the subject including a plurality of visual markers located on the subject at positions corresponding to corners of the predetermined frame,

detecting sides of the predetermined frame using the visual markers,
detecting a position of the predetermined frame relative to the mark image by determining one or more distances between one or more of the sides of the predetermined frame and one or more corresponding sides of the mark image,
controlling the camera and the light source when capturing the subject to obtain a captured image of the subject, the captured image of the subject being generated by a capturing process in a condition where light is emitted from the light source to a capturing area of the subject,
generating a corrected image by executing an image correcti

Assignees

• Itoh Atsushi
• Ohtsuka Aiko
• Moroyama Munetake
• Ricoh Co Ltd

Inventors

• Itoh Atsushi
• Ohtsuka Aiko
• Moroyama Munetake

Classifications

• H04N1/0044 Primary

  for image preview or review, e.g. to help the user position a sheet · CPC title

• H04N23/71

  Circuitry for evaluating the brightness variation · CPC title

• H04N23/74

  by influencing the scene brightness using illuminating means · CPC title

• H04N23/57

  Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title