Imaging apparatus and system for recoloring user-marked images

Patent metadata

Field	Value
Publication number	US-10747480-B2
Application number	US-201916297711-A
Country	US
Kind code	B2
Filing date	Mar 11, 2019
Priority date	Mar 12, 2018
Publication date	Aug 18, 2020
Grant date	Aug 18, 2020

Abstract

An image forming apparatus includes a determination unit, a process identifying unit, a color changing unit, and an image forming unit. The determination unit determines whether the writing image identified by a writing image identifying unit matches a preliminarily determined writing pattern. The process identifying unit identifies a color change process corresponding to the writing pattern when the writing image is determined to match the writing pattern at the determination unit. The color changing unit deletes the writing image from the image and changes a display style in the image to a display style with the writing color indicated in the color information in accordance with the color change process identified by the process identifying unit. The image forming unit forms an image obtained such that the color changing unit changes the display style in the image to the display style with the writing color on a recording sheet.

First claim

What is claimed is:

1. An image processing system comprising:
an information processing device; and
an image forming apparatus,
wherein the information processing device includes:
an image obtaining unit that obtains an image;
a display that displays the image obtained by the image obtaining unit on a display screen of the display;
an instruction body with which a user performs a selection operation of a writing color and a writing operation by moving the instruction body along the display screen;
a coordinate detecting unit that detects respective writing coordinates that indicate positions of the instruction body on the image of the display screen, the instruction body moving along the display screen;
a color information obtaining unit that obtains color information that indicates the writing color selected at the instruction body;
a writing image drawing unit that draws a writing image on the image of the display screen with the writing color indicated in the color information obtained by the color information obtaining unit and with a trajectory that connects the respective writing coordinates detected by the coordinate detecting unit;
a writing information generating unit that generates writing information including coordinate information and the color information, the coordinate information indicating the respective writing coordinates of the writing image drawn by the writing image drawing unit; and
a transmitter that transmits image data and the writing information, the image data including the writing image drawn by the writing image drawing unit,

wherein the image forming apparatus includes:
a receiver that receives the image data and the writing information from the transmitter;
a writing image identifying unit that identifies the writing image in the image with the image data received at the receiver using the coordinate information and the color information included in the writing information;
a determination unit that determines whether the writing image identified by the writing image identifying unit matches a preliminarily determined writing pattern or not;
a process identifying unit that identifies a color change process corresponding to the writing pattern when the writing image is determined to match the writing pattern at the determination unit;
a color changing unit that deletes the writing image from the image and changes a display style in the image to a display style with the writing color indicated in the color information in accordance with the color change process identified by the process identifying unit; and
an image forming unit that forms an image obtained such that the color changing unit changes the display style in the image to the display style with the writing color on a recording sheet.

2. An image forming apparatus for forming image based on data received from an information processing device, image forming apparatus comprising:
a receiver that receives image data and writing information from the information processing device, the image data including a writing image drawn on an image, the writing information including coordinate information and color information, the coordinate information including information on respective writing coordinates that indicate positions on the image for the writing image, the color information indicating a writing color of the writing image;
a writing image identifying unit that identifies the writing image in the image with the image data received at the receiver using the coordinate information and the color information included in the writing information;
a determination unit that determines whether the writing image identified by the writing image identifying unit matches a preliminarily determined writing pattern or not;
a process identifying unit that identifies a color change process corresponding to the writing pattern when the writing image is determined to match the writing pattern at the determination unit;
a color changing unit that deletes the writing image from the image and changes a display style in the image to a display style with the writing color indicated in the color information in accordance with the color change process identified by the process identifying unit; and
an image forming unit that forms an image obtained such that the color changing unit changes the display style in the image to the display style with the writing color on a recording sheet.

3. The image forming apparatus according to claim 2 ,
wherein the image includes a figure whose outline is closed,
the image forming apparatus further comprises an outline extracting unit that extracts an outline of a figure including the writing image identified by the writing image identifying unit or a figure having an outer periphery on which the writing image is positioned,
the determination unit determines whether the writing image identified by the writing image identifying unit matches a preliminarily determined writing pattern with respect to the figure whose outline has been extracted by the outline extracting unit in the image or not, and
the color changing unit deletes the writing image from the image and changes a display style of the figure whose outline has been extracted by the outline extracting unit in the image to a display style with the writing color indicated in the color information in accordance with the color change process identified by the process identifying unit.

4. The image forming apparatus according to claim 3 ,
wherein the preliminarily determined writing pattern includes a first writing pattern and a second writing pattern with respect to the figure where an inside of the outline is white, the first writing pattern is a style positioned inside the outline and along the outline, and the second writing pattern is a style positioned outside the outline of the figure and along the outline,
when the writing image is determined to match the first writing pattern at the determination unit, the process identifying unit identifies a first color change process as the color change process corresponding to the first writing pattern, and the color changing unit changes colors of the outline and the inside of the outline of the figure to the writing color in accordance with the first color change process,
when the writing image is determined to match the second writing pattern at the determination unit, the process identifying unit identifies a second color change process as the color change process corresponding to the second writing pattern, and the color changing unit changes a color of the outline of the figure to the writing color in accordance with the second color change process, and
when two of the writing images are determined to match the respective first writing pattern and second writing pattern at the determination unit, the process identifying unit identifies the first color change process as the color change process corresponding to the first writing pattern, the color changing unit changes a color inside the outline of the figure to a first writing color in accordance with the first color change process, the process identifying unit identifies the second color change process as the color change process corresponding to the second writing pattern, and the color changing unit changes a color of the outline of the figure to a second writing color in accordance with the second color change process.

5. The image forming apparatus according to claim 3 ,
wherein the preliminarily determined writing pattern includes a third writing pattern and a fourth writing pattern with respect to the figure where an inside of the outline is colored, the third writing pattern is a style positioned outside the outline and along the outline, and the fourth writing pattern is a style positioned outside the third writing pattern

Assignees

• Kyocera Document Solutions Inc

Inventors

• Utsumi Daisuke
• Sakashita Fumiya

Classifications

• G06V30/36

  Matching; Classification · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06T11/10

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06F40/166 Primary

  Editing, e.g. inserting or deleting · CPC title

• G06V10/56

  relating to colour · CPC title