Recording medium

Patent metadata

Field	Value
Publication number	US-2018089902-A1
Application number	US-201715714127-A
Country	US
Kind code	A1
Filing date	Sep 25, 2017
Priority date	Sep 28, 2016
Publication date	Mar 29, 2018
Grant date	—

Abstract

The disclosure discloses a non-transitory computer-readable recording medium storing a virtual label display process program for executing steps. The steps include a composite image generating step, a composite image output step, a determining step, and a notifying step. In the composite image generating step, a real image data of a desired field of view and a virtual image data of a label are combined. In the composite image output step, a composite image data is output to a display device, and a virtual image of the label on the display device is superimposed and displayed. In the determining step, it is determined whether a desired suitability is satisfied between an exterior appearance of a background object and an exterior appearance of the label based on the real image data and the virtual image data. In the notifying step, a predetermined suitability notification is made.

First claim

What is claimed is:

1 . A non-transitory computer-readable recording medium capable of reading by a computing device, storing a virtual label display process program for executing steps on said computing device, the computing device provided in a portable terminal that is configured to operate a label producing device configured to produce an attachable label and includes an operation device, an imaging device, a display device, and the computing device,
said steps comprising: a virtual image generating step for generating virtual image data of said label; a real image acquiring step for acquiring real image data of a desired field of view photographed by said imaging device; a composite image generating step for combining said real image data acquired in said real image acquiring step and said virtual image data generated in said virtual image generating step to generate composite image data; a composite image output step for outputting said composite image data generated in said composite image generating step to said display device, and superimposing and displaying a virtual image of said label in an image of said desired field of view on said display device; a determining step for determining whether a desired suitability is satisfied between an exterior appearance of a background object included in said desired field of view and an exterior appearance of said label based on said real image data acquired in said real image acquiring step and said virtual image data generated in said virtual image generating step; and a notifying step for making a predetermined suitability notification in the case that it is determined that said suitability is satisfied in said determining step.

2 . The recording medium according to claim 1 , wherein
in said composite image generating step, said composite image data is generated such that a display position of said virtual image of said label on said display device is substantially fixed regardless of variation of said field of view.

3 . The recording medium according to claim 2 , wherein
in said composite image generating step, said composite image data is generated such that said virtual image of said label is continuously displayed at the same position on said display device regardless of a passage of time.

4 . The recording medium according to claim 1 , wherein
in said determining step, said suitability is determined based on color information of a predetermined range among said real image data and color information of said virtual image data, wherein the range is narrower than said desired field of view and includes said background object.

5 . The recording medium according to claim 4 , wherein
in said determining step, it is at least determined as said desired suitability whether an increased degree of clarity of said label is equal to or greater than a predetermined threshold value if said label is attached to said background object.

6 . The recording medium according to claim 4 , wherein
in said determining step, it is at least determined as said desired suitability whether a decreased degree of clarity of said label is within a predetermined range if said label is attached to said background object.

7 . The recording medium according to claim 1 , wherein
said computing device is further caused to execute a suitability selection step for accepting selection input of contents of said desired suitability via said operation device, and wherein in said determining step, it is determined whether said desired suitability accepted in said suitability selection step is satisfied between the exterior appearance of said background object and the exterior appearance of said label.

8 . The recording medium according to claim 1 , wherein
in said composite image generating step, said composite image data is generated on the basis of the exterior appearance of said background object based on said real image data by combining and superimposing said virtual image data in a form having the exterior appearance size of said label changed in magnification ratio with said real image data.

9 . The recording medium according to claim 1 , wherein
said computing device is further caused to execute an editing accepting step for accepting an editing operation for print contents of said label, and wherein in said virtual image generating step, said virtual image data reflecting said editing operation accepted in said editing accepting step is generated.

Assignees

• Brother Ind Ltd

Inventors

• Zhu Feng
• Kako Keigo

Classifications

• G06T11/00

  Two-dimensional [2D] image generation · CPC title

• G06F3/1208

  resulting in improved quality of the output result, e.g. print layout, colours, workflows, print preview · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/1292

  Mobile client, e.g. wireless printing · CPC title

• G06F3/1256 Primary

  User feedback, e.g. print preview, test print, proofing, pre-flight checks · CPC title