Apparatus, system and method for controlling an image processing device via a mobile device

Patent metadata

Field	Value
Publication number	US-2016366294-A1
Application number	US-201514739856-A
Country	US
Kind code	A1
Filing date	Jun 15, 2015
Priority date	Jun 15, 2015
Publication date	Dec 15, 2016
Grant date	—

Abstract

An image processing device is provided that generates a graphical user interface including at least one image element that enables receipt of a data value of a particular type therein, the graphical user interface being generated in response to selecting a processing job to be performed by the image processing device. The generated graphical user interface is mirrored to a mobile computing device by transmitting data representative of the graphical user interface to a mobile computing device via a short distance communication protocol. A return data object is received, via the short distance communication protocol, that represents a modified graphical user interface including the at least one image element having the data value of the particular type, the data value having been provided using mobile computing device. The image processing device initiates execution of the processing job to generate job data and automatically associating the data value derived from the modified graphical user interface with the generated job data.

First claim

1 . An image processing device comprising:
one or more processors; and a memory coupled to the one or more processors, the memory including instructions stored therein that, when executed by the one or more processors, cause the one or more processors to
generate a graphical user interface including at least one image element enabling receipt of a data value of a particular type therein, the graphical user interface being generated in response to selecting a processing job to be performed by the image processing device;
mirror the generated graphical user interface on a mobile computing device by transmitting form object data describing a structure of the graphical user interface including the at least one image element and the particular type of data to be received within the graphical user interface to a mobile computing device via a short distance communication protocol, the form object data being used by the mobile computing device to render the graphical user on the mobile computing device;
receive a return data object, via the short distance communication protocol, including data describing a modified graphical user interface including the at least one image element having the data value of the particular type, the data value having been input using mobile computing device;
executing the processing job to generate job data and automatically associating the data value derived from the modified graphical user interface with the generated job data.

2 . The image processing device according to claim 1 , wherein the instructions, when executed by the one or more processors cause the one or more processors to generate the form data object used to mirror the graphical user interface by
identifying, from data used to generate the graphical user interface, a number of image elements and data types associated with each identified image element group identified image elements requiring a same type of data into respective groups; generating a unique tag describing each identified image element including the type of data required thereby; creating the form data object including each unique tag; and transmitting the form data object via short distance communication protocol to the mobile computing device.

3 . The image processing device according to claim 2 , wherein the instructions, when executed by the one or more processors cause the one or more processors to generate the unique tag for each image element having an associated data type by
generating an ID value identifying the particular type of data generating a descriptor value describing the image element and type of data, the descriptor value being displayed within the graphical user interface; and creating a value parameter describing at least one parameter of the data value being requested by the image element; and concatenating the ID value, descriptor value and value parameter to generate the unique tag.

4 . The image processing device according to claim 1 , wherein the type of data associated with a respective image element includes at least one of (a) text data; (b) location data associated with the mobile computing device; (c) a date value; and (d) selection value data identifying a particular value selected from a candidate set of data values.

5 . The image processing device according to claim 1 , wherein the type of data
associated with a respective image element is a type of data generated by at least one external application executing on the mobile computing device.

6 . The image processing device according to claim 5 , wherein
the return data object includes a data value derived from the at least one external application executing on the mobile computing device which enables the image processing device to indirectly acquire a data value of a particular type that the image processing device could not acquire directly via the graphical user interface generated thereby.

7 . The image processing device according to claim 6 , wherein
the return data object includes additional data values associated with image elements that were not present when the graphical user interface was mirrored on the mobile computing device; and the additional data values are associated with the job data.

8 . The image processing device according to claim 1 , wherein the instructions, when executed by the one or more processors cause the one or more processors to
suspend the selected processing job on the image processing device when the graphical user interface is mirrored on the mobile computing device.

9 . The image processing device according to claim 1 , wherein the instructions, when executed by the one or more processors cause the one or more processors to
detect a presence of a mobile computing device; and automatically mirroring the graphical user interface on the mobile computing device enabling entry of the data value associated with the at least one image element by the mobile computing device.

10 . A method for controlling an image processing device comprising:
generating a graphical user interface including at least one image element enabling receipt of a data value of a particular type therein, the graphical user interface being generated in response to selecting a processing job to be performed by the image processing device; mirroring the generated graphical user interface on a mobile computing device by transmitting a form object data describing a structure of the graphical user interface including the at least one image element and the particular type of data to be received within the graphical user interface to a mobile computing device via a short distance communication protocol, the form data object being used by the mobile computing device to render the graphical user interface on the mobile computing device; receive a return data object, via the short distance communication protocol, including data describing a modified graphical user interface including the at least one image element having the data value of the particular type, the data value having been input using mobile computing device; and executing the processing job to generate job data and automatically associating the data value derived from the modified graphical user interface with the generated job data.

11 . A mobile computing device comprising
one or more processors; and a memory coupled to the one or more processors, the memory including instructions stored therein that, when executed by the one or more processors, cause the one or more processors to
receive a form data object generated by an image processing device using a short distance communication protocol, the form data object includes data describing a form displayed in a graphical user interface of an image processing device, the form data object including configuration data used to render, on the mobile computing device, a mobile device user interface including at least one image element have a particular data type associated therewith;
parse the form data object to determine a type of data associated with the at least one image element;
select a function executed by the mobile computing device for inputting a data value corresponding to the determined type of data;
generate, by rendering on the mobile computing device, the mobile user interface based on the form data object and including the selected function enabling receipt of the data value input by a user of the mobile computing device;
create a return data object describing the at least one image element and including the data value entered by the user via the selected function; and
transmit the return data object, via the short distance communication protocol, to the image processing device enabling completion o

Assignees

• Canon Information & Imaging Solutions Inc
• Canon Usa Inc

Inventors

• Uroskin Konstantin
• Brady Nigel Patrick

Classifications

• H04N1/00493

  Particular location of the interface or console · CPC title

• H04N1/00474

  outputting a plurality of functional options, e.g. scan, copy or print · CPC title

• H04N2201/0075

  by a user operated remote control device, e.g. receiving instructions from a user via a computer terminal or mobile telephone handset · CPC title

• H04N1/00503 Primary

  Customising to a particular machine or model, machine function or application · CPC title

• H04N2201/0094

  Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception · CPC title