Display control method, data process apparatus, and computer-readable recording medium

Patent metadata

Field	Value
Publication number	US-10558425-B2
Application number	US-201615130241-A
Country	US
Kind code	B2
Filing date	Apr 15, 2016
Priority date	May 22, 2015
Publication date	Feb 11, 2020
Grant date	Feb 11, 2020

Abstract

A method that causes a computer to execute a display control process. The method includes generating identification information in a number corresponding to a number of object information included in a display area of a display, and displaying the object information and the identification information in association with each other.

First claim

What is claimed is:

1. A method that causes a terminal to execute a display control process, the method comprising:
specifying object information to be displayed on a display depending on a location of a reference object in an image among a plurality of object information upon detecting the reference object corresponding to the plurality of the object information in the image captured by an imaging device, the location of the reference object varying in the image in accordance with a movement of the imaging device;
generating a number of identification information corresponding to a current number of the specified object information to be displayed in a display area of the display;
displaying, on the display, the object information, and the identification information by corresponding to the object information;
detecting the object information that is selected to be displayed in the display area; and
determining whether relationship information associated with the detected object information by referring to a storage unit, the storage unit storing the relationship information that associates the object information with the identification information;
when the relationship information corresponding to the detected object information is stored in the storage unit, the detected object information is displayed in association with the identification information associated with the detected object information,
when the relationship information corresponding to the detected object information is not stored in the storage unit, a relationship information that associates the detected object information with the identification information is generated and stored in the storage unit,
when the detected object information disappears from the display area, the relationship information corresponding to the detected object information is erased from the storage unit at a predetermined timing on or after a time when the relationship information corresponding to the detected object information is stored in the storage unit, and
the predetermined timing is when the number of other object information stored in association with the relationship information exceeds a criterion.

2. The method as claimed in claim 1 , further comprising:
identifying a selectable object information among the object information included in the display area;
wherein the identified selectable object information is associated with the identification information and displayed in association with the identification information.

3. The method as claimed in claim 1 , wherein the generating includes generating the object information according to a position in which the object information is displayed in the display area.

4. A data process apparatus comprising:
a processor that executes a process including:
specifying object information to be displayed on a display depending on a location of a reference object in an image among a plurality of object information upon detecting the reference object corresponding to the plurality of the object information in the image captured by an imaging device, the location of the reference object varying in the image in accordance with a movement of the imaging device;
generating a number of identification information corresponding to a current number of the specified object information to be displayed in a display area of the display,
displaying, on the display, the object information, and the identification information by corresponding to the object information;
detecting, by way of the processor, the object information that is selected to be displayed in the display area, and
determining, by way of the processor, whether relationship information associated with the detected object information by referring to the memory, the memory storing the relationship information that associates the object information with the identification,
when the relationship information corresponding to the detected object information is stored in the memory, the detected object information is displayed in association with the identification information associated with the detected object information,
when the relationship information corresponding to the detected object information is not stored in the memory, the relationship information that associates the detected object information with the identification information is generated and stored in the memory,
when the detected object information disappears from the display area, the relationship information corresponding to the detected object information is erased from the memory at a predetermined timing after the detected object information disappears from the display area, and
the predetermined timing is when the period in which the detected object information reappears in the display area satisfies a criterion.

5. The data process apparatus as claimed in claim 4 ,
wherein the display control process further includes identifying, by way of the processor, selectable object information among the object information included in the display area, and
wherein the identified selectable information is associated with the identification information and displayed in association with the identification information.

6. The data process apparatus as claimed in claim 4 , wherein the generating includes generating, by way of the processor, the object information according to a position in which the object information is displayed in the display area.

7. The data process apparatus as claimed in claim 4 ,
wherein the display control process further includes assigning an order to the identification information displayed in association with the object information,
wherein the object information includes a first object information displayed on a left side of the display area and a second object information displayed on a right side of the display area, and
wherein the order assigned to the identification information of the first object information precedes the order assigned to the identification information of the second object information.

8. The data process apparatus as claimed in claim 7 , wherein the display control process further includes
analyzing, by way of the processor, audio information input to the data process apparatus, and
determining, by way of the processor, whether audio indicating a predetermined command is included in the audio information, and
wherein when the audio indicating the predetermined command is determined to be included in the audio information, an order to select the first object information before selecting the second object information is switched to an order to select the second object information before selecting the first object information.

9. The data process apparatus as claimed in claim 8 , wherein the audio includes audio corresponding to right, then, or next.

10. The data process apparatus as claimed in claim 4 , wherein the display control process further includes
detecting, by way of the processor, the object information that is selected to be displayed in the display area, and
determining, by way of the processor, whether relationship information associated with the detected object information by referring to a storage unit, the memory storing the relationship information that associates the object information with the identification information,
wherein when the relationship information corresponding to the detected object information is stored in the memory, the detected object information is displayed in association with the identification information associated with the detected object information,
wherein when the relationship information corresponding to the detected object information is not stored in the memory, the relationshi

Assignees

• Fujitsu Ltd

Inventors

• Imamura Kyosuke
• Murakami Iori

Classifications

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title