Information processing device and information processing method for improving operability in selecting graphical user interface by generating multiple virtual points of contact

Patent metadata

Field	Value
Publication number	US-9841890-B2
Application number	US-201213611239-A
Country	US
Kind code	B2
Filing date	Sep 12, 2012
Priority date	Nov 28, 2011
Publication date	Dec 12, 2017
Grant date	Dec 12, 2017

Abstract

A plurality of GUIs are displayed on the screen of a display. A hit determination area of each GUI is defined within a graphic of the GUI. When a user touches a point of contact, four virtual points of contact are generated in the shape of a ‘V’ within the screen. A GUI desired to be selected by the user is identified according to a predetermined rule by referring to whether points of contact are located within each hit determination area, the number of points of contact, the priority level defined for each GUI, etc.

First claim

What is claimed is:

1. An information processing device having a processor comprising:
an input and output control unit configured to acquire, using the processor, a position of a single point of designation designated by a user in a display image including graphical user interfaces (GUIs) shown on a display screen;
a user operation content identification unit configured to simultaneously generate multiple points which are not displayed with a predetermined pattern at positions determined according to the position of the single point of designation on a plane that forms the display image, to acquire a hit score for each GUI, the hit score being a number of the multiple points and the single point of designation inside hit determination areas defined for respective GUIs, and to select a single GUI with a highest score as a selected GUI; and
a content processing unit is configured to execute a process mapped to the selected GUI,
wherein the user operation content identification unit distributes the multiple points in a shape of a ‘V’ having an apex on the single point of designation when the information processing device is held by the user, and distributes the multiple points circularly and evenly around the single point of designation when the information processing device is not held by the user,
wherein, when the information processing device is held by the user, the input and output control unit acquires the single point of designation as a single point of contact on the touch panel by a finger of a hand holding the information processing device, and
wherein the user operation content identification unit refers to a position at a base of the finger of the hand holding the information processing device and defines a direction of a vector, extending from the position at the base of the finger to the single point of contact, as the direction of a tip of the finger and distributes the multiple points around a line extended from the vector in the direction of the vector.

2. The information processing device according to claim 1 , wherein the user operation content identification unit arranges the multiple points with the predetermined pattern defined in association with the device or the display image.

3. The information processing device according to claim 1 , further comprising: a rear touch panel configured to sense a position of a finger supporting the information processing device from behind, wherein the user operation content identification unit identifies the position of the base of the finger, based on the position sensed by the rear touch panel and a size of the hand holding the information processing device.

4. The information processing device according to claim 1 , further comprising: a sensor configured to acquire an angle of tilt of the display screen, wherein the user operation content identification unit changes the distribution of the multiple points in accordance with the angle of the tilt of the display screen by referring to a file where the angle of tilt and an optimum distribution shape are mapped together.

5. The information processing device according to claim 1 , further comprising: a sensor configured to acquire an image of the finger on the display screen, wherein the user operation content identification unit identifies a direction of the tip of the finger based on the image of the finger and distributes the multiple points around the identified direction.

6. The information processing device according to claim 1 , wherein the user operation content identification unit switches the position at the base of the finger depending on a region including the single point of contact on the touch panel.

7. The information processing device according to claim 1 , wherein the position at the base of the finger is marked on the information processing device so that a user adjusts the position of the hand holding accordingly.

8. The information processing device according to claim 1 ,
wherein the user operation content identification unit distributes the multiple points in a shape of ‘Y’, a straight line or a curved line that passes through the single point of contact on the touch panel depending on an information processing device or screen configuration.

9. The information processing device according to claim 1 , wherein the user operation content identification unit changes an orientation and a size of the ‘V’ depending on a relation between the single point of contact and an edge of the touch panel.

10. The information processing device according to claim 1 , wherein the user operation content identification unit changes a width of the ‘V’ depending on a relation between positions of the single point of contact, GUIs, and an edge of the touch panel.

11. An information processing method comprising:
acquiring a position of a single point of designation designated by a user in a display image including graphical user interfaces (GUIs);
simultaneously generating multiple points which are not displayed with a predetermined pattern at positions determined according to the single position of the point of designation on a plane that forms the display image,
acquiring a hit score for each GUI, the hit score being a number of the multiple points and the single point of designation inside hit determination areas defined for respective GUIs,
selecting a single GUI with a highest score as a selected GUI; and
executing information processing mapped to the selected GUI,
wherein the generating distributes the multiple points in a shape of ‘V’ having an apex on the single point of designation when an information processing device is held by the user, and distributes the multiple points circularly and evenly around the single point of designation when the information processing device is not held by the user,
wherein, when the information processing device is held by the user, the single point of designation is set as a single point of contact on the touch panel of a finger of a hand holding the information processing device, and
wherein the generating refers to a position at a base of the finger of the hand holding the information processing device and defines a direction of a vector, extending from the position at the base of the finger to the single point of contact, as the direction of a tip of the finger and distributes the multiple points around a line extended from the vector in the direction of the vector.

12. A non-transitory computer-readable recording medium encoded with a computer program comprising:
a module configured to acquire a position of a single point of designation designated by a user in a display image including graphical user interfaces (GUIs);
a module configured to simultaneously generate multiple points which are not displayed with a predetermined pattern at positions determined according to the position of the single point of designation on a plane that forms the display image, to acquire a hit score for each GUI, the hit score being a number of the multiple points and the single point of designation inside hit determination areas defined for respective GUIs, and to select a single GUI with a highest score as a selected GUI; and
a module configured to execute information processing mapped to the selected GUI, wherein
the module configured to generate the multiple points distributes the multiple points in a shape of ‘V’ having an apex on the single point of designation when the computer is held by the user, and distributes the multiple points circularly and evenly around the single point of designation when the computer is not held by the user,
wherein, when the information processing device is held by the user, the module configured to acqui

Assignees

• Kitao Takashi
• Hyodo Katsuya
• Mochizuki Arito
• Sony Corp
• Sony Interactive Entertainment Inc

Inventors

• Kitao Takashi
• Hyodo Katsuya
• Mochizuki Arito

Classifications

• G06F3/041

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G06F3/00

  Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements · CPC title

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title