Information processing device, method and program

Patent metadata

Field	Value
Publication number	US-9465433-B2
Application number	US-201113014953-A
Country	US
Kind code	B2
Filing date	Jan 27, 2011
Priority date	Mar 5, 2010
Publication date	Oct 11, 2016
Grant date	Oct 11, 2016

Abstract

An information processing device includes a capture section capturing an image of an object, an acquisition section acquiring the image captured by the capture section, a calculation section calculating vibration information on the basis of the image acquired by the acquisition section, a determination section determining a vibration command on the basis of the vibration information calculated by the calculation section, and a control section executing predetermined processing on the basis of the vibration command determined by the determination section.

First claim

What is claimed is:

1. An information processing device comprising:
circuitry configured to
recognize a gesture performed by a user as a gesture command, the gesture command corresponding to a first function,
acquire an image of an object,
calculate vibration information indicative of a vibration of the information processing device, as a result of a user tap input, on the basis of the acquired image,
determine whether a vibration event occurred based on the calculated vibration information,
when it is determined that the vibration event occurred, invalidate the gesture command and determine whether the vibration event includes a vibration command corresponding to a second function,
when it is determined that the vibration event did not occur, execute the first function,
when it is determined that the vibration event includes the vibration command and the vibration command is generated more than a predetermined time period after a latest recorded movement of the information processing device, execute the second function, and
when it is determined that the vibration event does not include the vibration command, store the vibration event as a new recorded movement of the information processing device.

2. The information processing device according to claim 1 , wherein, when determining whether the vibration event includes the vibration command, the circuitry is further configured to
determine whether a quantity of discrete feature points in the acquired image is a value greater than or equal to a first threshold, the first threshold corresponding to a quantity of discrete feature points sufficient for calculating a frequency of the vibration information;
when the quantity of discrete feature points in the acquired image is a value greater than or equal to the first threshold,
calculate the frequency of the vibration information;
determine that the vibration event includes the vibration command when the frequency is greater than or equal to a second threshold; and
determine that the vibration event does not include the vibration command when the frequency is less than the second threshold; and

when the quantity of discrete feature points in the acquired image is not a value greater than or equal to the first threshold, detect a new feature point.

3. The information processing device according to claim 2 ,
wherein the circuitry is configured to prohibit execution of the second function when the frequency is less than the second threshold.

4. The information processing device according to claim 2 ,
wherein the circuitry is configured to determine that the vibration event includes the vibration command when a ratio of a number of feature points having velocity vectors of the same direction is greater than or equal to a third threshold.

5. The information processing device according to claim 2 ,
wherein, when the quantity of discrete feature points in the acquired image is greater than or equal to the first threshold, the circuitry is configured to calculate the vibration information on the basis of positions and velocity vectors of the feature points in the acquired image.

6. The information processing apparatus according to claim 2 , wherein the circuitry is configured to cluster the feature points based upon velocity vectors of the feature points.

7. The information processing apparatus according to claim 2 , wherein, in calculating the vibration information based upon the feature points in the acquired image, the circuitry is configured to ignore feature points that are located close to one another.

8. The information processing device according to claim 2 , wherein the circuitry is configured to calculate the vibration information on the basis of positions and velocity vectors of the feature points in the acquired image.

9. The information procession apparatus according to claim 2 , wherein the circuitry is configured to cluster feature points whose velocity vectors point in the same direction into the same cluster.

10. The information processing apparatus according to claim 9 , wherein the circuitry is configured to determine that the vibration event includes the vibration command when a ratio of feature points of the same cluster with respect to all the feature points is greater than or equal to a third threshold.

11. An information processing method comprising:
recognizing a gesture performed by a user as a gesture command, the gesture command corresponding to a first function;
acquiring an image of an object;
calculating, by the circuitry, vibration information indicative of a vibration of an information processing device, as a result of a user tap input, on the basis of the acquired image;
determining whether a vibration event occurred based on the calculated vibration information;
when it is determined that the vibration event occurred, invalidating the gesture command and determining whether the vibration event includes a vibration command corresponding to a second function;
when it is determined that the vibration event did not occur, executing the first function by the information processing device;
when it is determined that the vibration event includes the vibration command and the vibration command is generated more than a predetermined time period after a latest recorded movement of the information processing device, executing the second function; and
when it is determined that the vibration event does not include the vibration command, storing the vibration event as a new recorded movement of the information processing device.

12. The information processing method according to claim 11 , wherein determining whether the vibration event includes the vibration command comprises:
determining whether a quantity of discrete feature points in the acquired image is a value greater than or equal to a first threshold, the first threshold corresponding to a quantity of discrete feature points sufficient for calculating a frequency of the vibration information;
when the quantity of discrete feature points in the acquired image is a value greater than or equal to the first threshold,
calculating the frequency of the vibration information;
determining that the vibration event includes the vibration command when the frequency is greater than or equal to a second threshold; and
determining that the vibration event does not include the vibration command when the frequency is less than the second threshold; and

when the quantity of discrete feature points in the acquired image is not a value greater than or equal to the first threshold, detecting a new feature point.

13. A non-transitory computer readable medium storing a program configured to cause a processor of an information processing device to perform a method comprising:
recognizing a gesture performed by a user as a gesture command, the gesture command corresponding to a first function;
acquiring an image of an object;
calculating vibration information indicative of a vibration of the information processing device, as a result of a user tap input, on the basis of the acquired image;
determining whether a vibration event occurred based on the calculated vibration information;
when it is determined that the vibration event occurred, invalidating the gesture command and determining whether the vibration event includes a vibration command corresponding to a second function;
when it is determined that the vibration event did not occur, executing the first function by the information processing device;
when it is determined that the vibration event includes the vibration command and the vibration command is generated more than a predetermined time period aft

Assignees

• Shigeta Osamu
• Noda Takuro
• Sony Corp

Inventors

• Shigeta Osamu
• Noda Takuro

Classifications

• G06F3/01 Primary

  Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title