Pointing system, pointing device, and pointing control method

Patent metadata

Field	Value
Publication number	US-9880639-B2
Application number	US-201214118590-A
Country	US
Kind code	B2
Filing date	May 22, 2012
Priority date	May 31, 2011
Publication date	Jan 30, 2018
Grant date	Jan 30, 2018

Abstract

[Object] To provide a pointing system capable of presenting an intuitive operational feeling to a user.
[Solving Means] A pointing device includes a casing, a tactile sense presentation section, and a sensor section. The sensor section detects an operation for the casing and outputs an operation signal for controlling a movement of a pointer on a screen. The control apparatus includes an area setting section and a signal generation section. The area setting section sets a first area that belongs to an inside of a display area of an object on the screen, a second area that belongs to an outside of the display area of the object, and a third area that belongs to a boundary portion between the first area and the second area. The signal generation section calculates a position of the pointer based on the operation signal to generate, when the pointer is located in the first area, a control signal by which the tactile sense presentation section is driven in a first drive mode and generates, when the pointer is located in the third area, a control signal by which the tactile sense presentation section is driven in a second drive mode.

First claim

The invention claimed is:

1. A pointing system, comprising:
a pointing device, wherein the pointing device is a spatial operation type input apparatus, the pointing device including:
a casing,
a tactile sense presentation section including a plurality of vibrating bodies, each of which is configured to generate a vibration in an arbitrary axis direction by being individually driven, wherein the tactile sense presentation section is configured to present a tactile sense having tactile characteristics to the casing, and
a sensor section configured to detect an operation for the casing and output an operation signal for controlling a movement of a pointer on a screen; and

at least one processor programmed to:
set a first area that belongs to an inside of a display area of an object on the screen, a second area that belongs to an outside of the display area of the object, and a third area that belongs to a boundary portion between the first area and the second area;
calculate a position of the pointer on the screen based on the operation signal;
generate, in response to determining that the pointer has entered the first area, a first control signal by which the tactile sense presentation section is driven in a first drive mode;
generate, when the pointer is located in the third area, a second control signal by which the tactile sense presentation section is driven in a second drive mode, wherein the tactile characteristics of a first tactile sense presented by the tactile sense presentation section to the casing when driven in the first drive mode are different than the tactile characteristics of a second tactile sense presented by the tactile sense presentation section to the casing when driven in the second drive mode;
determine that the pointer is moving toward the object by an operation of the casing; and
generate, in response to determining that the pointer is moving toward the object, a third control signal by which the tactile sense presentation section is driven toward a moving direction of the casing.

2. The pointing system according to claim 1 , wherein
the at least one processor is further programmed to generate, when determining that the pointer is moving away from the object by the operation of the casing, a fourth control signal by which the tactile sense presentation section is driven toward a direction opposite to the moving direction of the casing.

3. The pointing system according to claim 1 , wherein
the at least one processor is further programmed to:
calculate a moving speed of the casing; and
change a drive force of the tactile sense presentation section in accordance with the calculated moving speed.

4. The pointing system according to claim 1 , wherein the object is an icon.

5. The pointing system according to claim 1 , wherein
the object is a three-dimensional video, and
the first area is a three-dimensional area associated with the three-dimensional video.

6. The pointing system according to claim 1 , wherein
the sensor section includes an inertial sensor configured to detect a movement of the casing and generate a signal associated with the movement.

7. The pointing system according to claim 1 , wherein:
the at least one processor is further programmed to generate, when the pointer is located in the second area, a fifth control signal by which the tactile sense presentation section is driven in a third drive mode.

8. The pointing system according to claim 1 , wherein when the screen displays a plurality of objects,
the at least one processor is further programmed to:
set, for each object of the plurality of objects, a first area that belongs to the inside of a display area of each object; and
generate a different control signal when the pointer is located in the first area of a first object of the plurality of objects than when the pointer is located in the first area of a second object of the plurality of objects, wherein the tactile characteristics of the tactile sense presented by the tactile sense presentation section to the casing, when driven in response to the different control signals, are different.

9. The pointing system according to claim 1 , wherein:
the at least one processor is further programmed to change a width of the third area based on an operation of the user.

10. The pointing system according to claim 1 , wherein:
the tactile characteristics of the first tactile sense and/or the second tactile sense comprise a plurality of vibrating patterns.

11. The pointing system according to claim 1 , wherein:
the at least one processor is incorporated within the casing of the pointing device.

12. A pointing device, wherein the pointing device is a spatial operation type input apparatus, the pointing device comprising:
a casing;
a tactile sense presentation section including a plurality of vibrating bodies each of which is configured to generate a vibration in an arbitrary axis direction by being individually driven, wherein the tactile sense presentation section is configured to present a tactile sense having tactile characteristics to the casing;
a sensor section configured to detect a movement of the casing within a space and output an operation signal for controlling a movement of a pointer on a screen; and
at least one processor programmed to:
generate, in response to determining that the pointer has entered an inside of a display area of an object on the screen, a first control signal by which the tactile sense presentation section is driven in a first drive mode;
generate, when the pointer is located in a predetermined area around the object, a second control signal by which the tactile sense presentation section is driven in a second drive mode, wherein the tactile characteristics of a first tactile sense presented by the tactile sense presentation section to the casing when driven in the first drive mode are different than the tactile characteristics of a second tactile sense presented by the tactile sense presentation section to the casing when driven in the second drive mode;
determine that the pointer is moving toward the object by an operation of the casing; and
generate, in response to determining that the pointer is moving toward the object, a third control signal by which the tactile sense presentation section is driven toward a moving direction of the casing.

13. A pointing control method, comprising:
setting a first area that belongs to an inside of a display area of an object on a screen, a second area that belongs to an outside of the display area of the object, and a third area that belongs to a boundary portion between the first area and the second area;
calculating a position of a pointer on the screen based on an operation signal output from a pointing device that moves the pointer on the screen;
presenting, in response to determining that the pointer has entered the first area, a first tactile sense having tactile characteristics to the pointing device in a first drive mode;
presenting, when the pointer is located in the third area, a second tactile sense having tactile characteristics to the pointing device in a second drive mode, wherein the tactile characteristics of the first tactile sense in the first drive mode are different than the tactile characteristics of the second tactile sense in the second drive mode;
determining that the pointer is moving toward the object by an operation of the casing of the pointing device; and
presenting, in response to determining that the pointer is moving toward object, a third tactile sense having tactile characteristics toward a moving direction of the casing to the pointing device in a third drive mode.

Assignees

• Ito Osamu
• Kawabe Hideo
• Maeda Takeshi
• Seki Kousuke
• Sony Corp

Inventors

• Ito Osamu
• Kawabe Hideo
• Maeda Takeshi
• Seki Kousuke

Classifications

• G06F3/04812

  Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F2203/014

  Force feedback applied to GUI · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/033 Primary

  Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041) · CPC title