Information processing apparatus, information processing method, and driving data generation method

Patent metadata

Field	Value
Publication number	US-12528015-B2
Application number	US-202218577883-A
Country	US
Kind code	B2
Filing date	Jul 12, 2022
Priority date	Jul 14, 2021
Publication date	Jan 20, 2026
Grant date	Jan 20, 2026

Abstract

An operation information acquisition section acquires operation information indicating movement of an operation apparatus being held by a user's hand. The operation apparatus includes a kinesthetic sense presentation section that presents a kinesthetic sense to the user's hand and a tactile sense presentation section that presents a tactile sense to the user's hand. A control section controls movement of a virtual device corresponding to the operation apparatus in a space where a virtual object exists, according to the operation information. The control section generates first driving data for driving the kinesthetic sense presentation section and second driving data for driving the tactile sense presentation section, on the basis of a relation between the virtual device and the virtual object.

First claim

The invention claimed is:

1 . An information processing apparatus comprising:
at least one processor having hardware, a non-transitory memory containing instructions when executed by the processor causes the processor to perform the steps of: acquiring first operation information indicating movement of an operation apparatus that is held by a user's hand and includes a kinesthetic sense presentation section that presents a kinesthetic sense to the user's hand, controling movement of a virtual device corresponding to the operation apparatus in a virtual space according to the first operation information, generating driving data for driving the kinesthetic sense presentation section on a basis of the movement of the virtual device, acquiring second operation information indicating that the kinesthetic sense presentation section has been moved by the user's hand, and executing a function corresponding to the second operation information in the virtual space.

2 . The information processing apparatus according to claim 1 , wherein the second operation information includes a direction in which the kinesthetic sense presentation section has been moved by the user's hand.

3 . The information processing apparatus according to claim 2 , wherein the second operation information indicates that the kinesthetic sense presentation section has been moved by the user's hand in a direction different from a direction in which the kinesthetic sense presentation section has been moved in reference to the driving data.

4 . The information processing apparatus according to claim 3 , wherein the second operation information indicates that the kinesthetic sense presentation section has been moved by the user's hand in a direction opposite to the direction in which the kinesthetic sense presentation section has been moved in reference to the driving data.

5 . The information processing apparatus according to claim 2 , wherein the second operation information indicates that the kinesthetic sense presentation section has been moved by the user's hand in a direction identical to a direction in which the kinesthetic sense presentation section has been moved in reference to the driving data.

6 . The information processing apparatus according to claim 1 , wherein the at least one processor executes the function corresponding to the second operation information in the virtual space while the kinesthetic sense presentation section is presenting a kinesthetic sense to the user's hand.

7 . An information processing method comprising:
Acquiring, by a processor, first operation information indicating movement of an operation apparatus that is held by a user's hand and includes a kinesthetic sense presentation section that presents a kinesthetic sense to the user's hand; controlling, by the processor, movement of a virtual device corresponding to the operation apparatus in a virtual space according to the first operation information; generating, by the processor, driving data for driving the kinesthetic sense presentation section on a basis of the movement of the virtual device; acquiring, by the processor, second operation information indicating that the kinesthetic sense presentation section has been moved by the user's hand; and causing, by the processor, a function corresponding to the second operation information to be executed in the virtual space.

8 . An information processing apparatus comprising:
at least one processor having hardware, wherein the at least one processor a non-transitory memory containing instructions when executed by the processor causes the processor to perform the steps of: acquiring operation information indicating movement of an operation apparatus that is held by a user's hand and includes a kinesthetic sense presentation section that presents a kinesthetic sense to a first finger of the user and a tactile sense presentation section that presents a tactile sense to a second finger of the user, controling movement of a virtual device corresponding to the operation apparatus in a space where a virtual object exists, according to the operation information, and generating first driving data for driving the kinesthetic sense presentation section and second driving data for driving the tactile sense presentation section, on a basis of a relation between the virtual device and the virtual object.

9 . The information processing apparatus according to claim 8 , wherein the kinesthetic sense presentation section is a movable section that moves relative to a base body of the operation apparatus, and the tactile sense presentation section is a vibration section that generates vibration.

10 . The information processing apparatus according to claim 8 , wherein the at least one processor generates the first driving data for driving the kinesthetic sense presentation section, on a basis of a positional relation between the virtual device and the virtual object.

11 . The information processing apparatus according to claim 8 , wherein the at least one processor generates the second driving data for driving the tactile sense presentation section, on a basis of a relative speed between the virtual device and the virtual object.

12 . The information processing apparatus according to claim 11 , wherein the at least one processor generates the second driving data for driving the tactile sense presentation section, on a basis of a vibration profile derived from a vibration waveform that is decided according to the virtual object and a vibration amount that is decided according to the relative speed between the virtual device and the virtual object.

13 . A driving data generation method comprising:
Acquiring, by a processor, operation information indicating movement of an operation apparatus that is held by a user's hand and includes a kinesthetic sense presentation section that presents a kinesthetic sense to a first finger of the user and a tactile sense presentation section that presents a tactile sense to a second finger of the user; Controlling, by the processor, movement of a virtual device corresponding to the operation apparatus in a space where a virtual object exists, according to the operation information; and Generating, by the processor, first driving data for driving the kinesthetic sense presentation section and second driving data for driving the tactile sense presentation section, on a basis of a relation between the virtual device and the virtual object.

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Wakabayashi Makoto
• Mori Hideki

Classifications

• G06T2219/2004

  Aligning objects, relative positioning of parts · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• A63F13/285 Primary

  Generating tactile feedback signals via the game input device, e.g. force feedback · CPC title

• A63F13/24

  Constructional details thereof, e.g. game controllers with detachable joystick handles · CPC title

• A63F13/55 Primary

  Controlling game characters or game objects based on the game progress · CPC title