Methods and apparatus for generating haptic interaction for virtual reality

Patent metadata

Field	Value
Publication number	US-10996757-B2
Application number	US-201816488052-A
Country	US
Kind code	B2
Filing date	Feb 20, 2018
Priority date	Feb 24, 2017
Publication date	May 4, 2021
Grant date	May 4, 2021

Abstract

Virtual reality apparatus includes a display generator to generate images of a virtual environment, including a virtual representation of a display object and at least part of an avatar, for display to a user; a haptic interface including one or more actuators to provide a physical interaction with the user in response to a haptic interaction signal; a detector arrangement configured to detect two or more haptic detections applicable to a current configuration of the avatar relative to the object in the virtual environment; and a haptic generator to generate the haptic interaction signal in dependence upon the two or more haptic detections.

First claim

The invention claimed is:

1. An apparatus comprising:
a display generator to generate images of a virtual environment, including a virtual representation of a display object and at least part of an avatar, for display to a user;
a haptic interface comprising one or more actuators to provide a physical interaction with the user in response to a haptic interaction signal;
a detector arrangement configured to detect two or more haptic detections applicable to a current configuration of the avatar relative to the object in the virtual environment; and
a haptic generator to generate the haptic interaction signal in dependence upon the two or more haptic detections, wherein:
one of the haptic detections comprises a haptic interaction of a second object and a simulated propagation path between the avatar and the second object in the virtual environment, and
the haptic generator is configured to simulate the propagation path by applying a filtering operation to the haptic interaction of the second object.

2. The apparatus according to claim 1 , in which the haptic interaction of the second object is relative to the display object in the virtual environment, and the simulated propagation path is a propagation path between the display object and the second object in the virtual environment.

3. The apparatus according to claim 1 , in which the second object comprises an audio emitter, and the simulated propagation path comprises an audio propagation path.

4. The apparatus according to claim 1 , in which the haptic interaction of the second object comprises a simulated motion of the second object.

5. The apparatus according to claim 4 , in which the haptic generator is configured to simulate the motion of the second object according to haptic configuration data associated with the second object and/or the location, in the virtual environment, of the second object.

6. The apparatus according to claim 1 , in which the filtering operation comprises one or both of:
a time-based filtering operation; and
a gain varying operation;
dependent upon path configuration data associated with the simulated propagation path.

7. The apparatus according to claim 6 , in which the haptic generator is configured to detect a degree of contact between the avatar and the display object, and to apply the filtering operation in dependence upon the detected degree of contact.

8. The apparatus according to claim 1 , in which the haptic detections comprise detections selected from the list consisting of:
a detection of an audio signal for provision to the user;
a detection of contact between at least a part of the avatar and at least a part of the surface of the display object;
a detection of motion of a contact region between at least a part of the avatar and at least a part of the surface of the display object;
a detection of contact between at least a part of the avatar and at least a part of the interior of the display object;
a detection of motion of a contact region between at least a part of the avatar and at least a part of the interior of the display object; and
a detection of simulated motion of the display object.

9. The apparatus according to claim 8 , in which:
the avatar is a representation of a body having one or more limbs; and
an avatar contact region for contact with the display object is disposed at or near an extremity of one or more of the limbs.

10. The apparatus according to claim 1 , comprising a head mountable display (HMD) to display the images of the virtual environment to the user.

11. The apparatus according to claim 1 , in which the haptic generator is responsive to attributes defining one or capabilities of the haptic interface.

12. The apparatus according to claim 11 , in which an attribute defines a frequency response of the haptic interface.

13. The apparatus according to claim 11 , in which an attribute defines a maximum amplitude which may be represented by the haptic interface.

14. The apparatus according to claim 1 , in which the haptic interface comprises one or more actuators attachable to one or both of the user's hands.

15. The apparatus according to claim 14 , comprising one or two gloves to be worn by the user, each glove comprising one or more of the actuators.

16. The apparatus according to claim 1 , comprising:
a detector to detect the position and/or orientation of one or both of the user's hands;
in which the display generator is configured to generate the virtual representation of the avatar so that the avatar has a configuration dependent upon the detected position and/or orientation detected by the detector.

17. The apparatus according to claim 16 , in which the detector comprises one or more cameras.

18. The apparatus according to claim 17 , in which the detector comprises a depth camera.

19. An apparatus comprising:
a display generator to generate images of a virtual environment, including a virtual representation of a display object and at least part of an avatar, for display to a user;
a detector arrangement configured to detect two or more haptic detections applicable to a current configuration of the avatar relative to the object in the virtual environment; and
a haptic generator to generate a haptic interaction signal, to control a haptic interface comprising one or more actuators to provide a physical interaction with the user in response to a haptic interaction signal, in dependence upon the two or more haptic detections, wherein:
one of the haptic detections comprises a haptic interaction of a second object and a simulated propagation path between the avatar and the second object in the virtual environment, and
the haptic generator is configured to simulate the propagation path by applying a filtering operation to the haptic interaction of the second object.

20. An apparatus comprising:
a display generator to generate images of a virtual environment, including a virtual representation of a display object and at least part of an avatar, for display to a user;
a haptic interface comprising one or more actuators to provide a physical interaction with the user in response to a haptic interaction signal; and
a haptic generator to generate the haptic interaction signal in response to a configuration of the avatar relative to the object in the virtual environment;
in which the haptic generator is configured to detect an avatar contact region of the avatar touching the object, and generate the haptic interaction signal in dependence upon:
simulated haptic interaction of a second object relative to the display object in the virtual environment; and
a simulated propagation path between the display object and the second object in the virtual environment,
wherein the haptic generator is configured to simulate the propagation path by applying a filtering operation to the haptic interaction of the second object.

21. An apparatus comprising:
a display generator to generate images of a virtual environment, including a virtual representation of a display object and at least part of an avatar, for display to a user;
a haptic generator to generate the haptic interaction signal in response to a configuration of the avatar relative to the object in the virtual environment;
in which the haptic generator is configured to detect an avatar contact region of the avatar touching the object, and generate the haptic interaction signal in dependence upon:
simulated haptic interaction of a second object relative to the display object in the virtual environment;

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Raghoebardajal Sharwin Winesh
• Benson Simon Mark

Classifications

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/014

  Hand-worn input/output arrangements, e.g. data gloves · CPC title

• A63F13/285

  Generating tactile feedback signals via the game input device, e.g. force feedback · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/16

  Sound input; Sound output (speech processing G10L) · CPC title