Using vortices to provide tactile sensations corresponding to a visual presentation

Patent metadata

Field	Value
Publication number	US-9619027-B2
Application number	US-201313941149-A
Country	US
Kind code	B2
Filing date	Jul 12, 2013
Priority date	Jul 12, 2013
Publication date	Apr 11, 2017
Grant date	Apr 11, 2017

Abstract

To convey tactile sensations over an open space, a system may use a vortex generator to direct one or more vortices at an object in 3-D space. Once a vortex strikes an object—e.g., a user's hand—it applies a force. The vortex generator can control the frequency and intensity of the vortices in order to provide different tactile sensations that correspond to virtual objects or events in a visual presentation. The system may identify and track objects in the real-world environment, and based on information provided by a device displaying the visual presentation, transmit instructions to the vortex generator to discharge vortices that convey a tactile sensation corresponding to the virtual object or event in the visual presentation. By doing so, the vortices augment the real-world environment to immerse the user in the visual presentation.

First claim

What is claimed is:

1. A method for augmenting reality based on a visual presentation, the method comprising:
identifying the location of a physical object based on data captured from a sensing device;
orienting a vortex generator based on the identified location of the physical object;
determining a tactile sensation corresponding to at least one of a virtual object in the visual presentation and an event in the visual presentation;
selecting a predefined pattern of sequential vortices for conveying the tactile sensation upon striking the physical object, the predefined pattern defining one or more frequencies for discharging the sequential vortices and one or more intensities of the sequential vortices; and
after orienting the vortex generator, discharging the sequential vortices from the vortex generator using the predefined pattern.

2. The method of claim 1 , wherein the predefined pattern of sequential vortices provide the tactile sensation corresponding to a texture of the virtual object when striking the physical object.

3. The method of claim 1 , further comprising:
determining a time delay between the event in the visual presentation and the time required for the vortex to strike the physical object, wherein the vortex is discharged from the vortex generator to account for the time delay.

4. The method of claim 1 , further comprising:
adjusting an intensity of the vortex based on a measured distance from the vortex generator to the physical object such that a substantial similar tactile sensation is provided to the physical object regardless of the distance between the physical object and the vortex generator.

5. The method of claim 1 , wherein orienting the vortex generator further comprises:
determining a direction of movement of the physical object; and
orienting the vortex generator to discharge the vortex at a predicted, future location of the physical object.

6. A computer program product for augmenting reality based on a visual presentation, the computer program product comprising:
a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code configured to:
identify the location of a physical object based on data captured from a sensing device;
orient a vortex generator based on the identified location of the physical object;
determine a tactile sensation corresponding to at least one of a virtual object in the visual presentation and an event in the visual presentation;
select a predefined pattern of sequential vortices for conveying the tactile sensation upon striking the physical object, the predefined pattern defining one or more frequencies for discharging the sequential vortices and one or more intensities of the sequential vortices; and
after orienting the vortex generator, discharge the sequential vortices from the vortex generator using the predefined pattern.

7. The computer program product of claim 6 , wherein the predefined pattern of sequential vortices provide the tactile sensation corresponding to a texture of the virtual object when striking the physical object.

8. The computer program product of claim 6 , further comprising computer-readable program code configured to:
determine a time delay between the event in the visual presentation and the time required for the vortex to strike the physical object, wherein the vortex is discharged from the vortex generator to account for the time delay.

9. The computer program product of claim 6 , further comprising computer-readable program code configured to:
adjusting an intensity of the vortex based on a measured distance from the vortex generator to the physical object such that a substantial similar tactile sensation is provided to the physical object regardless of the distance between the physical object and the vortex generator.

10. The computer program product of claim 6 , wherein orienting the vortex generator further comprises computer-readable program code configured to:
determine a direction of movement of the physical object; and
orient the vortex generator to discharge the vortex at a predicted, future location of the physical object.

11. A system, comprising:
a sensing device;
a vortex generator configured to discharge a vortex, the vortex generator comprising adjusters configured to change an orientation of the vortex generator; and
a computing device communicatively coupled to the sensing device and the vortex generator, the computing device configured to:
identify the location of a physical object based on data captured from the sensing device;
orient the vortex generator based on the identified location of the physical object;
determine a tactile sensation corresponding to at least one of a virtual object in the visual presentation and an event in the visual presentation;
selecting a predefined pattern of sequential vortices for conveying the tactile sensation upon striking the physical object, the predefined pattern defining one or more frequencies for discharging the sequential vortices and one or more intensities for the sequential vortices; and
after orienting the vortex generator, discharge the sequential vortices from the vortex generator using the predefined pattern.

12. The system of claim 11 , wherein the sensing device is fixable mounted such that a position of the vortex generator relative to a position of the sensing device remains constant as the vortex generator is moved.

13. The system of claim 12 , further comprising a depth sensor, wherein the computing device is configured to use data captured by the sensing device and the depth sensor to identify the location of the physical object in 3-D space.

14. The system of claim 11 , wherein the computing device is configured to orient the vortex generator by transmitting instructions to the adjusters such that a nozzle of the vortex generator is moved.

15. The system of claim 11 , further comprising:
a display device configured to display the visual presentation, wherein the display device is communicatively coupled to the computing device to provide the computing device with information associated with at least one of the virtual object in the visual presentation and the event in the visual presentation.

16. The system of claim 15 , wherein the display device and the computing device are integrated to form a unified device, wherein the vortex generator and sensing device are mounted onto the unified device.

17. A vortex generator comprising:
a body enclosing a central cavity;
an actuator mounted onto the body, the actuator configured to change the volume of the central cavity in response to a first control signal;
a flexible, elongated nozzle attached to the body at a first end, wherein, in response to the actuator changing the volume of the central cavity, air flows through the nozzle and generates a vortex at a second end of the nozzle opposite the first end; and
an adjustment element coupled to the nozzle, the adjustment element is configured to, in response to a second control signal, adjust the position of the second end of the nozzle relative to the first end of the nozzle thereby changing the direction the vortex travels.

18. The vortex generator of claim 17 , wherein the adjustment element moves the second end of the nozzle relative to the body, such that the adjustment element does not move the body when adjusting the second end of the nozzle.

19. The vortex generator of claim 17 , wherein the adjustment element is a first gimbal controller that moves the second end o

Assignees

• Disney Entpr Inc

Inventors

• Sodhi Rajinder
• Poupyrev Ivan
• Glisson Matthew Feld

Classifications

• F15D1/009

  by means of vortex rings · CPC title

• A63F13/285

  Generating tactile feedback signals via the game input device, e.g. force feedback · CPC title

• F15D1/0015

  Whirl chambers, e.g. vortex valves · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title