Systems and methods for haptic and gesture-driven paper simulation

Patent metadata

Field	Value
Publication number	US-9547366-B2
Application number	US-201313827951-A
Country	US
Kind code	B2
Filing date	Mar 14, 2013
Priority date	Mar 14, 2013
Publication date	Jan 17, 2017
Grant date	Jan 17, 2017

Abstract

Systems and methods for haptic and gesture-driven paper simulation are disclosed. For example, one disclosed method includes the steps of receiving an electronic document; receiving metadata associated with the electronic document, the metadata comprising a characteristic indicating a type of paper; generating and transmitting a display signal configured to cause display of the at least a portion of the document; and generating and transmitting a haptic signal based on the type of paper, the haptic signal configured to cause a haptic output device to generate a haptic effect.

First claim

That which is claimed is:

1. A method comprising:
receiving an electronic document comprising a plurality of pages;
receiving metadata indicating a type of paper associated with the electronic document;
associating the metadata with the electronic document based on a second characteristic associated with the electronic document;
generating and transmitting a display signal configured to cause display of the at least a portion of the electronic document;
in response to a multi-page turn gesture on a touch sensitive input device, performing a multi-page turn by causing multiple pages of the plurality of pages to turn in succession; and
generating and transmitting a haptic signal in response to a particular page of the plurality of pages being passed during the multi-page turn, the haptic signal configured to cause a haptic output device to output a haptic effect.

2. The method of claim 1 , further comprising:
receiving contact data based on an interaction with the touch sensitive input device, the contact data associated with the portion of the electronic document;
determining a gesture based on the contact data;
determining a deformation of the portion of the document based on the gesture;
generating and transmitting a second display signal configured to cause display of the portion of the document comprising the deformation; and
generating and transmitting a second haptic signal based on the type of paper and the deformation, the second haptic signal configured to cause the haptic output device to generate a second haptic effect, the second haptic effect configured to indicate the deformation.

3. The method of claim 2 , wherein the gesture comprises a page-turn gesture or the multi-page turn gesture, the deformation is based on the gesture and the metadata, and the second haptic effect comprises texture or a change in friction.

4. The method of claim 3 , wherein the contact data comprises pressure data, and the change in friction is based on the pressure data.

5. The method of claim 3 , further comprising generating and transmitting an audio signal based on the gesture and the metadata.

6. The method of claim 3 , wherein the multi-page turn gesture comprises a scrub gesture, and transmitting the second haptic signal comprises transmitting the second haptic signal for each page of the electronic document accessed by the scrub gesture comprising the deformation.

7. The method of claim 3 , wherein determining the gesture is further based on the metadata.

8. The method of claim 2 , wherein the gesture comprises a folding gesture, the deformation comprises a folding of the portion of the document, and the second haptic effect comprises a texture or a change in friction.

9. The method of claim 8 , wherein the folding deformation is configured to simulate the size and shape of the fold based on the gesture and the metadata.

10. The method of claim 2 , wherein the gesture comprises a cut gesture, the deformation comprises a cutting of the portion of the document, and the second haptic effect comprises a vibration.

11. The method of claim 1 , wherein the metadata further comprises at least one of a roughness characteristic, a color characteristic, weight characteristic, an age characteristic, a brittleness characteristic, or a compliance characteristic.

12. A non-transitory computer-readable medium comprising program code configured to be executed by a processor, the program code configured to:
receive an electronic document comprising a plurality of pages;
receive metadata associated with the electronic document;
associate the metadata with the electronic document;
generate and transmit a display signal configured to cause display of the at least a portion of the electronic document;
in response to a multi-page turn gesture on a touch sensitive input device, perform a multi-page turn by causing multiple pages of the plurality of pages to turn in succession; and
generate and transmit a haptic signal in response to a particular page of the plurality of pages being passed during the multi-page turn, the haptic signal configured to cause a haptic output device to output a haptic effect.

13. The non-transitory computer-readable medium of claim 12 , wherein the program code is further configured to:
receive contact data based on an interaction with the touch sensitive input device, the contact data associated with the portion of the document;
determine a gesture based on the contact data;
determine a deformation of the portion of the document based on the gesture;
generate and transmit a second display signal configured to cause display of the portion of the document comprising the deformation; and
generate and transmit a second haptic signal based on a type of paper associated with the electronic document and the deformation, the second haptic signal configured to cause the haptic output device to generate a second haptic effect, the second haptic effect configured to indicate the deformation.

14. The non-transitory computer-readable medium of claim 13 , wherein the gesture comprises a page-turn gesture or the multi-page turn gesture, the deformation is based on the gesture and the metadata, and the second haptic effect comprises texture or a change in friction.

15. The non-transitory computer-readable medium of claim 14 , wherein the contact data comprises pressure data, and the change in friction is based on the pressure data.

16. The non-transitory computer-readable medium of claim 14 , wherein the program code is further configured to generate and transmit an audio signal based on the gesture and the metadata.

17. The non-transitory computer-readable medium of claim 14 , wherein the multi-page turn gesture comprises a scrub gesture, and wherein the program code is further configured to:
transmit the second haptic signal for each page of the electronic document accessed by the scrub gesture comprising the deformation.

18. The non-transitory computer-readable medium of claim 14 , wherein the program code is further configured to determine the gesture based at least in part on the metadata.

19. The non-transitory computer-readable medium of claim 13 , wherein the gesture comprises a folding gesture, the deformation comprises a folding of the portion of the document, and the second haptic effect comprises a texture or a change in friction.

20. The non-transitory computer-readable medium of claim 19 , wherein the folding deformation is configured to simulate the size and shape of the fold based on the gesture and the metadata.

21. The non-transitory computer-readable medium of claim 13 , wherein the gesture comprises a cut gesture, the deformation comprises a cutting of the portion of the document, and the second haptic effect comprises a vibration.

22. The non-transitory computer-readable medium of claim 12 , wherein the metadata comprises at least one of a roughness characteristic, a color characteristic, weight characteristic, an age characteristic, a brittleness characteristic, or a compliance characteristic associated with the electronic document.

23. A system comprising:
a computer-readable medium;
a touch-sensitive input device;
a display; and
a processor in communication with the computer-readable medium, the touch-sensitive input device, and the display, the processor configured to:
receive an electronic document comprising a plurality of pages;
generate and transmit a display signal configured to cause display of the at least a

Assignees

• Ullrich Christopher J
• Birnbaum David M
• Bothsa Marcus Aurelius
• Immersion Corp

Inventors

• Ullrich Christopher J
• Birnbaum David M
• Bothsa Marcus Aurelius

Classifications

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F15/0291

  for reading, e.g. e-books (constructional details of portable computers G06F1/1613) · CPC title

• G06F1/1684

  Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F1/1626

  with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs] · CPC title