Systems and methods for interfaces featuring surface-based haptic effects

Patent metadata

Field	Value
Publication number	US-10007340-B2
Application number	US-69690810-A
Country	US
Kind code	B2
Filing date	Jan 29, 2010
Priority date	Mar 12, 2009
Publication date	Jun 26, 2018
Grant date	Jun 26, 2018

Abstract

Systems and methods for interfaces featuring surface-based haptic effects are described. One described system includes a sensor configured to detect a touch in a touch area when an object contacts a touch surface. The touch surface may correspond to the display area or may correspond to a non-display surface of a computing device or peripheral interfaced to a computing device. The system can further include an actuator in communication with the processor and coupled to the touch surface, the actuator configured to output a haptic effect and a processor configured to select a haptic effect to generate. The haptic effect can be selected based on a position of the touch and recognizing an input gesture provided by the touch and/or content displayed in a graphical user interface at a location mapped to a position in the touch area at or near the touch. The haptic effect may provide a texture, simulate an obstacle, and/or adjust the coefficient of friction of the surface.

First claim

What is claimed:

1. A system comprising:
a sensor configured to detect a touch in a touch area when an object contacts a touch surface, the touch area mapped to a display area of a graphical user interface; and a processor in communication with an electrostatic actuator and the sensor, the processor configured to:
identify text displayed in the display area responsive to a search query;
highlight the identified text displayed in the display area in response to the search query;
select a haptic effect to generate based on identifying a position of the touch and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted-identified text; and
transmit a haptic signal corresponding to the selected haptic effect to the electrostatic actuator, the electrostatic actuator configured to receive the haptic signal and to generate the selected haptic effect while the touch is occurring, the haptic effect comprising adjusting a coefficient of friction of the touch surface.

2. The system set forth in claim 1 , wherein the processor is configured to select a haptic effect based on a control displayed in the graphical user interface at a location mapped to a position in the touch area at or near the position of the touch.

3. The system set forth in claim 1 , wherein the processor is configured to select a haptic effect in response to recognizing a page turn input gesture, the haptic effect selected to vary the coefficient of friction in a direction of the page turn input gesture as the gesture is provided.

4. The system set forth in claim 1 , wherein the processor is configured to select a haptic effect in response to recognizing a gesture indicating movement of an on-screen content item from a first location to a second location.

5. The system set forth in claim 1 , further comprising a display, the display comprising a plurality of pixels and defining the display area, the display configured to output an image based at least in part on a display signal,
wherein the touch surface corresponds to the display or a material above the display, and
wherein the processor is configured to output the display signal.

6. The system set forth in claim 1 , further comprising a second actuator configured to provide a haptic effect in response to a haptic signal from the processor.

7. The system of claim 1 , wherein an adjustment of the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

8. The system of claim 1 , wherein selecting a haptic effect to generate further comprises determining a haptic value associated with one or more pixels at the position of the touch.

9. A method, comprising:
tracking a location of a touch on a touch surface via a sensor in communication with a processor, the location tracked relative to a touch area mapped to a graphical user interface;
based on the location of the touch, identifying, by the processor, an interaction with the graphical user interface;
identifying, by the processor, text displayed in the display area responsive to a search query;
highlighting, by the processor, the identified text displayed in the display area in response to the search query;
selecting, by the processor, a haptic effect to generate based on the interaction and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted identified text; and
commanding, by the processor, at least one electrostatic actuator to generate the selected haptic effect, the haptic effect comprising an adjustment of a coefficient of friction of the touch surface, the at least one electrostatic actuator configured to vary the coefficient of friction of the touch surface.

10. The method set forth in claim 9 , wherein the interaction comprises adjusting an on-screen control and the haptic effect is selected based on a value of the on-screen control.

11. The method set forth in claim 9 , wherein the interaction comprises touching the surface at or near a location mapped to a portion of the graphical user interface containing a feature, the feature associated with the haptic effect.

12. The method set forth in claim 11 , wherein the feature comprises a textual or graphic element in the interface highlighted in response to the search query.

13. The method set forth in claim 11 , wherein the feature comprises graphical or textual content.

14. The method set forth in claim 11 , wherein the feature comprises a boundary in the graphical user interface.

15. The method set forth in claim 9 , wherein the interaction comprises an input gesture.

16. The method set forth in claim 15 , wherein the haptic effect is provided during the input gesture.

17. The method set forth in claim 15 , wherein the haptic effect is provided after the input gesture.

18. The method of claim 9 , wherein an adjustment of the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

19. A non-transitory computer-readable medium embodying program code, which when executed by a processor is configured to cause the processor to:
track a location of a touch on a touch surface via a sensor in communication with the processor, the location tracked relative to a touch area mapped to a graphical user interface;
identify, based on the location of the touch, an interaction with the graphical user interface;
identify text displayed in the display area responsive to a search query;
highlight the identified text displayed in the display area in response to the search query;
select a haptic effect to generate based on the interaction and the highlighted identified text, wherein the haptic effect is selected to generate a haptic effect at an identified position in the touch area mapped to a position in the display area at or near the highlighted identified text; and
transmit a haptic signal corresponding to the selected haptic effect to at least one electrostatic actuator, the haptic effect comprising adjusting a coefficient of friction of the touch surface, the at least one electrostatic actuator configured to vary the coefficient of friction of the touch surface.

20. The non-transitory computer readable medium of claim 19 , wherein adjusting the coefficient of friction of the touch surface comprises increasing the coefficient of friction of the touch surface.

Assignees

• Cruz Hernandez Juan Manuel
• Grant Danny A
• Modarres Ali
• Gosline Andrew
• Immersion Corp

Inventors

• Cruz-Hernandez Juan Manuel
• Grant Danny A
• Modarres Ali
• Gosline Andrew

Classifications

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/041

  Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means · CPC title

• G06F3/0416 Primary

  Control or interface arrangements specially adapted for digitisers · CPC title