Systems and methods for using textures in graphical user interface widgets

Patent metadata

Field	Value
Publication number	US-9927873-B2
Application number	US-69703710-A
Country	US
Kind code	B2
Filing date	Jan 29, 2010
Priority date	Mar 12, 2009
Publication date	Mar 27, 2018
Grant date	Mar 27, 2018

Abstract

Systems and methods for using textures in graphical user interface widgets are disclosed. For example, one disclosed system includes: a system including: an actuator configured to receive a haptic signal and output a haptic effect based at least in part on the haptic signal, the haptic effect configured to simulate a texture; a touch-sensitive interface configured to detect a user interaction and output a interface signal; and a processor in communication with the actuator and the touch-sensitive interface, the processor configured to: receive the interface signal; receive a display signal including a plurality of pixels defining a display area; determine a first texture associated with a first group of pixels defining a first section of the display area; determine a second texture associated with a second group of pixels defining a second section of the display area; and transmit a haptic signal configured to cause the actuator to: output a first haptic effect configured to simulate the first texture if the user interaction is associated with the first section of the display area, and output a second haptic effect configured to simulate the second texture if the user interaction is associated with the second section of the display area.

First claim

That which is claimed is:

1. A system comprising:
a first actuator and a second actuator, each configured to receive a haptic signal and output a haptic effect based at least in part on the haptic signal, the haptic effect configured to simulate a texture;
a touch-sensitive interface configured to detect a user interaction and output an interface signal; and
a processor in communication with the actuator and the touch-sensitive interface, the processor configured to:
receive the interface signal;
receive a display signal comprising a plurality of pixels defining a display area, wherein each of the plurality of pixels is associated with a color;
assign a haptic value to each color;
determine a first texture associated with a first group of pixels defining a first section of the display area, wherein determining the first texture comprises determining the haptic value associated with one or more of the first group of pixels;
determine a second texture associated with a second group of pixels defining a second section of the display area, wherein determining the second texture comprises determining the haptic value associated with one or more of the second group of pixels;
determine a selected actuator by selecting the first actuator if the haptic value is less than a threshold or selecting the second actuator if the haptic value is greater than or equal to the threshold; and
transmit a haptic signal configured to cause the selected actuator to:
output a first haptic effect configured to simulate the first texture if the user interaction is associated with the first section of the display area, and
output a second haptic effect configured to simulate the second texture if the user interaction is associated with the second section of the display area.

2. The system of claim 1 , wherein first texture and the second texture are each based at least in part on the display signal.

3. The system of claim 1 , wherein the texture is a vibrotactile effect.

4. The system of claim 1 , wherein the texture comprises the texture of: sand, grass, bricks, rocks, skin, fabric, or fur.

5. The system of claim 1 , wherein the selected actuator comprises: a linear resonant actuator, an eccentric rotating mass actuator, a shape memory alloy, an electroactive polymer, a composite piezoelectric actuator, or a piezoelectric actuator.

6. The system of claim 1 , wherein the first section of the display area comprises a boundary, and the second section of the display area comprises the pixels that do not comprise the boundary.

7. The system of claim 1 , wherein the first section of the display area comprises a route and the second section of the display area comprises a Global Positioning System Interface.

8. The system of claim 1 , wherein the first section of the display area comprises a destination and the second section of the display area comprises a Global Positioning System Interface.

9. The system of claim 1 , wherein the first section of the display area comprises a location on a social networking page and the second section of the display area comprises the remainder of the social networking page.

10. The system of claim 1 , wherein first section of the display area comprises a scrollbar and the second section of the display area comprises pixels that do not comprise the scrollbar.

11. The system of claim 10 , wherein the processor is configured to determine a different texture in the first section of the display area as the scrollbar moves.

12. The system of claim 1 , wherein the first section of the display area comprises text and the second section of the display area comprises the remainder of the display area.

13. The system of claim 1 , wherein the first section of the display area comprises a section of the display area determined based at least in part on the interface signal, and the second section of the display area comprises the remainder of the display area.

14. The system of claim 1 , wherein the first section of the display area comprises an icon and the second section of the display area comprises the remainder of the display area.

15. The system of claim 14 , wherein the icon comprises a drawing tool.

16. The system of claim 14 , wherein the icon comprises a folder.

17. The system of claim 16 , wherein the first texture is determined based at least in part on the contents of the folder.

18. The system of claim 1 , further comprising a display in communication with the processor, the display configured to receive the display signal and output an image based at least in part on the display signal.

19. The system of claim 18 , wherein the first texture and the second texture are output on a surface of the display.

20. A method for outputting textures comprising:
receiving a display signal comprising a plurality of pixels defining a display area, wherein each of the plurality of pixels is associated with a color;
assigning a haptic value to each color;
receiving an interface signal from a touch-sensitive interface configured to detect a user interaction and output an interface signal;
determining a first texture associated with a first group of pixels defining a first section of the display area, wherein determining the first texture comprises determining the haptic value associated with one or more of the first group of pixels;
determining a second texture associated with a second group of pixels defining a second section of the display area, wherein determining the second texture comprises determining the haptic value associated with one or more of the second group of pixels; and
determine a selected actuator by selecting a first actuator if the haptic value is less than a threshold or selecting a second actuator if the haptic value is greater than or equal to the threshold; and
transmitting a haptic signal to the selected actuator configured to receive the haptic signal and output a haptic effect, the haptic signal configured to cause the selected actuator to:
output a first haptic effect configured to simulate the first texture if the user interaction is associated with the first section of the display area, and
output a second haptic effect configured to simulate the second texture if the user interaction is associated with the second section of the display area.

21. The method of claim 20 , further comprising receiving the display signal and outputting an image based at least in part on the display signal.

22. The method of claim 21 , wherein the first haptic effect and the second haptic effect are output on a surface of the display.

23. A system comprising:
a first actuator and a second actuator, each configured to receive a haptic signal and output a haptic effect configured to simulate a texture based at least in part on the haptic signal;
a touch-sensitive interface configured to detect a user interaction and output an interface signal associated with the user interaction;
a processor in communication with the actuator and the touch-sensitive interface, the processor configured to:
receive the interface signal;
receive a display signal comprising a plurality of pixels defining a display area, wherein each of the plurality of pixels is associated with a color;
assign a haptic value to each color;
determine a first texture based at least in part on the display signal and the interface signal, the first texture associated with a first group of pixels defining a first section of the display area, wherein determining the first te

Assignees

• Cruz Hernandez Juan Manuel
• Grant Danny A
• Modarres Ali
• Gosline Andrew
• Immersion Corp

Inventors

• Cruz-Hernandez Juan Manuel
• Grant Danny A
• Modarres Ali
• Gosline Andrew

Classifications

• G06F3/0416 Primary

  Control or interface arrangements specially adapted for digitisers · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F1/1601

  Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays (constructional details related to flat displays integrated in a portable computer, e.g. laptop, handheld computer G06F1/1637; constructional details related to television receivers H04N5/64) · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• B06B1/06

  operating with piezoelectric effect or with electrostriction (piezoelectric or electrostrictive devices per se H10N30/00) · CPC title