Method and apparatus for representing user interface metaphors as physical changes on a shape-changing device

Patent metadata

Field	Value
Publication number	US-9703378-B2
Application number	US-201213495235-A
Country	US
Kind code	B2
Filing date	Jun 13, 2012
Priority date	Jun 13, 2012
Publication date	Jul 11, 2017
Grant date	Jul 11, 2017

Abstract

An electronic device having a user interface device that has a flexible surface, a haptic output device operatively coupled to the flexible surface and configured to cause a deformation of the flexible surface, and a controller in signal communication with the haptic output device. The controller is configured to trigger the haptic output device to cause the deformation of the flexible surface based on a simulated physical behavior of a virtual element represented on the user interface.

First claim

What is claimed is:

1. An electronic device, comprising:
a user interface comprising a flexible surface;
a haptic output device operatively coupled to the flexible surface and configured to cause a deformation of the flexible surface;
a screen configured to visually represent movement of a virtual element from one portion of the screen to another portion of the screen; and
a controller in signal communication with the haptic output device and configured to trigger the haptic output device to cause the deformation of the flexible surface based on a simulated physical interaction of the virtual element represented on the screen with the flexible surface, the deformation of the flexible surface corresponding to movement of the virtual element.

2. The electronic device of claim 1 , wherein the controller is configured to visually represent on the screen only a portion of the virtual element, and wherein the controller is configured to simulate the physical interaction of the virtual element with the flexible surface by triggering the haptic output device to cause the deformation to represent another portion of the virtual element not visually represented on the screen.

3. The electronic device of claim 2 , wherein the controller is configured to trigger the haptic output device to cause a size of the deformation to be based on a size of the another portion of the virtual element not visually represented on the screen.

4. The electronic device of claim 2 , wherein the controller is configured to trigger the haptic output device to cause a rate of the deformation to be based on a rate at which the portion of the virtual element is visually represented to be moving against the flexible surface.

5. The electronic device of claim 2 , wherein the controller is configured to simulate the physical interaction by visually representing on the screen a movement of the portion of the virtual element in response to a change in the deformation of the flexible surface.

6. The electronic device of claim 5 , wherein the controller is configured to simulate the physical interaction by adjusting a flexibility of the flexible surface based on a simulated resistance of the virtual element.

7. The electronic device of claim 1 , wherein the controller is further configured to simulate a physical behavior by triggering the haptic output device to cause the deformation based on a physical behavior of a physical element associated with the virtual element.

8. The electronic device of claim 7 , wherein the physical behavior comprises an expansion or a contraction of the physical element.

9. The electronic device of claim 1 , wherein the haptic output device comprises an actuator.

10. A method for representing a user interface metaphor applied to a user interface, the method comprising:
visually representing movement of a virtual element from one portion of a screen of the user interface to another portion of the screen; and
simulating a physical interaction of the virtual element represented on the screen with a flexible surface of the user interface by triggering a haptic output device operatively coupled to the flexible surface of the user interface to cause a deformation of the flexible surface corresponding to movement of the virtual element.

11. The method of claim 10 , wherein the visually representing the virtual element on the screen comprises visually representing on the screen only a portion of the virtual element, and wherein simulating the physical interaction of the virtual element with the flexible surface comprises triggering the haptic output device to cause the deformation to represent another portion of the virtual element not visually represented on the screen.

12. The method of claim 11 , wherein the triggering the haptic output device to cause the deformation comprises causing a size of the deformation to be based on a size of the another portion of the virtual element not visually represented on the screen.

13. The method of claim 11 , wherein the triggering the haptic output device to cause the deformation comprises causing a rate of the deformation to be based on a rate at which the portion of the virtual element is visually represented to be moving against the flexible surface.

14. The method of claim 11 , wherein the simulating the physical interaction comprises visually representing on the screen a movement of the portion of the virtual element in response to a change in the deformation of the flexible surface.

15. The method of claim 14 , wherein the simulating the physical interaction comprises adjusting a flexibility of the flexible surface based on a simulated resistance of the virtual element.

16. The method of claim 10 , wherein the simulating the physical interaction comprises triggering the haptic output device to cause the deformation based on a physical behavior of a physical element associated with the virtual element.

17. The method of claim 16 , wherein the physical behavior comprises an expansion or a contraction of the physical element.

18. A method for representing a user interface metaphor applied to a user interface, the method comprising: representing a behavior of a virtual element visually represented on a screen of the user interface by triggering a haptic output device operatively coupled to a flexible surface of the user interface to cause a deformation of the flexible surface, wherein the behavior comprises movement of the virtual element on the screen of the user interface.

19. The method of claim 18 , wherein the behavior includes scrolling of the virtual element on the screen, and wherein representing the behavior comprises triggering the haptic output device to cause a deformation of the flexible surface in a direction that is not aligned with a direction in which the virtual element is scrolled.

20. The method of claim 18 , wherein the behavior includes scrolling of the virtual element on the screen, and wherein representing the behavior comprises triggering the haptic output device to cause a deformation of the flexible surface based on a simulated physical interaction of the flexible surface with a portion of the virtual element that is scrolled off the screen.

Assignees

• Birnbaum David M
• Jiang Li
• Cruz-Hernandez Juan Manuel
• Modarres Ali
• Ramstein Christophe
• Grant Danny A
• Immersion Corp

Inventors

• Birnbaum David M
• Jiang Li
• Cruz-Hernandez Juan Manuel
• Modarres Ali
• Ramstein Christophe
• Grant Danny A

Classifications

• A63F13/92

  Video game devices specially adapted to be hand-held while playing · CPC title

• A63F13/218

  using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player · CPC title

• A63F13/212

  using sensors worn by the player, e.g. for measuring heart beat or leg activity · CPC title

• A63F13/837

  Shooting of targets · CPC title

• A63F13/285

  Generating tactile feedback signals via the game input device, e.g. force feedback · CPC title