Haptic feedback assisted text manipulation

Patent metadata

Field	Value
Publication number	US-10503255-B2
Application number	US-95870510-A
Country	US
Kind code	B2
Filing date	Dec 2, 2010
Priority date	Dec 2, 2010
Publication date	Dec 10, 2019
Grant date	Dec 10, 2019

Abstract

A system with a touchscreen generates haptic effects in response to a manipulation of text displayed on the touchscreen. The system senses a touch within the text, and determines if the touch is a manipulation of the text, and determines the type of the manipulation. The system then generates a type of haptic event that is based at least in part on the type of the manipulation that was determined.

First claim

What is claimed is:

1. A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to provide haptic feedback on a device comprising a touchscreen, the haptic feedback comprising:
displaying dynamically generated text comprising a plurality of characters comprising graphical objects;
sensing a touch by a user's finger within the dynamically generated text;
determining if the touch is a manipulation of the dynamically generated text and determining a type of the manipulation, wherein the manipulation of the dynamically generated text comprises performing a task on the dynamically generated text using the touch, wherein the task comprises sliding the finger across the dynamically generated text and moving at least one of the characters within the dynamically generated text via the sliding; and
while the finger is being slid across the dynamically generated text and is performing the task, generating a type of haptic event based at least in part on the type of the manipulation, wherein the haptic event generates the haptic feedback that is applied to the finger during the sliding;
wherein each type of manipulation includes the moving of at least one of the characters, and a first type of manipulation comprises moving a word within the dynamically generated text, and a second type of manipulation comprises moving a graphical object, and
wherein the type of haptic event is one of a plurality of different types of haptic events each being associated with a corresponding one of the different types of manipulation.

2. The non-transitory computer readable medium of claim 1 , wherein the manipulation comprises a selection of the dynamically generated text.

3. The non-transitory computer readable medium of claim 1 , wherein a third type of manipulation comprises moving a cursor within the dynamically generated text.

4. The non-transitory computer readable medium of claim 1 , wherein the manipulation comprises copying, moving, and pasting the dynamically generated text.

5. The non-transitory computer readable medium of claim 2 , wherein the selection of the dynamically generated text comprises one of selecting one of the characters, a word, a sentence, or a paragraph, and a first haptic event is generated for each of the characters, the word, the sentence, and the paragraph.

6. The non-transitory computer readable medium of claim 1 , wherein types of haptic events are generated by varying one or more of an amplitude, a time duration, or a frequency of a vibration.

7. The non-transitory computer readable medium of claim 1 , further comprising:
determining a portion of the dynamically generated text that is blocked by the touch; and
generating and displaying a magnification window that includes the portion of the dynamically generated text.

8. The non-transitory computer readable medium of claim 1 , wherein the type of haptic event is based at least on a speed of the sliding.

9. The non-transitory computer readable medium of claim 8 , wherein if the speed is a first amount, a first type of haptic event provides an individual character feeling, and if the speed is a second amount greater than the first amount, a second type of haptic event provides an individual word feeling.

10. The non-transitory computer readable medium of claim 1 ,
wherein determining the type of the manipulation comprises determining if a point of interest of the dynamically generated text is touched, and
wherein the point of interest comprises at least one of a name of a contact, a telephone number, and or an address.

11. The non-transitory computer readable medium of claim 2 , wherein the type of haptic event is based at least on an availability of operations for the selected dynamically generated text.

12. The non-transitory computer readable medium of claim 11 , wherein the availability of operations comprises at least one of cut, copy, paste or insert.

13. The non-transitory computer readable medium of claim 12 , wherein the haptic event generated in response to the availability of the paste comprises a strength based on a volume of selected dynamically generated text.

14. A computer implemented method for providing haptic feedback on a device comprising a touchscreen, the method implemented by a processor and comprising:
displaying dynamically generated text comprising a plurality of characters comprising graphical objects;
sensing by the processor a touch by a user's finger within the dynamically generated text;
determining by the processor if the touch is a manipulation of the dynamically generated text and determining a type of the manipulation, wherein the manipulation of the dynamically generated text comprises performing a task on the dynamically generated text using the touch, wherein the task comprises sliding the finger across the dynamically generated text and moving at least one of the characters within the dynamically generated text via the sliding; and
while the finger is being slid across the dynamically generated text and is performing the task, generating by the processor a type of haptic event based at least in part on the type of the manipulation, wherein the haptic event generates the haptic feedback that is applied to the finger during the sliding;
wherein each type of manipulation includes the moving of at least one of the characters, and a first type of manipulation comprises moving a word within the dynamically generated text, and a second type of manipulation comprises moving a graphical object, and
wherein the type of haptic event is one of a plurality of different types of haptic events each being associated with a corresponding one of the different types of manipulation.

15. The method of claim 14 , wherein the manipulation comprises a selection of the dynamically generated text.

16. The method of claim 14 , wherein a third type of manipulation comprises moving a cursor within the dynamically generated text.

17. The method of claim 14 , wherein the manipulation comprises copying, moving, and pasting the dynamically generated text.

18. The method of claim 15 , wherein the selection of the dynamically generated text comprises one of selecting one of the characters, a word, a sentence, or a paragraph, and a different type of haptic event is generated for each of the characters, the word, the sentence, and the paragraph.

19. The method of claim 14 , wherein different types of haptic events are generated by varying one or more of an amplitude, a time duration, or a frequency of a vibration.

20. The method of claim 14 , further comprising:
determining a portion of the dynamically generated text that is blocked by the touch; and
generating and displaying a magnification window that includes the portion of the dynamically generated text.

21. The method of claim 14 , wherein the type of haptic event is based at least on a speed of the sliding.

22. An apparatus comprising:
a processor;
a non-transitory memory coupled to the processor and storing instructions;
a touchscreen coupled to the processor;
an actuator coupled to the processor;
wherein the instructions, when executed by the processor, cause the apparatus to:
dynamically generate text from a word processing application executed by the processor;
display the dynamically generated text comprising a plurality of characters comprising graphical objects;
sense a touch by a user's finger within the dynamically generated text;
determine if the to

Assignees

• Ramstein Christophe
• Birnbaum David
• Immersion Corp

Inventors

• Ramstein Christophe
• Birnbaum David

Classifications

• G06F40/166

  Editing, e.g. inserting or deleting · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/016 Primary

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title