Implementing a customized interaction pattern for a device

Patent metadata

Field	Value
Publication number	US-10664041-B2
Application number	US-201715811505-A
Country	US
Kind code	B2
Filing date	Nov 13, 2017
Priority date	Nov 13, 2017
Publication date	May 26, 2020
Grant date	May 26, 2020

Abstract

A computer-implemented method according to one embodiment includes identifying one or more input mechanisms for a device, monitoring a plurality of interactions between a user and the device, utilizing the one or more input mechanisms, and implementing a customized interaction pattern for the device, based on the monitoring.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
identifying one or more input mechanisms for a device;
monitoring a plurality of interactions between a user and the device, utilizing the one or more input mechanisms, the plurality of interactions including:
a displaying of content of a predetermined type by an application of the device,
a detection by the device of one or more physical actions of the user, in response to the displaying of the content of the predetermined type, and
a detection of a selection by the user of an option to remove content of the predetermined type presented by the application of the device; and

implementing a customized interaction pattern for the device, based on the monitoring, including:
saving the plurality of interactions as interaction data, in association with a timing and a sequence of the interaction data,
creating an historical interaction pattern describing the plurality of interactions,
creating the customized interaction pattern for the device that automatically removes the content of the predetermined type presented by the application in response to the one or more physical actions of the user,
adding the customized interaction pattern to the device as a new control sequence for the application of the device, and
storing the customized interaction pattern in association with a profile of the user.

2. The computer-implemented method of claim 1 , wherein one or more of the plurality of interactions are monitored at an application layer of the device.

3. The computer-implemented method of claim 1 , wherein the customized interaction pattern is implemented for a plurality of predetermined applications of the device.

4. The computer-implemented method of claim 1 , wherein the one or more input mechanisms include one or more cameras of the device, one or more microphones of the device, one or more touch screens of the device, one or more pressure sensors of the device, one or more accelerometers of the device, one or more global positioning system (GPS) modules of the device, and one or more gyroscopes of the device.

5. The computer-implemented method of claim 1 , wherein the one or more input mechanisms include a facial recognition application, an eye movement recognition application, and a touch screen contact tracking application.

6. The computer-implemented method of claim 1 , wherein the plurality of interactions further include verbal input, physical gesture input, tactile input, eye movement input, and facial expression input.

7. The computer-implemented method of claim 1 , wherein:
the one or more input mechanisms include one or more cameras of the device, one or more microphones of the device, one or more touch screens of the device, one or more pressure sensors of the device, one or more accelerometers of the device, one or more global positioning system (GPS) modules of the device, one or more gyroscopes of the device, a facial recognition application, an eye movement recognition application, and a touch screen contact tracking application, and
the plurality of interactions further include verbal input, physical gesture input, tactile input, eye movement input, and facial expression input.

8. The computer-implemented method of claim 1 , wherein the customized interaction pattern is created by identifying, from interaction data created based on the monitoring, an historical interaction pattern including a recurring order and timing of input from the user as well as a performance of one or more actions by the device both before and after the input from the user.

9. The computer-implemented method of claim 1 , wherein the customized interaction pattern initiates a sending of one or more instructions to the device to perform one or more actions by the device, in response to receiving predetermined input from the user, and identifying a performance of predetermined actions by the device, in a timing and order that matches a predetermined portion of an historical interaction pattern.

10. The computer-implemented method of claim 1 , wherein the implementing includes presenting the customized interaction pattern to the user for approval.

11. The computer-implemented method of claim 1 , wherein the implementing includes configuring a user interface interaction profile to remember the customized interaction pattern.

12. The computer-implemented method of claim 1 , further comprising implementing the customized interaction pattern for one or more additional devices.

13. The computer-implemented method of claim 1 , further comprising:
presenting one or more additional users matching the profile with the customized interaction pattern for approval; and
implementing the customized interaction pattern for the additional users in response to receiving their approval.

14. The computer-implemented method of claim 1 , further comprising:
collecting feedback associated with the customized interaction pattern from one or more users; and
adjusting the customized interaction pattern, based on the feedback.

15. The computer-implemented method of claim 1 , further comprising implementing the customized interaction pattern for a second device.

16. A computer program product for implementing a customized interaction pattern for a device, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:
identifying, utilizing the processor, one or more input mechanisms for a device;
monitoring a plurality of interactions between a user and the device, utilizing the processor and the one or more input mechanisms, the plurality of interactions including:
a displaying of content of a predetermined type by an application of the device,
a detection by the device of one or more physical actions of the user, in response to the displaying of the content of the predetermined type, and
a detection of a selection by the user of an option to remove content of the predetermined type presented by the application of the device; and
implementing, utilizing the processor, a customized interaction pattern for the device, based on the monitoring, including:
saving the plurality of interactions as interaction data, in association with a timing and a sequence of the interaction data,
creating an historical interaction pattern describing the plurality of interactions,
creating the customized interaction pattern for the device that automatically removes the content of the predetermined type presented by the application in response to the one or more physical actions of the user,
adding the customized interaction pattern to the device as a new control sequence for the application of the device, and
storing the customized interaction pattern in association with a profile of the user.

17. The computer program product of claim 16 , wherein the one or more input mechanisms include one or more cameras of the device, one or more microphones of the device, one or more touch screens of the device, one or more pressure sensors of the device, one or more accelerometers of the device, one or more global positioning system (GPS) modules of the device, and one or more gyroscopes of the device.

18. The computer program product of claim 16 , wherein the one or more input mechanisms include a facial recognition application, an eye movement recognition application, and a touch screen contac

Assignees

• IBM
• Inernational Business Machines Corp

Inventors

• Flores Romelia H
• GU Yu
• Liu Kai
• Liu Su

Classifications

• G06F2203/011

  Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns · CPC title

• G06F2203/0381

  Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title