Automated User Interface Experimentation

Patent metadata

Field	Value
Publication number	US-2016349969-A1
Application number	US-201514726566-A
Country	US
Kind code	A1
Filing date	May 31, 2015
Priority date	May 31, 2015
Publication date	Dec 1, 2016
Grant date	—

Abstract

In one embodiment, a method includes providing a variant user interface to a first subset of a plurality of user devices, wherein the variant user interface is based on baseline user activity data indicative of user activities associated with a baseline user interface provided to the plurality of user devices, obtaining variant user activity data indicative of user activities associated with the variant user interface, and generating, based on the variant user activity data, effect data indicative of an effect of the variant user interface on one or more of the user activities.

First claim

What is claimed is:

1 . A method comprising:
providing a variant user interface to a first subset of a plurality of user devices, wherein the variant user interface is based on baseline user activity data indicative of user activities associated with a baseline user interface provided to the plurality of user devices; obtaining variant user activity data indicative of user activities associated with the variant user interface; and generating, based on the variant user activity data, effect data indicative of an effect of the variant user interface on one or more of the user activities.

2 . The method of claim 1 , further comprising providing the effect data via an administrator interface for adoption or rejection of the variant user interface in order to improve the baseline user interface.

3 . The method of claim 1 , further comprising:
providing a control user interface to a second subset of the plurality of user devices; and obtaining control user activity data indicative of user activities associated with the control user interface, wherein the effect data is generated based on the variant user activity data and the control user activity data.

4 . The method of claim 1 , further comprising determining the first subset of the plurality of user devices based on the baseline user activity data, wherein the baseline user activity data indicates that users of the first subset of the plurality of user devices have performed a target user activity associated with the variant user interface.

5 . The method of claim 1 , further comprising:
receiving baseline interaction data indicative of user interactions associated with the baseline user interface provided to the plurality of user devices; and generating the baseline user activity data based on the baseline interaction data.

6 . The method of claim 1 , further comprising:
determining a variant based on the baseline user activity data; and generating the variant user interface based on the baseline user interface and the variant.

7 . The method of claim 6 , wherein determining the variant comprises:
generating, based on the baseline user activity data, transition data indicative of, for a plurality of first user activities, a number of times that users have performed the first user activity following performance of each of a plurality of second activities; selecting a target user activity based on the transition data; selecting a variant associated with the target user activity.

8 . The method of claim 7 , wherein selecting the target user activity comprises:
determining a ranking score for each of a plurality of user activities based on the transition data; determining a desirability metric for each of the plurality of user activities; and selecting the target user activity based on the ranking score for each of the plurality of user activities and the desirability metric for each of the plurality of user activities.

9 . The method of claim 8 , wherein the ranking score is higher for a commonly performed user activity having a larger number of transitions to the commonly performed user activity than for an uncommonly performed activity having a smaller number of transitions to the uncommonly performed user activity.

10 . The method of claim 8 , wherein determining the desirability metric for each of the plurality of user activities includes receiving the desirability metric for each of the plurality of user activities via an administrator interface.

11 . The method of claim 7 , wherein selecting the variant comprises:
determining, based on the transition data, a plurality of transition user activities, the transition data indicating that users have performed the target user activity following performance of each of the plurality of transition user activities at least a threshold number of times; determining a plurality of subjects of the plurality of transition user activities; determining a plurality of potential variants, each of the plurality of potential variants associated with at least one of the plurality of subjects; determining a ranking score for each of the plurality of potential variants; and selecting, from the plurality of potential variants, the variant based on the ranking score for each of the plurality of potential variants.

12 . The method of claim 1 , wherein the baseline user interface comprises a network-based graphical user interface.

13 . The method of claim 1 , wherein the baseline user interface comprises at least one of an electronic programming guide, a website, a web application interface, or a mobile application interface.

14 . The method of claim 1 , further comprising:
providing a second variant user interface to a second subset of the plurality of user devices, wherein the second variant user interface is based the baseline user activity data; and obtaining second variant user activity data indicative of user activities associated with the second variant user interface; wherein the effect data is further based on the second variant user activity data and is further indicative of an effect of the second variant user interface on the one or more of the user activities.

15 . A system comprising:
a network interface configured to provide a user interface to a plurality of user devices; one or more processors; and a non-transitory memory comprising instructions that when executed cause the one or more processors to perform operations including:
controlling the network interface to provide a variant user interface to a first subset of a plurality of user devices, wherein the variant user interface is based on baseline user activity data indicative of user activities associated with a baseline user interface provided to the plurality of user devices;
obtaining variant user activity data indicative of user activities associated with the variant user interface; and
generating, based on the variant user activity data, effect data indicative of an effect of the variant user interface on one or more of the user activities.

16 . The system of claim 15 , the operations further comprising:
generating, based on the baseline user activity data, transition data indicative of, for a plurality of first user activities, a number of times that users have performed the first user activity following performance of each of a plurality of second activities; selecting a target user activity based on the transition data; selecting a variant associated with the target user activity; and generating the variant user interface based on the baseline user interface and the variant.

17 . The system of claim 16 , wherein selecting the target user activity comprises:
determining a ranking score for each of a plurality of user activities based on the transition data; determining a desirability metric for each of the plurality of user activities; and selecting the target user activity based on the ranking score for each of the plurality of user activities and the desirability metric for each of the plurality of user activities.

18 . A method comprising:
determining an experiment with respect to a user interface based on user activity data indicative of user activities associated with the user interface; performing the experiment; generating effect data indicative of results of the experiment; and providing the effect data via an administrator interface.

19 . The method of claim 18 , wherein determining the experiment comprises:
generating a variant user interface; determining a target group

Assignees

• Cisco Tech Inc

Inventors

• Tallamy Stephen Charles
• Frebourg Olivier Jean Bernard
• Smith Trevor George

Classifications

• G06F16/24578 Primary

  using ranking · CPC title

• G06F9/4451

  User profiles; Roaming · CPC title

• G06F9/451 Primary

  Execution arrangements for user interfaces · CPC title

• G06F17/3053

  Physics · mapped topic

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title