Method and apparatus for monitoring usage of at least one application executed within an operating system

Patent metadata

Field	Value
Publication number	US-2023142311-A1
Application number	US-202117913470-A
Country	US
Kind code	A1
Filing date	Feb 9, 2021
Priority date	Mar 26, 2020
Publication date	May 11, 2023
Grant date	—

Abstract

The present disclosure is directed towards an apparatus and method for monitoring usage of applications executed within an operating system of an electronic device. The apparatus and method are implemented using a monitoring application different from the monitored applications and aims at providing not only information regarding applications usage time, but also information regarding how some of the monitored applications are used. The monitoring application utilizes a trained model to acquired information regarding the monitored applications.

First claim

1 . A method for monitoring usage of at least one application executed within an operating system of an electronic device, the method being implemented by a monitoring application different from the at least one application, wherein, the method comprises upon detection of an input on a input control interface of the electronic device at least one iteration of:
acquiring a screenshot of a menu screen currently displayed by the monitored application; running a trained model on the screenshot, the trained model being capable of determining the type of menu screen of the currently displayed menu screen and retrieving data from at least one data field identified based on the type of menu screen of the currently displayed menu screen from the screenshot; and delivering a consolidated set of data obtained from the screenshot to a remote electronic device for data processing, the set of data including a type of menu screen corresponding to the currently displayed menu screen, and data retrieved from at least one data field identified based on the type of menu screen corresponding to the currently displayed menu screen.

2 . The method of claim 1 further comprising timestamping the screenshot.

3 . The method of claim 1 further comprising detecting the launch of the monitored application.

4 . The method of claim 1 wherein the consolidated set of data is transmitted for each iteration.

5 . The method of claim 1 wherein the consolidated set of data is transmitted upon detection of a shutting down of the monitored application.

6 . The method according to claim 1 wherein a type of screen of the currently displayed menu screen belongs to a group comprising a welcome screen, a catalogue screen, a search screen, and a content screen.

7 . The method according to claim 1 wherein a data field identified based on the type of screen of the currently displayed menu screen belongs to a group comprising a content name, a content type, actors' names, and a content display duration.

8 . (canceled)

9 . A method for training a model capable of determining, based on a screenshot of a menu screen of at least one application whose usage is to be monitored, a type of screen of the menu screen and identifying at least one data field based on the type of screen of the menu screen, the training method being executed by a learning engine and comprising:
receiving, as an input, at least one identified screenshot of all the menu screens that can be displayed during the execution of said application, and for a given type of menu screen, at least a list of data fields included in said menu screen; determining at least one generic layout corresponding to a type of menu screen based on at least one layout of the at least one menu screen by analysing a layout of at least one screenshot, said layout being compared in order to find similarities with other layouts already analysed, such as a number of data fields included in a menu screen along with information about these data fields; and delivering, to a monitoring application, a data-structure including a given type of menu screen and a list of data fields identifying the type of menu screen.

10 . The method according to claim 9 wherein the at least one generic layout is associated with a type of menu screen.

11 . The method according to claim 9 wherein the at least one generic layout is associated with a list comprising the at least one data field.

12 . The method according to claim 11 wherein the list further comprises geometric coordinates of the at least one data field.

13 . (canceled)

14 . An electronic device embedding a monitoring application capable of monitoring usage of at least one application executed within an operating system of the electronic device, the electronic device comprising at least one processor configured to, upon detection of an input on a input control interface of the electronic device:
acquire a screenshot of a menu screen currently displayed by the monitored application; run a trained model on the screenshot, the trained model being capable of determining the type of menu screen of the currently displayed menu screen and retrieving data from at least one data field identified based on the type of menu screen of the currently displayed menu screen from the screenshot; and deliver a consolidated set of data obtained from the screenshot, to a remote electronic device for data processing, including a type of menu screen of the currently displayed menu screen, and data retrieved from at least one data field identified based on the type of menu screen of the currently displayed menu screen.

15 . The apparatus of claim 14 , wherein the at least one processor is further configured to timestamp the screenshot.

16 . The apparatus of claim 14 , wherein the at least one processor is further configured to detect the launch of the monitored application.

17 . The apparatus of claim 14 , wherein the consolidated set of data is transmitted for each iteration.

18 . The apparatus of claim 14 , wherein the consolidated set of data is transmitted upon detection of a shutting down of the monitored application.

19 . The apparatus according to claim 14 , wherein a type of screen of the currently displayed menu screen belongs to a group comprising a welcome screen, a catalogue screen, a search screen, and a content screen.

20 . The apparatus according to claim 14 , wherein a data field identified based on the type of screen of the currently displayed menu screen belongs to a group comprising a content name, a content type, actors' names, and a content display duration.

Assignees

• Thomson Licensing

Inventors

• Dauvin Laurent
• Morillon Gilles
• Fraleu Sebastien
• Jollivet Christophe

Classifications

• G06F11/3419

  by assessing time · CPC title

• G06F9/451

  Execution arrangements for user interfaces · CPC title

• G06F11/3438 Primary

  monitoring of user actions (tracking the activity of the user H04L67/535) · CPC title

• G06F11/3447 Primary

  Performance evaluation by modeling · CPC title

• G06F11/302

  where the computing system component is a software system · CPC title