Method and electronic device for providing control functionality of display

Patent metadata

Field	Value
Publication number	US-12373093-B2
Application number	US-202318217229-A
Country	US
Kind code	B2
Filing date	Jun 30, 2023
Priority date	Jan 5, 2022
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

Embodiments are directed to providing control functionality of a display of an electronic device. The method includes determining, by the electronic device, an event and partitioning, by the electronic device, a rear side of the electronic device into dynamic tiles based on multiple parameters associated with the display, based on determining the event. The method also includes detecting, by the electronic device, a user gesture on the dynamic tile on the rear side of the electronic device and classifying, by the electronic device, the detected gesture into a gesture category. Further, the method includes determining, by the electronic device, a functionality based on the gesture on the rear side of the electronic device and the corresponding gesture category. The method includes controlling, by the electronic device, the functionality on the display of the electronic device.

First claim

What is claimed is:

1. A method for providing control functionality of a display of an electronic device, the method comprising:
determining, by the electronic device, a non-responsiveness of the display on a front side of the electronic device as an event associated with the display of the electronic device;
in response to determining the non-responsiveness of the display on the front side of the electronic device, partitioning, by the electronic device, a rear side of the electronic device into a plurality of dynamic tiles based on a plurality of parameters associated with the display of the electronic device, in response to determining the event, wherein the rear side is opposite the front side;
detecting, by the electronic device, at least one gesture on at least one dynamic tile of the plurality of dynamic tiles on the rear side of the electronic device;
classifying, by the electronic device, the at least one gesture into a gesture category;
determining, by the electronic device, at least one functionality to be performed on the display based on the at least one gesture on the rear side of the electronic device and the gesture category; and
controlling, by the electronic device, the at least one functionality on the display of the electronic device.

2. The method as claimed in claim 1 , wherein the event associated the display of the electronic device further comprises a reduction in user experience during interaction with the display of the electronic device.

3. The method as claimed in claim 1 , wherein the plurality of parameters associated with the display of the electronic device comprises at least one of an aspect ratio of the electronic device, a user touch area, or a sensor location and proximity of at least one actionable element with respect to other actionable elements on the display of the electronic device.

4. The method as claimed in claim 2 , wherein the non-responsiveness of the display of the electronic device is detected based on one of a capacitance change of the display, a temperature of the electronic device, or a ghost touch on the display of the electronic device.

5. The method as claimed in claim 2 wherein the reduction in the user experience during interaction with the display of the electronic device is determined based on at least one of a size of the display, a number of actionable elements on the display, and a distribution pattern of the number of the actionable elements on the display.

6. The method as claimed in claim 1 , wherein the gesture category comprises one of a single tap, a double tap, a long tap, a triple tap, a scroll with a single finger, a scroll with double fingers, and a horizontal swipe.

7. The method as claimed in claim 1 , wherein partitioning, by the electronic device, the rear side of the electronic device into the plurality of dynamic tiles based on the plurality of parameters associated with the display of the electronic device, in response to determining the event comprises:
dividing, by the electronic device, the rear side of the electronic device into the plurality of dynamic tiles based on an aspect ratio of the electronic device;
dividing, by the electronic device, a front side of the electronic device into a first set of blocks based on pixel coordinates, wherein each block of the first set of blocks comprises a block area;
determining, by the electronic device, a touch area of a user on the display of the electronic device;
determining, by the electronic device, that the touch area on the display is greater than the block area of each block of the first set of blocks;
merging, by the electronic device, at least two blocks of the first set of blocks to form a second set of blocks based on one of the touch area and a position of actionable elements on the front side of the electronic device;
determining, by the electronic device, a pattern of sensor features and coordinate values of each of the plurality of dynamic tiles on the rear side of the electronic device;
mapping, by the electronic device, the coordinate values of each of the plurality of dynamic tiles on the rear side of the electronic device to corresponding ones of the second set of blocks on the front side of the electronic device; and
partitioning, by the electronic device, the rear side of the electronic device into the plurality of dynamic tiles based on the mapping.

8. The method as claimed in claim 1 , wherein classifying, by the electronic device, the at least one gesture into the gesture category comprises:
detecting, by the electronic device, at least one touch coordinate associated with the at least one gesture on the rear side of the electronic device;
determining, by the electronic device, a time stamp of the at least one touch coordinate associated with the at least one gesture;
inputting, by the electronic device, the at least one touch coordinate associated with the at least one gesture and the time stamp of the at least one touch coordinate associated with the at least one gesture to a third machine learning (ML) model; and
classifying, by the electronic device, the at least one gesture into the gesture category using the third ML model.

9. The method as claimed in claim 1 , wherein determining, by the electronic device, the at least one functionality to be performed on the display based on the at least one gesture on the rear side of the electronic device and the gesture category comprises:
mapping, by the electronic device, coordinates associated with the at least one gesture on the rear side of the electronic device and the gesture category into a second set of blocks on the front side of the electronic device, wherein the mapping comprises a start coordinate and an end coordinate of at least one tile of the plurality of dynamic tiles, a tile number, and a list of applications within a tile area of the at least one tile; and
determining, by the electronic device, the at least one functionality to be performed on the display based on the mapping.

10. The method as claimed in claim 9 , further comprising:
determining, by the electronic device, a plurality of functionalities to be performed on the display based on the at least one gesture on the rear side of the electronic device;
inputting, by the electronic device, actionable elements within the tile area, a frequency of usage of the actionable elements, a last activity on the electronic device, and the gesture category of the at least one gesture to a fourth ML model; and
determining, by the electronic device, a priority score for each of the plurality of functionalities to be performed on the display using the fourth ML model.

11. The method as claimed in claim 10 , further comprising:
storing, by the electronic device, the at least one gesture, the gesture category, and the priority score for each of the plurality of functionalities to be performed on the display;
determining, by the electronic device, the at least one gesture on the rear side of the electronic device for performing the plurality of functionalities; and
automatically determining, by the electronic device, the at least one functionality to be performed based on the priority score for each of the plurality of functionalities.

12. The method as claimed in claim 1 , wherein detecting, by the electronic device, the at least one gesture on the at least one dynamic tile on the rear side of the electronic device comprises:
inputting, by the electronic device, predefined features and derived features associated with the at least one gesture to a first ML model;
determining, by the electronic device, a quadrant of a set of four quadrants of the at least one gesture by the first ML model;
inputt

Assignees

• Samsung Electronics Co Ltd

Inventors

• Choudhary Choice
• Agarwal Ankit
• Rajput Shivam Singh

Classifications

• G06F3/044

  by capacitive means · CPC title

• G06F3/0416

  Control or interface arrangements specially adapted for digitisers · CPC title

• G06F2203/04803

  Split screen, i.e. subdividing the display area or the window area into separate subareas · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G06F1/1694

  the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer · CPC title