Lid controller hub architecture for improved touch experiences

Patent metadata

Field	Value
Publication number	US-11789565-B2
Application number	US-202017134396-A
Country	US
Kind code	B2
Filing date	Dec 26, 2020
Priority date	Aug 18, 2020
Publication date	Oct 17, 2023
Grant date	Oct 17, 2023

Abstract

A lid controller hub (LCH) comprising processing components located in the lid of a mobile computing device, such as a laptop, processes sensor data generated by input sensors (microphones, cameras, touchscreen) and provides for improved and enhanced experiences over existing devices. For example, the LCH provides hardened privacy and the synchronization of touch display activities with the display refresh rate, the latter providing for a smoother and more responsive touch experience over existing designs. The LCH enables continuous gestures comprising touch gesture and in-air gesture portions as well as multi-plane gestures in which an initial touch gesture places the device into a mode or context in which it recognizes and acts upon subsequent in-air gestures. Touch operations of a mobile computing device can be based on user presence, user engagement, and a level of user interaction with the device.

First claim

The invention claimed is:

1. A method comprising:
receiving, at one or more processing units located in a lid of a mobile computing device, touch sensor data from a touch display controller; and
in response to receiving a display refresh notification at the one or more processing units located in the lid:
generating, at the one or more processing units located in the lid, conditioned touch sensor data based on the touch sensor data; and
sending, from the one or more processing units located in the lid, the conditioned touch sensor data to an operating system;

wherein the operating system is executing on one or more processing units located in a base of the mobile computing device.

2. The method of claim 1 , wherein the touch sensor data comprises touch location data, the generating the conditioned touch sensor data comprises generating conditioned touch location data based on the touch location data, the conditioned touch sensor data comprising the conditioned touch location data.

3. The method of claim 1 , wherein the touch sensor data comprises touch intensity data, the generating the conditioned touch sensor data comprises generating conditioned touch intensity data based on the touch intensity data, the conditioned touch sensor data comprising the conditioned touch intensity data.

4. The method of claim 1 , wherein the generating the conditioned touch sensor data comprises smoothing the touch sensor data.

5. The method of claim 1 , further comprising:
receiving, at the one or more processing units located in the lid, prior touch sensor data; and
receiving, at the one or more processing units located in the lid, a prior display refresh notification prior to the display refresh notification, the prior touch sensor data received prior to the receiving of the prior display refresh notification, wherein the generating the conditioned touch sensor data comprises averaging the touch sensor data with the prior touch sensor data.

6. The method of claim 1 , further comprising notifying, by the one or more processing units located in the lid, a display subsystem to change a refresh rate of a display.

7. The method of claim 1 , further comprising:
generating, by the operating system or an application executing on the mobile computing device, frame information based on the conditioned touch sensor data;
generating a new frame based on the frame information; and
refreshing a display to display the new frame.

8. One or more processing units to:
receive touch sensor data from a touch display controller;
receive a display refresh notification; and
in response to receiving the display refresh notification:
generate conditioned touch sensor data based on the touch sensor data; and
send the conditioned touch sensor data to a host processing unit;

wherein the one or more processing units are for use in a lid of a mobile computing device.

9. The one or more processing units of claim 8 , wherein the touch sensor data comprises touch location data, to generate the conditioned touch sensor data comprises to generate conditioned touch location data based on the touch location data, the conditioned touch sensor data comprising the conditioned touch location data.

10. The one or more processing units of claim 8 , wherein the touch sensor data comprises touch intensity data, to generate the conditioned touch sensor data comprising to generate conditioned touch intensity data based on the touch intensity data, the conditioned touch sensor data comprising the conditioned touch intensity data.

11. The one or more processing units of claim 8 , wherein to generate the conditioned touch sensor data comprises to average the touch sensor data with touch sensor data received prior to previous display refreshes.

12. The one or more processing units of claim 8 , the one or more processing units to further notify a display subsystem to increase a refresh rate of a display.

13. The one or more processing units of claim 8 , the one or more processing units to further notify a display subsystem to increase a refresh rate of a display to a maximum refresh rate.

14. The one or more processing units of claim 13 , the one or more processing units to further notify the display subsystem in response to receiving the touch sensor data.

15. A mobile computing device comprising:
a base comprising one or more host processing units to execute an operating system; and
a lid rotatably coupled to the base, the lid comprising:
a touch display;
a touch display controller;
a display subsystem to refresh the touch display; and
one or more processing units located in the lid, the one or more processing units located in the lid to:
receive touch sensor data from the touch display controller;
receive a display refresh notification from the display subsystem; and
in response to receiving the display refresh notification:
generate conditioned touch sensor data based on the touch sensor data; and
send the conditioned touch sensor data to the operating system.

16. The mobile computing device of claim 15 , wherein the touch sensor data comprises touch location data, to generate the conditioned touch sensor data comprises to generate conditioned touch location data based on the touch location data, the conditioned touch sensor data comprising the conditioned touch location data.

17. The mobile computing device of claim 15 , wherein the touch sensor data comprises touch intensity data, to generate the conditioned touch sensor data comprises to generate conditioned touch intensity data based on the touch intensity data, the conditioned touch sensor data comprising the conditioned touch intensity data.

18. The mobile computing device of claim 15 , the one or more processing units located in the lid further to:
receive prior touch sensor data; and
receive a prior display refresh notification prior to the display refresh notification, the prior touch sensor data received prior to the receiving of the prior display refresh notification, wherein to generate the conditioned touch sensor data comprises to average the touch sensor data with the prior touch sensor data.

19. The mobile computing device of claim 15 , the one or more processing units located in the lid to further notify the display subsystem to change a refresh rate of a display.

20. The mobile computing device of claim 15 , the one or more processing units located in the lid to further notify the display subsystem in response to receiving the touch sensor data.

21. The mobile computing device of claim 15 , wherein the display subsystem comprises a timing controller.

22. The mobile computing device of claim 15 , the host processing units to execute an application, the operating system to provide the conditioned touch sensor data to the application.

23. The mobile computing device of claim 15 , the operating system to generate frame information based on the conditioned touch sensor data; the operating system to generate a new frame based on the frame information, the display subsystem further to:
receive video data from the base; and
cause the touch display to be refreshed with the new frame.

Assignees

• Intel Corp

Inventors

• Parikh Kunjal S
• Cheng Antonio S
• Diefenbaugh Paul S
• Tsai Jackson
• Raleigh Edward James
• Sinha Vishal Ravindra
• Liang Chung-Yu
• Magi Aleksander
• Li Yifan
• King Matt

Classifications

• G06N3/09

  Supervised learning · CPC title

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G06F3/04184 Primary

  Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally · CPC title

• G06F1/1637

  Details related to the display arrangement, including those related to the mounting of the display in the housing · CPC title

• G06F3/03547 Primary

  Touch pads, in which fingers can move on a surface · CPC title