Machine learning based privacy processing

Patent metadata

Field	Value
Publication number	US-2022335945-A1
Application number	US-202017638613-A
Country	US
Kind code	A1
Filing date	Dec 17, 2020
Priority date	Dec 18, 2019
Publication date	Oct 20, 2022
Grant date	—

Abstract

Methods, systems, and apparatus, for handling applications in an ambient computing system with a privacy processor. One of the methods includes to remain in a monitoring power state until a controller receives an interrupt indicating that one or more sensor signals are present. The one or more sensor signals are provided as input to a machine learning engine. An inference pass is performed by the machine learning engine to generate an output representing a particular context that is specific to a particular user. It is determined that one or more components of an ambient computing system should be disabled based on the on the particular context for the particular user. In response, the one or more components of the ambient computing system are disabled.

First claim

What is claimed is:

1 . An ambient computing system comprising:
one or more sensors configured to generate sensor signals; and a plurality of processing components including a machine learning engine, and one or more other processing components, wherein the ambient computing system is configured to perform operations comprising:
remaining in a monitoring power state until a controller receives an interrupt indicating presence of one or more sensor signals,
providing the one or more sensor signals as input to the machine learning engine, wherein the machine learning engine implements a predictive model trained on user-specific data that is specific to a particular user,
performing, by the machine learning engine, an inference pass over the predictive model to generate an output representing a particular context that is specific to the particular user,
determining, based on the particular context for the particular user, that that one or more components of the ambient computing system should be disabled, and
in response, disabling the one or more components of the ambient computing system.

2 . The system of claim 1 , wherein disabling the one or more components of the ambient computing system comprises disabling one or more of the sensors.

3 . The system of claim 2 , wherein disabling one or more of the sensors comprises cutting power to the one or more sensors.

4 . The system of claim 2 , wherein disabling one or more of the sensors comprises disabling a microphone, a camera, a vision sensor, a radar sensor, or a location sensor.

5 . The system of claim 1 , wherein disabling one or more components of the ambient computing system comprises disabling a transcription module that automatically transcribes human speech.

6 . The system of claim 1 , wherein disabling one or more components of the ambient computing system comprises disabling an I/O channel between the sensors and other components of the ambient computing system.

7 . The system of claim 1 , wherein determining, based on the particular context for the particular user, that that one or more of the sensors should be disabled comprises determining that audio signals received by one or more microphones include speech uttered by a particular person previously identified by the user.

8 . The system of claim 1 , wherein the ambient computing system is configured to block transmission of data during the inference pass from being written to main memory, a main CPU cluster, or a main machine learning engine.

9 . The system of claim 1 , wherein the ambient computing system is configured to perform a training process to update the predictive model with user-specific data, wherein performing the training process comprises performing operations comprising:
receiving user input indicating that a current environmental context is a context in which one or more components of the ambient computing system should be disabled; generating training data from recorded inputs of the one or more sensors; and updating the predictive model using the training data generated from the recorded inputs of the one or more sensors.

10 . The system of claim 9 , wherein receiving the user input comprises receiving user input identifying a particular user who uttered speech during a recent time period.

11 . The system of claim 9 , wherein the current environmental context comprises data including a representation of a current location of the user.

12 . A computer implemented method comprising:
remaining in a monitoring power state until a controller receives an interrupt indicating presence of one or more sensor signals; providing the one or more sensor signals as input to a machine learning engine, wherein the machine learning engine implements a predictive model trained on user-specific data that is specific to a particular user; performing, by the machine learning engine, an inference pass over the predictive model to generate an output representing a particular context that is specific to the particular user; determining, based on the particular context for the particular user, that one or more components of an ambient computing system should be disabled, and in response, disabling the one or more components of the ambient computing system.

13 . The method of claim 12 , wherein disabling the one or more components of the ambient computing system comprises disabling one or more of the sensors.

14 . The method of claim 13 , wherein disabling one or more of the sensors comprises cutting power to the one or more sensors.

15 . The method of claim 13 , wherein disabling one or more of the sensors comprises disabling a microphone, a camera, a vision sensor, a radar sensor, or a location sensor.

16 . The method of claim 12 , wherein disabling one or more components of the ambient computing system comprises disabling a transcription module that automatically transcribes human speech.

17 . The method of claim 12 , wherein disabling one or more components of the ambient computing system comprises disabling an I/O channel between the sensors and other components of the ambient computing system.

18 . The method of claim 12 , wherein determining, based on the particular context for the particular user, that that one or more of the sensors should be disabled comprises determining that audio signals received by one or more microphones include speech uttered by a particular person previously identified by the user.

19 . The method of claim 12 , further comprising blocking transmission of data during the inference pass from being written to a main memory, a main CPU cluster, or a main machine learning engine.

20 . One or more non-transitory computer-readable media storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
remaining in a monitoring power state until a controller receives an interrupt indicating presence of one or more sensor signals; providing the one or more sensor signals as input to a machine learning engine, wherein the machine learning engine implements a predictive model trained on user-specific data that is specific to a particular user; performing, by the machine learning engine, an inference pass over the predictive model to generate an output representing a particular context that is specific to the particular user; determining, based on the particular context for the particular user, that one or more components of an ambient computing system should be disabled, and in response, disabling the one or more components of the ambient computing system.

Assignees

• Google Llc

Inventors

• Madar Iii Lawrence J
• Koyuncu Osman

Classifications

• G06F21/81

  by operating on the power supply, e.g. enabling or disabling power-on, sleep or resume operations · CPC title

• G06F21/6245 Primary

  Protecting personal data, e.g. for financial or medical purposes · CPC title

• G10L15/26 Primary

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G06N5/04

  Inference or reasoning models · CPC title

• H04W12/60

  Context-dependent security · CPC title