Action selection neural network training using imitation learning in latent space
US-2020104680-A1 · Apr 2, 2020 · US
US12458807B2 · US · B2
| Field | Value |
|---|---|
| Publication number | US-12458807-B2 |
| Application number | US-202117506019-A |
| Country | US |
| Kind code | B2 |
| Filing date | Oct 20, 2021 |
| Priority date | Oct 23, 2020 |
| Publication date | Nov 4, 2025 |
| Grant date | Nov 4, 2025 |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
Apparatus and methods for applying a phase-agnostic stimuli are disclosed herein. Certain embodiments include methods and apparatus that are configured to receive a detected signal from a subject and transmit a stimulation signal that is configured to optimize a response signal without regard to the phase of the detected signal.
Opening claim text (preview).
The invention claimed is: 1 . An apparatus for applying a therapeutic treatment to a subject, the apparatus comprising: a stimulation electrode; and a programmable arbitrary waveform generator, wherein the programmable arbitrary waveform generator is configured to: receive a detected biological oscillator signal from the subject; transmit a first stimulation signal to the subject via the stimulation electrode, wherein the first stimulation signal is transmitted at a phase of the detected biological oscillator signal; receive a response signal from the subject; and transmit a second stimulation signal to the subject via the stimulation electrode, wherein the second stimulation signal is configured to optimize the response signal without regard to the phase of the detected biological oscillator signal by suppressing oscillation in the detected biological oscillator signal while minimizing an electrical current level of the second stimulation, wherein: the second stimulation signal is generated using an extrema distortion algorithm, a deep learning algorithm or a reinforcement learning algorithm. 2 . The apparatus of claim 1 wherein the detected biological oscillator signal is received from a detection electrode. 3 . The apparatus of claim 2 wherein the detection electrode is a separate component coupled to the apparatus. 4 . The apparatus of claim 2 wherein the detection electrode is integral to the apparatus. 5 . The apparatus of claim 1 wherein the programmable arbitrary waveform generator is configured to: receive a second response signal generated by the second stimulation signal; transmit a third stimulation signal via the stimulation electrode, wherein the third stimulation is transmitted at a phase of the second response signal; receive a third response signal from the subject; and transmit a fourth stimulation signal to the subject via the stimulation electrode, wherein the fourth stimulation signal is configured to optimize the second response signal without regard to the phase of the third response signal. 6 . The apparatus of claim 5 wherein the programmable arbitrary waveform generator is configured to apply subsequent stimulation signals and receive subsequent response signals in an iterative process. 7 . The apparatus of claim 1 wherein the first stimulation signal and the second stimulation signal are complex waveforms. 8 . The apparatus of claim 1 wherein the first stimulation signal and the second stimulation signal are deep brain stimulation signals. 9 . The apparatus of claim 8 wherein the deep brain stimulation signals are directional deep brain stimulation signals. 10 . The apparatus of claim 9 wherein the deep brain stimulation signals are configured for treatment of Parkinson's disease. 11 . The apparatus of claim 9 wherein the deep brain stimulation signals are configured for treatment of epilepsy or a seizure disorder. 12 . The apparatus of claim 11 , wherein the deep brain stimulation signals are configured for treatment of absence seizures, tonic seizures, atonic seizures, clonic seizures, myoclonic seizures, or tonic-clonic seizures. 13 . The apparatus of claim 1 wherein the first stimulation signal and the second stimulation signal are cardiac stimulation signals. 14 . The apparatus of claim 13 , wherein the cardiac stimulation signals are configured for treatment of a cardiac arrythmia. 15 . An apparatus for applying a therapeutic treatment to a subject, the apparatus comprising: a detection module; a transmission module; and a waveform generator, wherein the waveform generator is configured to: receive a detected biological oscillator signal from the subject via the detection module; transmit a first stimulation signal to the subject via the transmission module; receive a first response biological oscillator signal from the subject via the detection module; transmit a second stimulation signal to the subject via the transmission module; and receive a second response biological oscillator signal from the subject via the detection module, wherein: the second stimulation signal is configured to optimize the first response signal by suppressing oscillation in the second response biological oscillator signal while minimizing an electrical current level of the second stimulation signal; and the first stimulation signal and the second stimulation signal are applied in a phase agnostic manner, wherein: the second stimulation signal is generated using an extrema distortion algorithm, a deep learning algorithm or a reinforcement learning algorithm. 16 . A method of treating a disease in a mammalian subject, the method comprising: receiving an oscillating electrical signal from a subject; applying a first stimulation signal to the subject at a phase window of the oscillating electrical signal, wherein the first stimulation signal modifies the oscillating electrical signal from the subject to produce a response signal; receiving the response signal from the subject; and applying a second stimulation signal to the subject, wherein the second stimulation signal is configured to optimize the response signal without regard to the phase window of the oscillating electrical signal by suppressing oscillation in the response signal while minimizing an electrical current level of the second stimulation, wherein: the second stimulation signal is generated using an extrema distortion algorithm, a deep learning algorithm or a reinforcement learning algorithm. 17 . A method of applying a therapeutic treatment to a subject, comprising: applying an electrical stimulation to the subject; receiving feedback from the subject in response to said electrical stimulation; adjusting said electrical stimulation based at least in part on said feedback, where the adjustment includes a change of the electrical stimulation waveform and comprises one or more of a change to phase, amplitude, timing, duration, shape; and applying the adjusted electrical stimulation to the subject, wherein: the adjusted electrical stimulation is generated using an extrema distortion algorithm, a deep learning algorithm or a reinforcement learning algorithm; and the adjusted electrical stimulation suppresses oscillation in the feedback while minimizing an electrical current level of the adjusted electrical stimulation.
Details of circuitry or electric components · CPC title
Cardiac control, e.g. by vagal stimulation (stimulating the heart A61N1/362) · CPC title
ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance · CPC title
Circuits for comparing several input signals and for indicating the result of this comparison, e.g. equal, different, greater, smaller, or for passing one of the input signals as output signal · CPC title
Electrodes for deep brain stimulation · CPC title
Related publications grouped by family.
Answers are generated from the same data shown on this page.