Learning and deployment of adaptive wireless communications

Patent metadata

Field	Value
Publication number	US-10217047-B2
Application number	US-201815970324-A
Country	US
Kind code	B2
Filing date	May 3, 2018
Priority date	May 3, 2017
Publication date	Feb 26, 2019
Grant date	Feb 26, 2019

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training and deploying machine-learned communication over radio frequency (RF) channels. One of the methods includes: determining first information; using an encoder machine-learning network to process the first information and generate a first RF signal for transmission through a communication channel; determining a second RF signal that represents the first RF signal having been altered by transmission through the communication channel; using a decoder machine-learning network to process the second RF signal and generate second information as a reconstruction of the first information; calculating a measure of distance between the second information and the first information; and updating at least one of the encoder machine-learning network or the decoder machine-learning network based on the measure of distance between the second information and the first information.

First claim

What is claimed is:

1. A method performed by at least one processor to train at least one machine-learning network to communicate over a communication channel, the method comprising:
determining first information;
using an encoder machine-learning network to process the first information and generate a first RF signal for transmission through a communication channel;
determining a second RF signal that represents the first RF signal having been altered by transmission through the communication channel;
using a decoder machine-learning network to process the second RF signal and generate second information as a reconstruction of the first information;
calculating a measure of distance between the second information and the first information; and
updating at least one of the encoder machine-learning network or the decoder machine-learning network based on the measure of distance between the second information and the first information, wherein the updating comprises:
determining an objective function comprising the measure of distance between the second information and the first information;
calculating a rate of change of the objective function relative to variations in at least one of the encoder machine-learning network or the decoder machine-learning network;
selecting, based on the calculated rate of change of the objective function, at least one of a first variation for the encoder machine-learning network or a second variation for the decoder machine-learning network; and
updating at least one of the encoder machine-learning network or the decoder machine-learning network based on the at least one of the selected first variation for the encoder machine-learning network or the selected second variation for the decoder machine-learning network.

2. The method of claim 1 , wherein the measure of distance between the second information and the first information comprises at least one of (i) a cross-entropy between the second information and the first information, or (ii) a geometric distance metric between the second information and the first information.

3. The method of claim 1 , wherein updating at least one of the encoder machine-learning network or the decoder machine-learning network comprises at least one of:
updating at least one encoding network weight or network connectivity in one or more layers of the encoder machine-learning network, or
updating at least one decoding network weight or network connectivity in one or more layers of the decoder machine-learning network.

4. The method of claim 1 , wherein updating at least one of the encoder machine-learning network or the decoder machine-learning network further comprises:
determining a channel mode, from among a plurality of channel modes, that represents a state of the communication channel; and
updating at least one of the encoder machine-learning network or the decoder machine-learning network based on the channel mode of the communication channel.

5. The method of claim 1 , wherein the encoder machine-learning network and the decoder machine-learning network are jointly trained as an auto-encoder to learn communication over a communication channel, and
wherein the auto-encoder comprises at least one channel-modeling layer representing effects of the communication channel on transmitted waveforms.

6. The method of claim 5 , wherein the at least one channel-modeling layer represents at least one of (i) additive Gaussian thermal noise in the communication channel, (ii) delay spread caused by time-varying effects of the communication channel, (iii) phase noise caused by transmission and reception over the communication channel, or (iv) offsets in phase, frequency, or timing caused by transmission and reception over the communication channel.

7. The method of claim 1 , wherein at least one of the encoder machine-learning network or the decoder machine-learning network comprises at least one of a deep dense neural network (DNN), a convolutional neural network (CNN), or a recurrent neural network (RNN) comprising parametric multiplications, additions, and non-linearities.

8. The method of claim 1 , further comprising:
processing the first RF signal to generate a first analog RF waveform that is input into the communication channel;
receiving a second analog RF waveform as an output of the communication channel that represents the first analog RF waveform having been altered by the communication channel; and
processing the second analog RF waveform to generate the second RF signal.

9. The method of claim 1 , wherein the communication channel comprises at least one of a radio communication channel, an acoustic communication channel, or an optical communication channel.

10. A system comprising:
at least one processor; and
at least one computer memory coupled to the at least one processor having stored thereon instructions which, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
determining first information;
using an encoder machine-learning network to process the first information and generate a first RF signal for transmission through a communication channel;
determining a second RF signal that represents the first RF signal having been altered by transmission through the communication channel;
using a decoder machine-learning network to process the second RF signal and generate second information as a reconstruction of the first information;
calculating a measure of distance between the second information and the first information; and
updating at least one of the encoder machine-learning network or the decoder machine-learning network based on the measure of distance between the second information and the first information, wherein the updating comprises:
determining an objective function comprising the measure of distance between the second information and the first information;
calculating a rate of change of the objective function relative to variations in at least one of the encoder machine-learning network or the decoder machine-learning network;
selecting, based on the calculated rate of change of the objective function, at least one of a first variation for the encoder machine-learning network or a second variation for the decoder machine-learning network; and
updating at least one of the encoder machine-learning network or the decoder machine-learning network based on the at least one of the selected first variation for the encoder machine-learning network or the selected second variation for the decoder machine-learning network.

11. The system of claim 10 , wherein the measure of distance between the second information and the first information comprises at least one of (i) a cross-entropy between the second information and the first information, or (ii) a geometric distance metric between the second information and the first information.

12. The system of claim 10 , wherein updating at least one of the encoder machine-learning network or the decoder machine-learning network comprises at least one of:
updating at least one encoding network weight or network connectivity in one or more layers of the encoder machine-learning network, or
updating at least one decoding network weight or network connectivity in one or more layers of the decoder machine-learning network.

13. The system of claim 10 , wherein updating at least one of the encoder machine-learning network or the decoder machine-learning network further comprises:
determining a channel mode, from among a plurality of channel modes, that represents a state of the communication channel; and
updating at least one of the encoder mach

Assignees

• Virginia Tech Intellectual Properties Inc

Inventors

• O'Shea Timothy James

Classifications

• G06N3/045

  Combinations of networks · CPC title

• G06N3/044

  Recurrent networks, e.g. Hopfield networks · CPC title

• G06N3/0455

  Auto-encoder networks; Encoder-decoder networks · CPC title

• G06N3/08 Primary

  Learning methods · CPC title

• G06N3/0445

  Physics · mapped topic