FI20205980A9 - Communication System - Google Patents
Communication System Download PDFInfo
- Publication number
- FI20205980A9 FI20205980A9 FI20205980A FI20205980A FI20205980A9 FI 20205980 A9 FI20205980 A9 FI 20205980A9 FI 20205980 A FI20205980 A FI 20205980A FI 20205980 A FI20205980 A FI 20205980A FI 20205980 A9 FI20205980 A9 FI 20205980A9
- Authority
- FI
- Finland
- Prior art keywords
- channel
- module
- estimate
- receiver
- generating
- Prior art date
Links
- 238000004891 communication Methods 0.000 title description 13
- 230000005540 biological transmission Effects 0.000 claims abstract description 125
- 239000011159 matrix material Substances 0.000 claims abstract description 76
- 238000010801 machine learning Methods 0.000 claims abstract description 27
- 238000000034 method Methods 0.000 claims abstract description 18
- 238000013528 artificial neural network Methods 0.000 claims description 56
- 238000012545 processing Methods 0.000 claims description 27
- 238000012549 training Methods 0.000 claims description 24
- 230000006870 function Effects 0.000 claims description 22
- 238000013213 extrapolation Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 8
- 238000007670 refining Methods 0.000 claims description 6
- 239000013598 vector Substances 0.000 description 21
- 238000010586 diagram Methods 0.000 description 12
- 238000012937 correction Methods 0.000 description 9
- 238000013459 approach Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- YTAHJIFKAKIKAV-XNMGPUDCSA-N [(1R)-3-morpholin-4-yl-1-phenylpropyl] N-[(3S)-2-oxo-5-phenyl-1,3-dihydro-1,4-benzodiazepin-3-yl]carbamate Chemical compound O=C1[C@H](N=C(C2=C(N1)C=CC=C2)C1=CC=CC=C1)NC(O[C@H](CCN1CCOCC1)C1=CC=CC=C1)=O YTAHJIFKAKIKAV-XNMGPUDCSA-N 0.000 description 3
- 239000000654 additive Substances 0.000 description 3
- 230000000996 additive effect Effects 0.000 description 3
- 238000005562 fading Methods 0.000 description 3
- 230000001537 neural effect Effects 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 239000013256 coordination polymer Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000013341 scale-up Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L25/00—Baseband systems
- H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
- H04L25/0202—Channel estimation
- H04L25/0224—Channel estimation using sounding signals
- H04L25/0228—Channel estimation using sounding signals with direct estimation from sounding signals
- H04L25/023—Channel estimation using sounding signals with direct estimation from sounding signals with extension to other symbols
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/02—Diversity systems; Multi-antenna system, i.e. transmission or reception using multiple antennas
- H04B7/04—Diversity systems; Multi-antenna system, i.e. transmission or reception using multiple antennas using two or more spaced independent antennas
- H04B7/0413—MIMO systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L25/00—Baseband systems
- H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
- H04L25/0202—Channel estimation
- H04L25/021—Estimation of channel covariance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L25/00—Baseband systems
- H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
- H04L25/0202—Channel estimation
- H04L25/024—Channel estimation channel estimation algorithms
- H04L25/0254—Channel estimation channel estimation algorithms using neural network algorithms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L25/00—Baseband systems
- H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
- H04L25/03—Shaping networks in transmitter or receiver, e.g. adaptive shaping networks
- H04L25/03006—Arrangements for removing intersymbol interference
- H04L25/03178—Arrangements involving sequence estimation techniques
- H04L25/03248—Arrangements for operating in conjunction with other apparatus
- H04L25/03286—Arrangements for operating in conjunction with other apparatus with channel-decoding circuitry
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L5/00—Arrangements affording multiple use of the transmission path
- H04L5/0001—Arrangements for dividing the transmission path
- H04L5/0003—Two-dimensional division
- H04L5/0005—Time-frequency
- H04L5/0007—Time-frequency the frequencies being orthogonal, e.g. OFDM(A), DMT
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L25/00—Baseband systems
- H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
- H04L25/0202—Channel estimation
- H04L25/024—Channel estimation channel estimation algorithms
- H04L25/0256—Channel estimation using minimum mean square error criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L25/00—Baseband systems
- H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
- H04L25/03—Shaping networks in transmitter or receiver, e.g. adaptive shaping networks
- H04L25/03006—Arrangements for removing intersymbol interference
- H04L25/03159—Arrangements for removing intersymbol interference operating in the frequency domain
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Power Engineering (AREA)
- Theoretical Computer Science (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Computational Linguistics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
An apparatus method and computer progress is described comprising: receiving, at a receiver of a transmission system, one or more pilot signals and one or more data symbols, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols for transmission over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals, wherein the channel estimation module is trained using machine learning principles; generating, using a channel error covariance module, a corrected channel error covariance matrix of the channel, wherein the channel error covariance module is trained using machine learning principles; generating, using an equalisation module of the receiver an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel; and generating, using a demapping module of the receiver, a soft estimate of the one or more transmission bits.
Description
Communication System
This specification relates to training in communication systems, such as communication systems having trainable parameters.
End-to-end communication systems comprising a transmitter, a channel and a receiver in which the transmitter and/or the receiver have trainable parameters are known.
Although a number of algorithms for using and training such systems are known, there remains a need for further developments in this field.
In a first aspect, this specification describes an apparatus (e.g. a receiver of a transmission system) comprising means for performing: receiving, at a receiver of a transmission system, one or more pilot signals and one or more data symbols, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols for transmission over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals (other channel state information, such as one or more signal-to-noise ratio of the transmission, the pilot pattern, RSSI etc. may also be considered), wherein the channel estimation module is trained using machine learning principles; generating, using a channel error covariance module, a corrected channel error covariance matrix of the channel, wherein the o channel error covariance module is trained using machine learning principles; & generating, using an equalisation module of the receiver (which equalization module
O may be trainable, for example using machine learning principles) an estimate of the one © or more transmission symbols based on the received data symbols, the channel z 30 estimate and the corrected channel error covariance matrix of the channel; and > generating, using a demapping module of the receiver, a soft estimate of the one or 3 more transmission bits. The apparatus may further comprise means configured to
S perform training the channel error covariance module. &
-o-
The soft estimate may take the form of log-likelihood ratios (LLRs). Such LLRs may provided to a decoder, which decoder may generate hard decisions that form estimates of the one or more transmission bits.
The channel estimation module may be configured to generate an estimate of a covariance matrix of channel estimate error based, at least in part, the one or more received pilot signals, wherein the channel estimation module is trained using machine learning principles. The channel error covariance module may be configured to generate the corrected channel error covariance matrix of the channel by refining the estimate of the covariance matrix of channel estimate error generated by the channel estimation module. In an alternative embodiment, the channel error covariance matrix may be generated directly by the channel error covariance module.
Some example embodiment further comprise means configured to perform: generating, using a variance module, an equivalent channel estimated variance, wherein the variance module is trained using machine learning principles, wherein the demapping module of the received generates the soft estimate of the one or more transmission bits based, at least in part, on the estimated transmission symbols and the equivalent channel estimated variance. Some example embodiment further comprise means configured to perform: training the variance module.
Some example embodiment further comprise means configured to perform: training said channel estimation module to generate said channel estimate. Generating said channel estimate may comprise generating independent time, frequency and spatial correlation matrices. Generating said channel estimate may comprise determining o decay parameters of an exponential decay model for the time, freguency and spatial
S correlation matrices respectively. © © The said means for training said channel estimation module may be configured to
T 30 perform: training a plurality of neural networks. Further, the plurality of neural i networks may comprise a first, second and third neural networks configured to process 3 time, frequency and spatial relationships respectively. The means configured to
S perform generating the channel estimate may be further configured to perform:
S interpolation and/or extrapolation of time-related pilot signal data following by processing by said first neural network; interpolation and/or extrapolation of freguency-related pilot signal data following by processing by said second neural network; and interpolation and/or extrapolation of spatial-related pilot signal data following by processing by said third neural network.
The channel error covariance module and/or the covariance module may be implemented using neural networks.
In a second aspect, this specification describes an apparatus (e.g. an apparatus for training a receiver) comprising means for performing: initialising (e.g. randomly or pseudo randomly) a first set of trainable parameters of a channel estimation module of = areceiverofatransmission system, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols and the receiver includes an egualisation module and a demapping module for converting one or more received symbols into one or more received bits; initialising (e.g. randomly or pseudo randomly) a second set of trainable parameters; receiving, at the receiver, one or more pilot signals and one or more data symbols transmitted by the transmitter over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals, wherein the channel estimation module includes the first set of trainable parameters; generating a corrected channel error covariance matrix of the channel using a channel error covariance module, wherein the channel error covariance module comprises the second set of trainable parameters; generating, using the equalisation module of the receiver, an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel estimate; generating, using the demapping module of o the receiver, a soft estimate of the one or more transmission bits based on the
S estimated transmission symbols and the eguivalent channel estimated covariance;
O generating a loss, using a loss function, based on the one or more transmission bits © (which may be known at the receiver/trainer) and the estimate of the one or more
I 30 transmission bits; updating (e.g. using stochastic gradient descent) the first and second i sets of trainable parameters to minimise the loss function; and repeating the receiving, 3 generating and updating until a first condition is reached. The said loss function may be
S related to one or more of block error rate, bit error rate, mutual information,
N categorical cross-entropy and binary cross-entropy.
Some example embodiment further comprise means configure to perform: generating an equivalent channel estimated variance using a variance module, wherein the covariance module comprises a third set of trainable parameters.
The first condition may comprise a defined performance level and/or a defined number of iterations.
The channel estimation module of the receiver may comprise a channel estimation neural network.
The channel error covariance module and/or the covariance module may be implemented using neural networks.
In the first or the second aspect, the said means may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program configured, with the at least one processor, to cause the performance of the apparatus.
In a third aspect, this specification describes a method comprising: receiving, at a receiver of a transmission system, one or more pilot signals and one or more data symbols, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols for transmission over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals, wherein the
Oo channel estimation module is trained using machine learning principles; generating, < using a channel error covariance module, a corrected channel error covariance matrix
O of the channel, wherein the channel error covariance module is trained using machine © learning principles; generating, using an equalisation module of the receiver an
I 30 estimate of the one or more transmission symbols based on the received data symbols, > the channel estimate and the corrected channel error covariance matrix of the channel; 3 and generating, using a demapping module of the receiver, a soft estimate of the one or
S more transmission bits. &
The soft estimate may take the form of log-likelihood ratios (LLRs). Such LLRs may provided to a decoder, which may generate hard decisions that form estimates of the one or more transmission bits.
The channel estimation module may generate an estimate of a covariance matrix of channel estimate error based, at least in part, the one or more received pilot signals, wherein the channel estimation module is trained using machine learning principles.
The channel error covariance module may generate the corrected channel error covariance matrix of the channel by refining the estimate of the covariance matrix of channel estimate error generated by the channel estimation module. In an alternative embodiment, the channel error covariance matrix may be generated directly by the channel error covariance module.
Some example embodiment further comprise: generating, using a variance module, an equivalent channel estimated variance, wherein the variance module is trained using machine learning principles, wherein the demapping module of the received generates the soft estimate of the one or more transmission bits based, at least in part, on the estimated transmission symbols and the equivalent channel estimated variance. Some example embodiment further comprise training the variance module.
Some example embodiment further comprise training said channel estimation module to generate said channel estimate. Generating said channel estimate may comprise generating independent time, frequency and spatial correlation matrices. Generating said channel estimate may comprise determining decay parameters of an exponential decay model for the time, frequency and spatial correlation matrices respectively.
N
< The method may comprise training a plurality of neural networks. Further, the plurality
O of neural networks may comprise a first, second and third neural networks configured © to process time, frequency and spatial relationships respectively. Generating the
I 30 channel estimate may comprise: interpolation and/or extrapolation of time-related
E pilot signal data following by processing by said first neural network; interpolation 3 and/or extrapolation of frequency-related pilot signal data following by processing by
S said second neural network; and interpolation and/or extrapolation of spatial-related
S pilot signal data following by processing by said third neural network.
In the fourth aspect, this specification describes a method comprising: initialising (e.g. randomly or pseudo randomly) a first set of trainable parameters of a channel estimation module of a receiver of a transmission system, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols and the receiver includes an egualisation module and a demapping module for converting one or more received symbols into one or more received bits; initialising (e.g. randomly or pseudo randomly) a second set of trainable parameters; receiving, at the receiver, one or more pilot signals and one or more data symbols transmitted by the transmitter over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals, wherein the channel estimation module includes the first set of trainable parameters; generating a corrected channel error covariance matrix of the channel using a channel error covariance module, wherein the channel error covariance module comprises the second set of trainable parameters; generating, using the equalisation module of the receiver, an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel estimate; generating, using the demapping module of the receiver, a soft estimate of the one or more transmission bits based on the estimated transmission symbols and the equivalent channel estimated covariance; generating a loss, using a loss function, based on the one or more transmission bits (which may be known at the receiver/trainer) and the estimate of the one or more transmission bits; updating (e.g. using stochastic gradient descent) the first and second sets of trainable parameters to minimise the loss function; and repeating the receiving, generating and updating until a first condition is reached. The o said loss function may be related to one or more of block error rate, bit error rate,
S mutual information, categorical cross-entropy and binary cross-entropy. The first
O condition may comprise a defined performance level and/or a defined number of © iterations. = 30 - Some example embodiment further comprise: generating an eguivalent channel 3 estimated variance using a variance module, wherein the covariance module comprises
S a third set of trainable parameters. &
In a fifth aspect, this specification describes computer-readable instructions which, when executed by computing apparatus, cause the computing apparatus to perform (at least) any method as described with reference to the third or fourth aspects.
Inasixthaspect, this specification describes a computer-readable medium (such as a non-transitory computer-readable medium) comprising program instructions stored thereon for performing (at least) any method as described with reference to the third or fourth aspects. = Inaseventh aspect, this specification describes an apparatus comprising: at least one processor; and at least one memory including computer program code which, when executed by the at least one processor, causes the apparatus to perform (at least) any method as described with reference to the third or fourth aspects.
In an eighth aspect, this specification describes a computer program comprising instructions for causing an apparatus to perform at least the following: receiving, at a receiver of a transmission system, one or more pilot signals and one or more data symbols, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols for transmission over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals, wherein the channel estimation module is trained using machine learning principles; generating, using a channel error covariance module, a corrected channel error covariance matrix of the channel, wherein the channel error covariance module is trained using machine o learning principles; generating, using an egualisation module of the receiver an
S estimate of the one or more transmission symbols based on the received data symbols,
O the channel estimate and the corrected channel error covariance matrix of the channel; © and generating, using a demapping module of the receiver, a soft estimate of the one or
I 30 more transmission bits. a 3 In a ninth aspect, this specification describes a computer program comprising
S instructions for causing an apparatus to perform at least the following: initialising (e.g.
S randomly or pseudo randomly) a first set of trainable parameters of a channel estimation module of a receiver of a transmission system, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols and the receiver includes an egualisation module and a demapping module for converting one or more received symbols into one or more received bits; initialising (e.g. randomly or pseudo randomly) a second set of trainable parameters; receiving, at the receiver, one or more pilot signals and one or more data symbols transmitted by the transmitter over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals, wherein the channel estimation module includes the first set of trainable parameters; generating a corrected channel error covariance matrix of the channel using a channel error covariance module, wherein the channel error covariance module comprises the second set of trainable parameters; generating, using the equalisation module of the receiver, an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel estimate; generating, using the demapping module of the receiver, a soft estimate of the one or more transmission bits based on the estimated transmission symbols and the equivalent channel estimated covariance; generating a loss, using a loss function, based on the one or more transmission bits (which may be known at the receiver/trainer) and the estimate of the one or more transmission bits; updating (e.g. using stochastic gradient descent) the first and second sets of trainable parameters to minimise the loss function; and repeating the receiving, generating and updating until a first condition is reached.
In a tenth aspect, this specification describes an apparatus comprising means (such as an input module) for receiving, at a receiver of a transmission system, one or more pilot signals and one or more data symbols, wherein the transmission system comprises a o transmitter, a channel and the receiver, wherein the transmitter includes a transmitter
S algorithm for converting one or more transmission bits into one or more transmission
O symbols for transmission over the channel; means (such as a channel estimation © module) for generating a channel estimate based, at least in part, on the one or more
I 30 received pilot signals, wherein the channel estimation module is trained using machine
E learning principles; means (such as a channel error covariance module) for generating 3 a corrected channel error covariance matrix of the channel, wherein the channel error
S covariance module is trained using machine learning principles; means (such as an
S egualization module) for generating an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel; and means (such as a demapping module) for generating a soft estimate of the one or more transmission bits.
In an eleventh aspect, this specification describes an apparatus comprising means (such as a training module) for initialising a first set of trainable parameters of a channel estimation module of a receiver of a transmission system, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols and the receiver includes an equalisation module and a demapping module for converting one or more received symbols into one or more received bits; means (such as the training module) for initialising a second set of trainable parameters; means (such as an input of the receiver of the transmission system) one or more pilot signals and one or more data symbols transmitted by the transmitter over the channel; means (such as a channel estimation module) for generating a channel estimate based, at least in part, on the one or more received pilot signals, wherein the channel estimation module includes the first set of trainable parameters; means (such as a neural network) for generating a corrected channel error covariance matrix of the channel using a channel error covariance module, wherein the channel error covariance module comprises the second set of trainable parameters; means (such as an equalisation module) for generating an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel estimate; means (such as a demapping module) for generating a soft estimate of the one or more transmission bits based on the estimated transmission symbols and the equivalent channel estimated covariance; generating a loss, using a loss function, based on the one or more o transmission bits (which may be known at the receiver/trainer) and the estimate of the
S one or more transmission bits; means (such as the training module) for updating the
O first and second sets of trainable parameters to minimise the loss function; and means © (such as the training module) for repeating the receiving, generating and updating until
I 30 = afirst condition is reached. a 3 Brief description of the drawings
S Example embodiments will now be described, by way of non-limiting examples, with
S reference to the following schematic drawings:
FIGS. 1 and 2 are block diagrams of an example end-to-end communication systems in accordance with example embodiments;
FIG. 3 is a plot showing pilot signals transmitted in accordance with an example embodiment;
FIGS. 4 and 5 are flow charts showing algorithms in accordance with example embodiments;
FIG. 6 shows a resource block in a multicarrier SISO system in accordance with an example embodiment.
FIG. 7 is a plot showing amplitudes of a matrix in accordance with an example embodiment;
FIGS. 8 and 9 are block diagrams of channel estimators in accordance with example embodiments;
FIGS. 10 and 11 are block diagrams of systems in accordance with example embodiments;
FIGS. 12 and 13 are flow charts showing algorithms in accordance with example embodiments;
FIG. 14 shows an example neural network that may be used in one or more example embodiments;
FIG. 15 is a plot showing simulation results in accordance with example embodiments;
FIG. 16 is a block diagram of components of a system in accordance with an example embodiment; and
FIGS. 17A and 17B show tangible media, respectively a removable non-volatile memory unit and a compact disc (CD) storing computer-readable code which when run by a computer perform operations according to example embodiment. o Detailed description < The scope of protection sought for various embodiments of the invention is set out by
O the independent claims. The embodiments and features, if any, described in the © specification that do not fall under the scope of the independent claims are to be
I 30 interpreted as examples useful for understanding various embodiments of the
E invention.
S
S In the description and drawings, like reference numerals refer to like elements
N throughout.
FIG. 1 is a block diagram of an example end-to-end communication system, indicated generally by the reference numeral 10, in accordance with an example embodiment.
The system 10 includes a transmitter 12, a channel 14 and a receiver 16. Viewedata system level, the system 10 converts data (b) received at the input to the transmitter 12 into transmit symbols (x) for transmission over the channel 14 and the receiver 16 generates an estimate of the transmitted data (b) from symbols (y) received from the channel 14.
The transmitter 12 may include a modulator (e.g. using orthogonal frequency division multiplexing (OFDM)) that converts the data symbols (b) into the transmit symbols (x) in accordance with a modulation scheme. The transmit symbols are then transmitted over the channel 14 and received at the receiver 16 as received symbols (y). The receiver may include a demodulator that converts the received symbols (y) into the estimate of the originally transmitted data symbols (b).
FIG. 2 is a block diagram of an example end-to-end communication system, indicated generally by the reference numeral 20, in accordance with an example embodiment.
The system 20 is an example implementation of the system 10.
The system 20 includes a transmitter 22, a channel 23, a channel estimation module 24, an equalization module 25 and a demapping module 26. The transmitter 22 and the channel 23 are similar to the transmitter 12 and channel 14 described above. The channel estimation module 24, equalization module 25 and demapping module 26 collectively form a receiver similar to the receiver 16 described above. < Channel estimation is a key element of a receiver that operates at the output of a fading
N channel. Many communication systems use orthogonal freguency division multiplexing > (OFDM) to simultaneously encode data in the frequency domain on adjacent 3 subcarriers. This transmission scheme has many advantages, among which a simplified = 30 channel estimation and equalization. For a single-input multiple-output (SIMO) > system, in which a single antenna transmitter transmits to a multi-antenna receiver, 3 the channel can be modelled as:
S
N Ye=hx+n (1 where x € C is the symbol sent by the transmitter which is computed from the bit vector to be sent b, y, € Cr is the corrupted received signal, and N, is the number of receiving antennas. n € C"r is a vector of complex white Gaussian noise with variance o? and h, € CV is the channel vector, which incorporates channel effects such as large and small scale fading.
The receiver task is to recover the transmitted bits from the received signal y,. In that aim, the channel estimation module 24 computes an estimate Ah, of the channel vector and an estimate E of the covariance matrix of the channel estimation error h, — hy. In some communication systems, channel estimation is performed based on known pilot symbols p transmitted by the transmitter.
Following channel estimation, the equalization module 25 converts the SIMO channel into an equivalent single-input single-output (SISO) channel by computing an estimate
X of the transmitted symbol x. This equivalent channel is assumed to incorporate only additive noise with an estimated variance 62,. Finally, the demapping module 26 computes log-likelihood ratios (LLRs) for the transmitted bits b from the transmitted symbol estimate £ and Ze.
As shown in FIG. 2, in addition to data symbols x, the transmitter 22 sends pilot signals p to the channel estimation module 24 of the receiver via the channel 23. Pilot signals may be sent for each user device, in order to estimate the channel between a base station and each user device served by that base station. o 25 FIG. 3is a plot, indicated generally by the reference numeral 30, showing a grid of data
S symbols and pilot symbols transmitted in an OFDM system in accordance with an
S example embodiment. The pattern shown in the plot 30 includes white cells © representing data symbols x and black symbols representing pilot signals p. = a 30 FIG. 4 is a flow chart showing an algorithm, indicated generally by the reference 2 numeral 40, in accordance with an example embodiment. The algorithm 40 may be
D implemented by the channel estimation module 24 based on pilot symbols p € C that
O are known to the receiver that are transmitted over the channel 23.
The algorithm 40 starts at operation 42, where the channel estimation module 24 computes estimates of the channel h, at pilot positions, from the received symbols Yp at pilot positions.
Atoperation 44, estimates of the channel A, are generated at the positions that correspond to data symbols (i.e., where no pilot symbols were sent) using the estimations h,,. The operation 44 may be implement using a pre-defined interpolation/extrapolation scheme. Note that this approach is inevitably suboptimal, as more accurate channel estimation would reguire considering the precise statistics of the channel. However, the channel statistics vary for each user and environment (as they depend on the speed, delay spread, power delay profile, etc.) and therefore such approaches are difficult to implement in practice.
FIG. 5 is a flow chart showing an algorithm, indicated generally by the reference numeral 50, in accordance with an example embodiment.
The algorithm 50 starts at operation 52, where correlation matrices are learnt that can be used to generate channel estimates at data positions based on channel estimates at pilot positions. Assuming that time, frequency, and spatial correlation are independent (Kronecker structure), the operation 52 may involve learning learn three different correlation matrices: a time correlation matrix, a frequency correlation matrix, and a spatial correlation matrix. As described further below, a practical machine learning (ML)-based channel estimation scheme may be used for estimating the relevant correlation matrices.
A At operation 54 of the algorithm 50, estimates of the channel h, at pilot positions are
N . . oe . . & generated, from the received symbols y, at pilot positions (as in the operation 42 > described above).
O
: 30 At operation 56 of the algorithm 50, the correlation matrices generated in the operation 3 52 are applied to the channel estimates generated in the operation 54, thereby
D implementing operation 44 of the algorithm described above.
IY
&
In a variant of the operation 52, a less complex variant may be implemented by assuming that the frequency, time and spatial correlation matrices follow an exponential decay model. These models rely on decay parameters ar, ar, as, which are the only parameters that need to be learned, thereby reducing the number of parameters that need to be optimized.
Inthe following, example embodiments relating to a multi-carrier single-input single- output (SISO) system are described, where only estimation over the frequencies is considered. The single-input multiple-output (SIMO) setup is then considered.
FIG. 6 shows a resource block, indicated generally by the reference numeral 60, in a multicarrier SISO system in accordance with an example embodiment. The resource block 60 shows transmitted pilot signals.
Let us first consider a resource block in a multicarrier SISO system. This corresponds to 12 resource elements on adjacent frequencies on a single time step. If we take the time step at a single time point (e.g. t = 3), we obtain the corresponding vector as shown in
FIG. 6.
The SISO channel can be modelled as: y = hx + n for the data symbols with x € C, y €
C,n € C,and he.
We denote by e yy € CP the vector of received symbols e py EC the pilot vector, which contains the sent pilot at every pilot position and 0 at every other position e Pp =diag(pp) the diagonal pilot matrix, where the diagonal elements are the one of o the vector pr
S e Rrthesguarefreguency correlation matrix 2 e 0, the standard deviation of the channel noise n
O e I the 12x12 identity matrix
E 30 o As described above, the algorithm 50 starts at operation 52, where the correlation 3 matrices are learnt.
S
N One estimator that computing channel estimates is an LMMSE estimator, which computes a channel estimate hp = Lryc (2) where L; may be defined by
Lp = RE;PE(PEREPE + iD! (3)
An issue with this estimator is that it reguires knowledge of the freguency correlation matrix Rp, which may not be known in practice. One could learn the matrix Rp. As the matrix is Hermitian complex, and of size 12x12, there are 2 Yj-1, 12i=156real parameters to be learned. Although learning R; should provide better performance, some computational instabilities can arise from the matrix inversion in (3), that may hinder convergence.
This issue can be at least partially addressed by assuming that the underlying fading — process follows an exponential decay model with a decay parameter ar . The corresponding correlation matrix is constructed as follows: RC” = al! where
RO) denotes the fit”, jt} element of Rp. FIG. 7 is a plot, indicated generally by the reference numeral 70, showing amplitudes of such a matrix for az = 0.9.
The value of the parameter a; is usually set to 0.9 or 0.99. By seeing the transmitter, channel, and receiver as an end-to-end system that is trainable, it is possible to learn ar. This technique has the benefit of having only one trainable parameter, enabling fast training and convergence on any system. o 25 Another possibility is to use a neural network (or similar module). Here, the channel
N ~ . . < estimates at each pilot position h, is estimated with
O
S hy=yp* (4)
I
= o 30 — where (-)* denotes the conjugate (assuming |p|? = 1). Once the vector of channel & estimation h,, € C® is computed for all 6 pilot elements, the refined channel estimation
O .
N for all 12 elements is computed by:
N
Ry = R2C (NN; (c2r(R,))) (5)
where NNg(.) isa neural network, and R2C and C2R converts a complex into two real number and vice versa. The channel estimate can also be pre-processed before being inputted to the neural network. For example, interpolated in freguency may be applied so that the neural network input vector has the same size as the neural network output.
This allows the neural network to be pilot-position agnostic, meaning that a single neural network can be used with any pilot placement. Another benefit of this approach is that the neural network can also be fed with channel state information (CSI), such as the signal to noise ratio (SNR) of the transmission.
FIG. 8 is a block diagram of a channel estimator, indicated generally by the reference numeral 80, in accordance with an example embodiment. The channel estimator 80 provides SISO channel estimation using neural networks. Specifically, the channel estimator 80 comprises a frequency interpolator 82, a complex-to-real converter 84, a — neural network 86 and a real-to-complex converter 88.
The channel estimator 80 receives channel estimates at each pilot position k, for example in the form of a 6x1x1 matrix (i.e. 6 frequency positions for one time step at one receiving antenna). The frequency interpolator 82 outputs are larger matrix (e.g. a — 12x1x1 matrix). The converter 84 convers the symbols into real numbers (having real and imaginary parts), for example providing a 24x1x1 matrix that is provided to the neural network 86 for processing. The output of the neural network is converted back into symbols by the converter 88, which converter provides the channel estimate hp.
The channel estimator 80 can therefore be used to impement the operation 54 of the
I algorithm 50. From our experimentations, a neural network with very low complexity
N can achieve high performance gains. For example, we have experimented with a neural > network made of a unique layer and linear activation, i.e, equivalent to a linear
S operation, and achieved significant gains over the baseline. o The embodiments described above relate to a multi-carrier single-input single-output & (SISO) system. To scale-up to SIMO systems, we assume that the freguency, time, and
S spatial correlations are independent. Therefore, the approaches outlined above are
N applied successively to these three dimensions. This process is usually called "Wiener filtering”, and based on knowledge of both the time correlation matrix Ry and the spatial correlation matrix Rs in addition to the frequency correlation Rp.
As for the SISO case, the trainable parameters are the correlation matrices Rg, Rp, and
Ry. Assuming an exponential power decay underlying processes for time, frequency, and space, only the three decay parameters ar, ar, and as need to be learned. The channel estimator is depicted in FIG. 9.
FIG. 9 is a block diagram of a channel estimator, indicated generally by the reference numeral 90, in accordance with an example embodiment. The channel estimator 90 provides SIMO channel estimation using neural networks.
The channel estimator 90 comprises a first estimator 92, a second estimator 94 and a third estimator 96. Each estimator may be an LMMSE estimator, as described above.
As noted above, in the example system 90, the received samples are processed in the following order: frequency, time, and then space. Thus, the first estimator 92 provides a channel estimate (Hy) based on processing in the frequency domain, the second estimator 94 provides a channel estimate (Hz r) based on processing in the frequency and time domains, and the third estimator 96 provides a channel estimate (Hp 1 5) based on processing in the frequency, time and spatial domains.
FIG. 10 is a block diagram of a system, indicated generally by the reference numeral 100, in accordance with an example embodiment. As in the SISO embodiments describe above, three successive small neural networks, each operating on a single dimension, can be used instead of LMMSE channel estimation. This is the
S configuration shown in the system 100 2 © We use the notation (i, j, k) for denoting the it" subcarrier (frequency), j** time step,
E 30 and k!" receiving antennas. We denote by x the vector of all symbols x on a same o subcarrier at time step j and receiving antenna k.
N First, the symbols received at a given freguency can be processed in parallel for every
N time steps and antenna. For each time step j and antenna k, we compute:
TU, k j,k
RU = Rac (NN; (cor (3 ))) (6)
We denote by H; € C12*2*Wr the concatenation of the vectors KY over all time steps j and antennas k.
A similar process is applied to the time dimension, for every freguency i and receiving antenna k. If we denote 2 the vector containing all estimates from Hy at a same time for the frequency i and receiving antenna k, we compute:
Tl, ik
RÖD = R2c (nn, (C2R (26 ”)) (8)
The refined channel estimates Hy; € C2*14*Nr js the concatenation of hl” over all freguencies i and receiving antennas k.
Finally, estimation is carried out over the space dimension for every freguency i and time step j. If we denote by zi) ) the vector containing all estimates from H Fr On a same antenna and for the frequency i and receiving antenna k :
RÖD = R2C (wns (C2R (2) (10)
Oo The final channel estimate Hp rs € C12¥1¥Nr js the concatenation of hl” for all
N frequency i and receiving antenna k.
O
& 25 The task of the three successive neural networks can be seen as refining an initial rough
I estimate. As those neural networks only operate on one dimension, their input and - output size are very small:
D
B
S NN s : R234 = R234
N 30 NNy : R?8 > RB
NN5 : R?W > R?
In the system 100, the R2C and C2R layers are not shown for clarity. H, denotes the channel estimates h,, at every pilot position. In the system 100, it is assumed that N, = 2 and that the pilot pattern contains two pilot in time and freguency, shown as separate elements. The elements are darkened each time the channel estimates are refined.
If, at the base station, the antennas are placed on a 2-dimensional grid, the spatial correlation can be further divided into a horizontal and a vertical spatial correlation. In that case, the equation (10) can be re-written to use both the horizontal and spatial — correlation separately. In the same way, the NNs visible in the system 100 can be replaced with two NNs ; and NNsy placed one after the other.
The embodiments described above relate to SISO and SIMO arrangements. The principles described herein can be extended to multiple-input multple-output (MIMO) — systems, as described further below.
In a multi-user MIMO (MU-MIMO) system, where N, single-antenna users transmit to a receiver comprising multiple antennas, the channel can be modelled as: y=Hx+n (11)
T . . where x = [xy, ...,xy,| € C"t is the vector containing the symbols sent by the N,
NU . T . transmitting antennas mapped from the bit vectors by, ..., by; ¥ = [y1,..., yn.] € CV is the vector containing the signal received from the N, receiving antennas, and n € CV is 2 25 the vector of complex additive white Gaussian noise (AWGN). H € CYuXNr is the matrix
O eo. . . .
N containing the channel coefficients for all users and receive antenna. In this case, the oO . Lo. . on . — receiver similarly estimates the channel matrix H and estimated channel error
S covariance matrix E, equalizes the signal x, 92, = equalizer (y, H), and find an estimate
I PS x of the sent bits b. o
S 3 2 Because the users use orthogonal pilots, i.e., not interfering with each other's, channel
O
N estimation is MU-MIMO is similar to channel estimation in SIMO: channel estimation
N . . . . for each user can be carried-out using the process depicted in the previous section.
As described above with reference to the system 20, the role of the equalization module 25 is to recover an estimate of the sent symbols X from the received signal 7. To do so, the equalizer needs the estimation of the channel error covariance matrix EC”. In the
MU-MIMO case, the corresponding equalization module (the module 112 in FIG. 11 described below) converts the channel into N, equivalent AWGN channel (one channel per user) with estimated noise standard deviations vu €[1,..., Ny]. Here, the subscript (-)® refers to the uth user. When channel estimation is not perfect, both the channel error covariance matrix E' and the equivalent estimated channels noise standard deviations el vu € [1, ..., N,] are impossible to know precisely.
FIG. 11 is a block diagram of a system, indicated generally by the reference numeral 110, in accordance with an example embodiment. The system 110 is a receiver that may be used in a MU-MIMO system in accordance with example embodiments.
The system 110 comprises a plurality of channel estimation modules 111a to 111n, an equalisation module 112 and a plurality of demapping modules 113a to 113n.
The channel estimation modules, equalisation module and demapping modules of the system 110 are similar to the channel estimation module 24, equalization module 25 and demapping module 26 of the system 20 described above. Thus: e Each channel estimation module 111a to 111n computes an estimate h of the relevant channel vector and an estimate E of the covariance matrix of the relevant channel estimation error h, — hy;
S 25 e The equalization module 112 computes an estimate % of the relevant transmitted
N symbol x. This equivalent channel is assumed to incorporate only additive noise 2 with an estimated variance 82,; and
S e The demapping modules 113a to 113n computes log-likelihood ratios (LLRs) for the
E transmitted bits b from the transmitted symbol estimate ? and 8,9.
O 30 & The system 110 further comprises a channel error covariance correction modules 114a
N to 114n and equivalent channel estimated variance correction modules 115a to 115n,
N which may be implemented using neural networks, as discussed below. The correction modules 114 and 115 may be used to refine the estimates of E and el vu €[1,..., Ny] respectively as follows:
EW = R2C (NN; (c2r(E®))) (12) — where NNE is a single NN that is used in parallel for every user. If EC” has a particular structure, e.g., E!) = e], then the NN can correct only the scalar e, In this case,
NN; has a single input and a single output, making it of low complexity osioon = NNe (BS) (13) where NN; is is a NN that is used in parallel for every user. As NN, takes as input a real number and output a real number, it is of low complexity. One can also correct all standard deviations at once by setting aly = 657, s öl ol and 800 corr = NNo(8cg)-
In both cases, the subscript “corr” in the system 110 indicates that the vector or matrices are "corrected" by the relevant neural network.
It should be noted that although the channel error covariance correction modules 114a to 114n are described above as refining an estimate of E generated by the respective channel estimation module 111 to 111n, this is not essential to all example embodiments. For example, the channel error covariance correction modules 114a to 114n could generate the initial estimates and refine those estimates (i.e. the function of generating the original estimate could be within the channel estimation module or within the channel error covariance correction module).
S 25 Similarly, although the variance correction modules 115a to 115n are described above as
O refining variance estimates generated by the egualisation module 112, this is not © essential to all example embodiments. For example, the variance correction modules
I 115a to 115n could generate the initial variance estimates and refine those estimates (i.e. > the function of generating the original estimate could be within the equalization 3 30 module or within the variance correction module).
LO
N
N FIG. 12 is a flow chart showing an algorithm, indicated generally by the reference numeral 120, in accordance with an example embodiment.
The algorithm 120 starts at operation 121 where pilot signals and data symbols are received at a receiver of a transmission system (such as the transmission system 20). As shown in FIG. 2, the received pilot signals are labelled by y, and the received data symbols are labelled by yx.
At operation 122, a channel estimate h and optionally an estimate of a covariance matrix E of channel estimate error are generated at a channel estimation module of the receiver. The channel estimate and the covariance matrix estimate are generated based on received pilot signals. The channel estimation module is trained using machine learning principles and may be implemented using a neural network.
As discussed in detail above, the estimation of the channel for resource elements carrying data h, from the estimation of the channel for resource elements carrying pilot signals R, may be implemented in a number of ways. For example, three different correlation matrices may be learned: a time correlation matrix, a frequency correlation matrix, and a spatial correlation matrix, which correlation matrices are then used to estimate h, from Ry. A less complex variant of this approach discussed above assumed that the frequency, time and spatial correlation matrices follow an exponential decay model. These models rely on decay parameters ar, ar, as, which are the only parameters that need to be learned, drastically reducing the number of parameters that need to be optimized. A second approach leverages small neural networks (NNs) to estimate h, from hy, and stochastic gradient descend (SGD) to learn a set of NN parameters that are suited for the underlying frequency, time, and spatial correlations. o 25 At operation 123, a corrected channel error covariance matrix £,,,, of the channel is
S generated using a channel error covariance module (for example using the modules
S 114a to 114n of the system 110). Each channel error covariance module may be trained © using machine learning principles and may be implemented using a neural network. If
I a channel error covariance matrix is generated in the operation 122, then the operation & 30 123 may corrected that covariance matrix. In an alternative embodiment, the corrected 3 channel error covariance matrix is generated in a single operation.
S
2 At operation 124, an estimate of the one or more transmission symbols (x) is generated using an egualisation module (such as the egualisation module 112) of the receiver based on the received data symbols (received in operation 121), the channel estimate
(generated in operation 122) and the corrected channel error covariance matrix of the channel (generated in operation 123). The egualisation module is trained using machine learning principles and may be implemented using a neural network. = Atoperation 125, an equivalent channel estimated variance (3,9 corr) is generated using a variance module (such as the equivalent channel estimated variance modules 115a to 115n). The variance module is trained using machine learning principles and may be implemented using a neural network. = At operation 126, a soft estimate of the one or more transmission bits is generated using a demapping module of the receiver, based on the estimated transmission symbols and the eguivalent channel estimated variance. As discussed above, the outputs of the demapping module may take the form of log-likelihood ratios (LLRs); these may be referred to as soft decisions. Such LLRs may provided to a decoder, which may generate hard decisions that form estimates of the one or more transmission bits.
As discussed further below, various modules of the system may be trained. For example, the channel estimation module (such as the modules 111a to 111n) may be trained in order to generate said channel estimate. Moreover, the channel estimation — module may be configured to perform: generating independent time, frequency and spatial correlation matrices, each having trainable parameters. The trainable parameters of the correlation matrices may be decay parameters of an exponential decay model for the time, freguency and spatial correlation matrices respectively.
Alternatively, or in addition, generating the channel estimate may involve: o interpolation and/or extrapolation of time-related pilot signal data following by & processing by said first neural network; interpolation and/or extrapolation of
O freguency-related pilot signal data following by processing by said second neural © network; and interpolation and/or extrapolation of spatial-related pilot signal data
I 30 following by processing by said third neural network. a 2 FIG. 13 is a flow chart showing an algorithm, indicated generally by the reference
S numeral 130, in accordance with an example embodiment.
O
N
The algorithm 130 is a training algorithm in which we denote by 0 the set of trainable parameters, found in the channel estimator and optionally in NNE and NN, described above.
The algorithm 130 starts at operation 131, where the trainable parameters 8 are initialised, e.g., randomly.
At operation 132, B bit vectors (bq, ba, ..., by) are generated, where B is the batch size.
At operation 133, a forward pass through the transmitter and receiver of the communication system is carried out.
When applied to the system 110, the operation 133 may include: e Generating, at a channel estimation module 111a to 111n of the receiver, a channel estimate and optionally an estimate of a covariance matrix of channel estimate error based on the one or more received pilot signals, wherein the channel estimation module includes the first set of trainable parameters; e Generating a corrected channel error covariance matrix of the channel using a channel error covariance module (114a to 114n), wherein the channel error covariance module comprises the second set of trainable parameters; e Generating, using the equalization module 112 of the receiver, an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel estimate; e Generating an equivalent channel estimated variance using a variance module 115a to 115n, wherein the variance module comprises the third set of trainable
S parameters;
N e Generating, using the demapping module 113a to 113n of the receiver, an estimate = of the one or more transmission bits based on the estimated transmission symbols
S and the equivalent channel estimated variance. o At operation 134, a loss function is evaluated based on the one or more transmission & bits (which are known at the receiver/trainer) and the estimate of the one or more
N transmission bits. The loss function may be related to one or more of block error rate,
N bit error rate, mutual information and categorical cross-entropy. The loss function may be defined as follows:
1 b b e LO) =" BY YK (Bui log (på?) + (1— hui O) log(1— hui”) where p, ;? is the probability that the i?” bit sent by the u** user is set to one for the b training example and is computed by taking the sigmoid of the LLRs.
At operation 135, the parameters 9 are updated by applying one step of stochastic gradient descent (SGD) (or a variant thereof) on the loss.
At operation 136, the algorithm either returns to operation 131 or is stopped, depending on whether a predefined stop criterion has been reached. The stop criterion can take multiple forms, e.g., a defined performance level, a defined number of iterations and/or when the loss function has not decreased for a predefined number of iterations.
Inthe algorithm 130, the learning rate, batch size, and possibly other parameters of the
SGD variant (Adam, RMSProp...) are optimization parameters.
Note that the loss function L corresponds, up to a constant, to the bit metric decoding rate, which is an achievable rate for practical systems that operates on bits (and not — symbols).
In some embodiments, a machine-learning based channel estimator is trained as part of an end-to-end communication system by directly comparing the send bits to the estimated received bits (or of their probabilities). Such a technigue has the benefit of not requiring the true knowledge of the channel realizations for training the channel oO
N estimator, which are inaccessible in practice. Therefore, training of the channel
AN aN estimator from actual measurements is possible. ©
O In some embodiments, a channel estimator is trained together with an egualizer and a
I
= 30 = demapper. Such channel estimators may therefore be optimized specifically for the 2 receiver for which it is part of.
O
LO
N FIG. 14 shows an example neural network that may be used in one or more example
N embodiments. The neural network 140 comprises an input layer 141, one or more hidden layers 142, and an output layer 143. The hidden layers 142 may comprise a plurality of hidden nodes, where the processing may be performed based on the received user device positioning information.
FIG. 15 is a plot, indicated generally by the reference numeral 150, showing simulation results in accordance with example embodiments.
Simulation were performed on a 3GPP compliant dataset, with 8 users, 32 receiving antennas, and using a 64 QAM modulation. Coded BER curves are shown in the plot 150. The two baselines are a receiver with perfect channel estimation (referred to as “Perf” in the legend), and a receiver that performs least-square channel estimation at pilot positions using (4) followed by linear interpolation (*LS? in the legend). Note that this last baseline is commonly used in practice. The proposed schemes are: e MMSE: Corresponds to LMMSE estimation with learned correlation matrices. e NN: Correspond to the channel estimation using neural networks, as discussed above. e LS corr/MMSE corr/NN corr refers to MMSE/NN with additional use of neural networks NNg and NN, to correct error correlation matrices and post-equalization noise-power.
For completeness, FIG. 16 is a schematic diagram of components of one or more of the example embodiments described previously, which hereafter are referred to generically as a processing system 300. The processing system 300 may, for example, be the apparatus referred to in the claims below. 2 The processing system 300 may have a processor 302, a memory 304 closely coupled to
N the processor and comprised of a RAM 314 and a ROM 312, and, optionally, a user 2 input 310 and a display 318. The processing system 300 may comprise one or more
O network/apparatus interfaces 308 for connection to a network/apparatus, e.g. a = 30 modem which may be wired or wireless. The network/apparatus interface 308 may - also operate as a connection to other apparatus such as device/apparatus which is not x network side apparatus. Thus, direct connection between devices/apparatus without 5 network participation is possible.
N
The processor 302 is connected to each of the other components in order to control operation thereof.
The memory 304 may comprise a non-volatile memory, such as a hard disk drive (HDD) or a solid state drive (SSD). The ROM 312 of the memory 304 stores, amongst other things, an operating system 315 and may store software applications 316. The
RAM 314 of the memory 304 is used by the processor 302 for the temporary storage of data. The operating system 315 may contain code which, when executed by the processor implements aspects of the algorithms 40, 50, 120 and 130 described above.
Note that in the case of small device/apparatus the memory can be most suitable for small size usage i.e. not always a hard disk drive (HDD) or a solid state drive (SSD) is used.
The processor 302 may take any suitable form. For instance, it may be a microcontroller, a plurality of microcontrollers, a processor, or a plurality of processors.
The processing system 300 may be a standalone computer, a server, a console, or a network thereof. The processing system 300 and needed structural parts may be all inside device/apparatus such as IoT device/apparatus i.e. embedded to very small size.
In some example embodiments, the processing system 300 may also be associated with external software applications. These may be applications stored on a remote server device/apparatus and may run partly or exclusively on the remote server — device/apparatus. These applications may be termed cloud-hosted applications. The o processing system 300 may be in communication with the remote server
S device/apparatus in order to utilize the software application stored there. 2 © FIGS. 17A and 17B show tangible media, respectively a removable memory unit 365 and
T 30 a compact disc (CD) 368, storing computer-readable code which when run by a
E computer may perform methods according to example embodiments described above. 3 The removable memory unit 365 may be a memory stick, e.g. a USB memory stick,
S having internal memory 366 storing the computer-readable code. The internal memory
S 366 may be accessed by a computer system via a connector 367. The CD 368 maybea
CD-ROMoraDVD or similar. Other forms of tangible storage media may be used.
Tangible media can be any device/apparatus capable of storing data/information which data/information can be exchanged between devices/apparatus/network.
Embodiments of the present invention may be implemented in software, hardware, application logic or a combination of software, hardware and application logic. The software, application logic and/or hardware may reside on memory, or any computer media. In an example embodiment, the application logic, software or an instruction set is maintained on any one of various conventional computer-readable media. In the context of this document, a *memory” or *computer-readable medium” may be any — non-transitory media or means that can contain, store, communicate, propagate or transport the instructions for use by or in connection with an instruction execution system, apparatus, or device, such as a computer.
Reference to, where relevant, “computer-readable medium”, “computer program product”, *tangibly embodied computer program” etc., or a “processor” or “processing circuitry” etc. should be understood to encompass not only computers having differing architectures such as single/multi-processor architectures and seguencers/ parallel architectures, but also specialised circuits such as field programmable gate arrays
FPGA, application specify circuits ASIC, signal processing devices/apparatus and other — devices/apparatus. References to computer program, instructions, code etc. should be understood to express software for a programmable processor firmware such as the programmable content of a hardware device/apparatus as instructions for a processor or configured or configuration settings for a fixed function device/apparatus, gate array, programmable logic device/apparatus, etc. o If desired, the different functions discussed herein may be performed in a different
S order and/or concurrently with each other. Furthermore, if desired, one or more of the
O above-described functions may be optional or may be combined. Similarly, it will also © be appreciated that the flow diagrams of Figures 4, 5, 12 and 13 are examples only and
I 30 — that various operations depicted therein may be omitted, reordered and/or combined. a 2 It will be appreciated that the above described example embodiments are purely
S illustrative and are not limiting on the scope of the invention. Other variations and
S modifications will be apparent to persons skilled in the art upon reading the present specification.
Moreover, the disclosure of the present application should be understood to include any novel features or any novel combination of features either explicitly or implicitly disclosed herein or any generalization thereof and during the prosecution of the present application or of any application derived therefrom, new claims may be formulated to cover any such features and/or combination of such features.
Although various aspects of the invention are set out in the independent claims, other aspects of the invention comprise other combinations of features from the described example embodiments and/or the dependent claims with the features of the independent claims, and not solely the combinations explicitly set out in the claims.
It is also noted herein that while the above describes various examples, these descriptions should not be viewed in a limiting sense. Rather, there are several variations and modifications which may be made without departing from the scope of the present invention as defined in the appended claims.
O
N
O
N
O
©
O
I a a
O
<
O
LO
O
IY
O
N
Claims (15)
1. An apparatus comprising means for performing: receiving, at a receiver of a transmission system, one or more pilot signals and one or more data symbols, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols for transmission over the channel; generating, at a channel estimation module of the receiver, a channel estimate — based, at least in part, on the one or more received pilot signals, wherein the channel estimation module is trained using machine learning principles; generating, using a channel error covariance module, a corrected channel error covariance matrix of the channel, wherein the channel error covariance module is trained using machine learning principles; generating, using an equalisation module of the receiver an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel; and generating, using a demapping module of the receiver, a soft estimate of the one or more transmission bits.
2. An apparatus as claimed in claim 1, wherein: the channel estimation module is configured to generate an estimate of a covariance matrix of channel estimate error based, at least in part, the one or more received pilot signals, wherein the channel estimation module is trained using machine learning principles; and o the channel error covariance module is configured to generate the corrected S channel error covariance matrix of the channel by refining the estimate of the O covariance matrix of channel estimate error generated by the channel estimation © module. = 30
- 3. An apparatus as claimed in claim 1 or claim 2, further comprising means 3 configured to perform: generating, using a variance module, an equivalent channel S estimated variance, wherein the variance module is trained using machine learning S principles, wherein the demapping module of the received generates the soft estimate ofthe one or more transmission bits based, at least in part, on the estimated transmission symbols and the equivalent channel estimated variance.
4. An apparatus as claimed in claim 3, further comprising means configured to perform: training the variance module.
5. An apparatus as claimed in any one of the preceding claims, further comprises means configured to perform: training said channel estimation module to generate said channel estimate.
6. An apparatus as claimed in any one of the preceding claims 5, wherein generating said channel estimate comprises generating independent time, frequency and spatial correlation matrices.
7. An apparatus as claimed in claim 6, wherein generating said channel estimate comprises determining decay parameters of an exponential decay model for the time, frequency and spatial correlation matrices respectively.
8. An apparatus as claimed in claims 5 to 7, wherein said means for training said channel estimation module is configured to perform: training a plurality of neural networks.
9. An apparatus as claimed in claim 8, wherein the plurality of neural networks comprises a first, second and third neural networks configured to process time, frequency and spatial relationships respectively.
10. An apparatus as claimed in claim 9, wherein the means configured to perform o generating the channel estimate is further configured to perform: S interpolation and/or extrapolation of time-related pilot signal data following by O processing by said first neural network; © interpolation and/or extrapolation of frequency-related pilot signal data T 30 following by processing by said second neural network; and E interpolation and/or extrapolation of spatial-related pilot signal data following 3 by processing by said third neural network. 3 N
11. An apparatus comprising means for performing: initialising a first set of trainable parameters of a channel estimation module of a receiver of a transmission system, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols and the receiver includes an equalisation module and a demapping module for converting one or more received symbols into one or more received bits; initialising a second set of trainable parameters; receiving, at the receiver, one or more pilot signals and one or more data symbols transmitted by the transmitter over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals, wherein the channel — estimation module includes the first set of trainable parameters; generating a corrected channel error covariance matrix of the channel using a channel error covariance module, wherein the channel error covariance module comprises the second set of trainable parameters; generating, using the equalisation module of the receiver, an estimate of the one — or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel estimate; generating, using the demapping module of the receiver, a soft estimate of the one or more transmission bits based on the estimated transmission symbols and the equivalent channel estimated covariance; generating a loss, using a loss function, based on the one or more transmission bits and the estimate of the one or more transmission bits; updating the first and second sets of trainable parameters to minimise the loss function; and repeating the receiving, generating and updating until a first condition is reached. N <
12. An apparatus as claimed in claim 11, further comprising means configure to O perform: generating an equivalent channel estimated variance using a variance module, © wherein the covariance module comprises a third set of trainable parameters. = 30 >
13. An apparatus as claimed in any one of the preceding claims, wherein the 3 channel error covariance module and/or the covariance module are implemented using S neural networks. &
14. A method comprising:
receiving, at a receiver of a transmission system, one or more pilot signals and one or more data symbols, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols for transmission over the channel; generating, at a channel estimation module of the receiver, a channel estimate based, at least in part, on the one or more received pilot signals, wherein the channel estimation module is trained using machine learning principles; generating, using a channel error covariance module, a corrected channel error covariance matrix of the channel, wherein the channel error covariance module is trained using machine learning principles; generating, using an egualisation module of the receiver an estimate of the one or more transmission symbols based on the received data symbols, the channel estimate and the corrected channel error covariance matrix of the channel; and generating, using a demapping module of the receiver, a soft estimate of the one or more transmission bits.
15. A computer program comprising instructions for causing an apparatus to perform at least the following: receiving, at a receiver of a transmission system, one or more pilot signals and one or more data symbols, wherein the transmission system comprises a transmitter, a channel and the receiver, wherein the transmitter includes a transmitter algorithm for converting one or more transmission bits into one or more transmission symbols for transmission over the channel; generating, at a channel estimation module of the receiver, a channel estimate 9 based, at least in part, on the one or more received pilot signals, wherein the channel < estimation module is trained using machine learning principles; O generating, using a channel error covariance module, a corrected channel error © covariance matrix of the channel, wherein the channel error covariance module is I 30 trained using machine learning principles; > generating, using an equalisation module of the receiver an estimate of the one 2 or more transmission symbols based on the received data symbols, the channel S estimate and the corrected channel error covariance matrix of the channel; and S generating, using a demapping module of the receiver, a soft estimate of the one or more transmission bits.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FI20205980A FI20205980A9 (en) | 2020-10-06 | 2020-10-06 | Communication System |
PCT/IB2021/061215 WO2022074639A2 (en) | 2020-10-06 | 2021-12-02 | Communication system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FI20205980A FI20205980A9 (en) | 2020-10-06 | 2020-10-06 | Communication System |
Publications (2)
Publication Number | Publication Date |
---|---|
FI20205980A1 FI20205980A1 (en) | 2022-04-07 |
FI20205980A9 true FI20205980A9 (en) | 2024-04-10 |
Family
ID=79283066
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
FI20205980A FI20205980A9 (en) | 2020-10-06 | 2020-10-06 | Communication System |
Country Status (2)
Country | Link |
---|---|
FI (1) | FI20205980A9 (en) |
WO (1) | WO2022074639A2 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114915361B (en) * | 2022-05-13 | 2023-07-14 | 西安交通大学 | Internet of things uplink signal detection method based on small sample learning |
WO2024007299A1 (en) * | 2022-07-08 | 2024-01-11 | Huawei Technologies Co., Ltd. | A signal processing device and method for a non-stationary dynamic environment |
US20240113919A1 (en) * | 2022-09-23 | 2024-04-04 | Qualcomm Incorporated | Recurrent equivariant inference machines for channel estimation |
-
2020
- 2020-10-06 FI FI20205980A patent/FI20205980A9/en unknown
-
2021
- 2021-12-02 WO PCT/IB2021/061215 patent/WO2022074639A2/en active Application Filing
Also Published As
Publication number | Publication date |
---|---|
WO2022074639A3 (en) | 2022-06-09 |
FI20205980A1 (en) | 2022-04-07 |
WO2022074639A2 (en) | 2022-04-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104683282B (en) | A kind of interference rejection combining method and device for supporting transmitting diversity | |
Tao | DFT-precoded MIMO OFDM underwater acoustic communications | |
US12021667B2 (en) | Transmission system with channel estimation based on a neural network | |
FI20205980A9 (en) | Communication System | |
WO2017097269A1 (en) | Interference estimation method and device | |
Goutay et al. | Machine learning for MU-MIMO receive processing in OFDM systems | |
WO2016034051A1 (en) | Interference suppression method and device | |
KR20160129628A (en) | Apparatus and method for downlink channel estimation in wireless communication system | |
JP2016163078A (en) | Demodulation device and demodulation method | |
EP3982568B1 (en) | Rate adaptation | |
CN115943395A (en) | Radio receiver, transmitter and system for pilot-free OFDM communication | |
EP3224964B1 (en) | Maximizing energy efficiency in non-linear precoding using vector perturbation | |
Ruder et al. | Joint user grouping and frequency allocation for multiuser SC-FDMA transmission | |
WO2014187356A1 (en) | Multiple-input multiple-output (mimo) detection method, apparatus and system for transmitting signal | |
CN108418619B (en) | Signal detection method and device | |
JP2013030940A (en) | Transmitter, receiver, and communication system | |
JP5770558B2 (en) | Receiving device, program, and integrated circuit | |
CN109150386B (en) | User terminal, serving cell demodulation method, storage medium, and electronic device | |
Du et al. | Adaptive blind channel identification and equalization for OFDM-MIMO wireless communication systems | |
EP2961118B1 (en) | Method for channel estimation and equalization | |
US9036461B2 (en) | LTE—advanced transmit diversity decoders | |
Goutay et al. | Machine Learning-enhanced Receive Processing for MU-MIMO OFDM Systems | |
Tao | Peer-Reviewed Technical Communication | |
Villena-Rodriguez et al. | Aging-Resistant Wideband Precoding in 5G and Beyond Using 3D Convolutional Neural Networks | |
CN106549898B (en) | MIMO-OFDM system-based SSFE signal detection method and device |