Mean square error (MSE) is the most prominent criterion in training neural networks and has been employed numerous learning problems. In this paper, we suggest a group of novel robust information theoretic backpropagation (BP) methods, as correntropy-based conjugate gradient BP (CCG-BP). CCG-BP algorithms converge faster than common have better performance CG-BP based on MSE, especially nonGaussian environments cases with impulsive noise or heavy-tailed distributions noise. addition,...

In this article, we consider the massive nonorthogonal multiple access (NOMA) with a hybrid automatic repeat request (HARQ) for short packet communications. To reduce latency, each user can perform one retransmission provided that previous was not decoded successfully. The system performance is evaluated both coordinated and uncoordinated transmissions. We first develop Markov model (MM) to analyze dynamics characterize error rate (PER) throughput of in scenario. power levels are then...

<title>Abstract</title> Physical layer security, as an important practical concept, in unmanned aerial vehicle (UAV) assisted channels has been studied the literature, where, impacts of side information and or correlation wireless channel coefficients have not considered. In this paper, having briefly reviewed (the discrete memoryless channel, physical secure rate copula function theory), a continuous alphabet wiretap with UAV transmitter two-sided is For we obtain closed form expressions...

This paper studies performance analysis of physical layer security in a Rayleigh fading wiretap channel, where, the main (transmitter-to-legitimate receiver) and eavesdropper (transmitter-to-eavesdropper) channel coefficients are correlated. By exploiting novel approach called Copula theory, we derive closed-form expressions for average secrecy capacity (ASC), outage probability (SOP), coverage region (SCR). Moreover, to more evaluate impact correlation, asymptotic behavior SOP high...

The past decade has seen the rapid development of information theoretic learning and its applications in signal processing machine learning. Specifically, minimum error entropy (MEE) maximum correntropy criterion (MCC) have been widely studied literature. Although MEE MCC are applied many branches knowledge could outperform statistical criteria (such as mean square error), they not compared with each other from theoretical point view. In some cases, perform similarly to other; however, under...

From practical and theoretical viewpoints, performance analysis of communications with correlated fading channels is important. In this study, the authors exploit a novel approach based on Copula function concept to investigate impact correlation Rayleigh communication performances. One most convenient ways describe dependence between several variables using functions. For purpose, by applying Farlie–Gumbel–Morgenstern function, they derive closed‐form expressions for outage probability as...

Automatic modulation classification of digital signals is essential for intelligent communication systems. This paper addresses the distributed amplitude-phase modulated in a system multiple sensors, which observe unknown signal corrupted with additive white Gaussian noise. The sensors are connected to fusion center through block-fading orthogonal access channels. We introduce new method, where: 1) classification, an information-theoretic similarity measure known as correntropy exploited by...

The authors indicate the dependence between inputs of relay channel with one auxiliary random variable as Cover, El-Gamal and Salehi have done for multiple access arbitrarily correlated sources. Then, by considering broadcast sub-channels in channel, describe essential role special Markovity conditions on input–outputs, unify most known capacity theorems into theorem. theorem potentially may be applicable to a more general class channels including at least capacity.

Abstract In this paper, we present a capacity analysis for broadband power line communication (PLC) channels, impaired by the Bernoulli–Gaussian impulsive noise, exploiting both orthogonal frequency division multiplexing (OFDM) and single‐carrier frequency‐domain equalisation (SC‐FDE) techniques. First, investigate point‐to‐point communications formulate continuous signal model OFDM SC‐FDE techniques in PLC environments find tight bounds derived differential entropy of non‐Gaussian noise...

We investigate the impact of fading correlation on performance doubly dirty multiple access channel (MAC) with non-causally known side information at transmitters. Using Copula theory, we derive closed-form expressions for outage probability (OP) and coverage region under positive/negative dependence conditions. show that a positive structure between coefficients is beneficial system performance, as it improves OP extends compared to case independent fading. Conversely, negative has...

In this paper, we study the impact of receiver cognition on channel capacity information theoretically. As a new idea, consider as side known at correlated to noise and derive theorem based Gaussian version Cover-Chiang for two-sided state channel. intuitively expected, increases our shows increase quantitatively. Also, theorem, while including famous Costa its special case, correlation between input transmitter capacity.

In this study, the authors obtain a general and new achievable rate region some certain capacity theorems for multiple‐access relay channel (MARC), using partial decode‐and‐forward (PDF) strategy at relay, superposition coding transmitters (RC) decoding schemes. (a) The (i) generalises achievability part of Slepian–Wolf theorem to MARC, (ii) extends Cover–El Gamal best RC with PDF (iii) gives Kramer–Wijengaarden anticipated MARC (iv) meets max‐flow min‐cut outer bound important classes MARC....

Summary Adaptive networks solve distributed optimization problems in which all agents of the network are interested to collaborate with their neighbors learn a similar task. Collaboration is useful when seek However, many applications, may belong different clusters that dissimilar tasks. In this case, nonselective collaboration will lead damaging results worse than noncooperative solution. paper, we contribute several interconnected learning multiple To address multitask problem, consider an...

In this paper we propose a novel relay selection method for cooperation communication networks using fuzzy logic. Many efforts have been made in the literature to select superior based on relay's SNR/SER and / or reputation (in stimulation methods). We jointly consider four criteria process of selection, SNR/SER, reputation, relaying strategy location. condition which network users employ different strategies, i.e., some nodes decode-and-forward strategy, amplify-and-forward other ones...

Abstract In this paper, we obtain a general achievable rate region for discrete memoryless multiple‐access relay channel (DM‐MARC) with common message via partial decode and forward strategy regular block Markov encoding/backward decoding. This region, as an extension of the achievability part to MARC, subsumes previous known regions MARC. Also, by applying Fano's inequality, derive outer bound DM‐MARC message. By extending alphabet results continuous alphabet, inner Gaussian MARC (GMARC) is...

Summary In this paper, we consider Rayleigh fading MIMO relay channel with state information at the receivers. First, extend previously obtained results for ergodic capacity of uncorrelated and semi‐correlated channels derive closed‐form expressions bounds channel. Next, study from a new point view, maximizing coverage region desired transmission rate, investigate optimal location in sense region. However, order to overcome mathematical complexity rate analysis, because randomness multiple...

This study investigates the application of simultaneous transmission and reflection (STAR) enabled by reconfigurable intelligent surface (RIS) in context both non-orthogonal multiple access (NOMA) orthogonal (OMA) communication systems. As an advanced technology, STAR-RIS holds significant potential to enhance performance NOMA networks. The primary focus this research is assess how influences key aspects NOMA, specifically secrecy coverage region (SCR) outage probability (SOP). Through a...

Spectrum sensing is a significant issue in cognitive radio networks which enables estimation of the frequency spectrum and hence provides reuse. In large-scale networks, secondary users cannot share common since coverage area primary limited. this study, authors suggest diffusion adaptive learning algorithm based on correntropy cooperation policy, first categorises received data into several groups, then learns inside each group. The mean-square performance proposed analysed supported by...

In this paper, we study the two transmitter multiple-access channel (MAC) with noncausal side information at one (single-sided) or both (two-sided) of encoders in presence an external wiretapper (WT) and under individual collective secrecy constraints. Our work consists four parts. First, consider discrete memoryless (DM-MAC-WT) case model derive inner outer bounds on capacity region Second, results are extended to Gaussian [Gaussian WT (GMAC-WT)] detail used illustrate numerically that rate...

Abstract Hierarchical temporal memory (HTM) is a promising unsupervised machine-learning algorithm that models key principles of neocortical computation. One the main components HTM spatial pooler (SP), which encodes binary input streams into sparse distributed representations (SDRs). In this paper, we propose an information-theoretic framework for performance comparison HTM-spatial (SP) algorithms, specifically, quantifying similarities and differences between in SP algorithms. We evaluate...

The past decade has seen a rapid application of information theoretic learning (ITL) criteria in robust signal processing and machine problems. Generally, ITL's literature, it is that, under non-Gaussian assumptions, especially when the data are corrupted by heavy-tailed or multi-modal distributions, [such as minimum error entropy (MEE)] outperform second order statistical ones. objective this research to investigate better performance MEE criterion against that mean square error. Having...

In this paper, we propose a new relay selection scheme for multi-user cooperation communications using novel multiple criteria decision making optimization method. We consider jointly three in our proposed method, two of which have been studied and employed the process literature, separately, next one has not considered schemes. paper these as scheme. To best knowledge, no prior work from point view. Also, approach selecting superior candidate relay, i.e., an information theoretic measure...