Hyperparameter Free MEEF-Based Learning for Next Generation Communication Systems

Rangeet Mitra*, Georges Kaddoum, Daniel Benevides Da Costa

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

Information theoretic learning (ITL) criteria have emerged useful for mitigating degradations caused by unknown non-Gaussian noise processes in future wireless communication systems. Specifically, the reproducing kernel Hilbert space (RKHS) based approaches relying on ITL based learning criteria are envisioned to provide near-optimal mitigation of unknown hardware impairments and non-Gaussian noises. Among several ITL criteria, the recent works find the minimum error entropy with fiducial points (MEEF) promising due to its guarantee of unbiased estimation and generalization over generic noise distributions. However, MEEF based learning approaches are known to depend on an accurate kernel-width initialization. Also, the optimal value of this kernel-width is well-known to vary temporally and across deployment scenarios. To remove the dependency on kernel-width, a hyperparameter-free MEEF based adaptive algorithm is derived using random-Fourier features with sampled kernel widths (RFF-SKW). In addition, a detailed convergence analysis is presented for the proposed hyperparameter-free MEEF, which promises a near-optimal error-floor independent of step-size and guarantees convergence for a wide range of step sizes. The promised hyperparameter-independence and improved convergence for the proposed hyperparameter-free MEEF are validated by computer simulations considering different case studies.

Original languageEnglish
Pages (from-to)1682-1696
Number of pages15
JournalIEEE Transactions on Communications
Volume70
Issue number3
DOIs
StatePublished - 1 Mar 2022
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 1972-2012 IEEE.

Keywords

  • Deep-learning
  • RKHS
  • hyperparameter independence
  • information theoretic learning
  • random Fourier features

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Hyperparameter Free MEEF-Based Learning for Next Generation Communication Systems'. Together they form a unique fingerprint.

Cite this