SlideShare uma empresa Scribd logo
1 de 1
Baixar para ler offline
www.projectsatbangalore.com 09591912372
2238 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 9, MAY 1, 2014
Stochastic Analysis of the LMS and NLMS
Algorithms for Cyclostationary White
Gaussian Inputs
Neil J. Bershad, Fellow, IEEE, Eweda Eweda, Fellow, IEEE, and José C. M. Bermudez, Senior Member, IEEE
Abstract—This paper studies the stochastic behavior of the
LMS and NLMS algorithms for a system identification framework
when the input signal is a cyclostationary white Gaussian process.
The input cyclostationary signal is modeled by a white Gaussian
random process with periodically time-varying power. Mathemat-
ical models are derived for the mean and mean-square-deviation
(MSD) behavior of the adaptive weights with the input cyclosta-
tionarity. These models are also applied to the non-stationary
system with a random walk variation of the optimal weights.
Monte Carlo simulations of the two algorithms provide strong
support for the theory. Finally, the performance of the two algo-
rithms is compared for a variety of scenarios.
Index Terms—Adaptive filters, analysis, LMS algorithm, NLMS
algorithm, stochastic algorithms.
I. INTRODUCTION
AN important aspect of adaptive filter performance is the
ability to track time variations of the underlying signal
statistics [1], [2]. The standard analytical model assumes the
input signal is stationary (see e.g., [3]–[9]).
However, a non-stationary signal model can be provided by
a random walk model for the optimum weights. The form of
the mean-square error performance surface remains unaltered
while the surface moves in the weight space over time. This
model provides the conditions for the adaptive algorithm to
track the optimum solution [1]. Alternatively, the input signal
can be modeled as a cyclostationary process in many practical
applications [10]–[12]. In these cases, the form of the perfor-
mance surface is periodic with the same period as the input
autocorrelation matrix [13]. This performance surface defor-
mation affects the adaptive filter convergence and is indepen-
dent of changes in the optimum weights. This transient perfor-
mance surface deformation can be modeled by standard ana-
lytical models. However, it is still desirable to understand the
Manuscript received June 17, 2013; revised December 06, 2013; accepted
February 06, 2014. Date of publication February 20, 2014; date of current ver-
sion April 04, 2014. The associate editor coordinating the review of this manu-
script and approving it for publication was Dr. Suleyman S. Kozat. This work
has been partially supported by CNPq under grant No. 307071/2013-8 and by
Capes.
N. J. Bershad is with the Department of Electrical Engineering and Com-
puter Science, University of California, Irvine, Newport Beach, CA 92660 USA
(e-mail: bershad@ece.uci.edu).
E. Eweda is with the National Knowledge Center, Abu Dhabi, United Arab
Emirates (e-mail: eweda@ieee.org).
J. C. M. Bermudez is with the Department of Electrical Engineering, Fed-
eral University of Santa Catarina, Florianópolis, SC 88040-900, Brazil (e-mail:
j.bermudez@ieee.org).
Digital Object Identifier 10.1109/TSP.2014.2307278
adaptive performance with non-stationary inputs. This type of
analysis is essentially absent from the technical literature [1],
[2]. A first analysis of the LMS behavior for cyclostationary in-
puts [14] studied only its convergence in the mean. The spe-
cial case of a pulsed variation of the input power and a linear
combiner structure has recently been studied for both LMS and
NLMS algorithms [15], [16]. An analysis of the Least Mean
Fourth (LMF) algorithm behavior for nonstationary inputs has
been recently presented in [17]. The analytical model derived
for the LMF behavior in [17] was valid only for a specific form
of the input autocorrelation matrix, and cannot be easily ex-
tended to a general time-varying input statistics. Also, as the
LMF weight update equation is a function of a higher power of
the estimation error, the statistical assumptions used in [17] are
necessarily different from those required for the analysis of the
LMS and NLMS algorithms. Hence, the study of the behaviors
of the LMS and NLMS algorithms under cyclostationary inputs
cannot be inferred from the analysis in [17] and new models
must be derived.
Adaptive solutions involving cyclostationary signals have
been sought for many application areas [18]. In particular,
communication, radar, and sonar systems frequently need
such solutions, as several man-made signals encountered in
these areas have parameters that vary periodically with time
[19]–[21]. [21] studied adaptive beamforming algorithms for
applications where input signals are cyclostationary. [22]
proposed an adaptive minimum variance equalizer that ex-
ploits the cyclostationarity properties of the intersymbol and
adjacent-channel interferences. [20] proposed a gradient-based
adaptive beamforming algorithm that exploits the cyclostation-
arity of the input signal. [23] employed adaptive filtering to
extract cyclostationary interference from speech signals. The
reader is directed to [18] for a survey on the importance of
cyclostationary signals in several areas, including communica-
tions, channel identification and equalization. Thus, a statistical
analysis of adaptive algorithms under cyclostationary inputs
could have a significant impact on a wide variety of problems
involving cyclostationary processes.
The analysis of the adaptive filter behavior for cyclosta-
tionary inputs is not easy because of the difficulty of modeling
the input cyclostationarity in a mathematically treatable way1.
Thus, relatively simple models are needed from which to infer
algorithm behavior for inputs with time-varying statistics.
1A similar difficulty exists for the time-varying weight model. The first order
Markov weight variation model is simplified to a vector random walk model
with independent components [24].
1053-587X © 2014 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

Mais conteúdo relacionado

Destaque

Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...CSCJournals
 
B.Tech Final Project
B.Tech Final ProjectB.Tech Final Project
B.Tech Final Projectsonix022
 
Acoustic echo cancellation using nlms adaptive algorithm ranbeer
Acoustic echo cancellation using nlms adaptive algorithm ranbeerAcoustic echo cancellation using nlms adaptive algorithm ranbeer
Acoustic echo cancellation using nlms adaptive algorithm ranbeerRanbeer Tyagi
 
Nlms algorithm for adaptive filter
Nlms algorithm for adaptive filterNlms algorithm for adaptive filter
Nlms algorithm for adaptive filterchintanajoshi
 
Echo Cancellation Algorithms using Adaptive Filters: A Comparative Study
Echo Cancellation Algorithms using Adaptive Filters: A Comparative StudyEcho Cancellation Algorithms using Adaptive Filters: A Comparative Study
Echo Cancellation Algorithms using Adaptive Filters: A Comparative Studyidescitation
 
Noice canclellation using adaptive filters with adpative algorithms(LMS,NLMS,...
Noice canclellation using adaptive filters with adpative algorithms(LMS,NLMS,...Noice canclellation using adaptive filters with adpative algorithms(LMS,NLMS,...
Noice canclellation using adaptive filters with adpative algorithms(LMS,NLMS,...Brati Sundar Nanda
 

Destaque (7)

Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
 
B.Tech Final Project
B.Tech Final ProjectB.Tech Final Project
B.Tech Final Project
 
Acoustic echo cancellation using nlms adaptive algorithm ranbeer
Acoustic echo cancellation using nlms adaptive algorithm ranbeerAcoustic echo cancellation using nlms adaptive algorithm ranbeer
Acoustic echo cancellation using nlms adaptive algorithm ranbeer
 
Nlms algorithm for adaptive filter
Nlms algorithm for adaptive filterNlms algorithm for adaptive filter
Nlms algorithm for adaptive filter
 
Echo Cancellation Paper
Echo Cancellation Paper Echo Cancellation Paper
Echo Cancellation Paper
 
Echo Cancellation Algorithms using Adaptive Filters: A Comparative Study
Echo Cancellation Algorithms using Adaptive Filters: A Comparative StudyEcho Cancellation Algorithms using Adaptive Filters: A Comparative Study
Echo Cancellation Algorithms using Adaptive Filters: A Comparative Study
 
Noice canclellation using adaptive filters with adpative algorithms(LMS,NLMS,...
Noice canclellation using adaptive filters with adpative algorithms(LMS,NLMS,...Noice canclellation using adaptive filters with adpative algorithms(LMS,NLMS,...
Noice canclellation using adaptive filters with adpative algorithms(LMS,NLMS,...
 

Semelhante a Stochastic Analysis of LMS and NLMS Algorithms for Cyclostationary Inputs

Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: ...
Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: ...Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: ...
Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: ...CSCJournals
 
Maximum likelihood estimation-assisted ASVSF through state covariance-based 2...
Maximum likelihood estimation-assisted ASVSF through state covariance-based 2...Maximum likelihood estimation-assisted ASVSF through state covariance-based 2...
Maximum likelihood estimation-assisted ASVSF through state covariance-based 2...TELKOMNIKA JOURNAL
 
Variable step size of lms algorithem using partical swarm optimization
Variable step size of lms algorithem using partical swarm optimizationVariable step size of lms algorithem using partical swarm optimization
Variable step size of lms algorithem using partical swarm optimizationeSAT Publishing House
 
ENHANCING COMPUTATIONAL EFFORTS WITH CONSIDERATION OF PROBABILISTIC AVAILABL...
ENHANCING COMPUTATIONAL EFFORTS WITH CONSIDERATION OF  PROBABILISTIC AVAILABL...ENHANCING COMPUTATIONAL EFFORTS WITH CONSIDERATION OF  PROBABILISTIC AVAILABL...
ENHANCING COMPUTATIONAL EFFORTS WITH CONSIDERATION OF PROBABILISTIC AVAILABL...Raja Larik
 
research journal
research journalresearch journal
research journalakhila1001
 
Power quality improvement of grid interconnected distribution system using fs...
Power quality improvement of grid interconnected distribution system using fs...Power quality improvement of grid interconnected distribution system using fs...
Power quality improvement of grid interconnected distribution system using fs...eSAT Publishing House
 
Comparison of analytical methods of analysing linear induction motors
Comparison of analytical methods of analysing linear induction motors Comparison of analytical methods of analysing linear induction motors
Comparison of analytical methods of analysing linear induction motors Chandan Kumar
 
Power quality improvement of grid interconnected distribution system using fs...
Power quality improvement of grid interconnected distribution system using fs...Power quality improvement of grid interconnected distribution system using fs...
Power quality improvement of grid interconnected distribution system using fs...eSAT Journals
 
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...VLSICS Design
 
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...VLSICS Design
 
A Novel Approach to GSA, GA and Wavelet Transform to Design Fuzzy Logic Contr...
A Novel Approach to GSA, GA and Wavelet Transform to Design Fuzzy Logic Contr...A Novel Approach to GSA, GA and Wavelet Transform to Design Fuzzy Logic Contr...
A Novel Approach to GSA, GA and Wavelet Transform to Design Fuzzy Logic Contr...IAES-IJPEDS
 
Dimensionless Approach to Multi-Parametric Stability Analysis of Nonlinear Ti...
Dimensionless Approach to Multi-Parametric Stability Analysis of Nonlinear Ti...Dimensionless Approach to Multi-Parametric Stability Analysis of Nonlinear Ti...
Dimensionless Approach to Multi-Parametric Stability Analysis of Nonlinear Ti...Alvin Zhang
 
Process optimization and process adjustment techniques for improving
Process optimization and process adjustment techniques for improvingProcess optimization and process adjustment techniques for improving
Process optimization and process adjustment techniques for improvingIAEME Publication
 
Modern Tools for the Small-Signal Stability Analysis and Design of FACTS Assi...
Modern Tools for the Small-Signal Stability Analysis and Design of FACTS Assi...Modern Tools for the Small-Signal Stability Analysis and Design of FACTS Assi...
Modern Tools for the Small-Signal Stability Analysis and Design of FACTS Assi...Power System Operation
 
A Robust Algorithm To Solve The Signal Setting Problem Considering Different ...
A Robust Algorithm To Solve The Signal Setting Problem Considering Different ...A Robust Algorithm To Solve The Signal Setting Problem Considering Different ...
A Robust Algorithm To Solve The Signal Setting Problem Considering Different ...Joshua Gorinson
 

Semelhante a Stochastic Analysis of LMS and NLMS Algorithms for Cyclostationary Inputs (20)

Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: ...
Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: ...Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: ...
Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: ...
 
Maximum likelihood estimation-assisted ASVSF through state covariance-based 2...
Maximum likelihood estimation-assisted ASVSF through state covariance-based 2...Maximum likelihood estimation-assisted ASVSF through state covariance-based 2...
Maximum likelihood estimation-assisted ASVSF through state covariance-based 2...
 
Variable step size of lms algorithem using partical swarm optimization
Variable step size of lms algorithem using partical swarm optimizationVariable step size of lms algorithem using partical swarm optimization
Variable step size of lms algorithem using partical swarm optimization
 
E121 gt2014 26029
E121 gt2014 26029E121 gt2014 26029
E121 gt2014 26029
 
E0812730
E0812730E0812730
E0812730
 
ENHANCING COMPUTATIONAL EFFORTS WITH CONSIDERATION OF PROBABILISTIC AVAILABL...
ENHANCING COMPUTATIONAL EFFORTS WITH CONSIDERATION OF  PROBABILISTIC AVAILABL...ENHANCING COMPUTATIONAL EFFORTS WITH CONSIDERATION OF  PROBABILISTIC AVAILABL...
ENHANCING COMPUTATIONAL EFFORTS WITH CONSIDERATION OF PROBABILISTIC AVAILABL...
 
research journal
research journalresearch journal
research journal
 
3445-8593-4-PB
3445-8593-4-PB3445-8593-4-PB
3445-8593-4-PB
 
Power quality improvement of grid interconnected distribution system using fs...
Power quality improvement of grid interconnected distribution system using fs...Power quality improvement of grid interconnected distribution system using fs...
Power quality improvement of grid interconnected distribution system using fs...
 
Comparison of analytical methods of analysing linear induction motors
Comparison of analytical methods of analysing linear induction motors Comparison of analytical methods of analysing linear induction motors
Comparison of analytical methods of analysing linear induction motors
 
Power quality improvement of grid interconnected distribution system using fs...
Power quality improvement of grid interconnected distribution system using fs...Power quality improvement of grid interconnected distribution system using fs...
Power quality improvement of grid interconnected distribution system using fs...
 
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
 
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
A Simulation Experiment on a Built-In Self Test Equipped with Pseudorandom Te...
 
A Novel Approach to GSA, GA and Wavelet Transform to Design Fuzzy Logic Contr...
A Novel Approach to GSA, GA and Wavelet Transform to Design Fuzzy Logic Contr...A Novel Approach to GSA, GA and Wavelet Transform to Design Fuzzy Logic Contr...
A Novel Approach to GSA, GA and Wavelet Transform to Design Fuzzy Logic Contr...
 
Dimensionless Approach to Multi-Parametric Stability Analysis of Nonlinear Ti...
Dimensionless Approach to Multi-Parametric Stability Analysis of Nonlinear Ti...Dimensionless Approach to Multi-Parametric Stability Analysis of Nonlinear Ti...
Dimensionless Approach to Multi-Parametric Stability Analysis of Nonlinear Ti...
 
nazelan2017.pdf
nazelan2017.pdfnazelan2017.pdf
nazelan2017.pdf
 
Process optimization and process adjustment techniques for improving
Process optimization and process adjustment techniques for improvingProcess optimization and process adjustment techniques for improving
Process optimization and process adjustment techniques for improving
 
I02095257
I02095257I02095257
I02095257
 
Modern Tools for the Small-Signal Stability Analysis and Design of FACTS Assi...
Modern Tools for the Small-Signal Stability Analysis and Design of FACTS Assi...Modern Tools for the Small-Signal Stability Analysis and Design of FACTS Assi...
Modern Tools for the Small-Signal Stability Analysis and Design of FACTS Assi...
 
A Robust Algorithm To Solve The Signal Setting Problem Considering Different ...
A Robust Algorithm To Solve The Signal Setting Problem Considering Different ...A Robust Algorithm To Solve The Signal Setting Problem Considering Different ...
A Robust Algorithm To Solve The Signal Setting Problem Considering Different ...
 

Mais de john236zaq

Images as Occlusions of Textures: A Framework for Segmentation
Images as Occlusions of Textures: A Framework for SegmentationImages as Occlusions of Textures: A Framework for Segmentation
Images as Occlusions of Textures: A Framework for Segmentationjohn236zaq
 
Image Restoration Using Joint Statistical Modeling in a Space-Transform Domain
Image Restoration Using Joint Statistical Modeling in a Space-Transform DomainImage Restoration Using Joint Statistical Modeling in a Space-Transform Domain
Image Restoration Using Joint Statistical Modeling in a Space-Transform Domainjohn236zaq
 
Low-Complexity DFT-Based Channel Estimation with Leakage Nulling for OFDM Sys...
Low-Complexity DFT-Based Channel Estimation with Leakage Nulling for OFDM Sys...Low-Complexity DFT-Based Channel Estimation with Leakage Nulling for OFDM Sys...
Low-Complexity DFT-Based Channel Estimation with Leakage Nulling for OFDM Sys...john236zaq
 
Low-Rank Neighbor Embedding for Single Image Super-Resolution
Low-Rank Neighbor Embedding for Single Image Super-ResolutionLow-Rank Neighbor Embedding for Single Image Super-Resolution
Low-Rank Neighbor Embedding for Single Image Super-Resolutionjohn236zaq
 
Mining Weakly Labeled Web Facial Images for Search-Based Face Annotation
Mining Weakly Labeled Web Facial Images for Search-Based Face AnnotationMining Weakly Labeled Web Facial Images for Search-Based Face Annotation
Mining Weakly Labeled Web Facial Images for Search-Based Face Annotationjohn236zaq
 
Modeling and Estimation of Transient Carrier Frequency Offset in Wireless Tra...
Modeling and Estimation of Transient Carrier Frequency Offset in Wireless Tra...Modeling and Estimation of Transient Carrier Frequency Offset in Wireless Tra...
Modeling and Estimation of Transient Carrier Frequency Offset in Wireless Tra...john236zaq
 
OFDM Synthetic Aperture Radar Imaging With Sufficient Cyclic Prefix
OFDM Synthetic Aperture Radar Imaging With Sufficient Cyclic PrefixOFDM Synthetic Aperture Radar Imaging With Sufficient Cyclic Prefix
OFDM Synthetic Aperture Radar Imaging With Sufficient Cyclic Prefixjohn236zaq
 
Phase-Based Binarization of Ancient Document Images: Model and Applications
Phase-Based Binarization of Ancient Document Images: Model and ApplicationsPhase-Based Binarization of Ancient Document Images: Model and Applications
Phase-Based Binarization of Ancient Document Images: Model and Applicationsjohn236zaq
 
Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...
Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...
Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...john236zaq
 
Reversible De-Identification for Lossless Image Compression using Reversible ...
Reversible De-Identification for Lossless Image Compression using Reversible ...Reversible De-Identification for Lossless Image Compression using Reversible ...
Reversible De-Identification for Lossless Image Compression using Reversible ...john236zaq
 

Mais de john236zaq (10)

Images as Occlusions of Textures: A Framework for Segmentation
Images as Occlusions of Textures: A Framework for SegmentationImages as Occlusions of Textures: A Framework for Segmentation
Images as Occlusions of Textures: A Framework for Segmentation
 
Image Restoration Using Joint Statistical Modeling in a Space-Transform Domain
Image Restoration Using Joint Statistical Modeling in a Space-Transform DomainImage Restoration Using Joint Statistical Modeling in a Space-Transform Domain
Image Restoration Using Joint Statistical Modeling in a Space-Transform Domain
 
Low-Complexity DFT-Based Channel Estimation with Leakage Nulling for OFDM Sys...
Low-Complexity DFT-Based Channel Estimation with Leakage Nulling for OFDM Sys...Low-Complexity DFT-Based Channel Estimation with Leakage Nulling for OFDM Sys...
Low-Complexity DFT-Based Channel Estimation with Leakage Nulling for OFDM Sys...
 
Low-Rank Neighbor Embedding for Single Image Super-Resolution
Low-Rank Neighbor Embedding for Single Image Super-ResolutionLow-Rank Neighbor Embedding for Single Image Super-Resolution
Low-Rank Neighbor Embedding for Single Image Super-Resolution
 
Mining Weakly Labeled Web Facial Images for Search-Based Face Annotation
Mining Weakly Labeled Web Facial Images for Search-Based Face AnnotationMining Weakly Labeled Web Facial Images for Search-Based Face Annotation
Mining Weakly Labeled Web Facial Images for Search-Based Face Annotation
 
Modeling and Estimation of Transient Carrier Frequency Offset in Wireless Tra...
Modeling and Estimation of Transient Carrier Frequency Offset in Wireless Tra...Modeling and Estimation of Transient Carrier Frequency Offset in Wireless Tra...
Modeling and Estimation of Transient Carrier Frequency Offset in Wireless Tra...
 
OFDM Synthetic Aperture Radar Imaging With Sufficient Cyclic Prefix
OFDM Synthetic Aperture Radar Imaging With Sufficient Cyclic PrefixOFDM Synthetic Aperture Radar Imaging With Sufficient Cyclic Prefix
OFDM Synthetic Aperture Radar Imaging With Sufficient Cyclic Prefix
 
Phase-Based Binarization of Ancient Document Images: Model and Applications
Phase-Based Binarization of Ancient Document Images: Model and ApplicationsPhase-Based Binarization of Ancient Document Images: Model and Applications
Phase-Based Binarization of Ancient Document Images: Model and Applications
 
Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...
Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...
Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...
 
Reversible De-Identification for Lossless Image Compression using Reversible ...
Reversible De-Identification for Lossless Image Compression using Reversible ...Reversible De-Identification for Lossless Image Compression using Reversible ...
Reversible De-Identification for Lossless Image Compression using Reversible ...
 

Último

A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 

Último (20)

Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 

Stochastic Analysis of LMS and NLMS Algorithms for Cyclostationary Inputs

  • 1. www.projectsatbangalore.com 09591912372 2238 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 62, NO. 9, MAY 1, 2014 Stochastic Analysis of the LMS and NLMS Algorithms for Cyclostationary White Gaussian Inputs Neil J. Bershad, Fellow, IEEE, Eweda Eweda, Fellow, IEEE, and José C. M. Bermudez, Senior Member, IEEE Abstract—This paper studies the stochastic behavior of the LMS and NLMS algorithms for a system identification framework when the input signal is a cyclostationary white Gaussian process. The input cyclostationary signal is modeled by a white Gaussian random process with periodically time-varying power. Mathemat- ical models are derived for the mean and mean-square-deviation (MSD) behavior of the adaptive weights with the input cyclosta- tionarity. These models are also applied to the non-stationary system with a random walk variation of the optimal weights. Monte Carlo simulations of the two algorithms provide strong support for the theory. Finally, the performance of the two algo- rithms is compared for a variety of scenarios. Index Terms—Adaptive filters, analysis, LMS algorithm, NLMS algorithm, stochastic algorithms. I. INTRODUCTION AN important aspect of adaptive filter performance is the ability to track time variations of the underlying signal statistics [1], [2]. The standard analytical model assumes the input signal is stationary (see e.g., [3]–[9]). However, a non-stationary signal model can be provided by a random walk model for the optimum weights. The form of the mean-square error performance surface remains unaltered while the surface moves in the weight space over time. This model provides the conditions for the adaptive algorithm to track the optimum solution [1]. Alternatively, the input signal can be modeled as a cyclostationary process in many practical applications [10]–[12]. In these cases, the form of the perfor- mance surface is periodic with the same period as the input autocorrelation matrix [13]. This performance surface defor- mation affects the adaptive filter convergence and is indepen- dent of changes in the optimum weights. This transient perfor- mance surface deformation can be modeled by standard ana- lytical models. However, it is still desirable to understand the Manuscript received June 17, 2013; revised December 06, 2013; accepted February 06, 2014. Date of publication February 20, 2014; date of current ver- sion April 04, 2014. The associate editor coordinating the review of this manu- script and approving it for publication was Dr. Suleyman S. Kozat. This work has been partially supported by CNPq under grant No. 307071/2013-8 and by Capes. N. J. Bershad is with the Department of Electrical Engineering and Com- puter Science, University of California, Irvine, Newport Beach, CA 92660 USA (e-mail: bershad@ece.uci.edu). E. Eweda is with the National Knowledge Center, Abu Dhabi, United Arab Emirates (e-mail: eweda@ieee.org). J. C. M. Bermudez is with the Department of Electrical Engineering, Fed- eral University of Santa Catarina, Florianópolis, SC 88040-900, Brazil (e-mail: j.bermudez@ieee.org). Digital Object Identifier 10.1109/TSP.2014.2307278 adaptive performance with non-stationary inputs. This type of analysis is essentially absent from the technical literature [1], [2]. A first analysis of the LMS behavior for cyclostationary in- puts [14] studied only its convergence in the mean. The spe- cial case of a pulsed variation of the input power and a linear combiner structure has recently been studied for both LMS and NLMS algorithms [15], [16]. An analysis of the Least Mean Fourth (LMF) algorithm behavior for nonstationary inputs has been recently presented in [17]. The analytical model derived for the LMF behavior in [17] was valid only for a specific form of the input autocorrelation matrix, and cannot be easily ex- tended to a general time-varying input statistics. Also, as the LMF weight update equation is a function of a higher power of the estimation error, the statistical assumptions used in [17] are necessarily different from those required for the analysis of the LMS and NLMS algorithms. Hence, the study of the behaviors of the LMS and NLMS algorithms under cyclostationary inputs cannot be inferred from the analysis in [17] and new models must be derived. Adaptive solutions involving cyclostationary signals have been sought for many application areas [18]. In particular, communication, radar, and sonar systems frequently need such solutions, as several man-made signals encountered in these areas have parameters that vary periodically with time [19]–[21]. [21] studied adaptive beamforming algorithms for applications where input signals are cyclostationary. [22] proposed an adaptive minimum variance equalizer that ex- ploits the cyclostationarity properties of the intersymbol and adjacent-channel interferences. [20] proposed a gradient-based adaptive beamforming algorithm that exploits the cyclostation- arity of the input signal. [23] employed adaptive filtering to extract cyclostationary interference from speech signals. The reader is directed to [18] for a survey on the importance of cyclostationary signals in several areas, including communica- tions, channel identification and equalization. Thus, a statistical analysis of adaptive algorithms under cyclostationary inputs could have a significant impact on a wide variety of problems involving cyclostationary processes. The analysis of the adaptive filter behavior for cyclosta- tionary inputs is not easy because of the difficulty of modeling the input cyclostationarity in a mathematically treatable way1. Thus, relatively simple models are needed from which to infer algorithm behavior for inputs with time-varying statistics. 1A similar difficulty exists for the time-varying weight model. The first order Markov weight variation model is simplified to a vector random walk model with independent components [24]. 1053-587X © 2014 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.