Scinovex
articleTop 1% cited

Multivariate stochastic approximation using a simultaneous perturbation gradient approximation

IEEE Transactions on Automatic Control · 1992 · Vol. 37(3) · pp. 332–341
James C. Spall

Abstract

The problem of finding a root of the multivariate gradient equation that arises in function minimization is considered. When only noisy measurements of the function are available, a stochastic approximation (SA) algorithm for the general Kiefer-Wolfowitz type is appropriate for estimating the root. The paper presents an SA algorithm that is based on a simultaneous perturbation gradient approximation instead of the standard finite-difference approximation of Keifer-Wolfowitz type procedures. Theory and numerical experience indicate that the algorithm can be significantly more efficient than the standard algorithms in large-dimensional problems.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Probabilistic and Robust Engineering DesignGaussian Processes and Bayesian InferenceAdvanced Multi-Objective Optimization AlgorithmsStochastic approximationSimultaneous perturbation stochastic approximationApproximation algorithmMinificationMathematicsApplied mathematicsMultivariate statisticsPerturbation (astronomy)Function approximationApproximation theory
Citations
2,241
FWCI
14.07
field-weighted impact
References
35
Percentile
99%
vs. same field & year
Citations per year
Cited by
Deformable Medical Image Registration: A Survey
IEEE Transactions on Medical Imaging · 2013 · 1,514 citations
References
An introduction to probability theory and its applications
Journal of the Franklin Institute · 1958 · 29,713 citations
Citation Network

How this paper connects to the literature. Drag to explore, click any node to open that paper.