Author, Subjects, Keywords

Cited Author

 
 
   » By Author or Editor
 » Browse Author by Alphabet
 » By Journal
 » By Subjects
 » By Affiliations
 » By Type
 » By Year
 » By Latest Additions
 
 
   » By Author
 » Top 20 Authors
 » Top 20 Article
 » Top 20 Journal Cited
 » Top 20 Cited
 » Top 20 Author Cited
 » Usage Since Sept 2007


 
 
 

Login | Create Account

Aspects of Control for the Normal Markov Processes

Saebi, Nasrollah, (2004) Aspects of Control for the Normal Markov Processes. Bulletin of the Malaysian Mathematical Sciences Society, 27 (2). pp. 103-110. ISSN 0126-6705

Full text not available from this repository.

Official URL: http://math.usm.my/bulletin/pdf/v27n2/v27n2p1.pdf

Affiliations

Kingston University, School of Mathematics

Abstract

The choice of optimal control policy for sequentially observed data studied in a Bayesian context is usually a dynamic programming problem that involves a backward iterative solution. In general, as in most sequential Bayes problems, optimal solutions are difficult to derive analytically in simple forms. The system of linear models examined here is, however, amongst the few cases with known explicit optimal solutions. This would allow analytical comparisons with the performance of sub-optimal control procedures. Certain sequence of myopic rules are introduced and applied to the control system. These rules, in general, will provide the user with good near-optimal control policies whenever optimal solutions are analytically difficult to determine. As the myopic rules do not involve backward iteration procedures, they are often convenient to apply, and in addition, the user has the option of improving the accuracy of any particular approximating solution by taking additional future costs into consideration. This approximation is, naturally, at its best when the complete future cost is considered and, for the Aoki (1967) linear control system, solutions are then proved to be optimal.

Item Type:Journal
Keywords:Bayes’ optimal control policies; myopic control rules; sequentially observed data; control of stochastic parameter; linear Markov processes; additive cost structure; Bayesian analysis.
Subjects:Q Science, Computer Science
ID Code:1300

1. M. Aoki, Optimisation of Stochastic Systems (Topics in Discrete-Time Systems), Academic Press, New York, 1967.

2. J.A. Bather, Control charts and the minimisation of costs, J. R. Stat. Soc. Ser. B Stat. Methodol. 25(1963), 49—80.

3. R. Bellman, Dynamic Programming, University Press, Princeton, 1957.

4. G.E.P. Box and G.C. Tiao, Bayesian Inference in Statistical Analysis, Addison-Wesley, London, 1973.

5. M.H. DeGroot, Optimal Statistical Decisions, McGraw-Hill, New York, 1970.

6. R.E. Kalman, A new approach to linear filtering and prediction problems, A.S.M.E. Trans. J. Basic Eng. 83, D, (1960), 35—45.

7. J.P. La Salle, The time-optimal control problem, Ann. of Math. Stud. 45 (1960), 1—25.

8. D.V. Lindley, Introduction to Probability and Statistics from a Bayesian View Point, Part 2, Inference, University Press, Cambridge, 1980.

9. P.A. Whittle, A view of stochastic control theory, J. Roy. Statist. Soc. Ser. A 132 (1969), 320—334.

10. D.M.G. Wishart, A survey of control theory, J. Roy. Statist. Soc. Ser. A 132 (1969), 293—319.

Repository Staff Only: item control page
 
 
 
 
 
   
© Copyright 2007 MyAIS Faculty of Computer Science and Information Technology, University of Malaya – All Rights Reserved. Malaysian Abstracting and Indexing System is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.