Um unsere Webseiten für Sie optimal zu gestalten und fortlaufend zu verbessern, verwenden wir Cookies. Durch Bestätigen des Buttons »Akzeptieren« stimmen Sie der Verwendung zu. Über den Button »Einstellungen« können Sie auswählen, welche Cookies Sie zulassen wollen.

AkzeptierenEinstellungen
Zum Hauptinhalt springen
Nicht aus der Schweiz? Besuchen Sie lehmanns.de
Foundations of Non-stationary Dynamic Programming with Discrete Time Parameter - K. Hinderer

Foundations of Non-stationary Dynamic Programming with Discrete Time Parameter

(Autor)

Buch | Softcover
VI, 164 Seiten
1970 | Softcover reprint of the original 1st ed. 1970
Springer Berlin (Verlag)
978-3-540-04956-2 (ISBN)
CHF 74,85 inkl. MwSt
The present work is an extended version of a manuscript of a course which the author taught at the University of Hamburg during summer 1969. The main purpose has been to give a rigorous foundation of stochastic dynamic programming in a manner which makes the theory easily applicable to many different practical problems. We mention the following features which should serve our purpose. a) The theory is built up for non-stationary models, thus making it possible to treat e.g. dynamic programming under risk, dynamic programming under uncertainty, Markovian models, stationary models, and models with finite horizon from a unified point of view. b) We use that notion of optimality (p-optimality) which seems to be most appropriate for practical purposes. c) Since we restrict ourselves to the foundations, we did not include practical problems and ways to their numerical solution, but we give (cf.section 8) a number of problems which show the diversity of structures accessible to non stationary dynamic programming. The main sources were the papers of Blackwell (65), Strauch (66) and Maitra (68) on stationary models with general state and action spaces and the papers of Dynkin (65), Hinderer (67) and Sirjaev (67) on non-stationary models. A number of results should be new, whereas most theorems constitute extensions (usually from stationary models to non-stationary models) or analogues to known results.

1. Introduction and summary.- I. Countable state space.- 2. Decision models and definition of the problem.- 3. The principle of optimality and the optimality equation.- 4. Value iteration.- 5. Criteria of optimality and existence of $$bar{p}$$-optimal plans.- 6. Sufficient statistics, Markovian and stationary models.- 7. Models with incomplete information.- 8. Examples of special models.- 9. Randomized plans.- 10. Dynamic programming under uncertainty.- II. General state space.- 11. Decision models.- 12. Measure-theoretic and topological preparations.- 13. Universal measurability of the maximal conditional expected reward.- 14. The optimality equation.- 15. Substitution of randomized plans by deterministic plans.- 16. A generalization of the fixed point theorem for contractions.- 17. Criteria of optimality and existence of $$bar{p}$$-optimal plans.- 18. Sufficient statistics, Markovian and stationary models.- 19. Validity of the optimality equation without topological assumptions on state space and action space.- 20. Supplementary remarks.- Appendix 1. List of symbols and conventions.- 2. Some notions and auxiliary results from probability theory.- 3. Conditional distributions and expectations.- Literature.- Index of definitions.

Erscheint lt. Verlag 1.1.1970
Reihe/Serie Lecture Notes in Economics and Mathematical Systems
Zusatzinfo VI, 164 p.
Verlagsort Berlin
Sprache englisch
Maße 178 x 254 mm
Gewicht 380 g
Themenwelt Mathematik / Informatik Mathematik Analysis
Wirtschaft Allgemeines / Lexika
Wirtschaft Betriebswirtschaft / Management Unternehmensführung / Management
Schlagworte Distribution • Diversity • Dynamic Programming • Foundation • Planungsrechnung • Statistics • Time
ISBN-10 3-540-04956-8 / 3540049568
ISBN-13 978-3-540-04956-2 / 9783540049562
Zustand Neuware
Informationen gemäß Produktsicherheitsverordnung (GPSR)
Haben Sie eine Frage zum Produkt?
Mehr entdecken
aus dem Bereich

von Tilo Arens; Frank Hettlich; Christian Karpfinger …

Buch | Hardcover (2022)
Springer Spektrum (Verlag)
CHF 118,95
Differentialrechnung im ℝⁿ, gewöhnliche Differentialgleichungen

von Otto Forster; Florian Lindemann

Buch | Softcover (2025)
Springer Spektrum (Verlag)
CHF 46,15