|
Reprint Server |
Automatic Differentiation as Nonarchimedean Analysis
Abstract
It is shown how the techniques of automatic differentiation can be viewed in a broader context as an application of analysis on a nonarchimedean field. The rings used in automatic differentiation can be ordered in a natural way and form finite dimensional real algebras which contain infinitesimals. Some of these algebras can be extended to become a Cauchy-complete real-closed nonarchimedean field, which forms an infinite dimensional real vector space and is denoted by L.On this field, a calculus is developed. Rules of differentiation and certain fundamental theorems are discussed. A remarkable property of differentiation is that difference quotients with infinitely small differences yield the exact derivative up to an infinitely small error. This is of historical interest since it justifies the concept of derivatives as differential quotients. But it is also of practical relevance; it turns out that the algebraic operations used to compute derivatives in automatic differentiation are just special cases of calculus concepts on L. The arithmetic on L can be implemented in programming languages, in particular if object oriented features exist, and should provide a useful data type for various applications.
M. Berz, in: "Computer Arithmetic and Enclosure Methods" (1992) 439-450, Elsevier
Download
Click on the icon to download the corresponding file.
Download Postscript version (359502 Bytes).
Download Adobe PDF version (572216 Bytes).
Go Back to the reprint server.
Go Back to the home page.
This page is maintained by Kyoko Makino. Please contact her if there are any problems with it.