Exploring the interrelation between information theory and signal processing theory, the book contains a new algebraic approach to signal processing theory. Readers will learn this new approach to constructing the unified mathematical fundamentals of both information theory and signal processing theory in addition to new methods of evaluating quality indices of signal processing. The book discusses the methodology of synthesis and analysis of signal processing algorithms providing qualitative increase of signal processing efficiency under parametric and nonparametric prior uncertainty conditions. Examples are included throughout the book to further emphasize new material.