Ideal observer analysis

Definition

Many definitions of this term have been offered.

Geisler (2003) (slightly reworded): The central concept in ideal observer analysis is the ideal observer, a theoretical device that performs a given task in an optimal fashion given the available information and some specified constraints. This is not to say that ideal observers perform without error, but rather that they perform at the physical limit of what is possible in the situation. The fundamental role of uncertainty and noise implies that ideal observers must be defined in probabilistic (statistical) terms. Ideal observer analysis involves determining the performance of the ideal observer in a given task and then comparing its performance to that of a real perceptual system, which (depending on the application) might be the system as a whole, a subsystem, or an elementary component of the system (e.g. a neuron).

Sequential ideal observer analysis

In sequential ideal observer analysis, the goal is to measure a real system's performance deficit (relative to ideal) at different processing stages. Such an approach is useful when studying systems that process information in discrete (or semi-discrete) stages or modules.

Natural and pseudo-natural tasks

To facilitate experimental design in the laboratory, an artificial task may be designed so that the system's performance in the task may be studied. If the task is too artificial, the system may be pushed away from a natural mode of operation. Depending on the goals of the experiment, this may diminish its external validity.

In such cases, it may be important to keep the system operating naturally (or almost naturally) by designing a pseudo-natural task. Such tasks are still artificial, but they attempt to mimic the natural demands placed on a system. For example, the task might employ stimuli that resemble natural scenes and might test the system's ability to make potentially useful judgments about these stimuli.

Natural scene statistics are the basis for calculating ideal performance in natural and pseudo-natural tasks. This calculation tends to incorporate elements of signal detection theory, information theory, or estimation theory.

Notes

References

1. (1958). "Definitions of d′ and η as Psychophysical Measures". [[Journal of the Acoustical Society of America]].
2. (1960). "Visual search techniques: proceedings of a symposium, held in the Smithsonian Auditorium, Washington, D. C., April 7 and 8, 1959". [[United States National Academies]].
3. W. P. Tanner Jr.. (1961). "Physiological implications of psychophysical data". [[Annals of the New York Academy of Sciences]].
4. (1996). "Perception as Bayesian Inference". [[Cambridge University Press]].
5. Pelli, D. G.. (1993). "Vision: Coding and Efficiency". [[Cambridge University Press]].
6. Geisler, Wilson S.. (2003). "The Visual Neurosciences". [[MIT Press]].
7. W. S. Geisler. (1989). "Sequential ideal-observer analysis of visual discriminations". [[Psychological Review]].