Assumptions and Values in the Practice of Information Systems Evaluation

Dan N. Stone

 

SYNOPSIS:

All approaches used to evaluate the impact of information Systems (IS) on organizational productivity contain assumptions (i.e., untested beliefs) and implicit values. Methodological choices for evaluation are intermixed with assumptions and values. As a consequence, there is no perfect way of knowing the effects of an IS. Instead, the "results" of an IS evaluation are highly dependent upon the assumptions and values of evaluators. This article highlights the implicit assumptions and explicit hypotheses of common IS evaluation practices and recommends strategies for making better evaluation method choices. These strategies include acknowledging tradeoffs, using triangulation, and making evaluative assumptions explicit. The paper concludes by suggesting that IS evaluation research could be improved by greater attention to and understanding of the limiting assumptions of alternative evaluation methods.

Back