Laserfiche WebLink
<br /> <br />(4) professional journals would better serve the profession if they would <br />require authors to consider the criteria of accuracy, reproducibility, and <br />practicality, and if they would adopt a consistent set of indices that reflect <br />these criteria. <br /> <br />INTRODUCTION <br /> <br />The Work Group recognized that a literature review and evaluation would be <br />an important aid in achieving their objectives. This publication summarizes <br />the literature evaluation that was performed. The literature evaluation was <br />designed specifically to provide the Work Group with information that would be <br />helpful in selecting procedures that are representative of those currently in <br />use. <br /> <br />The Work Group agreed that there are three criteria involved in the selec- <br />tion process: accuracy, reproducibility, and practicality. A selected proce- <br />dure should give the highest degree of accuracy possible within the limitation <br />of a practical procedure that achieves consistent results. It is not possible <br />to detail the appropriate level for these three criteria. To the, extent pos- <br />sible, standard measures of accuracy, i.e., standard errors of test results, <br />should be used as a criterion to judge between procedures. Reproducibility <br />can be enhanced by adopting procedures that require a minimum number of <br />subjective decisions. Practicality, as measured, for example, by the cost of <br />estimation and the time required to make an estimate, is an important criterion <br />in procedure selection and must be weighed against the available resources. <br />The selected. procedures need not be restricted to those capable of field com- <br />putation by individuals with limited experience and education. <br /> <br />CRITERIA FOR COMPARISON OF PROCEDURES <br /> <br />One objective of this study was to identify publications that described <br />the evaluation of models on the basis of accuracy, reproducibility, and prac- <br />ticality, which are the three criteria established by the Work Group for <br />comparing procedures. The following are definitions for these three criteria: <br /> <br />Accuracy: <br /> <br />a measure of the closeness of the predicated values <br />to the "true" value of the quantity being evaluated. <br />It considers both precision and bias. <br /> <br />Reproducibility: <br /> <br />a measure of the degree to which the predicted values <br />of the quantity being evaluated by a group of indi- <br />viduals agree with each other. <br /> <br />Practicality: <br /> <br />a measure of the effort and resources required to <br />obtain an estimate of the quantity being evaluated. <br /> <br />2 <br />