Laserfiche WebLink
<br />A-6 <br /> <br />2) giving past data 1/2 weight (per experimental unit or per block of agreed-upon size and <br />structure) . <br /> <br />3) analyzing past and future segments of the data together, with equal weight for equal <br />number of (similar) experimental units (unit weight on past data). <br /> <br />If those making decisions among such alternatives were routinely and keenly aware of just <br />where the breakeven points between these specific alternatives lie, we would expect much <br />better decisions as to how data before and after a change are to be combined. (If there are two <br />changes, the earliest group of data will usually get the product of the weights selected separately <br />for each changeJ <br /> <br />In any event, the analysis itself must take into account exactly when any changes were <br />made (something that can be automatic if the experiment is blocked, and blocks are not <br />allowed to run across changes in operation). <br /> <br />Such modifications should almost never be considered in a confirmatory phase that has <br />been going on, unless the decision is to give up the phase and start anew. <br /> <br />* parallel exploration * <br /> <br />An important question is the degree to which it is economical to have "parallel explora- <br />tion". Should we be EXPLORING the usefulness of seeding on days which we believe are less <br />suitable for seeding in the same experiment where we are trying to CONFIRM the usefulness <br />of seeding on days which we believe to be the most suitable? <br /> <br />If we are able to define, satisfactorily and objectively, not only "suitable of class A", but <br />also "suitable of class B" and "suitable of class C", etc., where we seek confirmation for Class <br />A days alone, but exploration for the days in the other classes, we may learn something of <br />whether our judgment in choosing class A was excellent, good, poor, or even just wrong -- and <br />we may learn, possibly a lot, about the consequences of seeding under conditions of classes B, <br />C, etc. There can be real gains here, but unless we are wary, there also can be real losses, both <br />in money and in confusion. <br /> <br />The economics deserve attention in each case, but it seems likely to be generally true that <br />the incremental costs of operating on additional days will, often, be small compared to the fixed <br />costs of having equipment, personnel, and data handling systems available. (Adequately organ- <br />ized data collection, oversight, management and auditing may be important here in holding <br />down the costs of handling additional days of dataJ <br /> <br />The two questions that need to be faced before deciding pro or con about parallel explora- <br />tion are: <br /> <br />a) What will be the dollar costs? <br /> <br />b) Can we keep the main questions adequately clear of the subsidiary ones, both in the <br />minds of the experimenters, and in the minds of those who read about their results? <br /> <br />In such a situation, the results of the confirmatory part might well deserve separate publi- <br />cation. Indeed, it would not, for example, seem to us to be going too far to publish, in consid- <br />erable detail and before the combined experiment began, the confirmatory phase's sharply <br />focused main question(s), perhaps even in the Federal Register. <br /> <br />In an exploratory phase, somewhat similar patterns -- a single well-thought-of definition of <br />"suitability of class A" accompanied by plausible or marginal definitions of "suitability of Class <br />B, ...Class C, etc." -- may often have a real place. An adequate advance record of what was <br />really "class A" will still be very important. <br />