|
<br />96
<br />
<br />.
<br />
<br />on which clouds suitable to the seeding hypothesis may
<br />have been plentiful, while substantial decreases occurred
<br />on the more common southerly wind days when large
<br />clouds containing much natural ice prevailed. While
<br />post-factum stratifications are not statistically convinc-
<br />ing, this suggestion is sufficiently reinforced by later
<br />physical understanding and numerical simulation of
<br />cloud processes to warrant testing in a second-stage
<br />experiment, to be proposed later.
<br />In fact, in my opinion, the only "failure" associated
<br />with Whitetop was the delay of second-stage experi-
<br />mentation, only recently recognized as necessary in
<br />virtually all successful weather-modification trials. There
<br />were several reasons for this problem. As Braham points
<br />out, Whitetop was tacitly regarded as a "confirmatory"
<br />experiment with a probable overall rainfall decrease,
<br />rather than as an exploratory experiment, as it should
<br />have been to enable improved phased experimentation.
<br />The distinction between "exploratory" and "confirma-
<br />tory" experimentation had not been incorporated into
<br />weather modification in the 1960s because it was first
<br />formulated by Tukey in 1969 (Tukey 1969, 1970). The
<br />problems were compounded by conflicting critical public
<br />pronouncements by a group of prominent but meteoro-
<br />logically inexperienced statisticians. These stirred up
<br />counterproductive controversy and muddied the waters
<br />to the extent that full publication and calm, objective
<br />discussion of the procedures and results by a wide com-
<br />munity of informed scientists were greatly hampered.
<br />. The delay, however, may have been compensated for by
<br />the advances which have been made in seeding tech-
<br />niques, in cloud physics, and particularly in the numeri-
<br />cal simulation of clouds and mesoscale processes
<br />(lQ-iOO km).
<br />Braham makes the point that to establish knowledge
<br />about cloud seeding, Whitetop should be repeated. He
<br />hesitates to urge this, however, on the ethical grounds that
<br />Whitetop I probably decreased rainfall in a water-needy
<br />region. The science could benefit and the ethical problem
<br />could probably be alleviated by phased experiment de-
<br />sign, provided that Whitetop II could eliminate from
<br />treatment most of those clouds or cloud situations where
<br />the learning. from all previous experimentation suggests
<br />a negative effect. Experience shows, however, that
<br />eliminating untreatable or negatively responding cloud
<br />conditions from treatment in a soundly designed con-
<br />firmatory experiment is easier said than done. Braham
<br />. discusses briefly two other important experiments,
<br />namely, Colorado River Basin and FACE 1, afflicted with
<br />this problem. In the former, cloud conditions had to be
<br />forecast 24 hours in advance (beyond the state of the art),
<br />I with the result that the experimenters' flexibility to leaye
<br />I unsuitable clouds untreated was restricted, which ren-
<br />'dered overall results inconclusive. Post-factum stratifica-
<br />tion on cloud-top temperature did support earlier results
<br />of Climax I and II that supercooled clouds with top
<br />temperatures warmer than about - 200C were amenable
<br />to treatment.
<br />
<br />: I
<br />'~i~;'~~3;i.~J'~'~:'~;'b"';~":~'"
<br />
<br />.gz;;;-"{~-.l, ."
<br />
<br />_~ ~,_ ;._~:i.ik'~_~~c~b~~'.--:..~__;~_~
<br />
<br />.
<br />
<br />Journal of the America" Statistical Association, March 1979
<br />
<br />In F'ACE 1, two levels of subjectivity have been neces-
<br />sary to cope with unsuitable cloud situations. The first
<br />is to terminate a "GO" day after 60 flare drops if clouds
<br />become either too developed or too stunted (or even
<br />absent) for the hypothesis to apply. The second is to
<br />select within the total target "floating targets" ,i.e.,
<br />groups of clouds with the characteristics suitable to the
<br />seedinj!1; hypothesis. Since the experiment design is
<br />double blind, with identical flights and dummy flare
<br />drops on random control days, inferences would be ac-
<br />ceptable if it were not possible to guess the seeding
<br />decision on many occasions from watching cloud be-
<br />havior. The hypothesis, in fact, would be in serious doubt
<br />were the cloud behavior not detectably different! Al-
<br />though it is rarely possible to guess the decision after only
<br />60 flares out of a usual 200-300 and although terminated
<br />days did not show seed/control differences, the experi-
<br />mental results of the exploratory phase (1970-1976) are
<br />still challengeable on grounds of subjectivity and po-
<br />tential bias (Woodley et al. 1978; Tukey, Brillinger, and
<br />Jones 1978). Worse yet, intense interaction between mete-
<br />orologilsts and statisticians has not yet been able to
<br />hammer out objective criteria for the confirmatory phase
<br />which started in the summer of 1978. The expense of
<br />additional seasons of experimentation is a major obstacle
<br />here siince workable, objective criteria could be formu-
<br />lated if a considerably longer experimentation period and
<br />sample size were foreseeable.
<br />Returning to a possible Whitetop II, we should keep
<br />in mind. that major advances in targeting and tracing
<br />seedinJ?; materials and improved measurements and
<br />model simulations have intervened since Whitetop I.
<br />Relatively uncomplicated research would show whether
<br />persistent south-wind days with mainly unsuitable clouds
<br />could be eliminated from the sample by an objective early
<br />decision. Two different continental seeding experiments
<br />have been proposed, one in the Midwest and one already
<br />in the early field stages in the high plains region, which
<br />should answer some of the questions raised by Whitetop.
<br />Bfaham, however, did not have space to discuss the
<br />only weather-modification experiment which has success-
<br />fully been confirmed in the opinion. of virtually all
<br />meteorologists and statisticians, namely, that in Israel
<br />(Gagin and Neumann 1974; Tukey et al. 1978). This
<br />experiment tested the "optimum nucleus concentration"
<br />strate~~y in the winter storm systems which bring nearly
<br />all of ][srael's rain. F'ortunately, rain is so well correlated
<br />between areas within these storms that the much more
<br />efficient design of randomized crossover was possible;
<br />this design would not work in the summer showery con-
<br />ditions of FACE 1 or Whitetop.
<br />After 12 years and 600 cases of an exploratory followed
<br />by a confirmatory phase, the Israel experiment has dem-
<br />onstrated, without subjectivity or the multiplicity (Tukey
<br />1977) .introduced by subsamples, that a useful 15-25
<br />percent precipitation increase was accomplished. This
<br />concept has now been implemented operationally in
<br />Israel. It needs to be replicated in another area with
<br />
|