Scientific Research

Inventing the Randomized Double-Blind Trial: The Nuremberg Salt Test of 1835

Nuremberg map
Written by Michael Stolberg

Inventing the Randomized Double-Blind Trial: The Nuremberg Salt Test of 1835

Commentary on: Loehner G, on behalf of a society of truth-loving men (1835). Die homoeopathischen Kochsalzversuche zu Nürnberg [The homeopathic salt trials in Nuremberg]. Nuremberg.
Control groups, randomization, blinding, placebos and related methods designed to eliminate bias have become widely recognized as key features of efforts to identify more effective and safer treatments. As others have shown (Kaptchuk 1998; Dean 2004), many of these methods were first developed and applied in the context of controversies between mainstream medicine and new, ‘alternative’ types of medicine. A very early example of randomization and double blinding was an evaluation of homeopathy conducted in Nuremberg in 1835 by a ‘society of truth-loving men’ (Stolberg 1996; 1999).At the time, homeopathy had garnered considerable support among the upper classes in the then Kingdom of Bavaria. In Nuremberg, one of Bavaria’s largest and most affluent cities, Karl Preu and Johann Jacob Reuter had treated some of the most prominent families with homeopathy, including members of the high aristocracy. In 1834, annoyed by homeopathy’s rising popularity, Friedrich Wilhelm von Hoven, the city’s highest ranking public health official and head of the local hospitals, published a devastating critique of homeopathy under the pseudonym ‘E. Wahrhold’ (Wahrhold 1834), which he had used previously in a way that allowed readers to identify the true author. Von Hoven accused homeopathy of lacking any scientific foundation. He suggested that homeopathic drugs were not real medicines at all and alleged homeopathic cures were either due to dietetic regimens and the healing powers of nature, or showed the power of belief. He called for an objective, comparative assessment by impartial experts. If, as he expected, homeopathic treatment proved ineffective, the government would need to take drastic measures to protect the lives of deceived patients.In 1835, as Karl Preu had died by this time, Johann Jacob Reuter was the sole remaining physician homeopath in the city. He reacted to Wahrhold/von Hoven’s attack with an ardent defence of homeopathy (Reuter 1835) and pointed out that even children, lunatics and animals had been successfully cured. Based on Hahnemann’s assertions, he challenged Wahrhold/von Hoven to try the effects of a C30 dilution of salt on himself. The odds were 10 to 1, he claimed, that his opponent would experience some extraordinary sensations as a result – and these were nothing compared to the much stronger effects on the sick.

Perhaps surprisingly, Reuter’s opponents took up his challenge. Various (allopathic) pharmacists and physicians conducted individual tests, following Reuter’s indications. Then it was decided to stage a larger-scale trial. It remains uncertain who took the initiative for this, but it was probably von Hoven and the circle of physicians around him. They were supported by George Loehner, the owner and editor of the daily Allgemeine Zeitung von und für Bayern, who later compiled the trial report. Loehner had no medical training but his newspaper had repeatedly carried polemical attacks against homeopathy.

Following a widely publicized invitation to anyone who was interested, more than 120 citizens met in a local tavern. The minimum number needed to proceed had been fixed at 50. The design of the proposed trial was explained in detail. In front of everyone, 100 vials were numbered, thoroughly shuffled and then split up at random into two lots of 50. One lot was filled with distilled snow water, the other with ordinary salt in a homeopathic C30-dilution of distilled snow water, prepared just as Reuter had demanded: a grain of salt was dissolved in 100 drops of distilled snow water and the resulting solution was diluted 29 times at a ratio of 1 to 100. Great care was taken to avoid any contamination with allopathic drugs. The two pharmacists in charge had taken two days off before the experiment. They had taken a bath and they used new weighing scales, which had not even come close to an allopathic pharmacy.

A list indicating the numbers of the vials with and without the salt dilution respectively was made, and sealed. The vials were then passed on to a ‘commission’ which distributed 47 of the vials to those among the audience who had declared their willingness to participate (the report speaks of 48 vials but this included an unnumbered vial with salt dilution given to a physician by the name of Lochner). The participants’ names and the number of the vial that each had received were written in a second list. Seven more numbered vials were distributed after the meeting by one of the members of the commission.

Three weeks later, at a second meeting, the participants were asked to report whether they had experienced anything unusual after ingesting the vial’s content. Those who did not come to the meeting were asked to send this information in. Responses were thus obtained from 50 of the 54 participants. Those participants who had perceived something unusual described their symptoms, as required by the protocol.

Finally, the sealed lists were opened to see who had received water and who the homeopathic dilution, and a list of results was compiled. It turned out that only 8 out of the 50 participants who reported back had experienced anything unusual. Five of them had received the dilution, 3 had received water (somewhat confusingly, the report mentions Dr Loehner as a 51st reporting participant and the 9th who had experienced symptoms; but he was aware that he had taken the salt dilution and thus had not actually participated in the trial). The vast majority of those who had received the homeopathic salt dilution had thus not experienced any ‘effect’. The investigators concluded that Reuter was wrong.

From a modern point of view, the major features of the trial can be summarized as follows:

  1. The trial design (protocol) was carefully set out and the details of the study were made public in advance
  2. The number of participants was relatively large and the differences between the two groups would have been significant if Reuter had been right
  3. Assignment to one group or the other was apparently perfectly randomized
  4. A control group receiving only placebo was used
  5. The trial was double blind: neither the participants nor those who organized the trial, distributed the vials and documented the effects had any idea whether a vial contained the homeopathic high dilution or merely water
  6. A rough comparative statistics of the results was compiled
  7. Irregularities were carefully recorded, such as the failure of 4 participants to report back, and the fact that several vials were distributed only after the first tavern meeting

The organizers concluded that the symptoms or changes which the homeopaths claimed to observe as an effect of their medicines were the fruit of imagination, self-deception and preconceived opinion – if not fraud. In spite of their efforts to achieve perfect blinding and randomization, they seem to have been aware, however, that the homeopaths could come up with solid methodological reasons for not accepting this interpretation: in this specific setting, even randomization and double blinding could not eliminate bias. Most participants seem to have opposed homeopathy, and if they wanted to discredit it, they could do so simply by reporting that they had not experienced anything unusual. No matter whether they actually had received the dilution or not, this would invalidate Reuter’s claims. Only if the participants were, in principle, convinced that the substance might have an effect would this problem have been overcome and double blinding could have served its intended purpose.

Historically, the value of the trial report thus lies above all in the principles it set out. The organizers called on others and, in particular, on the homeopaths themselves, to perform and repeat similar trials, with different dilutions, and to make the results public. They stressed once more the punctum saliens, the crucial element of their design: one must avoid anything that might enable the participants and those responsible for the trial to guess whether the actual medicine was given or not.

References

  1. Dean ME (2004). The trials of homeopathy. Origins, structure and development. Essen.
  2. Kaptchuk TJ (1998). Intentional ignorance: a history of blind assessment and placebo controls in medicine. Bulletin of the History of Medicine 72:389-433.
  3. Loehner G, on behalf of a society of truth-loving men (1835). Die homoeopathischen Kochsalzversuche zu Nürnberg [The homeopathic salt trials in Nuremberg]. Nuremberg.
  4. Reuter JJ (1835). Sendschreiben an Dr. E. Fr. Wahrhold als Erwiederung auf dessen Schrift “Auch etwas über die Homoeopathie”. Nuremberg.
  5. Stolberg M (1996): Die Homoeopathie auf dem Prüfstein. Der erste Doppelblindversuch der Medizingeschichte im Jahr 1835. Münchener medizinische Wochenschrift 138: 364-366.
  6. Stolberg M (1999). Die Homoeopathie im Koenigreich Bayern (1800-1914) (= Studien und Quellen zur Geschichte der Homoeopathie, Bd. 5), Heidelberg.
  7. Wahrhold EF (1834). Auch Etwas über die Homoeopathie. Nuremberg.

—————————————–

Prof. Michael Stolberg
Universität Würzburg
Institut für Geschichte der Medizin
Oberer Neubergweg 10a
97074 Würzburg
Germany
Tel. ++49 931 796780

*************

Original Trial – The Nuremberg salt test of 1835

The homeopathic salt trials in Nuremberg, by a society of truth-loving men, published by Dr. George Loehner, Editor of the “Allgemeine Zeitung von und für Bayern”. Including an appendix: An example of the homeopathic method of healing. Nuremberg, March 1835.

P r o g r a m m e

  1. Each person entering is requested to register with name and profession in the protocol on the table and in so doing to note whether he wishes to attend the experiment merely as a witness or wishes to conduct it on himself.
  2. As soon as 50 individuals have assembled, preparatory work for the trials will commence.
  3. The vials will be washed with distilled snow-water before the eyes of those present.
  4. In order to make the potentiation, 30 vials will be placed on the middle table, one after the other.
  5. 100 drops of distilled snow water are placed in a vial; the contents weighed precisely and following this the remaining vials are filled with the same weights of distilled snow water.
  6. One grain of purified salt is weighed, the remaining contents of the vial in which the salt is contained are sealed and handed over to the committee.
  7. Potentiation is done entirely in the manner that Dr. Reuter indicates on p. 11 of his writing against Dr. Wahrhold.
  8. 100 vials, 50 for filling with the potentiation, 50 for filling with pure distilled snow water, are labelled consecutively by Dr. Loehner with the numbers 1 – 100, then mixed well among each other and placed, 50 per table, on two tables.
  9. Those on the table at the right are filled with the potentiation, those on the table at the left are filled with pure distilled snow water.
  10. Dr. Loehner enters the number of each bottle, indicating its contents, in a list, seals the latter and hands it over to the committee, the members of which also affix their seals thereto.
  11. The filled bottles are then brought to the large table in the middle, are once more mixed among each other and thereupon submitted to the committee for the purpose of distribution.
  12. A committee member enters the name of each recipient, including the number assigned to the vial that has been given to the recipient, in a second list.
  13. This list is also submitted to the committee under a seal and is provided with the seals of the members of said committee.
  14. All those present are thereupon invited to either reappear personally on Thursday, 12th March of this year in the rooms of the Red Rooster Inn and state their observations in evidence or to deposit such observations in writing and sealed with the editor’s office of the “Allgemeine Zeitung v. u. f. Bayern” by the stipulated date.
  15. As soon as all depositions are recorded, the committee will proceed to open the lists which have been handed over to it, in order to compare the effect with the cause.

For images of original text – Title Page, Page 1, Page 2, Page 3

About the author

Michael Stolberg

Michael Stolberg

Leave a Comment