A blind or blinded experiment is a test or experiment in which information about the test that might lead to bias in the results is concealed from the tester, the subject, or both until after the test.[1] Bias may be intentional or unconscious. If both tester and subject are blinded, the trial is a double-blind trial.
Blind testing is used wherever items are to be compared without influences from testers' preferences or expectations, for example in clinical trials to evaluate the effectiveness of medicinal drugs and procedures without placebo or nocebo effect, observer bias, or conscious deception; and comparative testing of commercial products to objectively assess user preferences without being influenced by branding and other properties not being tested.
Blinding can be imposed on researchers, technicians, subjects, and funders. The opposite of a blind trial is an open trial. Blind experiments are an important tool of the scientific method, in many fields of research—medicine, psychology and the social sciences, natural sciences such as physics and biology, applied sciences such as market research, and many others. In some disciplines, such as medicinal drug testing, blind experiments are considered essential.
In some cases, while blind experiments would be useful, they are impractical or unethical; an example is in the field of developmental psychology: although it would be informative to raise children under arbitrary experimental conditions, such as on a remote island with a fabricated enculturation, it is obviously a violation of ethics and human rights.
The terms blind (adjective) or to blind (transitive verb) when used in this sense are figurative extensions of the literal idea of blindfolding someone. The terms masked or to mask may be used for the same concept; this is commonly the case in ophthalmology, where the word 'blind' is often used in the literal sense.
Contents
- 1 History
- 2 Single-blind trials
- 3 Double-blind trials
- 4 Triple-blind trials
- 5 Use
- 5.1 In medicine
- 5.2 In physics
- 5.3 In forensics
- 6 References
- 7 External links
History[edit]
The French Academy of Sciences originated the first recorded blind experiments in 1784: the Academy set up a commission to investigate the claims of animal magnetism proposed by Franz Mesmer. Headed by Benjamin Franklin and Antoine Lavoisier, the commission carried out experiments asking mesmerists to identify objects that had previously been filled with "vital fluid", including trees and flasks of water. The subjects were unable to do so. The commission went on to examine claims involving the curing of "mesmerized" patients. These patients showed signs of improved health, but the commission attributed this to the fact that these patients believed they would get better - the first scientific suggestion of the now well-known placebo effect.[2]
In 1799 the British chemist Humphry Davy performed another early blind experiment. In studying the effects of nitrous oxide (laughing gas) on human physiology, Davy deliberately did not tell his subjects what concentration of the gas they were breathing, or whether they were breathing ordinary air.[2]
Blind experiments went on to be used outside of purely scientific settings. In 1817, a committee of scientists and musicians compared a Stradivarius violin to one with a guitar-like design made by the naval engineer François Chanot. A well-known violinist played each instrument while the committee listened in the next room to avoid prejudice.[3][4]
One of the first essays advocating a blinded approach to experiments in general came from Claude Bernard in the latter half of the 19th century, who recommended splitting any scientific experiment between the theorist who conceives the experiment and a naive (and preferably uneducated) observer who registers the results without foreknowledge of the theory or hypothesis being tested. This suggestion contrasted starkly with the prevalent Enlightenment-era attitude that scientific observation can only be objectively valid when undertaken by a well-educated, informed scientist.[5]
Double-blind methods came into especial prominence in the mid-20th century.[6]
Single-blind trials[edit]
Single-blind describes experiments where information that could introduce bias or otherwise skew the result is withheld from the participants, but the experimenter will be in full possession of the facts.
In a single-blind experiment, the individual subjects do not know whether they are so-called "test" subjects or members of an "experimental control" group. Single-blind experimental design is used where the experimenters either must know the full facts (for example, when comparing sham to real surgery) and so the experimenters cannot themselves be blind, or where the experimenters will not introduce further bias and so the experimenters need not be blind. However, there is a risk that subjects are influenced by interaction with the researchers – known as the experimenter's bias. Single-blind trials are especially risky in psychology and social science research, where the experimenter has an expectation of what the outcome should be, and may consciously or subconsciously influence the behavior of the subject.
A classic example of a single-blind test is the "Pepsi challenge". A tester, often a marketing person, prepares two sets of cups of cola labeled "A" and "B". One set of cups is filled with Pepsi, while the other is filled with Coca-Cola. The tester knows which soda is in which cup but is not supposed to reveal that information to the subjects. Volunteer subjects are encouraged to try the two cups of soda and polled for which ones they prefer. One of the problems with a single-blind test like this is that the tester can unintentionally give subconscious cues which influence the subjects. In addition, it is possible the tester could intentionally introduce bias by preparing the separate sodas differently (e.g., by putting more ice in one cup or by pushing one cup closer to the subject). If the tester is a marketing person employed by the company which is producing the challenge, there's always the possibility of a conflict of interest where the marketing person is aware that future income will be based on the results of the test.
Double-blind trials[edit]
Not to be confused with double bind, a type of dilemma in communication.
Double-blind describes an especially stringent way of conducting an experiment which attempts to eliminate subjective, unrecognized biases carried by an experiment's subjects and conductors. Often but not exclusively applied to experiments on human test subjects, first used by W. H. R. Rivers in the investigation of "war neurosis", better known as "shell shock". In most cases, double-blind experiments are held to achieve a higher standard of scientific rigor than blind or non-blind experiments.
In a double-blind experiment, neither the participants nor the researchers know which participants belong to the control group, as opposed to the test group. Only after all data have been recorded (and in some cases, analyzed) do the researchers learn which participants were which. Performing an experiment in double-blind fashion can greatly lessen the power of preconceived notions or physical cues (e.g., the placebo effect, observer bias, experimenter's bias) to distort the results (by making researchers/participants behave differently than they would in everyday life). Random assignment of test subjects to the experimental and control groups is a critical part of any double-blind research design. The key that identifies the subjects and which group they belonged to is kept by a third party, and is not revealed to the researchers until the study is over.
Double-blind methods can be applied to any experimental situation in which there is a possibility that the results will be affected by conscious/unconscious bias on the part of researchers, participants, or both. For example, in animal studies both the carer of the animals and the assessor of the results have to be blinded; otherwise the carer might treat control subjects differently and alter the results.[7]
Computer-controlled experiments are sometimes also erroneously referred to as double-blind experiments, since software may not cause the type of direct bias between researcher and subject. Development of surveys presented to subjects through computers shows that bias can easily be built into the process. Voting systems are also examples where bias can easily be constructed into an apparently simple machine based system. In analogy to the human researcher described above, the part of the software that provides interaction with the human is presented to the subject as the blinded researcher, while the part of the software that defines the key is the third party. An example is the ABX test, where the human subject has to identify an unknown stimulus X as being either A or B.
Triple-blind trials[edit]
A triple-blind study is an extension of the double-blind design; the committee monitoring response variables is not told the identity of the groups. The committee is simply given data for groups A and B. A triple-blind study has the theoretical advantage of allowing the monitoring committee to evaluate the response variable results more objectively. This assumes that appraisal of efficacy and harm, as well as requests for special analyses, may be biased if group identity is known. However, in a trial where the monitoring committee has an ethical responsibility to ensure participant safety, such a design may be counterproductive since in this case monitoring is often guided by the constellation of trends and their directions. In addition, by the time many monitoring committees receive data, often any emergency situation has long passed.[8]
Use[edit]
In medicine[edit]
Double-blinding is relatively easy to achieve in drug studies, by formulating the investigational drug and the control (either a placebo or an established drug) to have identical appearance (color, taste, etc.). Patients are randomly assigned to the control or experimental group and given random numbers by a study coordinator, who also encodes the drugs with matching random numbers. Neither the patients nor the researchers monitoring the outcome know which patient is receiving which treatment, until the study is over and the random code is broken.
Effective blinding can be difficult to achieve where the treatment is notably effective (indeed, studies have been suspended in cases where the tested drug combinations were so effective that it was deemed unethical to continue withholding the findings from the control group, and the general population),[9][10] or where the treatment is very distinctive in taste or has unusual side-effects that allow the researcher and/or the subject to guess which group they were assigned to. It is also difficult to use the double blind method to compare surgical and non-surgical interventions (although sham surgery, involving a simple incision, might be ethically permitted). A good clinical protocol will foresee these potential problems to ensure blinding is as effective as possible. It has also been argued[11] that even in a double-blind experiment, general attitudes of the experimenter such as skepticism or enthusiasm towards the tested procedure can be subconsciously transferred to the test subjects.
Evidence-based medicine practitioners prefer blinded randomised controlled trials (RCTs), where that is a possible experimental design. These are high on the hierarchy of evidence; only a meta analysis of several well designed RCTs is considered more reliable.[citation needed]
In physics[edit]
Modern nuclear physics and particle physics experiments often involve large numbers of data analysts working together to extract quantitative data from complex datasets. In particular, the analysts want to report accurate systematic error estimates for all of their measurements; this is difficult or impossible if one of the errors is observer bias. To remove this bias, the experimenters devise blind analysis techniques, where the experimental result is hidden from the analysts until they've agreed—based on properties of the data set other than the final value—that the analysis techniques are fixed.
One example of a blind analysis occurs in neutrino experiments, like the Sudbury Neutrino Observatory, where the experimenters wish to report the total number N of neutrinos seen. The experimenters have preexisting expectations about what this number should be, and these expectations must not be allowed to bias the analysis. Therefore, the experimenters are allowed to see an unknown fraction f of the dataset. They use these data to understand the backgrounds, signal-detection efficiencies, detector resolutions, etc.. However, since no one knows the "blinding fraction" f, no one has preexisting expectations about the meaningless neutrino count N' = N x f in the visible data; therefore, the analysis does not introduce any bias into the final number N which is reported. Another blinding scheme is used in B meson analyses in experiments like BaBar and CDF; here, the crucial experimental parameter is a correlation between certain particle energies and decay times—which require an extremely complex and painstaking analysis—and particle charge signs, which are fairly trivial to measure. Analysts are allowed to work with all the energy and decay data, but are forbidden from seeing the sign of the charge, and thus are unable to see the correlation (if any). At the end of the experiment, the correct charge signs are revealed; the analysis software is run once (with no subjective human intervention), and the resulting numbers are published. Searches for rare events, like electron neutrinos in MiniBooNE or proton decay in Super-Kamiokande, require a different class of blinding schemes.
The "hidden" part of the experiment—the fraction f for SNO, the charge-sign database for CDF—is usually called the "blindness box". At the end of the analysis period, one is allowed to "unblind the data" and "open the box".
In forensics[edit]
In a police photo lineup, an officer shows a group of photos to a witness or crime victim and asks him or her to pick out the suspect. This is basically a single-blind test of the witness' memory, and may be subject to subtle or overt influence by the officer. There is a growing movement in law enforcement to move to a double blind procedure in which the officer who shows the photos to the witness does not know which photo is of the suspect.[12][13]
References[edit]
- ^ Oxford English Dictionary, 2nd ed.
- ^ a b Holmes, Richard (2009). The Age of Wonder: How the Romantic Generation Discovered the Beauty and Terror of Science. [full citation needed]
- ^ Fétis, François-Joseph (1868). Biographie Universelle des Musiciens et Bibliographie Générale de la Musique, Tome 1 (Second ed.). Paris: Firmin Didot Frères, Fils, et Cie. p. 249. Retrieved 2011-07-21.
- ^ Dubourg, George (1852). The Violin: Some Account of That Leading Instrument and its Most Eminent Professors... (Fourth ed.). London: Robert Cocks and Co. pp. 356–357. Retrieved 2011-07-21.
- ^ Daston, Lorraine (2005). "Scientific Error and the Ethos of Belief". Social Research 72 (1): 18.
- ^ Alder, Ken (2006), "The History of Science, Or, an Oxymoronic Theory of Relativistic Objectivity", in Kramer, Lloyd S.; Maza, Sarah C., A Companion to Western Historical Thought, Blackwell Companions to History (Wiley-Blackwell): 307, ISBN 978-1-4051-4961-7, retrieved 2012-02-11, "Shortly after the start of the Cold War [...] double-blind reviews became the norm for conducting scientific medical research, as well as the means by which peers evaluated scholarship, both in science and in history."
- ^ Aviva Petrie; Paul Watson (28 February 2013). Statistics for Veterinary and Animal Science. Wiley. pp. 130–131. ISBN 978-1-118-56740-1.
- ^ Friedman, L.M., Furberg, C.D., DeMets, D.L. (2010). Fundamentals of Clinical Trials. New York: Springer, pp. 119-132. ISBN 9781441915856
- ^ "Male circumcision 'cuts' HIV risk". BBC News. 2006-12-13. Retrieved 2009-05-18.
- ^ McNeil Jr, Donald G. (2006-12-13). "Circumcision Reduces Risk of AIDS, Study Finds". The New York Times. Retrieved 2009-05-18.
- ^ "Skeptical Comment About Double-Blind Trials". The Journal of Alternative and Complementary Medicine. Retrieved 2010-05-04.
- ^ Psychological sleuths – Accuracy and the accused on apa.org
- ^ Under the Microscope – For more than 90 years, forensic science has been a cornerstone of criminal law. Critics and judges now ask whether it can be trusted.
External links[edit]
- “control group study“ – The Skeptic’s Dictionary – More on why double blind is important.
- PharmaSchool JargonBuster Clinical Trial Terminology Dictionary
|
Clinical research and experimental design
|
|
| Overview |
- Clinical trial
- Trial protocols
- Adaptive clinical trial
- Academic clinical trials
- Clinical study design
|
|
Controlled study
(EBM I to II-1; A to B) |
- Randomized controlled trial (Blind experiment, Open-label trial)
|
|
Observational study
(EBM II-2 to II-3; B to C) |
- Cross-sectional study vs. Longitudinal study, Ecological study
- Cohort study
- Retrospective
- Prospective
- Case-control study (Nested case-control study)
- Case series
- Case study
- Case report
|
|
Epidemiology/
methods |
- occurrence: Incidence (Cumulative incidence)
- Prevalence
- association: absolute (Absolute risk reduction, Attributable risk, Attributable risk percent)
- relative (Relative risk, Odds ratio, Hazard ratio)
- other: End point of clinical trials
- Virulence
- Infectivity
- Mortality rate
- Morbidity
- Case fatality rate
- Specificity and sensitivity
- Likelihood-ratios
- Pre/post-test probability
|
|
| Trial/test types |
- In vitro
- In vivo
- Animal testing
- Animal testing on non-human primates
- First-in-man study
- Multicenter trial
- Seeding trial
- Vaccine trial
|
|
| Analysis of clinical trials |
- Risk–benefit analysis
- Systematic review
- Meta-analysis
|
|
| Interpretation of results |
- Selection bias
- Correlation does not imply causation
- Null result
|
|
- Category
- Glossary
- List of topics
|
|
|
Statistics
|
|
|
Descriptive statistics
|
|
| Continuous data |
| Location |
- Mean (Arithmetic, Geometric, Harmonic)
- Median
- Mode
|
|
| Dispersion |
- Range
- Standard deviation
- Coefficient of variation
- Percentile
- Interquartile range
|
|
| Shape |
- Variance
- Skewness
- Kurtosis
- Moments
- L-moments
|
|
|
| Count data |
|
|
| Summary tables |
- Grouped data
- Frequency distribution
- Contingency table
|
|
| Dependence |
- Pearson product-moment correlation
- Rank correlation (Spearman's rho, Kendall's tau)
- Partial correlation
- Scatter plot
|
|
| Statistical graphics |
- Bar chart
- Biplot
- Box plot
- Control chart
- Correlogram
- Fan chart
- Forest plot
- Histogram
- Pie chart
- Q–Q plot
- Run chart
- Scatter plot
- Stemplot
- Radar chart
|
|
|
|
|
Data collection
|
|
| Designing studies |
- Effect size
- Standard error
- Statistical power
- Sample size determination
|
|
| Survey methodology |
- Sampling
- Stratified sampling
- Opinion poll
- Questionnaire
|
|
| Controlled experiment |
- Design of experiments
- Randomized experiment
- Random assignment
- Replication
- Blocking
- Factorial experiment
- Optimal design
|
|
| Uncontrolled studies |
- Natural experiment
- Quasi-experiment
- Observational study
|
|
|
|
|
Statistical inference
|
|
| Statistical theory |
- Sampling distribution
- Order statistic
- Scan statistic
- Sufficiency
- Completeness
- Exponential family
- Permutation test (Randomization test)
- Empirical distribution
- Bootstrap
- U statistic
- Efficiency
- Asymptotics
- Robustness
|
|
| Frequentist inference |
- Unbiased estimator (Mean unbiased minimum variance, Median unbiased)
- Biased estimators (Maximum likelihood, Method of moments, Minimum distance, Density estimation)
- Confidence interval
- Testing hypotheses
- Power
- Parametric tests (Likelihood-ratio, Wald, Score)
|
|
| Specific tests |
- Z (normal)
- Student's t-test
- F
- Goodness of fit (Chi-squared, G, Sample source, sample normality, Skewness & kurtosis Normality, Model comparison, Model quality)
- Signed-rank (1-sample, 2-sample, 1-way anova)
- Shapiro–Wilk
- Kolmogorov–Smirnov
|
|
| Bayesian inference |
- Bayesian probability
- Prior
- Posterior
- Credible interval
- Bayes factor
- Bayesian estimator
- Maximum posterior estimator
|
|
|
|
|
Correlation and regression analysis
|
|
| Correlation |
- Pearson product–moment correlation
- Partial correlation
- Confounding variable
- Coefficient of determination
|
|
| Regression analysis |
- Errors and residuals
- Regression model validation
- Mixed effects models
- Simultaneous equations models
- MARS
|
|
| Linear regression |
- Simple linear regression
- Ordinary least squares
- General linear model
- Bayesian regression
|
|
| Non-standard predictors |
- Nonlinear regression
- Nonparametric
- Semiparametric
- Isotonic
- Robust
- Heteroscedasticity
- Homoscedasticity
|
|
| Generalized linear model |
- Exponential families
- Logistic (Bernoulli)
- Binomial
- Poisson
|
|
| Partition of variance |
- Analysis of variance (ANOVA)
- Analysis of covariance
- Multivariate ANOVA
- Degrees of freedom
|
|
|
|
|
Categorical, multivariate, time-series, or survival analysis
|
|
| Categorical data |
- Cohen's kappa
- Contingency table
- Graphical model
- Log-linear model
- McNemar's test
|
|
| Multivariate statistics |
- Multivariate regression
- Principal components
- Factor analysis
- Cluster analysis
- Classification
- Copulas
|
|
| Time series analysis |
| General |
- Decomposition
- Trend
- Stationarity
- Seasonal adjustment
- Exponential smoothing
- Cointegration
|
|
| Specific tests |
- Granger causality
- Q-Statistic
- Durbin–Watson
|
|
| Time domain |
- ACF
- PACF
- XCF
- ARMA model
- ARIMA model
- ARCH
- Vector autoregression
|
|
| Frequency domain |
- Spectral density estimation
- Fourier analysis
|
|
|
| Survival analysis |
- Survival function
- Kaplan–Meier
- Logrank test
- Failure rate
- Proportional hazards models
- Accelerated failure time model
|
|
|
|
|
Applications
|
|
| Biostatistics |
- Bioinformatics
- Clinical trials & studies
- Epidemiology
- Medical statistics
|
|
| Engineering statistics |
- Chemometrics
- Methods engineering
- Probabilistic design
- Process & Quality control
- Reliability
- System identification
|
|
| Social statistics |
- Actuarial science
- Census
- Crime statistics
- Demography
- Econometrics
- National accounts
- Official statistics
- Population
- Psychometrics
|
|
| Spatial statistics |
- Cartography
- Environmental statistics
- Geographic information system
- Geostatistics
- Kriging
|
|
|
|
- Category
- Portal
- Outline
- Index
|
|
|
Design of experiments
|
|
Scientific
Method |
- Scientific experiment
- Statistical design
- Control
- Internal & external validity
- Experimental unit
- Blinding
- Optimal design: Bayesian
- Random assignment
- Randomization
- Restricted randomization
- Replication versus subsampling
- Sample size
|
|
Treatment
& Blocking |
- Treatment
- Effect size
- Contrast
- Interaction
- Confounding
- Orthogonality
- Blocking
- Covariate
- Nuisance variable
|
|
Models
& Inference |
- Linear regression
- Ordinary least squares
- Bayesian
- Random effect
- Mixed model
- Hierarchical model: Bayesian
- Analysis of variance (Anova)
- Cochran's theorem
- Manova (multivariate)
- Ancova (covariance)
- Compare means
- Multiple comparison
|
|
Designs:
Completely
Randomized |
- Factorial
- Fractional factorial
- Plackett-Burman
- Taguchi
- Response surface methodology
- Polynomial & rational modeling
- Box-Behnken
- Central composite
- Block
- Generalized randomized block design (GRBD)
- Latin square
- Graeco-Latin square
- Orthogonal array
- Latin hypercube
Repeated measures design
- Crossover study
- Randomized controlled trial
- Sequential analysis
- Sequential probability ratio test
|
|
- Glossary
- Category
- Statistics portal
- Statistical outline
- Statistical topics
|
|
