Liebe Kolleg*innen in der DGS-Methodensektion,
wir geben gemeinsam ein Special Issue der Zeitschrift Survey Research Methods heraus und möchten Euch und Sie hiermit auf den Call for Papers aufmerksam machen und herzlich einladen, etwas beizutragen, wenn Ihr und Sie zu oder mit Survey-Experimenten forscht. Der Titel des Calls ist zwar lediglich "Learning Through Failures", das Special Issue dreht sich aber in erster Linie um alle Arten von Survey Experiments, wie diese schiefgehen oder anders als geplant verlaufen können, was das bedeutet und wie man damit angemessen umgeht. Der ganze CfP ist unten im PS sowie auf der folgenden Website zu lesen: https://ojs.ub.uni-konstanz.de/srm/article/view/8385/7324
Viele Grüße Sebastian (Wenz) & Lena (Hipp)
PS:
SRM Special Issue: Learning Through Failures Editors
* Lena Hipp (WZB - Berlin Social Science Center and University of Potsdam) * Sebastian E. Wenz (GESIS - Leibniz Institute for the Social Sciences)
Time line
* December 15, 2024, submission of full manuscripts * January - July 2025, peer review and revisions of manuscript * Spring 2026, estimated publication of Special Issue
Description
In recent years, social scientists have increasingly relied on survey experiments to estimate causal effects. As with any experimental design, survey experiments can fail, deviate from (preregistered) plans, or yield results that researchers did not anticipate. Researchers find themselves in situations with null, unexpected, inconsistent, or inconclusive results and must then decide whether results reflect on the theory being tested, the experimental design, or both. Usually, the insights gained from such failures are not widely shared, even though they could be very useful to improve the design of experiments, quality of research, and transparency.
The planned special issue for Survey Research Methods is dedicated to learning from survey experiments that failed or led to unexpected results. Sharing the design and results from failed survey experiments, carefully considering their possible flaws, and talking about unexpected findings is useful to the development of theory (e.g., identifying scope conditions) and methods, and contributes to transparent research practice.
Reasons for survey experiments to fail might include poor treatment assignment or ineffective manipulations, unreliable or invalid measurements, underdeveloped theory or hypotheses, and underpowered designs. The overall goal of the special issue is to share insights about the causes and consequences of failures in survey experiments, so that others can learn how to avoid these failures and general recommendations for survey experimental methodology can be derived.
We invite submissions of short papers, essays, comments (of up to 3.000 words), and full-length articles (of up to 8.000 words) for this special issue, including case studies of failed survey experiments, meta-analyses, systematic reviews, as well as theoretical, methodological, and statistical contributions that may or may not rely on empirical data, simulated data, or no data at all. Possible research questions we invite authors to address in their submissions include but are certainly not limited to the following:
* What exactly should we consider to be a "failed" survey experiment? * When, if at all, should we consider an experiment "failed" due to certain findings - e.g., null findings, findings that contradict theoretical predictions, or are otherwise unexpected? * Which problems during the field phase or implementation of a survey experiment constitute "failures"? * When and why do survey experiments fail to replicate findings from other survey experiments, field experiments, and laboratory experiments? * How should researchers appropriately handle or respond to "failed" survey experiments? * Which issues arise in pre-registered survey experiments regarding potential failures and how to deal with such failures?
Policies
To submit, go to the SRM websitehttps://ojs.ub.uni-konstanz.de/srm/ and upload the article as a PDF, just like a standard SRM article; be sure to mention the special issue in the field for Author comments. In addition to the general Author Guidelineshttps://ojs.ub.uni-konstanz.de/srm/about/submissions#authorGuidelines a maximum of one table is allowed per article (there are, however, no additional restrictions on the number of figures and graphs for the special issue).
Reviewing policies follow the common standards of SRM: Each submitted paper will be assigned to one of the two editors of the special issue. This supervising editor will then select two expert reviewers. The reviews and the reading of the supervising editor will be used for the final decision.
-- Dr. Sebastian E. Wenz
Senior Researcher GESIS - Leibniz Institute for the Social Sciences
Phone: +49 221-47694-159 www.gesis.org/traininghttp://www.gesis.org/training