To participate, you may either post a contribution to an existing discussion by selecting the thread for that topic (and then click on "Post Reply") or start a new thread by clicking on "New Topic" below.
The transition to Stage 2 of the deliberations is currently underway but will take some time to complete. In the meantime, we very much welcome additional contributions to the existing threads in this forum.
For instructions on how to follow a discussion thread by email, click here.
University of Wisconsin-Madison
- Posts: 5
- Joined: Wed Apr 13, 2016 7:26 am
But I fear that guidelines that treat all types of research the same, without distinguishing specific challenges inherent within them, will further privilege those who do quantitative research and will seriously disadvantage 1) comparativists; 2) researchers who work in non-democratic contexts; and 3) researchers who do qualitative fieldwork. They will serve as a disincentive to junior scholars to pursue qualitative research projects, especially in those parts of the world we understand the least, precisely because they are difficult to work in. While it is important to do quantitative analyses, they are insufficient to being able to understand complex processes and dynamics in a country or countries.
I have been recently working in southern Morocco (also known as Western Sahara), which is an extremely politically sensitive place to be working. But it is also one of the most fascinating places I have ever conducted research. Looking at the guidelines, I am now wondering if my research can ever be published in a major political science journal.
There seem to be protections for people who work in authoritarian contexts in the guidelines, but when editors actually see the kinds of restrictions the Human Subjects committees place on us, I wonder how much flexibility there will be in practice. I worry not so much about the guidelines and more about how aware those implementing them will be of the ethical considerations in and challenges of doing research in non-democratic contexts.
Even interviews that are not particularly sensitive can be barred from being revealed publicly and must be destroyed after a certain amount of time to meet IRB requirements, especially if one is working in a non-democratic context. The people who serve on the IRB committees also don’t always fully understand the research context and place restrictions based on their own limited knowledge of a country. The DA-RT guidelines refer to such situations as being an exception, but as IRB restrictions and requirements expand, I wonder how exceptional these cases are going to be. I worry that in actually implementing these guidelines, many of us are going to find ourselves caught between a rock and a hard place.
But even if there are no onerous IRB restrictions, do people who are interviewed really want their interviews made public? Will they have a say in any of this? If they know the interviews are going to be made public, how will this affect interviewees’ willingness to be fully open and honest even if the interviews aren’t associated with a name or affiliation? Often the content of the interview will reveal who the person is to those who know the context especially for those of us who do elite interviews. Won’t that erode trust and confidentiality in the interviewer? I study women and politics and women’s movements in Africa and I can’t imagine people would want some of the things they say publicly attributed to them or their organization or even to the women’s movement and its opponents. They don’t want their strategies, jealousies, frustrations or weaknesses revealed to their competitors, opponents, or people they are lobbying. The same is true for those who oppose the women’s organizations. If you have ever been interviewed by someone else you will know exactly what I mean, even if you have nothing in particular to hide.
I have interviewed people in contexts of war, where people do nasty things to each other. In the course of interviewing, people have confided in me about other politicians who tried to kill them or succeeded in killing their loved ones, admissions of stealing, of being raped, of having affairs with key leaders, of sabotaging industrial production to increase prices, and so on. Most of these specific comments should never be made public in any form, in part, because they are potentially libelous. But one might want to write generally about a certain related phenomenon based on such comments. How would one provide evidence without providing actual texts of interviews that people who made the statements never dreamed would be made public?
I have no idea how the replication part would work for qualitative research. It is already hard enough to conduct research in many parts of the world. I am working in North Africa at present and just to carry out research in what is a politically challenging environment to say the least, I had to learn not one but three languages (all of which are used on a daily basis), obtain funding, find a research affiliation, get research clearance and dozens of other complicated permissions, apply for writeup funding, line up research assistants, negotiate my personal life and a leave from my department, take care of complicated logistics in a country where all the systems are unfamiliar and sometimes unpredictable, go through an onerous IRB process, and establish a wide network of contacts. Anyone who wants to replicate this to check that my interviewees said what they said, you are more than welcome to do so.
I am concerned that the benefits of these new requirements do not outweigh the transaction costs of meeting them in challenging research environments and in some key parts of the discipline. They run the risk of creating serious ethical dilemmas and force researchers to violate IRB requirements if they comply. It would be good if APSA and the journals would give more consideration to how the DA-RT initiative will affect the whole field and find other ways to ensure greater rigor without making research and publication impossible for important sections of the field.
Aili Mari Tripp
Department of Political Science and Gender & Women’s Studies
University of Wisconsin-Madison
- Posts: 31
- Joined: Fri Feb 26, 2016 11:39 pm
I also greatly appreciate the point Aili raised about the need to think about costs, benefits, and tradeoffs differentially, e.g. for different research context, different analytical approaches, and different ontological and epistemological stances--and to articulate best practices, if there is a sense of such best practices among those who actually engage in (or are seeking to engage in) particular kinds of QMMR research. This is precisely what motivated the proposal for these deliberations at the QMMR business meeting at APSA 2015 (and the symposium that Alan Jacobs and I edited for QMMR).
For preparing the shift from the first to the second stage of the deliberations (which are in stage 2 supposed to take place in differentiated working groups), it would be extremely helpful to have all of you--and others--weigh in again to let us know: Is research in non-democratic countries/regimes sufficiently distinctive to warrant a separate working group? Or should it be combined with deliberations concerning other specific research contexts (keeping in mind that all of ultimately only have a limited bandwidth and that we therefore should avoid having a larger number of working groups than really necessary)? If you'd like to see this research context (as the defining feature of one differentiated working group) combined with others: Which other context do you consider sufficiently similar?
And if you'd like to already weigh in on what I trust we'll discuss at greater length during stage 2: Aili made the important point that she is in principle strongly supportive of "show[ing] how one’s conclusions are backed up by strong evidence." It would be really great to hear from as many political scientists as possible with research experience in non-democratic contexts: How might this objective be achieved without violating IRB rules or broader ethical commitments and obligations? What do you do yourself? What have you seen others do that you think works well in these (or other differentially identifiable research context)?
City University of New York
- Posts: 1
- Joined: Wed May 18, 2016 10:56 am