Qualitative Transparency Deliberations

... and to read the summary, please click here:

I-3_PowerInstitutionalization_summary_2019-05-30.pdf: (82.75 KiB) Downloaded 2402 times

Please use this thread to provide feedback on our working group's draft final report and/or the summary of the report.
Thank you!

Rachel Riedl, Ekrem Karakoc, and Tim Büthe

To view the draft final report of the Working Group on Power and Institutions, please click here:

I-3_PowerInstitutionalizationFinalReport_draft_2019-05-13.pdf: (234.57 KiB) Downloaded 6060 times

What published content-analytic work do you consider to be exemplary with respect to its research transparency? What makes it exemplary?

For the kind of content analytic-work you "produce" or "consume," what is the information about research methods and decisions, which you find most helpful to allow you to understand and assess the research? In other words, what kind of research transparency about content-analyti...

To the anonymous poster tho pointed out the chapter by A. Lutnick: Thank you for providing a specific, useful example; that's greatly appreciated. It would be even more helpful if you elaborated in a couple of sentences on the practices used by this author to enhance the interpretability, evaluabili...

In this thread, we especially invite discussion of how various forms of "explicitness" about one's sources, analytical approach(es), and methods interact with power and resource differentials between scholars. Do you have reason to believe (maybe based on your own experiences) to suggest c...

Fair enough; thanks for pointing this out. My statement about the lack of a governance structure was based on the possibly erroneous assumption that the lack of an explicit statement about a mechanism or procedure for amendments or revisions in the JETS statement (and the accompanying documents) had...

Thank you, Paolo. These are very constructive suggestions. I particularly like the one regarding the use of hyperlinks that would not just lead to primary sources or other documents but allow elaboration and background information beyond the word limit. This could be a very useful alternative to exp...

Thank you, Sean, Paolo and Mala, for your thoughtful posts on this issue. Note that we *did* have at least one previous post about pre-registration, though the title of the thread ("on the tip of the iceberg") might not have made it apparent. See the post here: https://www.qualtd.net/viewt...

Thank you to all the contributors on the thread. Allow me to re-direct the discussion a bit to solicit input from the many scholars of comparative politics who clearly have been following this thread, in order to solicit your input regarding the key issues with which the steering committee will need...

Allow me to temporarily re-direct the discussion on this widely read thread a bit to solicit input from scholars experienced in (or aspiring to undertake) fieldwork concerning the key issues with which the steering committee will need to grapple in the next few days when we try to decide how to defi...

Thank you to John, Mala, and Jonathan, for your contributions to this thread. I appears that you all agree (as do probably many others) that we do not want to reify the qualitative-quantitative divide--and that there are numerous different kinds of "qualitative" scholarship. Next week, we ...

Thank you for your post, Michael. I read Kurt Weyland's post as registering opposition to JETS-type requirements imposed by journal editors as prerequisites for publication. Your post appears to be a much more sweeping rejection of the entire QTD project. That's of course fine--and indeed it's impor...

Next week, we will start to move from the at-large deliberations of stage 1 of the QTD to stage 2. During stage 2, all of these threads remain available, but the deliberations are supposed to continue, primarily, in 12-15 separate working groups, so as to allow more differentiated discussions of res...

Thank you, Elliot, for this very useful addition to an already very insightful (and widely read) thread. One response to concerns that qualitative scholarship is held to a higher standard might be to raise the standard for everyone: I'd argue that research employing quantitative/statistical methods ...

Thank you, Daragh, Erica, and Catherine, for your posts. Some of the issues you raise have actually been addressed in the January 2014 symposium in PS, where both Arthur Lupia and Colin Elman in their introduction and Colin Elman and Diana Kapiszewski in their article on "Data Access and Resear...

Thank you all for your very helpful, detailed posts. Let me also strongly encourage everyone, but especially those of you who are tenured, to post "on the record" (i.e., logged in). It is very helpful for the Steering Committee (and maybe for others, but I can't speak for them) to get a se...

Thank you, Rick, for starting this thread focused on APD (American Political Development) scholarship. As we prepare to start moving from the at-large deliberations of stage 1 to stage 2, where deliberations are supposed to continue, primarily, in 12-15 working group so as to allow more differentiat...

Thank you, Aili, for starting a very important thread and writing such an informative post with reference to a specific context and with concrete examples. And thank you to the anonymous poster who noted an additional concern, as well as to those who have weighed in to confirm that you share Aili's ...

Thank you; this is helpful and the elaboration much appreciated!

An anonymous post to this thread recommended a particular platform as "an interesting option for opt-in dataverse" with no information as to why this product was being recommended. We will be happy to see suggestions of particular tools for specific transparency goals or practices, but to ...

Thank you, Guest #1 (May 4 post at 10:56am) for providing concrete, specific illustrations of why and how the ability to safeguard the anonymity of interview subjects and other interlocutors is important in some contexts--even when it might not be required by the researcher's IRB, i.e. the human sub...

Thank you; much appreciated. I look forward to seeing future posts from you and your colleagues.

Thank you for sharing these concerns and reflections, James. Very much appreciated. On behalf of the Steering Committee, let me also encourage you and other graduate students to go beyond responding to DA-RT and think of the deliberations on these pages as an opportunity to participate in shaping ou...

Thank you for your post, Sean. The question of how much our readers are interested in the "sausage-making," i.e., the research process rather than just the research product (and how much we as scholarly authors are interested in conveying information about that process) is certainly an int...

Thank you, Michelle. These are all good and important points. (Let me add that, including a request for permission to create and share full transcripts publicly can very significantly change the nature of the conversation and for some kinds of research undermine the entire purpose of having or obser...

Thank you, Michelle. This is very helpful; both points. On the first point, about transcribing interviews: While there are surely many circumstances (and types of research) where providing a complete, transcribed archive of interviews from a research project is (or would be) tremendously valuable fo...

Thank you, William. But don't most journals already put appendices online instead of printing them, including in security studies? Doesn't your or my ability to challenge "the sources" of published research (as you advise we should be able to do) require that authors disclose their sources...

Thank you Aisha for this very thoughtful post, which is exemplary in identifying numerous specific issues that require more thought in our discipline's discussion of research transparency. I would like to invite others (both in security studies and beyond) to weigh in, particularly concerning the qu...

Thank you, Donald and Guest, for your posts--which reinforces some of the points in the great thread started by Gary Marks about whether qualitative research is held to a higher standard. In our introduction and conclusion to the symposium in QMMR, Alan Jacobs and I argued that almost all of the sam...

Thank you Sheena, Kurt, and Guest, for your posts. On behalf of the Steering Committee, let me first of all express our appreciation for these posts and encourage more posts that endorse (or register disagreement) with previous posts. Even if posts contain no further information, they are very helpf...

Qualitative Transparency Deliberations

Cluster I: Fundamentals

Cluster II: Forms of Evidence

Cluster III: Analytic Approaches and Methodologies

Cluster IV: Research Settings/Topics

Stage One

Search found 32 matches

Re: Draft Report of Working Group I.3

Comments on the Draft Report and Summary

Draft Report of Working Group I.3

Exemplary research transparency in content-analytic work

Transparency needs and best practices for content-analytic research

Re: any examples?

Power and the Institutionalization of Research Transparency/Openness/Explicitness

Re: a working group with journal editors

Re: a working group with journal editors

Re: Preregistration (or lack thereof)

Re: CP newsletter: editorial or ideology?

Re: Just back from fieldwork

Re: Beyond the qual/quant divide

Re: Against "requirements"

Re: Transparency in Security Studies

Re: Are qualitative researchers held to a higher standard?

Re: A pointless DA-RT

Re: Transparency, openness, & ethnography in democratic contexts

Re: Transparency in APD Research

Re: research in non-democratic countries

Re: [From Steering Comm.] Inviting input on specific transparency practices

Re: [From Steering Comm.] Inviting input on specific transparency practices

Re: Just back from fieldwork

Re: Graduate Student concerns

Re: Graduate Student concerns

Re: No place for my work in this debate

Re: Against "requirements"

Re: Against "requirements"

Re: Security Research and DA-RT

Transparency in Security Studies

Re: Very Undesirable Unintended Consequences

Re: Against "requirements"