Qualitative Transparency Deliberations

Dear Colleagues, As a way of prompting some conversation about transparency in automated text analysis, we're inviting responses to a recent, brief essay by David Romney, Brandon Stewart, and Dustin Tingley that lays out some general transparency principles for this set of methods. The essay can be ...

What are the implications of “the right of first use” for the pursuit of transparency? - Data access and “right to first use” of newly collected quantitative data Join the conversation by responding to any of these threads or by creating a new topic to raise an issue we haven’t gotten to yet by cli...

What should be QTD working group foci? - Re: Are qualitative researchers held to a higher standard? - How should the QTD Working Groups be defined? Join the conversation by responding to any of these threads or by creating a new topic to raise an issue we haven’t gotten to yet by clicking "New...

What role does transparency play in the evaluation of research? What alternative criteria or tools of evaluation do/should scholars employ? - What is openness/transparency/explicitness in violence/contentious politics research? - Do no harm Join the conversation by responding to any of these thread...

How should the QTD Working Groups be defined?
-How should QTD Working Groups be defined?

Join the conversation by responding to any of these threads or by creating a new topic to raise an issue we haven’t gotten to yet by clicking "New Topic"!

Thank you, Pepper, Nikhar, and Guest for these excellent suggestions. We've also received comments on the Working Group structure in a couple of other threads:

a working group with journal editors

Transparency in APD Research

Thanks to all who have been contributing to this very interesting exchange. It is clear that there is considerable discomfort with the idea of uniform, rigid editorial transparency rules being applied to the assessment of qualitative journal submissions. Some, like Michael Coppedge (above), have als...

Many thanks to all those who have been contributing to this agenda-setting discussion, and to those who will do so in the days to come. At the beginning of next week, the QTD process begins the transition to Stage 2, in which specialized Working Groups will consult and deliberate about the meaning a...

What are the benefits of research transparency in general? (See here for discussion of benefits of data access in particular.) - Graduate Student concerns - Doing the thing right and doing the right thing - Against “requirements” Join the conversation by responding to any of these threads or by cre...

You can more easily follow a discussion by having the QTD system email you when someone replies within a topic. Here's how to do this: - If you are writing a post within a topic and want to be notified of replies, check the box "Notify me when a reply is posted" below your post. Then in th...

How might DA-RT affect public perceptions of political science? - DA-RT will not raise or restore public trust in our discipline - DA-RT will cause contempt for the political science profession among political professionals Join the conversation by responding to any of these threads or by creating ...

What are the implications of transparency rules for graduate training? - DA-RT: effect on graduate training - Graduate Student concerns - Re: No place for my work in this debate - Re: [From Steering Comm.] Inviting input on specific transparency practices - Re: Against “requirements” Join the conve...

Who should judge whether research is sufficiently transparent? Should we have transparency rules? Organically evolving norms? Acknowledged best practices? - Who are the gatekeepers? Editors or reviewers? - Re: Data access – human subjects protections - Re: Are qualitative researchers held to a high...

What do we think of journals’ current transparency policies? - Journal standards in practice - Re: DA-RT: effect on graduate training - Re: [From Steering Comm.] Inviting input on specific transparency practices - Re: [From Steering Comm.] Inviting input on specific transparency practices - AJPS ba...

What does analytic transparency look like in qualitative research? - Access to the broader evidentiary record in Congruence Analysis - Re: "Truth" or DARE: Let's Replace "Transparency" with "Explicitness" - Preregistration (or lack thereof) Join the conversation by res...

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • How central are “data” to qualitative political analysis? What counts as data? - Data access – what is data and who decides? - DA-RT Approach Misses Important Aspects of Qualitative Research ...

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • How could data access rules affect researchers’ incentives or ability to undertake certain kinds of research? - Data access – discourage original data production? - Very Undesirable Unintende...

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • How beneficial is greater sharing of qualitative data? Some have argued that the benefits of greater sharing of qualitative data are limited... - A pointless DA-RT - Data access – costs and i...

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • What are the costs of and obstacles to data-sharing, and how might these differently affect scholars employing different methods or working at different kinds of institutions or at different ...

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • What does data-sharing concretely mean? - Very Undesirable Unintended Consequences - Are qualitative researchers held to a higher standard? - What might qualitative data access look like? - I...

What ethical and human-subject protection issues confront the pursuit of transparency? - Data access – discourage original data production? - Association for the Study of Nationalities (ASN) on DA-RT - Beyond the qual/qant divide - Do no harm - Data access – human subjects protections - Research in...

What do we mean by “transparency” anyway? What about forms of transparency beyond the DA-RT framework, such as being explicit about how research design choices were made or about positionality? - “Truth” or DARE: Let’s Replace “Transparency” with “Explicitness” - CP Newsletter: editorial or ideolog...

What transparency practices are of value? - Inviting input on specific transparency practices - Resource: Oral History Principles and Best Practices - What are the implications of transparency rules for graduate training? - A Brighter Side to Data Dissemination - Active citation versus the meaty fo...

What does the pursuit of transparency mean for specific research approaches? • Ethnography : See Steering Committee query here - Data Access – Discourage Original Data Production? - Transparency, openness, & ethnography in democratic contexts - Harms in study of identity, and forgotten agency -...

If you’re just arriving at the site, here’s a map to some of the issues that we’ve been discussing so far (as of 5/11). Click on a question below to see a set of links on the topic. Join the conversation by responding to any of these threads or by creating a new topic to raise an issue we haven’t go...

Thanks, Rick Vallely, for putting implications for APD scholarship on the agenda. I'd be interested in hearing more from APD scholars about a.) what specific transparency practices are common, feasible, or of value for the kinds of analysis and evidence typically employed in the study of political d...

Thank you, Sean Yom. This is an interesting set of points about what I would think of as transparency in the broadest sense. I agree that it is rare to see, and important. In another thread, Margaret Keck and I discuss how she pursues transparency of this sort in her book, Practical Authority.

Many thanks to the several anonymous contributors for the above comments. In my mind, these comments provoke a few questions: One interesting question suggested by one of the posts above is about the role of peer reviewers, as opposed to editors or editorial rules, in the pursuit of transparency. Th...

Thank you, Milli Lake, for this extremely rich and thoughtful set of comments. The principle of "do no harm" must surely be a non-negotiable ethical bedrock of all of our research practices; and your post very helpfully elaborates some of its implications in contexts of political violence,...

Thank you, Karen Alter, for these very useful comments on the costliness of a form of data-sharing. It's especially helpful to have this level of concrete detail from someone who has engaged in extensive data-sharing practices. It would be great to hear from others who have had experience with provi...

This "Deliberative Process" forum is intended for discussion of process through which the transparency deliberations will be carried out in the coming months. Please see here for an outline of the plan approved by a vote of the QMMR section membership. For questions about or problems with ...

Over in a thread begun by Gary Marks, an interesting discussion has started about the nature of qualitative data access. To briefly frame the issue: There seem to be a number of different understandings of how qualitative scholars might make the evidence underlying their claims more accessible. One ...

Thanks for this comment and query, Hillel. We are extremely keen to generate the kind of diversity of perspectives that you're asking for. This is critical to making this a successful consultative, agenda-setting process. We are doing all we can think of to raise the visibility of this process acros...

Thank you, Sheena Greitens, for raising this important issue, and to the anonymous contributor for this further perspective. It is interesting to hear that it is uncertainty about expectations that seems to be a deterrent. As I've noted in another post , many journal transparency policies (as posted...

Thanks very much for this comment, Hillel. It would indeed be helpful to hear what people think of those journal policies that are currently in place. Judging by their online author guidelines, many policies of JETS journals remain rather general or appear to still be under development. Some indicat...

Hi Mala, I believe it is possible to do this. When you're reading a topic/thread, go to the gear icon, and then choose "Subscribe to this post." Then in the upper righthand corner of your screen, go to "Notifications" and then click on "Settings." There's a setting to b...

Thank you very much for your comments, Margaret. You write in your post of a disconnect between the DA-RT framework and your work. When I read this, I immediately thought about how transparent I find your work. One particular way in which your work is unusually open – I am thinking here of your rece...

Many thanks to those who have already contributed to the conversation and put a number of very important issues and questions on the table. Here's one area in which we would like to invite some additional input: What are some specific transparency practices and tools that you think are of value, and...

Search found 38 matches