Search found 38 matches

by AlanJacobs
Mon Dec 19, 2016 3:58 am
Forum: III.4. Algorithmic analytic approaches
Topic: Automated text analysis: your reactions to these transparency guidelines?
Replies: 0
Views: 30864

Automated text analysis: your reactions to these transparency guidelines?

Dear Colleagues, As a way of prompting some conversation about transparency in automated text analysis, we're inviting responses to a recent, brief essay by David Romney, Brandon Stewart, and Dustin Tingley that lays out some general transparency principles for this set of methods. The essay can be ...
by AlanJacobs
Fri Aug 19, 2016 6:16 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far (Updated 5/11)

What are the implications of “the right of first use” for the pursuit of transparency? - Data access and “right to first use” of newly collected quantitative data Join the conversation by responding to any of these threads or by creating a new topic to raise an issue we haven’t gotten to yet by cli...
by AlanJacobs
Fri Aug 19, 2016 5:29 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far (Updated 5/11)

What should be QTD working group foci? - Re: Are qualitative researchers held to a higher standard? - How should the QTD Working Groups be defined? Join the conversation by responding to any of these threads or by creating a new topic to raise an issue we haven’t gotten to yet by clicking "New...
by AlanJacobs
Fri Aug 19, 2016 5:05 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far (Updated 5/11)

What role does transparency play in the evaluation of research? What alternative criteria or tools of evaluation do/should scholars employ? - What is openness/transparency/explicitness in violence/contentious politics research? - Do no harm Join the conversation by responding to any of these thread...
by AlanJacobs
Fri Aug 19, 2016 3:59 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far (Updated 5/11)

How should the QTD Working Groups be defined?
-How should QTD Working Groups be defined?


Join the conversation by responding to any of these threads or by creating a new topic to raise an issue we haven’t gotten to yet by clicking "New Topic"!
by AlanJacobs
Wed May 25, 2016 11:50 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [From Steering Committee] How should the QTD Working Groups be defined?
Replies: 4
Views: 20764

Re: [From Steering Committee] How should the QTD Working Groups be defined?

Thank you, Pepper, Nikhar, and Guest for these excellent suggestions. We've also received comments on the Working Group structure in a couple of other threads:

a working group with journal editors

Transparency in APD Research
by AlanJacobs
Sun May 22, 2016 4:07 pm
Forum: Substantive Dimensions of the Deliberations
Topic: Against "requirements"
Replies: 22
Views: 54046

Re: Against "requirements"

Thanks to all who have been contributing to this very interesting exchange. It is clear that there is considerable discomfort with the idea of uniform, rigid editorial transparency rules being applied to the assessment of qualitative journal submissions. Some, like Michael Coppedge (above), have als...
by AlanJacobs
Thu May 19, 2016 11:52 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [From Steering Committee] How should the QTD Working Groups be defined?
Replies: 4
Views: 20764

[From Steering Committee] How should the QTD Working Groups be defined?

Many thanks to all those who have been contributing to this agenda-setting discussion, and to those who will do so in the days to come. At the beginning of next week, the QTD process begins the transition to Stage 2, in which specialized Working Groups will consult and deliberate about the meaning a...
by AlanJacobs
Fri May 13, 2016 7:48 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

What are the benefits of research transparency in general? (See here for discussion of benefits of data access in particular.) - Graduate Student concerns - Doing the thing right and doing the right thing - Against “requirements” Join the conversation by responding to any of these threads or by cre...
by AlanJacobs
Thu May 12, 2016 2:17 pm
Forum: Substantive Dimensions of the Deliberations
Topic: HOW TO: Follow a topic discussion by email
Replies: 0
Views: 43639

HOW TO: Follow a topic discussion by email

You can more easily follow a discussion by having the QTD system email you when someone replies within a topic. Here's how to do this: - If you are writing a post within a topic and want to be notified of replies, check the box "Notify me when a reply is posted" below your post. Then in th...
by AlanJacobs
Sun May 01, 2016 3:34 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

How might DA-RT affect public perceptions of political science? - DA-RT will not raise or restore public trust in our discipline - DA-RT will cause contempt for the political science profession among political professionals Join the conversation by responding to any of these threads or by creating ...
by AlanJacobs
Sun May 01, 2016 3:33 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

What are the implications of transparency rules for graduate training? - DA-RT: effect on graduate training - Graduate Student concerns - Re: No place for my work in this debate - Re: [From Steering Comm.] Inviting input on specific transparency practices - Re: Against “requirements” Join the conve...
by AlanJacobs
Sun May 01, 2016 3:33 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

Who should judge whether research is sufficiently transparent? Should we have transparency rules? Organically evolving norms? Acknowledged best practices? - Who are the gatekeepers? Editors or reviewers? - Re: Data access – human subjects protections - Re: Are qualitative researchers held to a high...
by AlanJacobs
Sun May 01, 2016 3:33 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

What do we think of journals’ current transparency policies? - Journal standards in practice - Re: DA-RT: effect on graduate training - Re: [From Steering Comm.] Inviting input on specific transparency practices - Re: [From Steering Comm.] Inviting input on specific transparency practices - AJPS ba...
by AlanJacobs
Sun May 01, 2016 3:32 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

What does analytic transparency look like in qualitative research? - Access to the broader evidentiary record in Congruence Analysis - Re: "Truth" or DARE: Let's Replace "Transparency" with "Explicitness" - Preregistration (or lack thereof) Join the conversation by res...
by AlanJacobs
Sun May 01, 2016 3:25 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • How central are “data” to qualitative political analysis? What counts as data? - Data access – what is data and who decides? - DA-RT Approach Misses Important Aspects of Qualitative Research ...
by AlanJacobs
Sun May 01, 2016 3:24 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • How could data access rules affect researchers’ incentives or ability to undertake certain kinds of research? - Data access – discourage original data production? - Very Undesirable Unintende...
by AlanJacobs
Sun May 01, 2016 3:23 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • How beneficial is greater sharing of qualitative data? Some have argued that the benefits of greater sharing of qualitative data are limited... - A pointless DA-RT - Data access – costs and i...
by AlanJacobs
Sun May 01, 2016 3:12 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • What are the costs of and obstacles to data-sharing, and how might these differently affect scholars employing different methods or working at different kinds of institutions or at different ...
by AlanJacobs
Sun May 01, 2016 2:17 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

There’s been extensive discussion of data-sharing rules and their implications, around questions such as: • What does data-sharing concretely mean? - Very Undesirable Unintended Consequences - Are qualitative researchers held to a higher standard? - What might qualitative data access look like? - I...
by AlanJacobs
Sun May 01, 2016 2:06 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

What ethical and human-subject protection issues confront the pursuit of transparency? - Data access – discourage original data production? - Association for the Study of Nationalities (ASN) on DA-RT - Beyond the qual/qant divide - Do no harm - Data access – human subjects protections - Research in...
by AlanJacobs
Sun May 01, 2016 2:03 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

What do we mean by “transparency” anyway? What about forms of transparency beyond the DA-RT framework, such as being explicit about how research design choices were made or about positionality? - “Truth” or DARE: Let’s Replace “Transparency” with “Explicitness” - CP Newsletter: editorial or ideolog...
by AlanJacobs
Sun May 01, 2016 2:01 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

What transparency practices are of value? - Inviting input on specific transparency practices - Resource: Oral History Principles and Best Practices - What are the implications of transparency rules for graduate training? - A Brighter Side to Data Dissemination - Active citation versus the meaty fo...
by AlanJacobs
Sun May 01, 2016 1:45 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

Re: [READ FIRST] What we've been talking about so far

What does the pursuit of transparency mean for specific research approaches? • Ethnography : See Steering Committee query here - Data Access – Discourage Original Data Production? - Transparency, openness, & ethnography in democratic contexts - Harms in study of identity, and forgotten agency -...
by AlanJacobs
Fri Apr 29, 2016 12:27 am
Forum: Substantive Dimensions of the Deliberations
Topic: [READ FIRST] What we've been talking about so far (Updated 5/24)
Replies: 19
Views: 60402

[READ FIRST] What we've been talking about so far (Updated 5/24)

If you’re just arriving at the site, here’s a map to some of the issues that we’ve been discussing so far (as of 5/11). Click on a question below to see a set of links on the topic. Join the conversation by responding to any of these threads or by creating a new topic to raise an issue we haven’t go...
by AlanJacobs
Tue Apr 26, 2016 11:48 pm
Forum: Substantive Dimensions of the Deliberations
Topic: Transparency in APD Research
Replies: 6
Views: 23627

Re: Transparency in APD Research

Thanks, Rick Vallely, for putting implications for APD scholarship on the agenda. I'd be interested in hearing more from APD scholars about a.) what specific transparency practices are common, feasible, or of value for the kinds of analysis and evidence typically employed in the study of political d...
by AlanJacobs
Mon Apr 25, 2016 11:44 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [From Steering Comm.] Inviting input on specific transparency practices
Replies: 23
Views: 77106

Re: [From Steering Comm.] Inviting input on specific transparency practices

Thank you, Sean Yom. This is an interesting set of points about what I would think of as transparency in the broadest sense. I agree that it is rare to see, and important. In another thread, Margaret Keck and I discuss how she pursues transparency of this sort in her book, Practical Authority.
by AlanJacobs
Mon Apr 25, 2016 8:44 pm
Forum: Substantive Dimensions of the Deliberations
Topic: Are qualitative researchers held to a higher standard?
Replies: 19
Views: 53848

Re: Are qualitative researchers held to a higher standard?

Many thanks to the several anonymous contributors for the above comments. In my mind, these comments provoke a few questions: One interesting question suggested by one of the posts above is about the role of peer reviewers, as opposed to editors or editorial rules, in the pursuit of transparency. Th...
by AlanJacobs
Mon Apr 25, 2016 8:24 pm
Forum: Substantive Dimensions of the Deliberations
Topic: Do no harm
Replies: 5
Views: 21698

Re: Do no harm

Thank you, Milli Lake, for this extremely rich and thoughtful set of comments. The principle of "do no harm" must surely be a non-negotiable ethical bedrock of all of our research practices; and your post very helpfully elaborates some of its implications in contexts of political violence,...
by AlanJacobs
Mon Apr 25, 2016 12:19 am
Forum: Substantive Dimensions of the Deliberations
Topic: Questionable benefits, Disproportionate costs, Narrowing of future research
Replies: 6
Views: 20632

Re: Questionable benefits, Disproportionate costs, Narrowing of future research

Thank you, Karen Alter, for these very useful comments on the costliness of a form of data-sharing. It's especially helpful to have this level of concrete detail from someone who has engaged in extensive data-sharing practices. It would be great to hear from others who have had experience with provi...
by AlanJacobs
Sat Apr 23, 2016 7:18 pm
Forum: The Deliberative Process
Topic: [Steering Committee] Purpose of this forum
Replies: 0
Views: 30514

[Steering Committee] Purpose of this forum

This "Deliberative Process" forum is intended for discussion of process through which the transparency deliberations will be carried out in the coming months. Please see here for an outline of the plan approved by a vote of the QMMR section membership. For questions about or problems with ...
by AlanJacobs
Thu Apr 21, 2016 4:36 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [From Steering Comm.] What might qualitative data access look like?
Replies: 7
Views: 24143

[From Steering Comm.] What might qualitative data access look like?

Over in a thread begun by Gary Marks, an interesting discussion has started about the nature of qualitative data access. To briefly frame the issue: There seem to be a number of different understandings of how qualitative scholars might make the evidence underlying their claims more accessible. One ...
by AlanJacobs
Thu Apr 21, 2016 1:56 pm
Forum: Substantive Dimensions of the Deliberations
Topic: Where are the DA-RT supporters?
Replies: 2
Views: 16275

[Steering Committee] Where are the DA-RT supporters?

Thanks for this comment and query, Hillel. We are extremely keen to generate the kind of diversity of perspectives that you're asking for. This is critical to making this a successful consultative, agenda-setting process. We are doing all we can think of to raise the visibility of this process acros...
by AlanJacobs
Thu Apr 21, 2016 1:17 pm
Forum: Substantive Dimensions of the Deliberations
Topic: DA-RT: effect on graduate training
Replies: 6
Views: 20832

[Steering Committee] DA-RT: effect on graduate training

Thank you, Sheena Greitens, for raising this important issue, and to the anonymous contributor for this further perspective. It is interesting to hear that it is uncertainty about expectations that seems to be a deterrent. As I've noted in another post , many journal transparency policies (as posted...
by AlanJacobs
Wed Apr 20, 2016 6:48 pm
Forum: Substantive Dimensions of the Deliberations
Topic: Journal standards in practice
Replies: 7
Views: 21139

[Steering Committee] Journal standards in practice

Thanks very much for this comment, Hillel. It would indeed be helpful to hear what people think of those journal policies that are currently in place. Judging by their online author guidelines, many policies of JETS journals remain rather general or appear to still be under development. Some indicat...
by AlanJacobs
Tue Apr 19, 2016 1:59 pm
Forum: The Deliberative Process
Topic: is it possible to email people when others contribute to their thread?
Replies: 1
Views: 10345

Re: is it possible to email people when others contribute to their thread?

Hi Mala, I believe it is possible to do this. When you're reading a topic/thread, go to the gear icon, and then choose "Subscribe to this post." Then in the upper righthand corner of your screen, go to "Notifications" and then click on "Settings." There's a setting to b...
by AlanJacobs
Wed Apr 13, 2016 2:17 pm
Forum: Substantive Dimensions of the Deliberations
Topic: No place for my work in this debate
Replies: 12
Views: 51682

[Steering Committee] No place for my work in this debate

Thank you very much for your comments, Margaret. You write in your post of a disconnect between the DA-RT framework and your work. When I read this, I immediately thought about how transparent I find your work. One particular way in which your work is unusually open – I am thinking here of your rece...
by AlanJacobs
Tue Apr 12, 2016 2:34 pm
Forum: Substantive Dimensions of the Deliberations
Topic: [From Steering Comm.] Inviting input on specific transparency practices
Replies: 23
Views: 77106

[From Steering Comm.] Inviting input on specific transparency practices

Many thanks to those who have already contributed to the conversation and put a number of very important issues and questions on the table. Here's one area in which we would like to invite some additional input: What are some specific transparency practices and tools that you think are of value, and...