News and views about philosophy, the academic profession, academic freedom, intellectual culture, and other topics. The world’s most popular philosophy blog, since 2003.
My former colleagues at another university in Middle East have also been moved to online teaching indefinitely, with the students…
If much of the interest of high-quality papers lies between the lines—in the metaphorical fire that a paper lights in…
I would also recommend that potential grad students make inquiries into how far the compensation package actually goes towards cost…
It’s a mix. I’m still in the UAE with my family, and we feel safe. But some students and faculty…
In the above comment, Michel wrote: “As an aside, every once in a while I check out how the chatbots…
I could imagine LLMs having saved me a *ton* of time in graduate school–e.g., by having supplied reasonable answers to…
The McMaster Department of Philosophy has now put together the following notice commemorating Barry: Barry Allen: A Philosophical Life Barry…
Folks interested in XPhil should read this, if they have not already. Comments welcome from those knowledgeable about the issues.
The issue of low quality Amazon Turk data has been known for years now. Many experimental philosophers, perhaps most, have moved to other platforms that do not suffer from similar issues.
"Are you a robot?" seems an improper question to use as a filter in a survey on free will v. determinism.
As Edouard said, experimental philosophers are aware of concerns about data quality on MTurk. And most will have read Florian's post, since it was on the main x-phi blog. But I think it is important to note that this should not be thought of as trouble for experimental philosophy, for a few reasons. First, it's worth noting that the concerns are supported by the results of an experimental philosophy study done by an experimental philosopher, who goes on to suggest that an alternative platform that is also widely used, Prolific, may fare better in the relevant respects. Second, there are ongoing discussions of how to maintain data quality on MTurk and other platforms, e.g. on twitter regularly, and Florian links to one helpful discussion about MTurk by Nick Byrd toward the end of his post (this is not to disagree at all with Florian's concerns). Lastly, any problems with MTurk data are not problems for experimental philosophy in particular, since it's not only experimental philosophers, but psychologists, cognitive scientists, and other researchers who have used this tool for participant recruitment. So how we think about these concerns matters quite a lot.
—–
KEYWORDS:
Primary Blog
Leave a Reply to Edouard Machery Cancel reply