by Eric Schwitzgebel and Christopher McVey
... or at least this is so for one narrative we've tried and one type of philosophical argument.
Update, Sep 9: In a follow-up study, we have replicated the main results described below using four different arguments and four different narratives.
Introduction
From 2009 to 2015, Eric published a series of studies that consistently found, using a wide variety of measures, that ethics professors do not behave any morally better than comparison groups of other professors (summarized here). One simple explanation (favored, for example, by Jon Haidt in his discussion of Eric's work) is that philosophical moral reflection has little to no influence on people's moral behavior. However, Eric and his frequent collaborator Joshua Rust have been hesitant to draw that conclusion without more empirical evidence (see here and here for possible alternative explanations).
Meanwhile, Eric's PhD student Chris was growing interested in the power of narratives to change behavior. So we decided to collaborate on a project to compare the influence of narrative and argument on charitable giving.
Design
For our argument, we chose an argument constructed by philosopher Peter Singer with the aim of convincing ordinary readers to donate to charity. The argument was originally written for a paper in draft by Luke Buckland, Matthew Lindauer, David Rodriguez-Arias, and Carissa Veliz. (Thanks to them and to Peter Singer for sharing this argument with us.) We supplemented Singer's argument with some additional clarificatory text. It's a typical Singer-style argument, emphasizing that people have a duty to prevent death and suffering due to extreme poverty by donating money that they would otherwise spend on luxuries, and that our physical distance from those who are suffering does not excuse us from the obligation to help.
For our narrative, we chose a true story, about the same word-length as the argument, about a family rescued from slavery by a charitable donation, which we adapted from the website of a charitable organization.
Participants were 918 MTurk workers in the United States. We divided them into four conditions: (1.) narrative only, (2.) argument only, (3.) narrative + argument, and (4.) control (who received a similar-length text from a middle-school physics textbook). Participants were then asked to rate, on a 7-point scale, how much they agreed or disagreed with statements about the ethics of donation and their own motivation to donate (e.g., "It is morally good to give money to charities that help those in extreme poverty", "Currently I feel motivated to give money to a charity that helps people in extreme poverty"). In Experiment 1, we then asked them a hypothetical question about how much they would give to a charity if we offered them a bonus of $10. In Experiment 2, we replaced the hypothetical-donation language with a lottery choice. We'll report only on Experiment 2 here, but the results of Experiment 1 were very similar.
Here is the exact language for the lottery choice:
Upon completion of this study, 10% of participants in this study will receive an additional $10. You have the option to donate some portion of this $10 to one of six well-known charities that have been shown to effectively fight suffering due to extreme poverty. If you are one of the recipients of the additional $10, the portion you decide to keep will appear as a bonus credited to your Mechanical Turk worker account, and the portion you decide to donate will be given to the charity you pick from the list below. If you are one of the recipients of the additional $10, how much of your additional $10 would you like to donate?
Participants then ticked a number on a scale from $0 to $10 in dollar intervals, indicating how much they would donate if they won the $10.
(A big thanks to The Life You Can Save, especially Jon Behar, for funding this study!)
Finally, we asked questions designed to measure "narrative transportation" (i.e., how immersive and moving they found the narrative, or argument, or physics text), adapted from Green and Brock 2000.
We thought we'd share some preliminary results. We emphasize that these results are only preliminary. Later, we'll want to double-check our numbers, confirm that we got the exclusions exactly right, etc. (We have a preregistration at Open Science Foundation, but we haven't made it public yet.)
Results
Mean amount donated, by condition:
(Apologies for blurry image. Click to enhance. Error bars are 95% confidence intervals.)
Statistically, the conditions are different (ANOVA [913,3], F=4.99, p = .002). In planned, pre-registered one-tailed t-tests, we found that the narrative and narrative+argument conditions generated more donation than the control condition (p = .02, .001) but the argument condition did not (p = .48). Similarly in a multiple regression analysis we found that being in one of the narrative conditions (narrative only or narrative+argument) predicted donation amount but being in one of the argumentative conditions was not statistically significantly predictive. In other words, exposure to a Singer-style philosophical argument had no statistically detectable effect on charitable giving, but exposure to a narrative about a family rescued from slavery did have a detectable effect. This was also true in Experiment 1, concerning hypothetical donation.
The results were even clearer for the measure of ethical opinion and motivation to donate, which was scored on a scale from 5 to 35, based on 5 questions:
It's not a huge effect size -- about 2 points on the scale -- but it's easier to see how the results for argument and control are similar to each other and different from the results for narrative and narrative+argument, which are also similar to each other (ANOVA [913,3], F=10.8, p < .001; one-tailed t vs. control condition: argument p = .71, narrative p < .001, nar+arg p < .001).
Similarly to the lottery donation results, a regression analysis of reported motivation and moral opinion finds being in a narrative condition predictive and being in an argument condition non-predictive.
As expected, we also found that participants reported more narrative transportation in the narrative and narrative+argument conditions than in the other conditions (ANOVA, p < .001) and that narrative transport, amount given, and motivation to give were mutually correlated (transport-amount given, r = .24; transport-motivation, r = .40, motivation-amount given, r = .50; all p's < .001).
Conclusion
We regard this as preliminary evidence that exposure to at least one type of narrative influences charitable giving, motivation, and opinion, while exposure to one common type of philosophical argument has little if any influence.
In our teaching, we also seem to find that Singer-style arguments have little effect on moral opinion or motivation to donate. In another series of studies (collaborative with Peter Singer and Brad Cokelet), which we hope to be able to report on soon, professors and TAs at UC Riverside taught lower-division philosophy students philosophical arguments for charitable donation and for vegetarianism. In subsequent questionnaires, students' self-reported attitudes toward charity don't appear to have been much influenced by the arguments, but their self-reported attitudes toward vegetarianism do appear to have been influenced.
This is not to deny that some people are influenced to donate by Singer's arguments. Eric believes that he has been, for example. But the effect might be weak or uncommon or not effectively produced by brief exposures.
In follow-up research, we plan to see if we find similar results with different types of arguments and narratives, and we hope to zero in on what underlying factors are at work behind these effects.