Data from a pre-publication independent replication initiative examining ten moral judgement effects

Warren Tierney; Martin Schweinsberg; Jennifer Jordan; Deanna M. Kennedy; Israr Qureshi; S. Amy Sommer; Nico Thornley; Nikhil Madan; Michelangelo Vianello; Eli Awtrey; Luke Lei Zhu; Daniel Diermeier; Justin E. Heinze; Malavika Srinivasan; David Tannenbaum; Eliza Bivolaru; Jason Dana; Clintin P. Davis-Stober; Christilene du Plessis; Quentin F. Gronau; Andrew C. Hafenbrack; Eko Yi Liao; Alexander Ly; Maarten Marsman; Toshio Murase; Michael Schaerer; Christina M. Tworek; Eric-Jan Wagenmakers; Wendy Wei-Lynn Wong; Tabitha Anderson; Christopher W. Bauman; Wendy L. Bedwell; Victoria Brescoll; Andrew Canavan; Jesse J. Chandler; Erik Cheries; Sapna Cheryan; Felix Cheung; Andrei Cimpian; Mark A. Clark; Diana Cordon; Fiery Cushman; Peter H. Ditto; Alice Amell; Sarah E. Frick; Monica Gamez-Djokic; Rebecca Hofstein Grady; Jesse Graham; Jun Gu; Adam Hahn; Brittany E. Hanson; Nicole J. Hartwich; Kristie Hein; Yoel Inbar; Lily Jiang; Tehlyr Kellogg; Nicole Legate; Timo P. Luoma; Heidi Maibeucher; Peter Meindl; Jennifer Miles; Alexandra Mislin; Daniel C. Molden; Matt Motyl; George Newman; Hoai Huong Ngo; Harvey Packham; P. Scott Ramsay; Jennifer L. Ray; Aaron M. Sackett; Anne Laure Sellier; Tatiana Sokolova; Walter Sowden; Daniel Storage; Xiaomin Sun; Jay J. Van Bavel; Anthony N. Washburn; Cong Wei; Erik Wetter; Carlos T. Wilson; Sophie Charlotte Darroux; Eric Luis Uhlmann

doi:10.1038/sdata.2016.82

Data from a pre-publication independent replication initiative examining ten moral judgement effects

Warren Tierney, Martin Schweinsberg, Jennifer Jordan, Deanna M. Kennedy, Israr Qureshi, S. Amy Sommer, Nico Thornley, Nikhil Madan, Michelangelo Vianello, Eli Awtrey, Luke Lei Zhu, Daniel Diermeier, Justin E. Heinze, Malavika Srinivasan, David Tannenbaum, Eliza Bivolaru, Jason Dana, Clintin P. Davis-Stober, Christilene du Plessis, Quentin F. GronauAndrew C. Hafenbrack, Eko Yi Liao, Alexander Ly, Maarten Marsman, Toshio Murase, Michael Schaerer, Christina M. Tworek, Eric-Jan Wagenmakers, Wendy Wei-Lynn Wong, Tabitha Anderson, Christopher W. Bauman, Wendy L. Bedwell, Victoria Brescoll, Andrew Canavan, Jesse J. Chandler, Erik Cheries, Sapna Cheryan, Felix Cheung, Andrei Cimpian, Mark A. Clark, Diana Cordon, Fiery Cushman, Peter H. Ditto, Alice Amell, Sarah E. Frick, Monica Gamez-Djokic, Rebecca Hofstein Grady, Jesse Graham, Jun Gu, Adam Hahn, Brittany E. Hanson, Nicole J. Hartwich, Kristie Hein, Yoel Inbar, Lily Jiang, Tehlyr Kellogg, Nicole Legate, Timo P. Luoma, Heidi Maibeucher, Peter Meindl, Jennifer Miles, Alexandra Mislin, Daniel C. Molden, Matt Motyl, George Newman, Hoai Huong Ngo, Harvey Packham, P. Scott Ramsay, Jennifer L. Ray, Aaron M. Sackett, Anne Laure Sellier, Tatiana Sokolova, Walter Sowden, Daniel Storage, Xiaomin Sun, Jay J. Van Bavel, Anthony N. Washburn, Cong Wei, Erik Wetter, Carlos T. Wilson, Sophie Charlotte Darroux, Eric Luis Uhlmann

Department of Management

Research output: Contribution to journal › Article › Research › peer-review

4 Citations (Scopus)

Abstract

We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.

Original language	English
Article number	160082
Number of pages	7
Journal	Scientific Data
Volume	3
DOIs	https://doi.org/10.1038/sdata.2016.82
Publication status	Published - 11 Oct 2016

Access to Document

10.1038/sdata.2016.82

Link to publication in Scopus

Cite this

Tierney, W., Schweinsberg, M., Jordan, J., Kennedy, D. M., Qureshi, I., Sommer, S. A., Thornley, N., Madan, N., Vianello, M., Awtrey, E., Zhu, L. L., Diermeier, D., Heinze, J. E., Srinivasan, M., Tannenbaum, D., Bivolaru, E., Dana, J., Davis-Stober, C. P., du Plessis, C., ... Uhlmann, E. L. (2016). Data from a pre-publication independent replication initiative examining ten moral judgement effects. Scientific Data, 3, [160082]. https://doi.org/10.1038/sdata.2016.82

Tierney, Warren ; Schweinsberg, Martin ; Jordan, Jennifer ; Kennedy, Deanna M. ; Qureshi, Israr ; Sommer, S. Amy ; Thornley, Nico ; Madan, Nikhil ; Vianello, Michelangelo ; Awtrey, Eli ; Zhu, Luke Lei ; Diermeier, Daniel ; Heinze, Justin E. ; Srinivasan, Malavika ; Tannenbaum, David ; Bivolaru, Eliza ; Dana, Jason ; Davis-Stober, Clintin P. ; du Plessis, Christilene ; Gronau, Quentin F. ; Hafenbrack, Andrew C. ; Liao, Eko Yi ; Ly, Alexander ; Marsman, Maarten ; Murase, Toshio ; Schaerer, Michael ; Tworek, Christina M. ; Wagenmakers, Eric-Jan ; Wong, Wendy Wei-Lynn ; Anderson, Tabitha ; Bauman, Christopher W. ; Bedwell, Wendy L. ; Brescoll, Victoria ; Canavan, Andrew ; Chandler, Jesse J. ; Cheries, Erik ; Cheryan, Sapna ; Cheung, Felix ; Cimpian, Andrei ; Clark, Mark A. ; Cordon, Diana ; Cushman, Fiery ; Ditto, Peter H. ; Amell, Alice ; Frick, Sarah E. ; Gamez-Djokic, Monica ; Grady, Rebecca Hofstein ; Graham, Jesse ; Gu, Jun ; Hahn, Adam ; Hanson, Brittany E. ; Hartwich, Nicole J. ; Hein, Kristie ; Inbar, Yoel ; Jiang, Lily ; Kellogg, Tehlyr ; Legate, Nicole ; Luoma, Timo P. ; Maibeucher, Heidi ; Meindl, Peter ; Miles, Jennifer ; Mislin, Alexandra ; Molden, Daniel C. ; Motyl, Matt ; Newman, George ; Ngo, Hoai Huong ; Packham, Harvey ; Ramsay, P. Scott ; Ray, Jennifer L. ; Sackett, Aaron M. ; Sellier, Anne Laure ; Sokolova, Tatiana ; Sowden, Walter ; Storage, Daniel ; Sun, Xiaomin ; Van Bavel, Jay J. ; Washburn, Anthony N. ; Wei, Cong ; Wetter, Erik ; Wilson, Carlos T. ; Darroux, Sophie Charlotte ; Uhlmann, Eric Luis. / Data from a pre-publication independent replication initiative examining ten moral judgement effects. In: Scientific Data. 2016 ; Vol. 3.

@article{2c5ea73f531b45fb9b835b2e55057182,

title = "Data from a pre-publication independent replication initiative examining ten moral judgement effects",

abstract = "We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.",

author = "Warren Tierney and Martin Schweinsberg and Jennifer Jordan and Kennedy, {Deanna M.} and Israr Qureshi and Sommer, {S. Amy} and Nico Thornley and Nikhil Madan and Michelangelo Vianello and Eli Awtrey and Zhu, {Luke Lei} and Daniel Diermeier and Heinze, {Justin E.} and Malavika Srinivasan and David Tannenbaum and Eliza Bivolaru and Jason Dana and Davis-Stober, {Clintin P.} and {du Plessis}, Christilene and Gronau, {Quentin F.} and Hafenbrack, {Andrew C.} and Liao, {Eko Yi} and Alexander Ly and Maarten Marsman and Toshio Murase and Michael Schaerer and Tworek, {Christina M.} and Eric-Jan Wagenmakers and Wong, {Wendy Wei-Lynn} and Tabitha Anderson and Bauman, {Christopher W.} and Bedwell, {Wendy L.} and Victoria Brescoll and Andrew Canavan and Chandler, {Jesse J.} and Erik Cheries and Sapna Cheryan and Felix Cheung and Andrei Cimpian and Clark, {Mark A.} and Diana Cordon and Fiery Cushman and Ditto, {Peter H.} and Alice Amell and Frick, {Sarah E.} and Monica Gamez-Djokic and Grady, {Rebecca Hofstein} and Jesse Graham and Jun Gu and Adam Hahn and Hanson, {Brittany E.} and Hartwich, {Nicole J.} and Kristie Hein and Yoel Inbar and Lily Jiang and Tehlyr Kellogg and Nicole Legate and Luoma, {Timo P.} and Heidi Maibeucher and Peter Meindl and Jennifer Miles and Alexandra Mislin and Molden, {Daniel C.} and Matt Motyl and George Newman and Ngo, {Hoai Huong} and Harvey Packham and Ramsay, {P. Scott} and Ray, {Jennifer L.} and Sackett, {Aaron M.} and Sellier, {Anne Laure} and Tatiana Sokolova and Walter Sowden and Daniel Storage and Xiaomin Sun and {Van Bavel}, {Jay J.} and Washburn, {Anthony N.} and Cong Wei and Erik Wetter and Wilson, {Carlos T.} and Darroux, {Sophie Charlotte} and Uhlmann, {Eric Luis}",

year = "2016",

month = oct,

day = "11",

doi = "10.1038/sdata.2016.82",

language = "English",

volume = "3",

journal = "Scientific Data",

issn = "2052-4463",

publisher = "Nature Publishing Group",

}

Tierney, W, Schweinsberg, M, Jordan, J, Kennedy, DM, Qureshi, I, Sommer, SA, Thornley, N, Madan, N, Vianello, M, Awtrey, E, Zhu, LL, Diermeier, D, Heinze, JE, Srinivasan, M, Tannenbaum, D, Bivolaru, E, Dana, J, Davis-Stober, CP, du Plessis, C, Gronau, QF, Hafenbrack, AC, Liao, EY, Ly, A, Marsman, M, Murase, T, Schaerer, M, Tworek, CM, Wagenmakers, E-J, Wong, WW-L, Anderson, T, Bauman, CW, Bedwell, WL, Brescoll, V, Canavan, A, Chandler, JJ, Cheries, E, Cheryan, S, Cheung, F, Cimpian, A, Clark, MA, Cordon, D, Cushman, F, Ditto, PH, Amell, A, Frick, SE, Gamez-Djokic, M, Grady, RH, Graham, J, Gu, J, Hahn, A, Hanson, BE, Hartwich, NJ, Hein, K, Inbar, Y, Jiang, L, Kellogg, T, Legate, N, Luoma, TP, Maibeucher, H, Meindl, P, Miles, J, Mislin, A, Molden, DC, Motyl, M, Newman, G, Ngo, HH, Packham, H, Ramsay, PS, Ray, JL, Sackett, AM, Sellier, AL, Sokolova, T, Sowden, W, Storage, D, Sun, X, Van Bavel, JJ, Washburn, AN, Wei, C, Wetter, E, Wilson, CT, Darroux, SC & Uhlmann, EL 2016, 'Data from a pre-publication independent replication initiative examining ten moral judgement effects', Scientific Data, vol. 3, 160082. https://doi.org/10.1038/sdata.2016.82

Data from a pre-publication independent replication initiative examining ten moral judgement effects. / Tierney, Warren; Schweinsberg, Martin; Jordan, Jennifer; Kennedy, Deanna M.; Qureshi, Israr; Sommer, S. Amy; Thornley, Nico; Madan, Nikhil; Vianello, Michelangelo; Awtrey, Eli; Zhu, Luke Lei; Diermeier, Daniel; Heinze, Justin E.; Srinivasan, Malavika; Tannenbaum, David; Bivolaru, Eliza; Dana, Jason; Davis-Stober, Clintin P.; du Plessis, Christilene; Gronau, Quentin F.; Hafenbrack, Andrew C.; Liao, Eko Yi; Ly, Alexander; Marsman, Maarten; Murase, Toshio; Schaerer, Michael; Tworek, Christina M.; Wagenmakers, Eric-Jan; Wong, Wendy Wei-Lynn; Anderson, Tabitha; Bauman, Christopher W.; Bedwell, Wendy L.; Brescoll, Victoria; Canavan, Andrew; Chandler, Jesse J.; Cheries, Erik; Cheryan, Sapna; Cheung, Felix; Cimpian, Andrei; Clark, Mark A.; Cordon, Diana; Cushman, Fiery; Ditto, Peter H.; Amell, Alice; Frick, Sarah E.; Gamez-Djokic, Monica; Grady, Rebecca Hofstein; Graham, Jesse; Gu, Jun; Hahn, Adam; Hanson, Brittany E.; Hartwich, Nicole J.; Hein, Kristie; Inbar, Yoel; Jiang, Lily; Kellogg, Tehlyr; Legate, Nicole; Luoma, Timo P.; Maibeucher, Heidi; Meindl, Peter; Miles, Jennifer; Mislin, Alexandra; Molden, Daniel C.; Motyl, Matt; Newman, George; Ngo, Hoai Huong; Packham, Harvey; Ramsay, P. Scott; Ray, Jennifer L.; Sackett, Aaron M.; Sellier, Anne Laure; Sokolova, Tatiana; Sowden, Walter; Storage, Daniel; Sun, Xiaomin; Van Bavel, Jay J.; Washburn, Anthony N.; Wei, Cong; Wetter, Erik; Wilson, Carlos T.; Darroux, Sophie Charlotte; Uhlmann, Eric Luis.

In: Scientific Data, Vol. 3, 160082, 11.10.2016.

Research output: Contribution to journal › Article › Research › peer-review

TY - JOUR

T1 - Data from a pre-publication independent replication initiative examining ten moral judgement effects

AU - Tierney, Warren

AU - Schweinsberg, Martin

AU - Jordan, Jennifer

AU - Kennedy, Deanna M.

AU - Qureshi, Israr

AU - Sommer, S. Amy

AU - Thornley, Nico

AU - Madan, Nikhil

AU - Vianello, Michelangelo

AU - Awtrey, Eli

AU - Zhu, Luke Lei

AU - Diermeier, Daniel

AU - Heinze, Justin E.

AU - Srinivasan, Malavika

AU - Tannenbaum, David

AU - Bivolaru, Eliza

AU - Dana, Jason

AU - Davis-Stober, Clintin P.

AU - du Plessis, Christilene

AU - Gronau, Quentin F.

AU - Hafenbrack, Andrew C.

AU - Liao, Eko Yi

AU - Ly, Alexander

AU - Marsman, Maarten

AU - Murase, Toshio

AU - Schaerer, Michael

AU - Tworek, Christina M.

AU - Wagenmakers, Eric-Jan

AU - Wong, Wendy Wei-Lynn

AU - Anderson, Tabitha

AU - Bauman, Christopher W.

AU - Bedwell, Wendy L.

AU - Brescoll, Victoria

AU - Canavan, Andrew

AU - Chandler, Jesse J.

AU - Cheries, Erik

AU - Cheryan, Sapna

AU - Cheung, Felix

AU - Cimpian, Andrei

AU - Clark, Mark A.

AU - Cordon, Diana

AU - Cushman, Fiery

AU - Ditto, Peter H.

AU - Amell, Alice

AU - Frick, Sarah E.

AU - Gamez-Djokic, Monica

AU - Grady, Rebecca Hofstein

AU - Graham, Jesse

AU - Gu, Jun

AU - Hahn, Adam

AU - Hanson, Brittany E.

AU - Hartwich, Nicole J.

AU - Hein, Kristie

AU - Inbar, Yoel

AU - Jiang, Lily

AU - Kellogg, Tehlyr

AU - Legate, Nicole

AU - Luoma, Timo P.

AU - Maibeucher, Heidi

AU - Meindl, Peter

AU - Miles, Jennifer

AU - Mislin, Alexandra

AU - Molden, Daniel C.

AU - Motyl, Matt

AU - Newman, George

AU - Ngo, Hoai Huong

AU - Packham, Harvey

AU - Ramsay, P. Scott

AU - Ray, Jennifer L.

AU - Sackett, Aaron M.

AU - Sellier, Anne Laure

AU - Sokolova, Tatiana

AU - Sowden, Walter

AU - Storage, Daniel

AU - Sun, Xiaomin

AU - Van Bavel, Jay J.

AU - Washburn, Anthony N.

AU - Wei, Cong

AU - Wetter, Erik

AU - Wilson, Carlos T.

AU - Darroux, Sophie Charlotte

AU - Uhlmann, Eric Luis

PY - 2016/10/11

Y1 - 2016/10/11

N2 - We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.

AB - We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.

UR - http://www.scopus.com/inward/record.url?scp=84991111172&partnerID=8YFLogxK

U2 - 10.1038/sdata.2016.82

DO - 10.1038/sdata.2016.82

M3 - Article

C2 - 27727246

AN - SCOPUS:84991111172

VL - 3

JO - Scientific Data

JF - Scientific Data

SN - 2052-4463

M1 - 160082

ER -