[ prog / sol / mona ]

prog


ACM Library is open access during the pandemic

26 2020-06-18 20:23 *

Speaking of computer science education...

https://dl.acm.org/doi/abs/10.1145/2999541.2999554
Replication in computing education research: researcher attitudes and experiences by Ahadi et al.

We have published results that we didn't believe ourselves, so we tried to replicate them.

This was one of the better answers to a survey the authors of this paper conducted to find out what's the deal with the abysmal replication rate in their field. First, the good: most researchers who answered this survey believe replication to be a good thing. However, their views on how much of the studies done in CS education could even be replicated was tragic, with the median being at just 30%, and the maximum at 70%. This maximum is lower than the average in some other fields... While ideologically supporting replication, many of those who answered are unwilling to do the actual work, as they either prefer working on novel problems or realize that not even the journals care about reproductions and will likely refuse to publish their work. I guess the takeaways is: next time you are reading about computer science education, remember that not even the researchers active in this field have any trust in the veracity of the published papers.

Maybe things have improved since 2016?

35


VIP:

do not edit these