content image

社会科学研究の85%が再現性テストに合格――しかし本当の課題はさらに深いところにある

85% of Social Science Studies Pass the Reproducibility Test—But the Real Challenge Lies Deeper

社会科学の研究結果は再現できるのか? Natureの最新論文群が経済学・政治学の再現性を大規模検証。データ公開の効果と残る課題が明らかに。
分からないところをタップすると
↓日本語訳が表示されます↓

Can a study give the same answer when other researchers check it again? A new Nature paper, published on April 1, 2026, looked at this question in economics and political science. The researchers tested 110 recent papers from leading journals where data and code sharing are required. They found that more than 85% of published claims were computationally reproducible. In other words, when another team used the same data and the same analysis steps, they usually got the same result. (nature.com)

But that is only the first test. The paper also asked about robustness. That means changing the analysis in reasonable ways and seeing whether the conclusion still stands. Here, the picture was less perfect. In the reanalyses, 72% of statistically significant estimates stayed significant and pointed in the same direction. The median reproduced effect size was almost identical to the original one, at 99% of the published effect size. The authors also found that teams with more experience reported lower robustness, which suggests that small research decisions can still change results. (nature.com)

This paper was part of a larger Nature collection about trust in social and behavioural science. Another study in the same collection checked 600 papers from 62 journals published between 2009 and 2018. Only 144 papers, or 24.0%, made their data available for direct reproducibility checks. Among the 143 papers that could be assessed, 53.6% were precisely reproducible and 73.5% were at least approximately reproducible. The researchers also found better reproducibility in economics and political science, in newer papers, and in journals that require data sharing. (nature.com)

And what about doing the study again with new data? That is even harder. A separate Nature paper tried to replicate 274 claims from 164 papers and found success for 49.3% of papers by its main measure. Replication effect sizes were also much smaller than the originals. So the latest message is not simply “science is failing.” It is more useful than that: open data, open code, and careful checking clearly help, but strong-looking results still need to be tested again before we trust them too much. (nature.com)

by EigoBoxAI
作成:2026/04/26 21:02
レベル:初中級 (語彙目安:1000〜2000語)

まだ読んでいないコンテンツ

content image
by EigoBoxAI
作成:2026/04/26 21:03
レベル:中級 (語彙目安:2000〜2500語)
content image
by EigoBoxAI
作成:2026/04/26 21:01
レベル:超上級 (語彙目安:8000語以上)
content image
by EigoBoxAI
作成:2026/04/26 15:04
レベル:上級 (語彙目安:6000〜8000語)
content image
by EigoBoxAI
作成:2026/04/26 15:03
レベル:中上級 (語彙目安:4000〜6000語)
content image
by EigoBoxAI
作成:2026/04/26 15:01
レベル:超入門 (語彙目安:〜300語)
content image
by EigoBoxAI
作成:2026/04/26 09:03
レベル:初級 (語彙目安:300〜1000語)
content image
by EigoBoxAI
作成:2026/04/26 09:02
レベル:中級 (語彙目安:2000〜2500語)
content image
by EigoBoxAI
作成:2026/04/26 09:01
レベル:初中級 (語彙目安:1000〜2000語)
content image
by EigoBoxAI
作成:2026/04/26 03:05
レベル:超上級 (語彙目安:8000語以上)
content image
by EigoBoxAI
作成:2026/04/26 03:04
レベル:上級 (語彙目安:6000〜8000語)