Replication is fundamental, but is it common? A call for scientific self-reflection and contemporary research practices in gambling-related research

Abstract:
Researchers around the world have observed that in many fields the published peerreviewed literature reflects a widespread publication bias that favours statistically significant and novel outcomes (e.g. Nosek & Lakens, 2014). These preferences relate to the replication crisis first uncovered by the Many Labs research initiative (Open Science Collaborative, 2015). This initiative noted that successful replication occurred for about 40% of the effects tested from 100 published social science studies in select high-impact journals (i.e. Journal of Personality and Social Psychology, Psychological Science, and Journal of Experimental Psychology: Learning, Memory, and Cognition). Other studies have identified similar concerns. For example, a high-powered (i.e. sample sizes approximately five times larger than initial publication sample sizes) replication test of 21 social science publications from the journals Science and Nature observed that a significant effect in the same direction was obtained for roughly 62% of findings; however, the effect sizes for those outcomes were about 50% of those in the original publications (Camerer et al., 2018). Other disciplines (e.g. artificial intelligence, medicine, economics, and marketing) also have identified similarly troubling replication rates or concerns (Berman, Pekelis, Aisling, & Van den Bulte, 2018; Camerer et al., 2016; Hutson, 2018; Kaiser, 2017). Altogether, these findings suggest that replication and publication bias are important issues that gambling researchers would be wise to investigate. Researchers have identified a variety of likely methodological contributors to the replication crisis. Researcher degrees of freedom (see Wicherts et al., 2016), for example, consist of potentially unprincipled data analysis decisions and practices that favour methods and techniques that yield statistically significant outcomes (Mackinnon, 2013; Simmons, Nelson, & Simonsohn, 2011). One possible expression of this practice might be failing to be transparent about searching for moderators in the absence of hypothesized main effects (e.g. testing for gender or age differences when a proposed main effect does not reach statistical significance). A second example might include selectively reporting outcome variables (e.g. dropping non-significant measures that ‘do not work’ from a manuscript and only reporting significant findings). Another form of researcher degrees of freedom might involve the selection of specific analytic approaches that are more likely to yield statistically significant findings (e.g. opting to report one-tailed tests in the absence of wellfounded directional hypotheses). Analytic decisions by researchers aren’t the only possible contributors to poor replication rates. HARKing (i.e. hypothesizing after the results are known; Kerr, 1998), occurs when researchers write their manuscripts with post hoc hypotheses as if these were developed a priori. This is problematic because this practice might advance and highlight findings that INTERNATIONAL GAMBLING STUDIES 2019, VOL. 19, NO. 3, 362–368 https://doi.org/10.1080/14459795.2019.1672768
Author Listing: Debi A. LaPlante
Volume: 19
Pages: 362 - 368
DOI: 10.1080/14459795.2019.1672768
Language: English
Journal: International Gambling Studies

International Gambling Studies

INT GAMBL STUD

影响因子:1.8 是否综述期刊:否 是否OA:否 是否预警:不在预警名单内 发行时间:- ISSN:1445-9795 发刊频率:- 收录数据库:Scopus收录 出版国家/地区:- 出版社:Taylor & Francis

期刊介绍

年发文量 16
国人发稿量 2
国人发文占比 11.11%
自引率 8.0%
平均录取率 -
平均审稿周期 -
版面费 -
偏重研究方向 SUBSTANCE ABUSE-
期刊官网 https://www.tandfonline.com/toc/rigs20/current
投稿链接 -

质量指标占比

研究类文章占比 OA被引用占比 撤稿占比 出版后修正文章占比
85.19% 26.88% 0.00% 2.27%

相关指数

{{ relationActiveLabel }}
{{ item.label }}

期刊预警不是论文评价,更不是否定预警期刊发表的每项成果。《国际期刊预警名单(试行)》旨在提醒科研人员审慎选择成果发表平台、提示出版机构强化期刊质量管理。

预警期刊的识别采用定性与定量相结合的方法。通过专家咨询确立分析维度及评价指标,而后基于指标客观数据产生具体名单。

具体而言,就是通过综合评判期刊载文量、作者国际化程度、拒稿率、论文处理费(APC)、期刊超越指数、自引率、撤稿信息等,找出那些具备风险特征、具有潜在质量问题的学术期刊。最后,依据各刊数据差异,将预警级别分为高、中、低三档,风险指数依次减弱。

《国际期刊预警名单(试行)》确定原则是客观、审慎、开放。期刊分区表团队期待与科研界、学术出版机构一起,夯实科学精神,打造气正风清的学术诚信环境!真诚欢迎各界就预警名单的分析维度、使用方案、值得关切的期刊等提出建议!

预警情况 查看说明

时间 预警情况
2024年02月发布的2024版 不在预警名单中
2023年01月发布的2023版 不在预警名单中
2021年12月发布的2021版 不在预警名单中
2020年12月发布的2020版 不在预警名单中

JCR分区 WOS分区等级:Q3区

版本 按学科 分区
WOS期刊SCI分区
WOS期刊SCI分区是指SCI官方(Web of Science)为每个学科内的期刊按照IF数值排 序,将期刊按照四等分的方法划分的Q1-Q4等级,Q1代表质量最高,即常说的1区期刊。
(2021-2022年最新版)
SUBSTANCE ABUSE Q2

关于2019年中科院分区升级版(试行)

分区表升级版(试行)旨在解决期刊学科体系划分与学科发展以及融合趋势的不相容问题。由于学科交叉在当代科研活动的趋势愈发显著,学科体系构建容易引发争议。为了打破学科体系给期刊评价带来的桎梏,“升级版方案”首先构建了论文层级的主题体系,然后分别计算每篇论文在所属主题的影响力,最后汇总各期刊每篇论文分值,得到“期刊超越指数”,作为分区依据。

分区表升级版(试行)的优势:一是论文层级的主题体系既能体现学科交叉特点,又可以精准揭示期刊载文的多学科性;二是采用“期刊超越指数”替代影响因子指标,解决了影响因子数学性质缺陷对评价结果的干扰。整体而言,分区表升级版(试行)突破了期刊评价中学科体系构建、评价指标选择等瓶颈问题,能够更为全面地揭示学术期刊的影响力,为科研评价“去四唯”提供解决思路。相关研究成果经过国际同行的认可,已经发表在科学计量学领域国际重要期刊。

《2019年中国科学院文献情报中心期刊分区表升级版(试行)》首次将社会科学引文数据库(SSCI)期刊纳入到分区评估中。升级版分区表(试行)设置了包括自然科学和社会科学在内的18个大类学科。基础版和升级版(试行)将过渡共存三年时间,推测在此期间各大高校和科研院所仍可能会以基础版为考核参考标准。 提示:中科院分区官方微信公众号“fenqubiao”仅提供基础版数据查询,暂无升级版数据,请注意区分。

中科院分区 查看说明

版本 大类学科 小类学科 Top期刊 综述期刊
心理学
4区
SUBSTANCE ABUSE
药物滥用
4区
2021年12月
升级版
心理学
4区
SUBSTANCE ABUSE
药物滥用
4区
2020年12月
旧的升级版
心理学
4区
SUBSTANCE ABUSE
药物滥用
4区
2022年12月
最新升级版
心理学
3区
SUBSTANCE ABUSE
药物滥用
3区