Do citation counts indicate quality? Statistical errors = No Strength of evidence = No Estimated replicability = No Actual replicability = No So....maybe?
New #preprint suggests that journal impact factor isn’t a great proxy for paper quality, with these figures showing associations of JIF and replication index (left) and stats errors (right)
#187 Citation counts and journal impact factors do not capture research quality in the behavioral and brain sciences via by Michael Dougherty & Zachary Horne
Guess what? Citation counts and journal impact factors don't predict research quality ...
Citations alone do not capture scientific quality. The other day a bot called me a bad name on Twitter, if Twitter employed JIF, my JIF would be higher every time someone called me bad names. Exhibt B
Citation counts & journal impact factors do not capture research quality in the behavioral & brain sciences. "Our findings impugn their validity as indices of research quality & call into question their usefulness in evaluating scientists & their research"
Citation counts and journal impact factors do not capture research quality in the behavioral and brain sciences via
“Both citation counts and impact factors were weak and inconsistent predictors of research quality... and sometimes negatively related to quality”.