Background: Researchers may be tempted to favorably distort the interpretation of their findings when reporting the abstract (i.e., spin). Spin bias overemphasizes the beneficial effects of the intervention compared with the results shown in the full text. Objective: To assess the occurrence of spin bias and incompleteness in reporting abstracts in post-stroke upper limb (UL) rehabilitation randomized clinical trials (RCTs). Methods: A sample of 120 post-stroke UL rehabilitation RCTs (indexed in PEDro database), published in English between 2012 and 2020, was included. The completeness of reporting and spin were assessed using the Consolidated Standards of Reporting Trials for Abstracts (CONSORT-A) and the spin checklist. The relationship between CONSORT-A and spin checklist scores with RCT and journal characteristics was assessed. Results: CONSORT-A and spin checklist scored 5.3±2.4 (max 15-points, higher scores indicating better reporting) and 5.5±2.0 (max 7-points, higher scores indicating presence of spin), respectively; Significant differences were detected between abstract and full-text scores in the CONSORT-A checklist (p < 0.01) and the spin checklist (p < 0.01). Items of the CONSORT-A checklist in the abstracts and full text showed a fair agreement (k = 0.31), while a moderate agreement (k = 0.59) for the spin checklist was detected. Completeness of abstract was associated (R2 = 0.46) with journal Impact Factor (p < 0.01), CONSORT Guideline endorsement (p = 0.04), and abstract word number (p = 0.02). A lower spin was associated with a higher journal Impact Factor (p = 0.01) and CONSORT Guideline endorsement (p = 0.01). Conclusions: Post-stroke UL rehabilitation RCTs abstracts were largely incomplete showing spin. Authors, reviewers, publishers, and stakeholders should be aware of this phenomenon. Publishers should consider allowing more words in abstracts to improve the completeness of reporting abstracts. Although we have investigated only stroke rehabilitation, our results suggest that health care professionals of all disciplines should avoid clinical decision-making based solely upon abstracts.

Tosatto, D., Bonacina, D., Signori, A., Pellicciari, L., Cecchi, F., Cornaggia, C., et al. (2022). Spin of information and inconsistency between abstract and full text in RCTs investigating upper limb rehabilitation after stroke: An overview study. RESTORATIVE NEUROLOGY AND NEUROSCIENCE, 40(3), 195-207 [10.3233/RNN-211247].

Spin of information and inconsistency between abstract and full text in RCTs investigating upper limb rehabilitation after stroke: An overview study

Cornaggia, Cesare Maria;Piscitelli, Daniele
2022

Abstract

Background: Researchers may be tempted to favorably distort the interpretation of their findings when reporting the abstract (i.e., spin). Spin bias overemphasizes the beneficial effects of the intervention compared with the results shown in the full text. Objective: To assess the occurrence of spin bias and incompleteness in reporting abstracts in post-stroke upper limb (UL) rehabilitation randomized clinical trials (RCTs). Methods: A sample of 120 post-stroke UL rehabilitation RCTs (indexed in PEDro database), published in English between 2012 and 2020, was included. The completeness of reporting and spin were assessed using the Consolidated Standards of Reporting Trials for Abstracts (CONSORT-A) and the spin checklist. The relationship between CONSORT-A and spin checklist scores with RCT and journal characteristics was assessed. Results: CONSORT-A and spin checklist scored 5.3±2.4 (max 15-points, higher scores indicating better reporting) and 5.5±2.0 (max 7-points, higher scores indicating presence of spin), respectively; Significant differences were detected between abstract and full-text scores in the CONSORT-A checklist (p < 0.01) and the spin checklist (p < 0.01). Items of the CONSORT-A checklist in the abstracts and full text showed a fair agreement (k = 0.31), while a moderate agreement (k = 0.59) for the spin checklist was detected. Completeness of abstract was associated (R2 = 0.46) with journal Impact Factor (p < 0.01), CONSORT Guideline endorsement (p = 0.04), and abstract word number (p = 0.02). A lower spin was associated with a higher journal Impact Factor (p = 0.01) and CONSORT Guideline endorsement (p = 0.01). Conclusions: Post-stroke UL rehabilitation RCTs abstracts were largely incomplete showing spin. Authors, reviewers, publishers, and stakeholders should be aware of this phenomenon. Publishers should consider allowing more words in abstracts to improve the completeness of reporting abstracts. Although we have investigated only stroke rehabilitation, our results suggest that health care professionals of all disciplines should avoid clinical decision-making based solely upon abstracts.
Articolo in rivista - Articolo scientifico
abstracting and indexing; Data accuracy; neurological rehabilitation; randomized controlled trials; spin bias; stroke;
English
19-ago-2022
2022
40
3
195
207
none
Tosatto, D., Bonacina, D., Signori, A., Pellicciari, L., Cecchi, F., Cornaggia, C., et al. (2022). Spin of information and inconsistency between abstract and full text in RCTs investigating upper limb rehabilitation after stroke: An overview study. RESTORATIVE NEUROLOGY AND NEUROSCIENCE, 40(3), 195-207 [10.3233/RNN-211247].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/391408
Citazioni
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 3
Social impact