Indian Journal of Anaesthesia  
About us | Editorial board | Search | Ahead of print | Current Issue | Past Issues | Instructions
Home | Login  | Users Online: 660  Print this pageEmail this pageSmall font sizeDefault font sizeIncrease font size    




 
 Table of Contents    
REVIEW ARTICLE
Year : 2016  |  Volume : 60  |  Issue : 9  |  Page : 670-673  

Critical appraisal of published literature


1 Department of Anaesthesia, Dharwad Institute of Mental Health and Neuro Sciences, Dharwad, Karnataka, India
2 Department of Anaesthesiology, Universal Hospital, Abu Dhabi, United Arab Emirates
3 Department of Pulmonary Medicine, Kasturba Medical College, Manipal University, Manipal, Karnataka, India

Date of Web Publication15-Sep-2016

Correspondence Address:
Goneppanavar Umesh
Department of Anaesthesia, Dharwad Institute of Mental Health and Neuro Sciences, Dharwad, Karnataka
India
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/0019-5049.190624

Rights and Permissions
 

With a large output of medical literature coming out every year, it is impossible for readers to read every article. Critical appraisal of scientific literature is an important skill to be mastered not only by academic medical professionals but also by those involved in clinical practice. Before incorporating changes into the management of their patients, a thorough evaluation of the current or published literature is an important step in clinical practice. It is necessary for assessing the published literature for its scientific validity and generalizability to the specific patient community and reader's work environment. Simple steps have been provided by Consolidated Standard for Reporting Trial statements, Scottish Intercollegiate Guidelines Network and several other resources which if implemented may help the reader to avoid reading flawed literature and prevent the incorporation of biased or untrustworthy information into our practice.

Keywords: Allocation concealment, bias, conflict of interest, critical appraisal, randomisation, study design


How to cite this article:
Umesh G, Karippacheril JG, Magazine R. Critical appraisal of published literature. Indian J Anaesth 2016;60:670-3

How to cite this URL:
Umesh G, Karippacheril JG, Magazine R. Critical appraisal of published literature. Indian J Anaesth [serial online] 2016 [cited 2019 Apr 19];60:670-3. Available from: http://www.ijaweb.org/text.asp?2016/60/9/670/190624


   Introduction Top


Critical appraisal

'The process of carefully and systematically examining research to judge its trustworthiness, and its value and relevance in a particular context'

-Burls A [1]

The objective of medical literature is to provide unbiased, accurate medical information, backed by robust scientific evidence that could aid and enhance patient care. With the ever increasing load of scientific literature (more than 12,000 new articles added every week to the MEDLINE database), [2] keeping abreast of the current literature can be arduous. Critical appraisal of literature may help distinguish between useful and flawed studies. Although substantial resources of peer-reviewed literature are available, flawed studies may abound in unreliable sources. Flawed studies if used to guide clinical decisions may end up with no benefit or at worse result in significant harm. Readers can, thus, make informed decisions by critically evaluating medical literature.


   Steps to Critically Evaluate an Article Top


Initial evaluation of an article published in literature should be based on certain core questions. These may include querying what could be the key learning points in the article, about its clinical relevance, if the study has a robust methodology, if the results are reproducible and could there be any bias or conflict of interest [Table 1]. If there are serious doubts regarding any of these steps, the reader could skip the article at this stage itself.
Table 1: Core questions for initial evaluation of a scientific article

Click here to view


Introduction, methods, results and discussion pattern of scientific literature

Introduction

Evaluate if the need (as dearth of studies on the topic in scientific literature) and the purpose of the study (attempting to find answers to one of the important unanswered queries of clinical relevance) are properly explained with scientific rationale. If the research objective and hypothesis were not clearly defined or the findings of the study are different from the objectives (chance findings), the study outcomes become questionable.

Methods

A good working scientific hypothesis backed by a strong methodology is the stepping stone for carrying out a meaningful research. The groups to be involved and the study end points should be determined prior to starting the study. Strong methodology depends on several aspects that must be properly addressed and evaluated [Table 2]. The methodology for statistical analysis including tests for distribution pattern of study data, level of significance and sample size calculation should be clearly defined in the methods section. Data that violate the assumption of normal distribution pattern must be analysed with non-parametric statistical tests. Inadequate sample size can lead to false-negative results or beta error (aide-memoire: beta error is blindness). Setting a higher level of significance, especially when performing multiple comparisons, can lead to false-positive results or alpha error (aide-memoire: alpha error is hallucination). A confidence interval when used in the study methodology provides information on the direction and strength of the effect, in contrast to P values alone, from which the magnitude, direction or comparison of relative risk between groups cannot be inferred. P value simply accepts or rejects the null hypothesis, therefore it must be reported in conjunction with confidence intervals. [6] An important guideline for evaluating and reporting randomised controlled trials, mandatory for publication in several international medical journals, is the Consolidated Standard for Reporting Trial (CONSORT) statement. [7] Other scientific societies such as the Scottish Intercollegiate Guidelines Network have devised checklists that may aid in the critical evaluation of articles depending on the type of study methodology. [8],[9]
Table 2: Appraisal elements for robust evaluation of study methodology

Click here to view


Results

The results section should only report the findings of the study, without attempting to reason them out. The total number of participants with the number of those excluded, dropped out or withdrawn from the study should be analysed. Failure to do so may lead to underestimation or overestimation of results. [10] A summary flowchart containing enrolment data could be created as per the CONSORT statement. [5] Actual values including the mean with standard deviation/error or median with interquartile range should be reported. Evaluate for completeness - all the variables in the study methodology should be analysed using appropriate statistical tests. Ensure that findings stated in the results are the same in other areas of the article - abstract, tables and figures. Appropriate tables and graphs should be used to provide the results of the study. Assess if the results of the study can be generalised and are useful to our workplace or patient population.

Although significant positive results from the study are more likely to be accepted for publication (publication bias), remember that high rates of falsely inflated results are demonstrated in studies that had flawed methodology (due to improper or lack of appropriate randomisation, allocation concealment, blinding and/or assessing outcomes through statistical modeling). Further, the publication bias towards studies with positive outcome leads to scientific distortions in the body of scientific knowledge. [11],[12]

Discussion and conclusion

The discussion is used to account for or reason out the outcomes of the study, including dropouts and any change in methodology, to comment on the external validity of the study and to discuss its limitations. The authors should report their findings in comparison with that previously published in literature, if the study results added new information to the current literature, if it could alter patient management and if the findings need larger studies for further evaluation or confirmation. When concluding, the interpretation should be consistent with the actual findings. Evaluate if the questions in the study hypothesis were adequately addressed and if the conclusions were justified by the actual data. Authors should also provide limitations of their study and constructive suggestions for future research.

Readers may find useful resources on how to constructively read the published literature at the following resources:




   Summary Top


Critical appraisal of scientific literature is an important skill to be mastered not just by academic medical professionals but also by those involved in clinical practice. Before incorporating changes in the management of their patients, a thorough evaluation of the current or published literature is a necessary step in practicing evidence-based medicine.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.

 
   References Top

1.
Burls A. What is Critical Appraisal? 2 nd ed. Oxford, UK: University of Oxford; 2009. (What is…? Series). Available from: http://www.medicine.ox.ac.uk/bandolier/painres/download/whatis/what_is_critical_appraisal.pdf. [Last accessed on 2016 Jun 19].  Back to cited text no. 1
    
2.
Glasziou PP. Information overload: What′s behind it, what′s beyond it? Med J Aust 2008;189:84-5.  Back to cited text no. 2
    
3.
Strite SA, Stuart ME. Getting started with critical appraisal of medical literature: It is easier than you think. Calif Pharm 2009;LVI:52-5.  Back to cited text no. 3
    
4.
Forder PM, Gebski VJ, Keech AC. Allocation concealment and blinding: When ignorance is bliss. Med J Aust 2005;182:87-9.  Back to cited text no. 4
    
5.
Bialocerkowski A, Klupp N, Bragge P. How to read and critically appraise a reliability article. Int J Ther Rehabil 2010;17:114-20.  Back to cited text no. 5
    
6.
du Prel JB, Hommel G, Röhrig B, Blettner M. Confidence interval or P-value?: Part 4 of a series on evaluation of scientific publications. Dtsch Arztebl Int 2009;106:335-9.  Back to cited text no. 6
    
7.
Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. BMJ 2010;340:698-702.  Back to cited text no. 7
    
8.
Scottish Intercollegiate Guidelines Network. Available from: http://www.sign.ac.uk/methodology/checklists.html. [Last accessed on 2016 Jun 19].  Back to cited text no. 8
    
9.
Strobe Statement. Available from: http://www.strobe-statement.org/index.php?id=available-checklists. [Last accessed on 2016 Jun 19].  Back to cited text no. 9
    
10.
Lachin JM. Statistical considerations in the intent-to-treat principle. Control Clin Trials 2000;21:167-89.  Back to cited text no. 10
    
11.
du Prel JB, Röhrig B, Blettner M. Critical appraisal of scientific articles: Part 1 of a series on evaluation of scientific publications. Dtsch Arztebl Int 2009;106:100-5.  Back to cited text no. 11
    
12.
Kjaergard LL, Villumsen J, Gluud C. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med 2001;135:982-9.  Back to cited text no. 12
    



 
 
    Tables

  [Table 1], [Table 2]



 

Top
 
  Search
 
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

 
  In this article
    Abstract
   Introduction
    Steps to Critica...
   Summary
    References
    Article Tables

 Article Access Statistics
    Viewed1967    
    Printed4    
    Emailed0    
    PDF Downloaded849    
    Comments [Add]    

Recommend this journal