Open Journal Systems

EXPERIENCES IN PRACTICE

How to cite this article:

Romo-Martínez JE. La lista de cotejo como herramienta para la lectura crítica de artículos de investigación publicados. Rev Enferm Inst Mex Seguro Soc. 2015;23(2)109-13.

Checklist as a tool for critical reading of published research papers

Jesús Eduardo Romo-Martínez¹

¹Epidemiología, Unidad de Medicina Familiar/Unidad Médica de Atención Ambulatoria No. 29, Instituto Mexicano del Seguro Social, Acapulco, Guerrero, México

Correspondence: Jesús Eduardo Romo-Martínez

Email: jesus.romom@imss.gob.mx

Received: September 12^th 2014

Judged: February 16^th 2015

Accepted: March 24^th 2015

Abstract

The growth of scientific knowledge requires health professionals to form a habit of reading medical journals with minimum skills of comprehension, analysis and criticism in order to enrich the exercise of continuous updating. Learning the basics of epidemiology plays a very important role at the time of reading a medical publication; from the analytical point of view, it is important to understand the basis of this branch of medicine that allow to generate a critique of what we read with grounds. A check list is a useful test for the evaluation through observation (in this case the reading of a document), which enumerates the characteristics, aspects, qualities, etcetera, whose presence (or absence) we aim to determine. It is a list of comparison (material) to be applied while reading medical publications (method); an objective tool to facilitate the understanding and analysis. This list is divided into five essential sections: an overview of the publication, type of study, methodology, presentation and interpretation of results, as well as the discussion and conclusions of the publication. It is imperative to develop capacities to evaluate critical aspects that allow us using valid information and then integrating them to our knowledge. Far from seeking to shorten the fundamentals and basic concepts of basic epidemiology, biostatistics and research methodology, this is an invitation to the reader of medical journals to take a close look at the fascinating field of these branches of medicine through the references.

Keywords: Critical reading; Scientific and technical publications; Checklist

---

Introduction

Significant and abundant evidence in the field of biomedical, clinical, and public health research has been generated on a global level;¹ this is a step forward that, thanks to technology and the expansion of the media, is available to health professionals and the general public. Given this algorithmic growth of technical and scientific knowledge (more than 20,000 biomedical journals and 2 million publications a year),² it is necessary to make a special focus for those working in the field of public health and epidemiology.³

As health professionals, we are forced to form a habit of reading with minimal skills of comprehension, analysis, and criticism to truly enrich the exercise of continuously staying up to date.⁴ Publications or medical articles are, per se, the tool of first resort to achieve this objective.⁵ This tool moreover represents a very profitable activity at the time of research design, as both activities have many similarities and points convergence.⁶

The first thing you should turn to is the means by which we will get the information. To do this we must know the available information resources that are electronically systematized to facilitate obtaining publications and which are stored in Internet databases: Medline, PubMed, LILACS, EMBASE, OVID, EBSCO, Cochrane, et cetera. The next step is to choose the article, so we have proposed several strategies to select a publication under the assumptions of relevance and quality of the presence of a number of features (in most cases).⁷ Finally, the article should be read and reviewed to generate an idea and, even better, a critique of it.

Taking into account the principles of epidemiology plays an important role in critical conception when reading a publication, so from an analytical point of view it is important to understand the basics of numerical language,⁸ know the basics of biostatistics,⁹ understand the methodology of epidemiological research and other skills in order to formulate an enriched opinion and determine the clinical relevance of the material consulted.¹⁰
A checklist is a useful verification tool for evaluating through observation (in this case the reading of a document). It lists the features, aspects, qualities, etc., of which one is interested in determining the presence (and absence).

The aim of this work is to provide, through a checklist, an objective tool to facilitate understanding and analysis of medical literature.

Tool design

A tool is presented in checklist format (material) to execute during the reading (method) of medical publications. It is a guide characterized by "checklist" format, divided into five sections, allowing readers to identify the most essential points in order to develop the ability to form a critique and an opinion on any published work, and for evidence to strengthen their knowledge (Table I).

Overview of publications

Definitely a reading with critical view is not always easy,¹¹ and the first step when we hold reading material in our own hands (or on the screen of our computer) will be to evaluate general aspects to decide whether to continue.

In most cases we turn to publications in order to stay up to date, so logically we must consider the source, taking into account the journal and if its theme is appropriate to our field and needs; check that the research is relatively current (less than five years); if the author is recognized in the subject (with other similar work); the institution where the research took place, and so on.

In any publication it is hoped that the title of material will project a short nature of the investigation. This must be clear and preferably show the cause and effect variables; in the best case, it will specify the type of study.

The abstract will be presented in a structured way, according to the sections of the publication and providing appropriate keywords to grasp the nature of the article.

The introduction of the work will provide an overview of the subject matter, definitions and background, inviting the reader to being reading. Finally, the objectives should be clear and directly connected with the title; this is expected to be in the infinitive (to describe, to analyze, to investigate, etc.).¹²

Type of study

Medical literature has multiple publications regarding the type of article, which is, broadly speaking, informative or of a research nature. For the informative article we have newsletters, reviews, letters to the editor, consensus information, and so on. In the case of research articles they are found in the form of original articles; however, it is worth noting that those of an epidemiological nature are best suited to exercise judgment based on an investigation, because medicine is mainly built on evidence, because they provide results obtained from populations.

Within the category of other types of research studies, such as case studies or case series, beyond providing scientific evidence, they share with us an outcome from the point of view of isolated experiences.¹³

Once a publication has been identified with epidemiological research, you should consider the divisions within this kind of studies, which are classified according to specific criteria, among which jump out the factor of exposure and its effect, temporality, and the position of the researcher (observational or experimental).^6,10

Methodology in a publication

This section is the backbone of any item. It is related to the objective description of the way the investigation was conducted, showing the steps to the extent that it could be reproduced by a researcher.¹ This section should contain information about the date and place where the research was conducted; define the study population; describe the criteria for their inclusion or exclusion; expose and ideally exemplify the calculation of sample size;^14,15 consider the types of potential bias;¹ appropriately explain the type of epidemiological study looking at the distribution of subjects included, comparison, follow-up over time (if applicable); mention quality control, etc.^6,8,10

One aspect that deserves special attention has to do with the hypothesis. It is said that this is "null" when there is no statistically significant difference, and therefore it is likely that the result is due to chance; it is said to be "alternative" when there is a statistically significant difference (e.g. a result with p-value <0.05). This latter is how researchers mostly opt to provide relevant knowledge. This statistical result is derived from a special test, depending on the type of variable (qualitative or quantitative).¹⁷

Presentation and interpretation of results

To describe and analyze data, it is necessary to apply the concepts and methods of biostatistics. In epidemiological research, samples are often used from which one can infer characteristics of the populations studied.⁶ The findings should be presented in a logical order and the most important highlighted using the past tense; they will be supported by tables and figures appropriate to the information they provide and in turn saving on redundant descriptions in the text.^1,6

Discussion and conclusions of the publication

The discussion should answer the research question, as this section deals with the evaluation and interpretation of the data.¹ It should preferably follow a logical order to break down the main contributions of the study and put greatest emphasis on the primary outcome and comparison with other research and with secondary outcomes. We must take into account that even if there is no statistically significant result, this may be relevant in some situations. Also the author must state the strengths and limitations of the study and finally conclude with the contribution of research (if applicable), recommendations, and the main message.

Final thoughts

When evaluating a published work with these points, the goal is to develop capabilities to assess critical aspects which allow the use of valid information and to then integrate them into our knowledge, to consider whether such an article read offered an impact or anything new for current knowledge and if it was really significant to your need.

At no time was the goal to abbreviate the fundamentals and basic concepts of basic epidemiology, biostatistics and research methodology; rather, the opposite: to invite the reader in the spirit of staying current, to delve into the fascinating field of epidemiology and public health through the referenced bibliographies.

References

1. Hernández M, Lazcano E. Salud Pública teórica y práctica. 1^st ed. México: Manual Moderno; 2013.
2. Rivas R, Talavera J. Investigación clínica VII. Búsqueda sistemática: cómo localizar artículos. Rev. Med Inst Mex Seguro Soc. 2012;50(1):53-8.
3. Tricco A, Tetzlaff J, Moher D. The art and science of knowledge synthesis J. Clin epidemiol. 2011;64:11-20.
4. Khan K, Kunz R, Kleijnen J, Antes G. Systematic reviews to support evidence-based medicine. Second edition. London: Royal Society of Medicine; 2011.
5. Feinstein AR. Clinical epidemiology. The architecture of clinical research. US: WB Saunders; 1985.
6. Bonita R, Beaglehole R, Kjellström. Epidemiología básica. Segunda edición. Washington, D. C: OPS; 2008.
7. Talavera J, Rivas-Ruiz R. Investigación clínica VIII. Revisión estructurada de un artículo. Rev Med Inst Mex Seguro Soc. 2012;50 (2):163-6.
8. Londoño F. Metodología de la investigación epidemiológica. 3a ed. Bogotá: Manual Moderno; 2004.
9. Feinstein AR. Principles of medical statistics. New York, NY: Chapman and Hall/CRC; 2002.
10. Hernández M, Garrido F, López S. Diseño de estudios epidemiológicos. Salud Publica Mex. 2000;42(2):144-54.
11. Zaccai J. How to assess epidemiological studies. Postgrad Med J. 2004;80:140-7.
12. González-Labrador G. Partes componentes y elaboración del protocolo de investigación y terminación del trabajo de la residencia. Rev Cubana Med Gen Integr. 2010; 26(2):387-406.
13. Portney LG, Watkins MP. Foundations of clinical research. Applications to practice. Chicago IL: Appleton and Lange; 1993.
14. Celis AJ. Bioestadística. 2a ed. México: Manual Moderno; 2008.
15. Talavera J, Rivas R, Bernal L. Investigación clínica V. Tamaño de la muestra. Rev Med Inst Mex Seguro Soc. 2011;49(5):517-522.
16. Hernández M, Garrido F, Salazar E. Sesgos en estudios epidemiológicos. Sal Publica Mex. 2000;42(5):438-46.
17. Talavera J, Rivas R. Investigación clínica IV. Pertinencia de la prueba estadística seleccionada. Rev Mex Inst Mex Seguro Soc. 2011;49(4):401-5.

Enlaces refback

• No hay ningún enlace refback.