THC Science

Systematic reviews are a type of review that uses repeatable analytical methods to collect secondary data and analyse it. Systematic reviews are a type of evidence synthesis which formulate research questions that are broad or narrow in scope, and identify and synthesize data that directly relate to the systematic review question.^[1] While some people might associate ‘systematic review’ with 'meta-analysis', there are multiple kinds of review which can be defined as ‘systematic’ which do not involve a meta-analysis. Some systematic reviews critically appraise research studies, and synthesize findings qualitatively or quantitatively.^[2] Systematic reviews are often designed to provide an exhaustive summary of current evidence relevant to a research question. For example, systematic reviews of randomized controlled trials are an important way of informing evidence-based medicine,^[3] and a review of existing studies is often quicker and cheaper than embarking on a new study.

While systematic reviews are often applied in the biomedical or healthcare context, they can be used in other areas where an assessment of a precisely defined subject would be helpful.^[4] Systematic reviews may examine clinical tests, public health interventions, environmental interventions,^[5] social interventions, adverse effects, qualitative evidence syntheses, methodological reviews, policy reviews, and economic evaluations.^[6]^[7]

An understanding of systematic reviews and how to implement them in practice is highly recommended for professionals involved in the delivery of health care, public health and public policy. }}

Characteristics

Systematic reviews can be used to inform decision making in many different disciplines, such as evidence-based healthcare and evidence-based policy and practice.^[8]

A systematic review can be designed to provide an exhaustive summary of current literature relevant to a research question.

A systematic review uses a rigorous and transparent approach for research synthesis, with the aim of assessing and, where possible, minimizing bias in the findings. While many systematic reviews are based on an explicit quantitative meta-analysis of available data, there are also qualitative reviews and other types of mixed-methods reviews which adhere to standards for gathering, analyzing and reporting evidence.^[9]

Systematic reviews of quantitative data or mixed-method reviews sometimes use statistical techniques (meta-analysis) to combine results of eligible studies. Scoring levels are sometimes used to rate the quality of the evidence depending on the methodology used, although this is discouraged by the Cochrane Library.^[10] As evidence rating can be subjective, multiple people may be consulted to resolve any scoring differences between how evidence is rated.^[11]^[12]^[13]

The EPPI-Centre, Cochrane and the Joanna Briggs Institute have all been influential in developing methods for combining both qualitative and quantitative research in systematic reviews.^[14]^[15]^[16] Several reporting guidelines exist to standardise reporting about how systematic reviews are conducted. Such reporting guidelines are not quality assessment or appraisal tools. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement^[17] suggests a standardized way to ensure a transparent and complete reporting of systematic reviews, and is now required for this kind of research by more than 170 medical journals worldwide.^[8] Several specialized PRISMA guideline extensions have been developed to support particular types of studies or aspects of the review process, including PRISMA-P for review protocols and PRISMA-ScR for scoping reviews.^[8] A list of PRISMA guideline extensions is hosted by the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network.^[18]

For qualitative reviews, reporting guidelines include ENTREQ (Enhancing transparency in reporting the synthesis of qualitative research) for qualitative evidence syntheses; RAMESES (Realist And MEta-narrative Evidence Syntheses: Evolving Standards) for meta-narrative and realist reviews;^[19]^[20] and eMERGe (Improving reporting of Meta-Ethnography) for meta-ethnograph.^[14]

Developments in systematic reviews during the 21st century included realist reviews and the meta-narrative approach, both of which addressed problems of variation in methods and heterogeneity existing on some subjects.^[21]^[22]

Types of systematic review

There are over 30 types of systematic review and the Table 1 below summarises some of these, but it is not exhaustive.^[8]^[17] It is important to note that there is not always consensus on the boundaries and distinctions between the approaches described below.

Table 1: A summary of some of the types of systematic review.
Review type	Summary
Mapping review/systematic map	A mapping review maps existing literature and categorizes data. The method characterizes quantity and quality of literature, including by study design and other features. Mapping reviews can be used to identify the need for primary or secondary research.^[8]
Meta-analysis	A meta-analysis is a statistical analysis that combines the results of multiple quantitative studies. Using statistical methods, results are combined to provide evidence from multiple studies. The two types of data generally used for meta-analysis in health research are individual participant data and aggregate data (such as odds ratios or relative risks).
Mixed studies review/mixed methods review	Refers to any combination of methods where one significant stage is a literature review (often systematic). It can also refer to a combination of review approaches such as combining quantitative with qualitative research.^[8]
Qualitative systematic review/qualitative evidence synthesis	This method for integrates or compares findings from qualitative studies. The method can include ‘coding’ the data and looking for ‘themes’ or ‘constructs’ across studies. Multiple authors may improve the ‘validity’ of the data by potentially reducing individual bias.^[8]
Rapid review	An assessment of what is already known about a policy or practice issue, which uses systematic review methods to search for and critically appraise existing research. Rapid reviews are still a systematic review, however parts of the process may be simplified or omitted in order to increase rapidity.^[23] Rapid reviews were used during the COVID-19 pandemic.^[24]
Systematic review	A systematic search for data, using a repeatable method. It includes appraising the data (for example the quality of the data) and a synthesis of research data.
Systematic search and review	Combines methods from a ‘critical review’ with a comprehensive search process. This review type is usually used to address broad questions to produce the most appropriate evidence synthesis. This method may or may not include quality assessment of data sources.^[8]
Systematized review	Include elements of systematic review process, but searching is often not as comprehensive as a systematic review and may not include quality assessments of data sources.

Scoping reviews

Scoping reviews are distinct from systematic reviews in several important ways. A scoping review is an attempt to search for concepts by mapping the language and data which surrounds those concepts and adjusting the search method iteratively to synthesize evidence and assess the scope of an area of inquiry.^[21]^[22] This can mean that the concept search and method (including data extraction, organisation and analysis) are refined throughout the process, sometimes requiring deviations from any protocol or original research plan.^[25]^[26] A scoping review may often be a preliminary stage before a systematic review, which 'scopes' out an area of inquiry and maps the language and key concepts to determine if a systematic review is possible or appropriate, or to lay the groundwork for a full systematic review. The goal can be to assess how much data or evidence is available regarding a certain area of interest.^[25]^[27] This process is further complicated if it is mapping concepts across multiple languages or cultures.

As a scoping review should be systematically conducted and reported (with a transparent and repeatable method), some academic publishers categorize them as a kind of 'systematic review', which may cause confusion. Scoping reviews are helpful when it is not possible to carry out a systematic synthesis of research findings, for example, when there are no published clinical trials in the area of inquiry. Scoping reviews are helpful when determining if it is possible or appropriate to carry out a systematic review, and are a useful method when an area of inquiry is very broad,^[28] for example, exploring how the public are involved in all stages systematic reviews.^[29]

There is still a lack of clarity when defining the exact method of a scoping review as it is both an iterative process and is still relatively new.^[30] There have been several attempts to improve the standardisation of the method,^[31]^[32]^[33]^[34] for example via a PRISMA guideline extension for scoping reviews (PRISMA-ScR).^[35] PROSPERO (the International Prospective Register of Systematic Reviews) does not permit the submission of protocols of scoping reviews,^[36] although some journals will publish protocols for scoping reviews.^[29]

{{FIG}} template missing ID and not present in Wikidata.While there are multiple kinds of systematic review methods, the main stages of a review can be summarised into five stages:

1. Defining the research question

Defining an answerable question and agreeing an objective method is required to design a useful systematic review.^[37] Best practice recommends publishing the protocol of the review before initiating it to reduce the risk of unplanned research duplication and to enable consistency between methodology and protocol.^[38] Clinical reviews of quantitative data are often structured using the acronym PICO, which stands for 'Population or Problem', 'Intervention or Exposure', 'Comparison' and 'Outcome', with other variations existing for other kinds of research. For qualitative reviews PICo is 'Population or Problem', 'Interest' and 'Context'.

2. Searching for relevant data sources

Planning how the review will search for relevant data from research that matches certain criteria is a decisive stage in developing a rigorous systematic review. Relevant criteria can include only selecting research that is good quality and answers the defined question.^[37] The search strategy should be designed to retrieve literature that matches the protocol's specified inclusion and exclusion criteria.

The methodology section of a systematic review should list all of the databases and citation indices that were searched. The titles and abstracts of identified articles can be checked against pre-determined criteria for eligibility and relevance. Each included study may be assigned an objective assessment of methodological quality, preferably by using methods conforming to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement,^[18] or the high-quality standards of Cochrane.^[39]

Common information sources used in searches include scholarly databases of peer-reviewed articles such as MEDLINE, Web of Science, Embase, and PubMed as well as sources of unpublished literature such as clinical trial registries and grey literature collections. Key references can also be yielded through additional methods such as citation searching, reference list checking (related to a search method called 'pearl growing'), manually searching information sources not indexed in the major electronic databases (sometimes called 'hand-searching'),^[40] and directly contacting experts in the field.^[41]

To be systematic, searchers must use a combination of search skills and tools such as database subject headings, keyword searching, Boolean operators, proximity searching, while attempting to balance the sensitivity (systematicity) and precision (accuracy). Inviting and involving an experienced information professional or librarian can notably improve the quality of systematic review search strategies and reporting.^[42]^[43]^[44]^[45]^[46]

3. 'Extraction' of relevant data

Relevant data are 'extracted' from the data sources according to the review method. It is important to note that the data extraction method is specific to the kind of data, and data extracted on ‘outcomes’ is only relevant to certain types of reviews. For example, a systematic review of clinical trials might extract data about how the research was done (often called the method or 'intervention'), who participated in the research (including how many people), how it was paid for (for example funding sources) and what happened (the outcomes).^[37] Figure 1 illustrates relevant data being extracted and 'combined' in a Cochrane intervention effect review, where a meta-analysis is possible.

4. Assess the eligibility of the data

This stage involves assessing the eligibility of data for inclusion in the review, by judging it against criteria identified at the first stage.^[37] This can include assessing if a data source meets the eligibility criteria, and recording why decisions about inclusion or exclusion in the review were made. Software can be used to support the selection process including text mining tools and machine learning, which can automate aspects of the process.^[47] The ‘Systematic Review Toolbox’ is a community driven, web-based catalogue of tools, to help reviewers chose appropriate tools for reviews.^[48]

5. Analyse and combine the data

Analysing and combining data can provide an overall result from all the data. Because this combined result uses qualitative or quantitative data from all eligible sources of data, it is considered more reliable as it provides better evidence, as the more data included in reviews, the more confident we can be of conclusions. When appropriate, some systematic reviews include a meta-analysis, which uses statistical methods to combine data from multiple sources. A review might use quantitative data, or might employ a qualitative meta-synthesis, which synthesises data from qualitative studies. The combination of data from a meta-analysis can sometimes be visualised. One method uses a a forest plot (also called a blobbogram).^[37] In an intervention effect review, the diamond in the 'forest plot' represents the combined results of all the data included.^[37]

An example of a 'forest plot' is the Cochrane Collaboration logo.^[37] The logo is a forest plot of one of the first reviews which showed that corticosteroids given to women who are about to give birth prematurely can save the life of the newborn child.^[49]

Recent visualisation innovations include the albatross plot, which plots p-values against sample sizes, with approximate effect-size contours superimposed to facilitate analysis.^[50] The contours can be used to infer effect sizes from studies that have been analysed and reported in diverse ways. Such visualisations may have advantages over other types when reviewing complex interventions.

Assessing the quality (or certainty) of evidence is an important part of some reviews. GRADE (Grading of Recommendations, Assessment, Development and Evaluations) is a transparent framework for developing and presenting summaries of evidence and is used to grade the quality of evidence.^[51] The GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative research) is used to provide a transparent method for assessing the confidence of evidence from reviews or qualitative research.^[52] Once these stages are complete, the review may be published, disseminated and translated into practice after being adopted as evidence.

Living systematic reviews

Living systematic reviews are a relatively new kind of high quality, semi-automated, up-to-date online summaries of research which are updated as new research becomes available.^[53] The essential difference between a living systematic review and a conventional systematic review is the publication format. Living systematic reviews are 'dynamic, persistent, online-only evidence summaries, which are updated rapidly and frequently'.^[54]

Research fields

Medicine and human health

History of systematic reviews in medicine

A 1904 British Medical Journal paper by Karl Pearson collated data from several studies in the UK, India and South Africa of typhoid inoculation. He used a meta-analytic approach to aggregate the outcomes of multiple clinical studies.^[55] In 1972 Archie Cochrane wrote: 'It is surely a great criticism of our profession that we have not organised a critical summary, by specialty or subspecialty, adapted periodically, of all relevant randomised controlled trials'.^[56] Critical appraisal and synthesis of research findings in a systematic way emerged in 1975 under the term 'meta analysis'.^[57]^[58] Early syntheses were conducted in broad areas of public policy and social interventions, with systematic research synthesis applied to medicine and health.^[59] Inspired by his own personal experiences as a senior medical officer in prisoner of war camps, Archie Cochrane worked to improve how the scientific method was used in medical evidence, writing in 1971: 'the general scientific problem with which we are primarily concerned is that of testing a hypothesis that a certain treatment alters the natural history of a disease for the better'.^[60] His call for the increased use of randomised controlled trials and systematic reviews led to the creation of The Cochrane Collaboration,^[61] which was founded in 1993 and named after him, building on the work by Iain Chalmers and colleagues in the area of pregnancy and childbirth.^[62]^[56]

Current use of systematic reviews in medicine

Many organisations around the world use systematic reviews, with the methodology depending on the guidelines being followed. Organisations which use systematic reviews in medicine and human health include the National Institute for Health and Care Excellence (NICE, UK), the Agency for Healthcare Research and Quality (AHRQ, USA) and the World Health Organisation. Most notable among international organisations is Cochrane, a group of over 37,000 specialists in healthcare who systematically review randomised trials of the effects of prevention, treatments and rehabilitation as well as health systems interventions. When appropriate, they also include the results of other types of research. Cochrane Reviews are published in The Cochrane Database of Systematic Reviews section of the Cochrane Library. The 2015 impact factor for The Cochrane Database of Systematic Reviews was 6.103, and it was ranked 12th in the Medicine, General & Internal category.^[63]

There are several types of Cochrane Review, including:^[64]^[65]^[66]^[67]

Intervention reviews assess the benefits and harms of interventions used in healthcare and health policy.
Diagnostic test accuracy reviews assess how well a diagnostic test performs in diagnosing and detecting a particular disease.
Methodology reviews address issues relevant to how systematic reviews and clinical trials are conducted and reported.
Qualitative reviews synthesize qualitative evidence to address questions on aspects other than effectiveness.
Prognosis reviews address the probable course or future outcome(s) of people with a health problem.
Overviews of Systematic Reviews (OoRs) are a new type of study to compile multiple evidence from systematic reviews into a single document that is accessible and useful to serve as a friendly front end for the Cochrane Collaboration with regard to healthcare decision-making. These are sometimes referred to as 'umbrella reviews'.
Living Systematic reviews are continually updated, incorporating relevant new evidence as it becomes available.^[68] They are a relatively new kind of review, with methods still being developed and evaluated. They can be high quality, semi-automated, up-to-date online summaries of research which are updated as new research becomes available.^[69] The essential difference between a 'living systematic review' and a conventional systematic review is the publication format. Living systematic reviews are 'dynamic, persistent, online-only evidence summaries, which are updated rapidly and frequently'.^[70]
Rapid reviews are a form of knowledge synthesis that ‘accelerates the process of conducting a traditional systematic review through streamlining or omitting specific methods to produce evidence for stakeholders in a resource-efficient manner’.^[71]
Reviews of complex health interventions in complex systems review interventions and interventions delivered in complex systems to improve evidence synthesis and guideline development at a global, national or health systems level.^[72]

The Cochrane Collaboration provides a handbook for systematic reviewers of interventions which 'provides guidance to authors for the preparation of Cochrane Intervention reviews.'^[39] The Cochrane Handbook also outlines the key steps for preparing a systematic review^[39] and forms the basis of two sets of standards for the conduct and reporting of Cochrane Intervention Reviews (MECIR - Methodological Expectations of Cochrane Intervention Reviews).^[73] It also contains guidance on how to undertake qualitative evidence synthesis, economic reviews and integrating patient-reported outcomes into reviews.

The Cochrane Library is a collection of databases that contains different types of independent evidence to inform healthcare decision-making. It contains a database of systematic review and meta-analyses which summarize and interpret the results of multi-disciplinary research. The library contains the Cochrane Database of Systematic Reviews (CDSR), which is a journal and database for systematic reviews in health care. The Cochrane Library also contains the Cochrane Central Register of Controlled Trials (CENTRAL) which is a database of reports of randomized and quasi-randomized controlled trials.^[74] The Cochrane Library is also available in Spanish.^[75]

The Cochrane Library is owned by Cochrane. It was originally published by Update Software and now published by the share-holder owned publisher John Wiley & Sons, Ltd. as part of Wiley Online Library. Royalties from sales of the Cochrane Library are the major source of funds for Cochrane (over £6 million in 2017). There are 3.66 billion people around the world who have access to the Library through national licences (national licences cost £1.5 billion^[76]) or free provision for populations in low- and middle-income countries eligible under the WHO’s HINARI initiative.^[76] Authors must pay an additional fee for their review to be truly open access.^[77] Cochrane has an annual income of $10m USD.^[78]

Public involvement and citizen science in systematic reviews

Cochrane has several tasks that the public or other 'stakeholders' can be involved in doing, associated with producing systematic reviews and other outputs. Tasks can be organised as 'entry level' or higher. Tasks include:

Joining a collaborative volunteer effort to help categorise and summarise healthcare evidence^[79]
Data extraction and risk of bias assessment
Translation of reviews into other languages

A recent systematic review of how people were involved in systematic reviews aimed to document the evidence-base relating to stakeholder involvement in systematic reviews and to use this evidence to describe how stakeholders have been involved in systematic reviews.^[80] Thirty percent involved patients and/or carers. The ACTIVE framework provides a way to consistently describe how people are involved in systematic review, and may be used as a way to support the decision-making of systematic review authors in planning how to involve people in future reviews.^[81] Standardised Data on Initiatives (STARDIT) is another proposed way of reporting who has been involved in which tasks during research, including systematic reviews.^[82]

While there has been some criticism of how Cochrane prioritises systematic reviews,^[83] a recent project involved people in helping identify research priorities to inform future Cochrane Reviews.^[84]^[85] In 2014, the Cochrane-Wikipedia partnership was formalised. This supports the inclusion of relevant evidence within all Wikipedia medical articles, as well as other processes to help ensure that medical information included in Wikipedia is of the highest quality and accuracy.^[86]

Learning resources

Cochrane has produced many learning resources to help people understand what systematic reviews are, and how to do them. Most of the learning resources can be found at the 'Cochrane Training' webpage,^[87] which also includes a link to the book Testing Treatments, which has been translated into many languages.^[88] In addition, Cochrane has created a short video What are Systematic Reviews which explains in plain English how they work and what they are used for.^[89] The video has been translated into multiple languages,^[90] and viewed over 192,282 times (as of August 2020). In addition, an animated storyboard version was produced and all the video resources were released in multiple versions under Creative Commons for others to use and adapt.^[91]^[92]^[93]^[94] The Critical Appraisal Skills Programme (CASP) provides free learning resources to support people to appraise research critically, including a checklist which contains 10 questions to 'help you make sense of a systematic review'.^[95]^[96]

Social, behavioural and educational

Several organisations use systematic reviews in social, behavioural, and educational areas of evidence-based policy, including the National Institute for Health and Care Excellence (NICE, UK), Social Care Institute for Excellence (SCIE, UK), the Agency for Healthcare Research and Quality (AHRQ, USA), the World Health Organisation, the International Initiative for Impact Evaluation (3ie), the Joanna Briggs Institute and the Campbell Collaboration. The quasi-standard for systematic review in the social sciences is based on the procedures proposed by the Campbell Collaboration, which is one of several groups promoting evidence-based policy in the social sciences. The Campbell Collaboration: 'helps people make well-informed decisions by preparing, maintaining and disseminating systematic reviews in education, crime and justice, social welfare and international development.'^[97] The Campbell Collaboration is a sibling initiative of Cochrane, and was created in 2000 at the inaugural meeting in Philadelphia, USA, attracting 85 participants from 13 countries.^[98]

Business and economics

Due to the different nature of research fields outside of the natural sciences, the aforementioned methodological steps cannot easily be applied in all areas of business research. Some attempts to transfer the procedures from medicine to business research have been made,^[99] including a step-by-step approach,^[100] and developing a standard procedure for conducting systematic literature reviews in business and economics. The Campbell & Cochrane Economics Methods Group (C-CEMG) works to improve the inclusion of economic evidence into Cochrane and Campbell systematic reviews of interventions, to enhance the usefulness of review findings as a component for decision-making.^[101] Such economic evidence is crucial for health technology assessment processes.

International development research

Systematic reviews are increasingly prevalent in other fields, such as international development research.^[102] Subsequently, several donors (including the UK Department for International Development (DFID) and AusAid) are focusing more attention and resources on testing the appropriateness of systematic reviews in assessing the impacts of development and humanitarian interventions.^[102]

Environment

The Collaboration for Environmental Evidence (CEE) works to achieve a sustainable global environment and the conservation of biodiversity. The CEE has a journal titled Environmental Evidence which publishes systematic reviews, review protocols and systematic maps on impacts of human activity and the effectiveness of management interventions.^[103]

Review tools

A 2019 publication identified 15 systematic review tools and ranked them according to the number of 'critical features' as required to perform a systematic review, including:^[104]

DistillerSR: a paid web application
Swift Active Screener: a paid web application
Covidence: a paid web application and Cochrane technology platform.
Rayyan: a free web application
Sysrev: a free web application

Limitations

Out-dated or risk of bias

While systematic reviews are regarded as the strongest form of evidence, a 2003 review of 300 studies found that not all systematic reviews were equally reliable, and that their reporting can be improved by a universally agreed upon set of standards and guidelines.^[105] A further study by the same group found that of 100 systematic reviews monitored, 7% needed updating at the time of publication, another 4% within a year, and another 11% within 2 years; this figure was higher in rapidly changing fields of medicine, especially cardiovascular medicine.^[106] A 2003 study suggested that extending searches beyond major databases, perhaps into grey literature, would increase the effectiveness of reviews.^[107]

Some authors have highlighted problems with systematic reviews, particularly those conducted by Cochrane, noting that published reviews are often biased, out of date and excessively long.^[108] Cochrane reviews have been criticized as not being sufficiently critical in the selection of trials and including too many of low quality. They proposed several solutions, including limiting studies in meta-analyses and reviews to registered clinical trials, requiring that original data be made available for statistical checking, paying greater attention to sample size estimates, and eliminating dependence on only published data.

Some of these difficulties were noted as early as 1994:

much poor research arises because researchers feel compelled for career reasons to carry out research that they are ill equipped to perform, and nobody stops them.

DG Altman, 1994^[109]

Methodological limitations of meta-analysis have also been noted.^[110] Another concern is that the methods used to conduct a systematic review are sometimes changed once researchers see the available trials they are going to include.^[111] Some website have described retractions of systematic reviews and published reports of studies included in published systematic reviews.^[112]^[113]^[114] Eligibility criteria must be justifiable and not arbitrary (for example, the date range searched) as this may affect the perceived quality of the review.^[115]^[116]

Limited reporting of clinical trials and data from human studies

The 'AllTrials' campaign highlights that around half of clinical trials have never reported results and works to improve reporting.^[117] This lack of reporting has extremely serious implications for research, including systematic reviews, as it is only possible to synthesize data of published studies. In addition, 'positive' trials were twice as likely to be published as those with 'negative' results.^[118] At present, it is legal for for-profit companies to conduct clinical trials and not publish the results.^[119] For example, in the past 10 years 8.7 million patients have taken part in trials that have not published results.^[119] These factors mean that it is likely there is a significant publication bias, with only 'positive' or perceived favourable results being published. A recent systematic review of industry sponsorship and research outcomes concluded that 'sponsorship of drug and device studies by the manufacturing company leads to more favorable efficacy results and conclusions than sponsorship by other sources' and that the existence of an industry bias that cannot be explained by standard 'Risk of bias' assessments.^[120] Systematic reviews of such a bias may amplify the effect, although it is important to note that the flaw is in the reporting of research generally, not in the systematic review method.

Poor compliance with review reporting guidelines

The rapid growth of systematic reviews in recent years has been accompanied by the attendant issue of poor compliance with guidelines, particularly in areas such as declaration of registered study protocols, funding source declaration, risk of bias data, and description of clear study objectives.^[121]^[122]^[123]^[124] A host of studies have identified weaknesses in the rigour and reproducibility of search strategies in systematic reviews.^[125]^[126]^[127]^[128]^[129]^[130] To remedy this issue, a new PRISMA guideline extension called PRISMA-S is being developed to improve the quality, reporting, and reproducibility of systematic review search strategies.^[131]^[132] Furthermore, tools and checklists for peer-reviewing search strategies have been created, such as the Peer Review of Electronic Search Strategies (PRESS) guidelines.^[133]

A key challenge for using systematic reviews in clinical practice and healthcare policy is assessing the quality of a given review. Consequently, a range of appraisal tools to evaluate systematic reviews have been designed. The two most popular measurement instruments and scoring tools for systematic review quality assessment are AMSTAR 2 (a measurement tool to assess the methodological quality of systematic reviews)^[134]^[135]^[136]^[137] and ROBIS (Risk Of Bias In Systematic reviews); however, these are not appropriate for all systematic review types.^[138]

About this article

This article is adapted from a peer-reviewed version of this article from the WikiJournal of Medicine.

Standardised Data on Initiatives (STARDIT) report

A STARDIT report about this article can be found here:

Reviewed STARDIT report version at time of publishing: STARDIT Report: What are systematic reviews? (Q101116128)
'Living' version: STARDIT Report: What are systematic reviews? (Q101116128)

References

^ "systematic review". GET-IT glossary. Retrieved 18 November 2015.
^ Armstrong R, Hall BJ, Doyle J, Waters E (March 2011). "Cochrane Update. 'Scoping the scope' of a cochrane review". Journal of Public Health. 33 (1): 147–50. doi:10.1093/pubmed/fdr015. PMID 21345890.
^ "What is EBM?". Centre for Evidence Based Medicine. 2009-11-20. Archived from the original on 2011-04-06. Retrieved 2011-06-17.
^ Ader, Herman J.; Mellenbergh, Gideon J.; Hand, David J. (2008). "Methodological quality". Advising on Research Methods: A consultant's companion. Johannes van Kessel Publishing. ISBN 978-90-79418-02-2. {{cite book}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ Bilotta, Gary S.; Milner, Alice M.; Boyd, Ian (2014). "On the use of systematic reviews to inform environmental policies". Environmental Science & Policy. 42: 67–77. doi:10.1016/j.envsci.2014.05.010. {{cite journal}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ Systematic reviews: CRD's guidance for undertaking reviews in health care (PDF). York: University of York, Centre for Reviews and Dissemination. 2008. ISBN 978-1-900640-47-3. Retrieved 17 June 2011.
^ Petticrew M, Roberts H (2006). Systematic reviews in the social sciences (PDF). Wiley Blackwell. ISBN 978-1-4051-2110-1. Archived from the original (PDF) on 2015-06-16.
^ ^a ^b ^c ^d ^e ^f ^g ^h Grant, Maria J.; Booth, Andrew (2009). "A typology of reviews: an analysis of 14 review types and associated methodologies". Health Information & Libraries Journal. 26 (2): 91–108. doi:10.1111/j.1471-1842.2009.00848.x. ISSN 1471-1842.
^ Bearman, Margaret; Dawson, Phillip (2013). "Qualitative synthesis and systematic review in health professions education". Medical Education. 47 (3): 252–260. doi:10.1111/medu.12092. ISSN 1365-2923.
^ Higgins, Julian P.T.; Thomas, James; Chandler, Jacqueline; Cumpston, Miranda; Li, Tianjing; Page, Matthew J.; Welch, Vivian A., eds. (2019-09-20). Cochrane Handbook for Systematic Reviews of Interventions. version 6.1. pp. section 4.6. Retrieved 2020-09-14. {{cite book}}: |website= ignored (help)
^ Siemieniuk, Reed; Guyatt, Gordon. "What is GRADE?". BMJ Best Practice. Retrieved 2020-08-26.
^ Adèr, Hermanus Johannes (2008). Advising on Research Methods: A Consultant's Companion. Johannes van Kessel Publishing. ISBN 978-90-79418-01-5.
^ Schünemann, Holger; Brożek, Jan; Guyatt, Gordon; Oxman, Andrew, eds. (2013). GRADE Handbook. Retrieved 2020-08-26.
^ ^a ^b Flemming, Kate; Booth, Andrew; Hannes, Karin; Cargo, Margaret; Noyes, Jane (2018-05). "Cochrane Qualitative and Implementation Methods Group guidance series—paper 6: reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses". Journal of Clinical Epidemiology. 97: 79–85. doi:10.1016/j.jclinepi.2017.10.022. {{cite journal}}: Check date values in: |date= (help)
^ Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin (2018-05-01). "Cochrane Qualitative and Implementation Methods Group guidance series—paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews". Journal of Clinical Epidemiology. 97: 70–78. doi:10.1016/j.jclinepi.2017.11.029. ISSN 0895-4356.
^ "EPPI-Centre Home". eppi.ioe.ac.uk. Retrieved 2020-06-29.
^ ^a ^b Booth, A; Noyes, J; Flemming, K; Gerhardus, A; Wahlster, P; Van der Wilt, GJ; Mozygemba, K; Refolo, P; Sacchini, D; Tummers, M; Rehfuess, E (2016). Guidance on choosing qualitative evidence synthesis methods for use in health technology assessments of complex interventions. p. 32. OCLC 944453327.
^ ^a ^b "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement". www.equator-network.org. Retrieved 2020-06-29.
^ Wong, Geoff; Greenhalgh, Trish; Westhorp, Gill; Buckingham, Jeanette; Pawson, Ray (2013). "RAMESES publication standards: meta‐narrative reviews". Journal of Advanced Nursing. 97: 987–1004. doi:10.1111/jan.12092.
^ Wong, Geoff; Greenhalgh, Trish; Westhorp, Gill; Buckingham, Jeanette; Pawson, Ray (2013). "RAMESES publication standards: realist syntheses". Journal of Advanced Nursing. 97: 987–1004. doi:10.1111/jan.12095.
^ ^a ^b Arksey, Hilary; O'Malley, Lisa (2005). "Scoping studies: Towards a methodological framework". International Journal of Social Research Methodology. 8: 19–32. doi:10.1080/1364557032000119616. {{cite journal}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ ^a ^b "PRISMA". www.prisma-statement.org. Retrieved 2020-07-01.
^ "What is a rapid review? Systematic Review Library Guides at CQ University". library.cqu.edu.au. Archived from the original on 2020-09-16. Retrieved 2020-09-16.
^ "Home". covidrapidreviews.cochrane.org. Retrieved 2020-07-01.
^ ^a ^b Peters, Micah D. J.; Godfrey, Christina M.; Khalil, Hanan; McInerney, Patricia; Parker, Deborah; Soares, Cassia Baldini (2015-09). "Guidance for conducting systematic scoping reviews". JBI Evidence Implementation. 13 (3): 141–146. doi:10.1097/XEB.0000000000000050. ISSN 2691-3321. {{cite journal}}: Check date values in: |date= (help)
^ Levac, Danielle; Colquhoun, Heather; O'Brien, Kelly K (2010-12). "Scoping studies: advancing the methodology". Implementation Science. 5 (1): 69. doi:10.1186/1748-5908-5-69. ISSN 1748-5908. {{cite journal}}: Check date values in: |date= (help)CS1 maint: unflagged free DOI (link)
^ Colquhoun, Heather L.; Levac, Danielle; O'Brien, Kelly K.; Straus, Sharon; Tricco, Andrea C.; Perrier, Laure; Kastner, Monika; Moher, David (2014-12). "Scoping reviews: time for clarity in definition, methods, and reporting". Journal of Clinical Epidemiology. 67 (12): 1291–1294. doi:10.1016/j.jclinepi.2014.03.013. ISSN 1878-5921. PMID 25034198. {{cite journal}}: Check date values in: |date= (help)
^ Lacaze, Paul; Fransquet, Peter; Tiller, Jane; Nunn, Jack S. (2019). "Public Involvement in Global Genomics Research: A Scoping Review". Frontiers in Public Health. 7. doi:10.3389/fpubh.2019.00079. ISSN 2296-2565.{{cite journal}}: CS1 maint: unflagged free DOI (link)
^ ^a ^b Pollock A, Campbell P, Struthers C, Synnot A, Nunn J, Hill S, Goodare H, Watts C, Morley R (2017-04-21). "Stakeholder involvement in systematic reviews: a protocol for a systematic review of methods, outcomes and effects". Research Involvement and Engagement. 3 (1): 9. doi:10.1186/s40900-017-0060-4. PMC 5611627. PMID 29062534.{{cite journal}}: CS1 maint: unflagged free DOI (link)
^ Munn, Zachary; Peters, Micah D. J.; Stern, Cindy; Tufanaru, Catalin; McArthur, Alexa; Aromataris, Edoardo (2018-12). "Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach". BMC Medical Research Methodology. 18 (1): 143. doi:10.1186/s12874-018-0611-x. ISSN 1471-2288. PMC 6245623. PMID 30453902. {{cite journal}}: Check date values in: |date= (help)CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)
^ Levac D, Colquhoun H, O'Brien KK (September 2010). "Scoping studies: advancing the methodology". Implementation Science. 5 (1): 69. doi:10.1186/1748-5908-5-69. PMC 2954944. PMID 20854677.{{cite journal}}: CS1 maint: unflagged free DOI (link)
^ Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB (September 2015). "Guidance for conducting systematic scoping reviews". International Journal of Evidence-Based Healthcare. 13 (3): 141–6. doi:10.1097/XEB.0000000000000050. PMID 26134548.
^ Colquhoun HL, Levac D, O'Brien KK, Straus S, Tricco AC, Perrier L, Kastner M, Moher D (December 2014). "Scoping reviews: time for clarity in definition, methods, and reporting". Journal of Clinical Epidemiology. 67 (12): 1291–4. doi:10.1016/j.jclinepi.2014.03.013. PMID 25034198.
^ Arksey, Hilary; O'Malley, Lisa (2005-02-01). "Scoping studies: towards a methodological framework". International Journal of Social Research Methodology. 8 (1): 19–32. doi:10.1080/1364557032000119616. {{cite journal}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ Tricco, Andrea C.; Lillie, Erin; Zarin, Wasifa; O'Brien, Kelly K.; Colquhoun, Heather; Levac, Danielle; Moher, David; Peters, Micah D.J.; Horsley, Tanya (2018-10-02). "PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation". Annals of Internal Medicine. 169 (7): 467. doi:10.7326/M18-0850. ISSN 0003-4819.
^ "PROSPERO". Centre for Reviews and Dissemination. University of York. Retrieved 2019-02-24.
^ ^a ^b ^c ^d ^e ^f ^g "Animated Storyboard: What Are Systematic Reviews?". cccrg.cochrane.org. Cochrane Consumers and Communication. Retrieved 1 June 2016.
^ "PRISMA". Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). Retrieved 2019-02-24.
^ ^a ^b ^c Higgins JP, Green S (eds.). "Cochrane handbook for systematic reviews of interventions, version 5.1.0 (updated March 2011)". The Cochrane Collaboration. Retrieved 2 June 2016.
^ "5. Handsearching". training.cochrane.org. Retrieved 2020-09-14.
^ Papaioannou, Diana; Sutton, Anthea; Carroll, Christopher; Booth, Andrew; Wong, Ruth (2010). "Literature searching for social science systematic reviews: consideration of a range of search techniques". Health Information & Libraries Journal. 27 (2): 114–122. doi:10.1111/j.1471-1842.2009.00863.x. ISSN 1471-1842.
^ Rethlefsen ML, Farrell AM, Osterhaus Trzasko LC, Brigham TJ (June 2015). "Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews". Journal of Clinical Epidemiology. 68 (6): 617–26. doi:10.1016/j.jclinepi.2014.11.025. PMID 25766056.
^ Koffel, Jonathan B. (2015-05-04). "Use of Recommended Search Strategies in Systematic Reviews and the Impact of Librarian Involvement: A Cross-Sectional Survey of Recent Authors". PLOS ONE. 10 (5): e0125931. doi:10.1371/journal.pone.0125931. ISSN 1932-6203. PMC 4418838. PMID 25938454.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)
^ Costella, John; Torabi, Nazi; Meert, Deborah (2016). "Impact of librarians on reporting of the literature searching component of pediatric systematic reviews". Journal of the Medical Library Association. 104 (4): 267–277. doi:10.5195/jmla.2016.139. ISSN 1558-9439. PMC 5079487. PMID 27822147.{{cite journal}}: CS1 maint: PMC format (link)
^ Yang, Kehu; Yao, Liang; Jiang, Tongxiao; Liang, Fuxiang; Moher, David; Tian, Hongliang; Tian, Jinhui; Li, Lun (2014-09-01). "Network meta-analyses could be improved by searching more sources and by involving a librarian". Journal of Clinical Epidemiology. 67 (9): 1001–1007. doi:10.1016/j.jclinepi.2014.04.003. ISSN 0895-4356. PMID 24841794.
^ Rethlefsen, Melissa L.; Murad, M. Hassan; Livingston, Edward H. (2014-09-10). "Engaging Medical Librarians to Improve the Quality of Review Articles". JAMA. 312 (10): 999. doi:10.1001/jama.2014.9263. ISSN 0098-7484.
^ Higgins, Julian P.T.; Thomas, James; Chandler, Jacqueline; Cumpston, Miranda; Li, Tianjing; Page, Matthew J.; Welch, Vivian A., eds. (2019-09-20). "Chapter 4: Searching for and selecting studies". Cochrane Handbook for Systematic Reviews of Interventions. version 6.1. section 4.6. Retrieved 2020-09-14. {{cite book}}: |website= ignored (help); Unknown parameter |nopp= ignored (|no-pp= suggested) (help)
^ Marshall, Christopher; Brereton, Pearl (2015-04-27). "Systematic review toolbox: a catalogue of tools to support systematic reviews". Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering. EASE '15. Nanjing, China: Association for Computing Machinery: 1–6. doi:10.1145/2745802.2745824. ISBN 978-1-4503-3350-4.
^ "The difference we make". www.cochrane.org. Retrieved 2019-03-08.
^ Higgins, Julian P. T.; López-López, José A.; Becker, Betsy J.; Davies, Sarah R.; Dawson, Sarah; Grimshaw, Jeremy M.; McGuinness, Luke A.; Moore, Theresa H. M.; Rehfuess, Eva A. (2019-01-01). "Synthesising quantitative evidence in systematic reviews of complex health interventions". BMJ Global Health. 4 (Suppl 1): e000858. doi:10.1136/bmjgh-2018-000858. ISSN 2059-7908.
^ "GRADE working group". www.gradeworkinggroup.org. Retrieved 2019-03-08.
^ "GRADE CERQual". www.cerqual.org. Retrieved 2020-07-01.
^ Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E (July 2014). "Systematic review automation technologies". Systematic Reviews. 3 (1): 74. doi:10.1186/2046-4053-3-74. PMC 4100748. PMID 25005128.{{cite journal}}: CS1 maint: unflagged free DOI (link)
^ Elliott JH, Turner T, Clavisi O, Thomas J, Higgins JP, Mavergames C, Gruen RL (February 2014). "Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap". PLoS Medicine. 11 (2): e1001603. doi:10.1371/journal.pmed.1001603. PMC 3928029. PMID 24558353.{{cite journal}}: CS1 maint: unflagged free DOI (link)
^ Group, British Medical Journal Publishing (1904-11-05). "Report on Certain Enteric Fever Inoculation Statistics". BMJ. 2 (2288): 1243–1246. doi:10.1136/bmj.2.2288.1243. ISSN 0007-1447.
^ ^a ^b "1.1.2 A brief history of Cochrane". community.cochrane.org. Archived from the original on 2019-01-17. Retrieved 2019-02-24.
^ Glass, Gene V.; Smith, Mary Lee; et al. (Far West Lab. for Educational Research and Development, San Francisco, CA) (1978). Meta-Analysis of Research on the Relationship of Class-Size and Achievement. The Class Size and Instruction Project. Washington, D.C.]: Distributed by ERIC Clearinghouse. {{cite book}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ "History of Systematic Reviews". Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre). Retrieved 2019-02-24.
^ Lau, J.; Antman, E. M.; Jimenez-Silva, J.; Kupelnick, B.; Mosteller, F.; Chalmers, T. C. (1992-07-23). "Cumulative meta-analysis of therapeutic trials for myocardial infarction". The New England Journal of Medicine. 327 (4): 248–254. doi:10.1056/NEJM199207233270406. ISSN 0028-4793. PMID 1614465.
^ Cochrane, A. L. (1972). Effectiveness and efficiency: random reflections on health services (PDF). [London]: Nuffield Provincial Hospitals Trust. ISBN 0-900574-17-8. OCLC 741462. Archived from the original on 2020-09-16.
^ Shah, Hriday M.; Chung, Kevin C. (2009-09). "Archie Cochrane and his vision for evidence-based medicine". Plastic and reconstructive surgery. 124 (3): 982. doi:10.1097/PRS.0b013e3181b03928. PMID 19730323. {{cite journal}}: Check date values in: |date= (help)
^ Evans, Imogen. (2011). Testing treatments : better research for better healthcare. Thornton, Hazel, 1935-, Chalmers, Iain., Glasziou, Paul, 1954- (Second edition ed.). London: Pinter & Martin. ISBN 978-1-905177-48-6. OCLC 778837501. {{cite book}}: |edition= has extra text (help)
^ The Cochrane Library. 2015 impact factor. Cochrane Database of Systematic Reviews (CDSR) Retrieved 2016-07-20.
^ Review Manager (RevMan) [Computer program]. Version 5.2. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2012.
^ "Main page". Cochrane Library.
^ Silva V, Grande AJ, Carvalho AP, Martimbianco AL, Riera R (2015). "Overview of systematic reviews - a new type of study. Part II". Revista Paulista de Medicina. 133 (3): 206–17. doi:10.1590/1516-3180.2013.8150015. PMID 25388685.
^ Silva V, Grande AJ, Martimbianco AL, Riera R, Carvalho AP (2012). "Overview of systematic reviews - a new type of study: part I: why and for whom?". Revista Paulista de Medicina. 130 (6): 398–404. doi:10.1590/S1516-31802012000600007. PMID 23338737.
^ "Living systematic reviews". community.cochrane.org. Retrieved 2020-07-01.
^ Tsafnat, Guy; Glasziou, Paul; Choong, Miew Keen; Dunn, Adam; Galgani, Filippo; Coiera, Enrico (2014-12). "Systematic review automation technologies". Systematic Reviews. 3 (1): 74. doi:10.1186/2046-4053-3-74. ISSN 2046-4053. PMC 4100748. PMID 25005128. {{cite journal}}: Check date values in: |date= (help)CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)
^ Elliott, Julian H.; Turner, Tari; Clavisi, Ornella; Thomas, James; Higgins, Julian P. T.; Mavergames, Chris; Gruen, Russell L. (2014-02-18). "Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap". PLoS Medicine. 11 (2): e1001603. doi:10.1371/journal.pmed.1001603. ISSN 1549-1676. PMC 3928029. PMID 24558353.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)
^ "Cochrane's work on Rapid Reviews in response to COVID-19". www.cochrane.org. Retrieved 2020-07-01.
^ Norris, Susan L.; Rehfuess, Eva A.; Smith, Helen; Tunçalp, Özge; Grimshaw, Jeremy M.; Ford, Nathan P.; Portela, Anayda (2019-01-01). "Complex health interventions in complex systems: improving the process and methods for evidence-informed health decisions". BMJ Global Health. 4 (Suppl 1): e000963. doi:10.1136/bmjgh-2018-000963. ISSN 2059-7908.
^ "Methodological Expectations of Cochrane Intervention Reviews (MECIR)". Cochrane. Retrieved 6 October 2014.
^ "Cochrane Controlled Register of Trials (CENTRAL)". Cochrane Library. Retrieved 2020-07-01.
^ "Revisiones Cochrane". Cochrane Library (in Spanish). Retrieved 2020-07-01.
^ ^a ^b "Cochrane's Future Publishing and Open Access Arrangements". Cochrane.org. 2019-07-02. Archived from the original on 2019-07-02.
^ "Open access options for the Cochrane Database of Systematic Reviews". Cochrane. Retrieved 2019-02-24.
^ Newman M (January 2019). "Has Cochrane lost its way?". BMJ. 364: k5302. doi:10.1136/bmj.k5302. PMID 30606713.
^ "Cochrane crowd". crowd.cochrane.org. Retrieved 2019-02-14.
^ Pollock A, Campbell P, Struthers C, Synnot A, Nunn J, Hill S, Goodare H, Morris J, Watts C, Morley R (November 2018). "Stakeholder involvement in systematic reviews: a scoping review". Systematic Reviews. 7 (1): 208. doi:10.1186/s13643-018-0852-0. PMC 6260873. PMID 30474560.{{cite journal}}: CS1 maint: unflagged free DOI (link)
^ Pollock, Alex; Campbell, Pauline; Struthers, Caroline; Synnot, Anneliese; Nunn, Jack; Hill, Sophie; Goodare, Heather; Morris, Jacqui; Watts, Chris (2019-04-18). "Development of the ACTIVE framework to describe stakeholder involvement in systematic reviews". Journal of Health Services Research & Policy: 135581961984164. doi:10.1177/1355819619841647. ISSN 1355-8196.
^ [Pre-print] "Standardised Data on Initiatives - STARDIT: Alpha Version". osf.io. doi:10.31219/osf.io/5q47h. Retrieved 2020-08-20.
^ Newman, Melanie (2019-01-03). "Has Cochrane lost its way?". BMJ. 364: k5302. doi:10.1136/bmj.k5302. ISSN 0959-8138. PMID 30606713.
^ Synnot, Anneliese J.; Tong, Allison; Bragge, Peter; Lowe, Dianne; Nunn, Jack S.; O’Sullivan, Molly; Horvat, Lidia; Kay, Debra; Ghersi, Davina (2019-04-29). "Selecting, refining and identifying priority Cochrane Reviews in health communication and participation in partnership with consumers and other stakeholders". Health Research Policy and Systems. 17 (1): 45. doi:10.1186/s12961-019-0444-z. ISSN 1478-4505. PMC 6489310. PMID 31036016.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)
^ Synnot A, Bragge P, Lowe D, Nunn JS, O'Sullivan M, Horvat L, Tong A, Kay D, Ghersi D, McDonald S, Poole N, Bourke N, Lannin N, Vadasz D, Oliver S, Carey K, Hill SJ (May 2018). "Research priorities in health communication and participation: international survey of consumers and other stakeholders". BMJ Open. 8 (5): e019481. doi:10.1136/bmjopen-2017-019481. PMC 5942413. PMID 29739780.
^ "The Cochrane-Wikipedia partnership in 2016". Cochrane. Retrieved 2019-02-24.
^ "Welcome". training.cochrane.org. Retrieved 2019-06-25.
^ "Testing Treatments". Cochrane Training. 2019-06-25. Archived from the original on 2019-06-25. Retrieved 2019-06-25.
^ Cochrane (2016-01-27), What are systematic reviews?, retrieved 2019-06-25
^ "Successful multi-language free online animated learning resource". Abstracts of the 24th Cochrane Colloquium; 23–27 October 2016, Seoul, South Korea. Wiley. 2016-10-23. doi:10.1002/14651858.CD201602.
^ "Creating a successful online animation resource: the 'what are systematic reviews?' video". Cochrane Community. 2019-06-25. Archived from the original on 2019-06-25. Retrieved 2019-06-25.
^ "Animated Storyboard: What Are Systematic Reviews?". cccrg.cochrane.org. Cochrane Consumers and Communication. Retrieved 1 June 2016.
^ Nunn, Jack; Synnot, Anneliese; Mcdonald, Steve; Allen, Kelly; Hill, Sophie (2015). "Building partnerships with the public by learning about Cochrane evidence". 23rd Cochrane Colloquium 2015. Archived from the original on 2015-11-09.
^ Nunn, Jack; Hill, Sophie. "What are systematic reviews?". Retrieved 2020-08-20.
^ "CASP Checklists". Critical Appraisal Skills Programme. Retrieved 2020-08-21.
^ "CASP Systematic Review Checklist" (PDF). casp-uk.net. 2020-08-21. Archived from the original (PDF) on 2020-08-21. Retrieved 2020-08-21.
^ "About Us". The Campbell Collaboration. Archived from the original on February 3, 2014. Retrieved March 26, 2014.
^ "History - Campbell". www.campbellcollaboration.org. Archived from the original on 24 September 2016. Retrieved 2016-09-27.
^ Tranfield D, Denyer D, Smart P (2003). "Towards a methodology for developing evidence-informed management knowledge by means of systematic review". British Journal of Management. 14 (3): 207–222. CiteSeerX 10.1.1.622.895. doi:10.1111/1467-8551.00375.
^ Durach CF, Kembro J, Wieland A (2017). "A New Paradigm for Systematic Literature Reviews in Supply Chain Management". Journal of Supply Chain Management. 53 (4): 67–85. doi:10.1111/jscm.12145.
^ "About us". methods.cochrane.org. Retrieved 2020-07-01.
^ ^a ^b Hagen-Zanker, Jessica; Duvendack, Maren; Mallett, Richard; Slater, Rachel; Carpenter, Samuel; Tromme, Mathieu (January 2012). "Making systematic reviews work for international development research". Overseas Development Institute. {{cite web}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ "Environmental Evidence: Reliable evidence, informed decisions, better environment". www.environmentalevidence.org. Retrieved 2020-07-01.
^ van der Mierden, Stevie (2019). "Software tools for literature screening in systematic reviews in biomedical research". ALTEX. doi:10.14573/altex.1902131. PMID 31113000.
^ Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG (March 2007). "Epidemiology and reporting characteristics of systematic reviews". PLoS Medicine. 4 (3): e78. doi:10.1371/journal.pmed.0040078. PMC 1831728. PMID 17388659.{{cite journal}}: CS1 maint: unflagged free DOI (link)
^ Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D (August 2007). "How quickly do systematic reviews go out of date? A survival analysis". Annals of Internal Medicine. 147 (4): 224–33. doi:10.7326/0003-4819-147-4-200708210-00179. PMID 17638714.
^ Savoie I, Helmer D, Green CJ, Kazanjian A (2003). "Beyond Medline: reducing bias through extended systematic review search". International Journal of Technology Assessment in Health Care. 19 (1): 168–78. doi:10.1017/S0266462303000163. PMID 12701949.
^ Roberts I, Ker K, Edwards P, Beecher D, Manno D, Sydenham E (June 2015). "The knowledge system underpinning healthcare is not fit for purpose and must change". BMJ. 350: h2463. doi:10.1136/bmj.h2463. PMID 26041754.
^ Altman DG (January 1994). "The scandal of poor medical research". BMJ. 308 (6924): 283–4. doi:10.1136/bmj.308.6924.283. PMC 2539276. PMID 8124111.
^ Shapiro S (November 1994). "Meta-analysis/Shmeta-analysis". American Journal of Epidemiology. 140 (9): 771–8. doi:10.1093/oxfordjournals.aje.a117324. PMID 7977286.
^ Page MJ, McKenzie JE, Kirkham J, Dwan K, Kramer S, Green S, Forbes A (October 2014). "Bias due to selective inclusion and reporting of outcomes and analyses in systematic reviews of randomised trials of healthcare interventions". The Cochrane Database of Systematic Reviews (10): MR000035. doi:10.1002/14651858.MR000035.pub2. PMID 25271098.
^ Roberts, Ian. "Retraction Of Scientific Papers For Fraud Or Bias Is Just The Tip Of The Iceberg". IFL Science!. Retrieved 29 June 2015. {{cite web}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ Ferguson, Cat (2015-04-02). "Retraction and republication for Lancet Resp Med tracheostomy paper". Retraction Watch. Retrieved 29 June 2015. {{cite web}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ Ferguson, Cat (2015-03-26). "BioMed Central retracting 43 papers for fake peer review". Retraction Watch. {{cite web}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)
^ Library, Flinders University. "Search Smart: Systematic Reviews: Methodology overview". flinders.libguides.com. Retrieved 2020-09-16.
^ Pursell, Edward; McCrae, Niall (2020). How to Perform a Systematic Literature Review: a guide for healthcare researchers, practitioners and students. Springer Nature. ISBN 978-3-030-49672-2. OCLC 1182880684.
^ "Half of all clinical trials have never reported results". AllTrials. 2015-08-20. Retrieved 2019-03-08.
^ Song, F.; Parekh, S.; Hooper, L.; Loke, Y. K.; Ryder, J.; Sutton, A. J.; Hing, C.; Kwok, C. S.; Pang, C. (February 2010). "Dissemination and publication of research findings: an updated review of related biases". Health Technology Assessment (Winchester, England). 14 (8): iii, ix–xi, 1–193. doi:10.3310/hta14080. ISSN 2046-4924. PMID 20181324.
^ ^a ^b Iacobucci, Gareth (2016-11-04). "Nearly half of all trials run by major sponsors in past decade are unpublished". BMJ. 355: i5955. doi:10.1136/bmj.i5955. ISSN 1756-1833. PMID 27815253.
^ Lundh, Andreas; Lexchin, Joel; Mintzes, Barbara; Schroll, Jeppe B; Bero, Lisa (2017-02-16). Cochrane Methodology Review Group (ed.). "Industry sponsorship and research outcome". Cochrane Database of Systematic Reviews. 2: MR000033. doi:10.1002/14651858.MR000033.pub3. PMID 28207928.
^ Pidgeon, Thomas Edward; Wellstead, Georgina; Sagoo, Harkiran; Jafree, Daniyal J.; Fowler, Alexander J.; Agha, Riaz A. (2016-10). "An assessment of the compliance of systematic review articles published in craniofacial surgery with the PRISMA statement guidelines: A systematic review". Journal of Cranio-Maxillofacial Surgery. 44 (10): 1522–1530. doi:10.1016/j.jcms.2016.07.018. {{cite journal}}: Check date values in: |date= (help)
^ Lee, Seon-Young; Sagoo, Harkiran; Whitehurst, Katharine; Wellstead, Georgina; Fowler, Alexander J.; Agha, Riaz A.; Orgill, Dennis (2016-03-01). "Compliance of Systematic Reviews in Plastic Surgery With the PRISMA Statement". JAMA Facial Plastic Surgery. 18 (2): 101. doi:10.1001/jamafacial.2015.1726. ISSN 2168-6076.
^ Bulters, D.; Zolnourian, A.; Akhigbe, T. (2017-05-01). "Compliance of systematic reviews articles in brain arteriovenous malformation with PRISMA statement guidelines: Review of literature". Journal of Clinical Neuroscience. 39: 45–48. doi:10.1016/j.jocn.2017.02.016. ISSN 0967-5868. PMID 28246008.
^ Lee, Seon-Young; Sagoo, Harkiran; Farwana, Reem; Whitehurst, Katharine; Fowler, Alex; Agha, Riaz (2017-12). "Compliance of systematic reviews in ophthalmology with the PRISMA statement". BMC Medical Research Methodology. 17 (1). doi:10.1186/s12874-017-0450-1. ISSN 1471-2288. PMC 5745614. PMID 29281981. {{cite journal}}: Check date values in: |date= (help)CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)
^ Koffel, Jonathan B.; Rethlefsen, Melissa L. (2016-09-26). Thombs, Brett D (ed.). "Reproducibility of Search Strategies Is Poor in Systematic Reviews Published in High-Impact Pediatrics, Cardiology and Surgery Journals: A Cross-Sectional Study". PLOS ONE. 11 (9): e0163309. doi:10.1371/journal.pone.0163309. ISSN 1932-6203. PMC 5036875. PMID 27669416.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)
^ Yoshii, Adriana; Plaut, Daphne A.; McGraw, Kathleen A.; Anderson, Margaret J.; Wellik, Kay E. (2009-1). "Analysis of the reporting of search strategies in Cochrane systematic reviews". Journal of the Medical Library Association : JMLA. 97 (1): 21–29. doi:10.3163/1536-5050.97.1.004. ISSN 1536-5050. PMC PMCPMC2605027. PMID 19158999. {{cite journal}}: Check |pmc= value (help); Check date values in: |date= (help)
^ Toews, Lorraine C. (2017-07-07). "Compliance of systematic reviews in veterinary journals with Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) literature search reporting guidelines". Journal of the Medical Library Association. 105 (3): 233–239. doi:10.5195/jmla.2017.246. ISSN 1558-9439. PMC 5490700. PMID 28670210.{{cite journal}}: CS1 maint: PMC format (link)
^ Mullins, Mary M.; DeLuca, Julia B.; Crepaz, Nicole; Lyles, Cynthia M. (2014). "Reporting quality of search methods in systematic reviews of HIV behavioral interventions (2000–2010): are the searches clearly explained, systematic and reproducible?". Research Synthesis Methods. 5 (2): 116–130. doi:10.1002/jrsm.1098. ISSN 1759-2887. PMC 5861495. PMID 26052651.{{cite journal}}: CS1 maint: PMC format (link)
^ Briscoe, Simon (2018). "A review of the reporting of web searching to identify studies for Cochrane systematic reviews". Research Synthesis Methods. 9 (1): 89–99. doi:10.1002/jrsm.1275. ISSN 1759-2887.
^ McIntosh, Heather M.; Loke, Yoon; Golder, Su (2008-05-01). "Poor reporting and inadequate searches were apparent in systematic reviews of adverse effects". Journal of Clinical Epidemiology. 61 (5): 440–448. doi:10.1016/j.jclinepi.2007.06.005. ISSN 0895-4356. PMID 18394536.
^ Waffenschmidt, Siw; Koffel, Jonathan; Kirtley, Shona; Ayala, Ana Patricia; Rethlefsen, Melissa (2019-03-04). "PRISMA-S PRISMA Search Reporting Extension". doi:10.17605/OSF.IO/YGN9W. {{cite journal}}: Cite journal requires |journal= (help)
^ [Pre-print] "Preferred Reporting Items for Systematic reviews and Meta-Analysis Search Extension (PRISMA-S) 2019: Explanation and Elaboration". osf.io. doi:10.31219/osf.io/sfc38. Retrieved 2019-03-20.
^ Lefebvre, Carol; Foerster, Vicki; Cogo, Elise; Salzwedel, Douglas M.; Sampson, Margaret; McGowan, Jessie (2016-07-01). "PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement". Journal of Clinical Epidemiology. 75: 40–46. doi:10.1016/j.jclinepi.2016.01.021. ISSN 0895-4356. PMID 27005575.
^ Shea, Beverley J.; Reeves, Barnaby C.; Wells, George; Thuku, Micere; Hamel, Candyce; Moran, Julian; Moher, David; Tugwell, Peter; Welch, Vivian (2017-09-21). "AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both". BMJ. 358. doi:10.1136/bmj.j4008. ISSN 0959-8138. PMID 28935701.
^ Shea, Beverley J.; Grimshaw, Jeremy M.; Wells, George A.; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C.; Tugwell, Peter; Moher, David (2007-02-15). "Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews". BMC Medical Research Methodology. 7 (1): 10. doi:10.1186/1471-2288-7-10. ISSN 1471-2288. PMC 1810543. PMID 17302989.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)
^ Boers, Maarten; Henry, David A.; Grimshaw, Jeremy; Kristjansson, Elizabeth; Bouter, Lex M.; Wells, George A.; Hamel, Candyce; Shea, Beverley J. (2009-10-01). "AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews". Journal of Clinical Epidemiology. 62 (10): 1013–1020. doi:10.1016/j.jclinepi.2008.10.009. ISSN 0895-4356. PMID 19230606.
^ Henry, David A.; Kristjansson, Elizabeth; Welch, Vivian; Tugwell, Peter; Moher, David; Moran, Julian; Hamel, Candyce; Thuku, Micere; Wells, George (2017-09-21). "AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both". BMJ. 358: j4008. doi:10.1136/bmj.j4008. ISSN 0959-8138. PMC 5833365. PMID 28935701.{{cite journal}}: CS1 maint: PMC format (link)
^ Churchill, Rachel; Kleijnen, Jos; Davies, Philippa; Shea, Beverley; Reeves, Barnaby C.; Caldwell, Deborah M.; Higgins, Julian P. T.; Savović, Jelena; Whiting, Penny (2016-01-01). "ROBIS: A new tool to assess risk of bias in systematic reviews was developed". Journal of Clinical Epidemiology. 69: 225–234. doi:10.1016/j.jclinepi.2015.06.005. ISSN 0895-4356. PMC 4687950. PMID 26092286.{{cite journal}}: CS1 maint: PMC format (link)

External links

Library resources about
systematic review

Resources in your library

Cochrane Collaboration
MeSH: Review Literature—articles about the review process
MeSH: Review [Publication Type] - limit search results to reviews
Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Statement, "an evidence-based minimum set of items for reporting in systematic reviews and meta-analyses"
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and explanation
Animated Storyboard: What Are Systematic Reviews? - Cochrane Consumers and Communication Group
Sysrev - a free platform with open access systematic reviews.

[1] "systematic review". GET-IT glossary. Retrieved 18 November 2015.

[2] Armstrong R, Hall BJ, Doyle J, Waters E (March 2011). "Cochrane Update. 'Scoping the scope' of a cochrane review". Journal of Public Health. 33 (1): 147–50. doi:10.1093/pubmed/fdr015. PMID 21345890.

[CEBM_about2-3] "What is EBM?". Centre for Evidence Based Medicine. 2009-11-20. Archived from the original on 2011-04-06. Retrieved 2011-06-17.

[4] Ader, Herman J.; Mellenbergh, Gideon J.; Hand, David J. (2008). "Methodological quality". Advising on Research Methods: A consultant's companion. Johannes van Kessel Publishing. ISBN 978-90-79418-02-2. {{cite book}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[5] Bilotta, Gary S.; Milner, Alice M.; Boyd, Ian (2014). "On the use of systematic reviews to inform environmental policies". Environmental Science & Policy. 42: 67–77. doi:10.1016/j.envsci.2014.05.010. {{cite journal}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[CRD20082-6] Systematic reviews: CRD's guidance for undertaking reviews in health care (PDF). York: University of York, Centre for Reviews and Dissemination. 2008. ISBN 978-1-900640-47-3. Retrieved 17 June 2011.

[7] Petticrew M, Roberts H (2006). Systematic reviews in the social sciences (PDF). Wiley Blackwell. ISBN 978-1-4051-2110-1. Archived from the original (PDF) on 2015-06-16.

[:0-8] ^ ^a ^b ^c ^d ^e ^f ^g ^h Grant, Maria J.; Booth, Andrew (2009). "A typology of reviews: an analysis of 14 review types and associated methodologies". Health Information & Libraries Journal. 26 (2): 91–108. doi:10.1111/j.1471-1842.2009.00848.x. ISSN 1471-1842.

[9] Bearman, Margaret; Dawson, Phillip (2013). "Qualitative synthesis and systematic review in health professions education". Medical Education. 47 (3): 252–260. doi:10.1111/medu.12092. ISSN 1365-2923.

[10] Higgins, Julian P.T.; Thomas, James; Chandler, Jacqueline; Cumpston, Miranda; Li, Tianjing; Page, Matthew J.; Welch, Vivian A., eds. (2019-09-20). Cochrane Handbook for Systematic Reviews of Interventions. version 6.1. pp. section 4.6. Retrieved 2020-09-14. {{cite book}}: |website= ignored (help)

[11] Siemieniuk, Reed; Guyatt, Gordon. "What is GRADE?". BMJ Best Practice. Retrieved 2020-08-26.

[12] Adèr, Hermanus Johannes (2008). Advising on Research Methods: A Consultant's Companion. Johannes van Kessel Publishing. ISBN 978-90-79418-01-5.

[13] Schünemann, Holger; Brożek, Jan; Guyatt, Gordon; Oxman, Andrew, eds. (2013). GRADE Handbook. Retrieved 2020-08-26.

[:1-14] Flemming, Kate; Booth, Andrew; Hannes, Karin; Cargo, Margaret; Noyes, Jane (2018-05). "Cochrane Qualitative and Implementation Methods Group guidance series—paper 6: reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses". Journal of Clinical Epidemiology. 97: 79–85. doi:10.1016/j.jclinepi.2017.10.022. {{cite journal}}: Check date values in: |date= (help)

[15] Harden, Angela; Thomas, James; Cargo, Margaret; Harris, Janet; Pantoja, Tomas; Flemming, Kate; Booth, Andrew; Garside, Ruth; Hannes, Karin (2018-05-01). "Cochrane Qualitative and Implementation Methods Group guidance series—paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews". Journal of Clinical Epidemiology. 97: 70–78. doi:10.1016/j.jclinepi.2017.11.029. ISSN 0895-4356.

[16] "EPPI-Centre Home". eppi.ioe.ac.uk. Retrieved 2020-06-29.

[:2-17] Booth, A; Noyes, J; Flemming, K; Gerhardus, A; Wahlster, P; Van der Wilt, GJ; Mozygemba, K; Refolo, P; Sacchini, D; Tummers, M; Rehfuess, E (2016). Guidance on choosing qualitative evidence synthesis methods for use in health technology assessments of complex interventions. p. 32. OCLC 944453327.

[:5-18] "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement". www.equator-network.org. Retrieved 2020-06-29.

[19] Wong, Geoff; Greenhalgh, Trish; Westhorp, Gill; Buckingham, Jeanette; Pawson, Ray (2013). "RAMESES publication standards: meta‐narrative reviews". Journal of Advanced Nursing. 97: 987–1004. doi:10.1111/jan.12092.

[20] Wong, Geoff; Greenhalgh, Trish; Westhorp, Gill; Buckingham, Jeanette; Pawson, Ray (2013). "RAMESES publication standards: realist syntheses". Journal of Advanced Nursing. 97: 987–1004. doi:10.1111/jan.12095.

[:3-21] Arksey, Hilary; O'Malley, Lisa (2005). "Scoping studies: Towards a methodological framework". International Journal of Social Research Methodology. 8: 19–32. doi:10.1080/1364557032000119616. {{cite journal}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[:4-22] "PRISMA". www.prisma-statement.org. Retrieved 2020-07-01.

[23] "What is a rapid review? Systematic Review Library Guides at CQ University". library.cqu.edu.au. Archived from the original on 2020-09-16. Retrieved 2020-09-16.

[24] "Home". covidrapidreviews.cochrane.org. Retrieved 2020-07-01.

[Peters_141–146-25] Peters, Micah D. J.; Godfrey, Christina M.; Khalil, Hanan; McInerney, Patricia; Parker, Deborah; Soares, Cassia Baldini (2015-09). "Guidance for conducting systematic scoping reviews". JBI Evidence Implementation. 13 (3): 141–146. doi:10.1097/XEB.0000000000000050. ISSN 2691-3321. {{cite journal}}: Check date values in: |date= (help)

[26] Levac, Danielle; Colquhoun, Heather; O'Brien, Kelly K (2010-12). "Scoping studies: advancing the methodology". Implementation Science. 5 (1): 69. doi:10.1186/1748-5908-5-69. ISSN 1748-5908. {{cite journal}}: Check date values in: |date= (help)CS1 maint: unflagged free DOI (link)

[27] Colquhoun, Heather L.; Levac, Danielle; O'Brien, Kelly K.; Straus, Sharon; Tricco, Andrea C.; Perrier, Laure; Kastner, Monika; Moher, David (2014-12). "Scoping reviews: time for clarity in definition, methods, and reporting". Journal of Clinical Epidemiology. 67 (12): 1291–1294. doi:10.1016/j.jclinepi.2014.03.013. ISSN 1878-5921. PMID 25034198. {{cite journal}}: Check date values in: |date= (help)

[28] Lacaze, Paul; Fransquet, Peter; Tiller, Jane; Nunn, Jack S. (2019). "Public Involvement in Global Genomics Research: A Scoping Review". Frontiers in Public Health. 7. doi:10.3389/fpubh.2019.00079. ISSN 2296-2565.{{cite journal}}: CS1 maint: unflagged free DOI (link)

[ReferenceA2-29] Pollock A, Campbell P, Struthers C, Synnot A, Nunn J, Hill S, Goodare H, Watts C, Morley R (2017-04-21). "Stakeholder involvement in systematic reviews: a protocol for a systematic review of methods, outcomes and effects". Research Involvement and Engagement. 3 (1): 9. doi:10.1186/s40900-017-0060-4. PMC 5611627. PMID 29062534.{{cite journal}}: CS1 maint: unflagged free DOI (link)

[30] Munn, Zachary; Peters, Micah D. J.; Stern, Cindy; Tufanaru, Catalin; McArthur, Alexa; Aromataris, Edoardo (2018-12). "Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach". BMC Medical Research Methodology. 18 (1): 143. doi:10.1186/s12874-018-0611-x. ISSN 1471-2288. PMC 6245623. PMID 30453902. {{cite journal}}: Check date values in: |date= (help)CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)

[31] Levac D, Colquhoun H, O'Brien KK (September 2010). "Scoping studies: advancing the methodology". Implementation Science. 5 (1): 69. doi:10.1186/1748-5908-5-69. PMC 2954944. PMID 20854677.{{cite journal}}: CS1 maint: unflagged free DOI (link)

[32] Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB (September 2015). "Guidance for conducting systematic scoping reviews". International Journal of Evidence-Based Healthcare. 13 (3): 141–6. doi:10.1097/XEB.0000000000000050. PMID 26134548.

[33] Colquhoun HL, Levac D, O'Brien KK, Straus S, Tricco AC, Perrier L, Kastner M, Moher D (December 2014). "Scoping reviews: time for clarity in definition, methods, and reporting". Journal of Clinical Epidemiology. 67 (12): 1291–4. doi:10.1016/j.jclinepi.2014.03.013. PMID 25034198.

[34] Arksey, Hilary; O'Malley, Lisa (2005-02-01). "Scoping studies: towards a methodological framework". International Journal of Social Research Methodology. 8 (1): 19–32. doi:10.1080/1364557032000119616. {{cite journal}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[35] Tricco, Andrea C.; Lillie, Erin; Zarin, Wasifa; O'Brien, Kelly K.; Colquhoun, Heather; Levac, Danielle; Moher, David; Peters, Micah D.J.; Horsley, Tanya (2018-10-02). "PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation". Annals of Internal Medicine. 169 (7): 467. doi:10.7326/M18-0850. ISSN 0003-4819.

[36] "PROSPERO". Centre for Reviews and Dissemination. University of York. Retrieved 2019-02-24.

[Cochrane_storyboard2-37] ^ ^a ^b ^c ^d ^e ^f ^g "Animated Storyboard: What Are Systematic Reviews?". cccrg.cochrane.org. Cochrane Consumers and Communication. Retrieved 1 June 2016.

[38] "PRISMA". Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). Retrieved 2019-02-24.

[CochraneHandbook2-39] Higgins JP, Green S (eds.). "Cochrane handbook for systematic reviews of interventions, version 5.1.0 (updated March 2011)". The Cochrane Collaboration. Retrieved 2 June 2016.

[40] "5. Handsearching". training.cochrane.org. Retrieved 2020-09-14.

[41] Papaioannou, Diana; Sutton, Anthea; Carroll, Christopher; Booth, Andrew; Wong, Ruth (2010). "Literature searching for social science systematic reviews: consideration of a range of search techniques". Health Information & Libraries Journal. 27 (2): 114–122. doi:10.1111/j.1471-1842.2009.00863.x. ISSN 1471-1842.

[42] Rethlefsen ML, Farrell AM, Osterhaus Trzasko LC, Brigham TJ (June 2015). "Librarian co-authors correlated with higher quality reported search strategies in general internal medicine systematic reviews". Journal of Clinical Epidemiology. 68 (6): 617–26. doi:10.1016/j.jclinepi.2014.11.025. PMID 25766056.

[43] Koffel, Jonathan B. (2015-05-04). "Use of Recommended Search Strategies in Systematic Reviews and the Impact of Librarian Involvement: A Cross-Sectional Survey of Recent Authors". PLOS ONE. 10 (5): e0125931. doi:10.1371/journal.pone.0125931. ISSN 1932-6203. PMC 4418838. PMID 25938454.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)

[44] Costella, John; Torabi, Nazi; Meert, Deborah (2016). "Impact of librarians on reporting of the literature searching component of pediatric systematic reviews". Journal of the Medical Library Association. 104 (4): 267–277. doi:10.5195/jmla.2016.139. ISSN 1558-9439. PMC 5079487. PMID 27822147.{{cite journal}}: CS1 maint: PMC format (link)

[45] Yang, Kehu; Yao, Liang; Jiang, Tongxiao; Liang, Fuxiang; Moher, David; Tian, Hongliang; Tian, Jinhui; Li, Lun (2014-09-01). "Network meta-analyses could be improved by searching more sources and by involving a librarian". Journal of Clinical Epidemiology. 67 (9): 1001–1007. doi:10.1016/j.jclinepi.2014.04.003. ISSN 0895-4356. PMID 24841794.

[46] Rethlefsen, Melissa L.; Murad, M. Hassan; Livingston, Edward H. (2014-09-10). "Engaging Medical Librarians to Improve the Quality of Review Articles". JAMA. 312 (10): 999. doi:10.1001/jama.2014.9263. ISSN 0098-7484.

[47] Higgins, Julian P.T.; Thomas, James; Chandler, Jacqueline; Cumpston, Miranda; Li, Tianjing; Page, Matthew J.; Welch, Vivian A., eds. (2019-09-20). "Chapter 4: Searching for and selecting studies". Cochrane Handbook for Systematic Reviews of Interventions. version 6.1. section 4.6. Retrieved 2020-09-14. {{cite book}}: |website= ignored (help); Unknown parameter |nopp= ignored (|no-pp= suggested) (help)

[48] Marshall, Christopher; Brereton, Pearl (2015-04-27). "Systematic review toolbox: a catalogue of tools to support systematic reviews". Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering. EASE '15. Nanjing, China: Association for Computing Machinery: 1–6. doi:10.1145/2745802.2745824. ISBN 978-1-4503-3350-4.

[49] "The difference we make". www.cochrane.org. Retrieved 2019-03-08.

[50] Higgins, Julian P. T.; López-López, José A.; Becker, Betsy J.; Davies, Sarah R.; Dawson, Sarah; Grimshaw, Jeremy M.; McGuinness, Luke A.; Moore, Theresa H. M.; Rehfuess, Eva A. (2019-01-01). "Synthesising quantitative evidence in systematic reviews of complex health interventions". BMJ Global Health. 4 (Suppl 1): e000858. doi:10.1136/bmjgh-2018-000858. ISSN 2059-7908.

[51] "GRADE working group". www.gradeworkinggroup.org. Retrieved 2019-03-08.

[52] "GRADE CERQual". www.cerqual.org. Retrieved 2020-07-01.

[53] Tsafnat G, Glasziou P, Choong MK, Dunn A, Galgani F, Coiera E (July 2014). "Systematic review automation technologies". Systematic Reviews. 3 (1): 74. doi:10.1186/2046-4053-3-74. PMC 4100748. PMID 25005128.{{cite journal}}: CS1 maint: unflagged free DOI (link)

[54] Elliott JH, Turner T, Clavisi O, Thomas J, Higgins JP, Mavergames C, Gruen RL (February 2014). "Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap". PLoS Medicine. 11 (2): e1001603. doi:10.1371/journal.pmed.1001603. PMC 3928029. PMID 24558353.{{cite journal}}: CS1 maint: unflagged free DOI (link)

[55] Group, British Medical Journal Publishing (1904-11-05). "Report on Certain Enteric Fever Inoculation Statistics". BMJ. 2 (2288): 1243–1246. doi:10.1136/bmj.2.2288.1243. ISSN 0007-1447.

[:7-56] "1.1.2 A brief history of Cochrane". community.cochrane.org. Archived from the original on 2019-01-17. Retrieved 2019-02-24.

[57] Glass, Gene V.; Smith, Mary Lee; et al. (Far West Lab. for Educational Research and Development, San Francisco, CA) (1978). Meta-Analysis of Research on the Relationship of Class-Size and Achievement. The Class Size and Instruction Project. Washington, D.C.]: Distributed by ERIC Clearinghouse. {{cite book}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[58] "History of Systematic Reviews". Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre). Retrieved 2019-02-24.

[59] Lau, J.; Antman, E. M.; Jimenez-Silva, J.; Kupelnick, B.; Mosteller, F.; Chalmers, T. C. (1992-07-23). "Cumulative meta-analysis of therapeutic trials for myocardial infarction". The New England Journal of Medicine. 327 (4): 248–254. doi:10.1056/NEJM199207233270406. ISSN 0028-4793. PMID 1614465.

[60] Cochrane, A. L. (1972). Effectiveness and efficiency: random reflections on health services (PDF). [London]: Nuffield Provincial Hospitals Trust. ISBN 0-900574-17-8. OCLC 741462. Archived from the original on 2020-09-16.

[61] Shah, Hriday M.; Chung, Kevin C. (2009-09). "Archie Cochrane and his vision for evidence-based medicine". Plastic and reconstructive surgery. 124 (3): 982. doi:10.1097/PRS.0b013e3181b03928. PMID 19730323. {{cite journal}}: Check date values in: |date= (help)

[62] Evans, Imogen. (2011). Testing treatments : better research for better healthcare. Thornton, Hazel, 1935-, Chalmers, Iain., Glasziou, Paul, 1954- (Second edition ed.). London: Pinter & Martin. ISBN 978-1-905177-48-6. OCLC 778837501. {{cite book}}: |edition= has extra text (help)

[63] The Cochrane Library. 2015 impact factor. Cochrane Database of Systematic Reviews (CDSR) Retrieved 2016-07-20.

[64] Review Manager (RevMan) [Computer program]. Version 5.2. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2012.

[65] "Main page". Cochrane Library.

[66] Silva V, Grande AJ, Carvalho AP, Martimbianco AL, Riera R (2015). "Overview of systematic reviews - a new type of study. Part II". Revista Paulista de Medicina. 133 (3): 206–17. doi:10.1590/1516-3180.2013.8150015. PMID 25388685.

[67] Silva V, Grande AJ, Martimbianco AL, Riera R, Carvalho AP (2012). "Overview of systematic reviews - a new type of study: part I: why and for whom?". Revista Paulista de Medicina. 130 (6): 398–404. doi:10.1590/S1516-31802012000600007. PMID 23338737.

[68] "Living systematic reviews". community.cochrane.org. Retrieved 2020-07-01.

[69] Tsafnat, Guy; Glasziou, Paul; Choong, Miew Keen; Dunn, Adam; Galgani, Filippo; Coiera, Enrico (2014-12). "Systematic review automation technologies". Systematic Reviews. 3 (1): 74. doi:10.1186/2046-4053-3-74. ISSN 2046-4053. PMC 4100748. PMID 25005128. {{cite journal}}: Check date values in: |date= (help)CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)

[70] Elliott, Julian H.; Turner, Tari; Clavisi, Ornella; Thomas, James; Higgins, Julian P. T.; Mavergames, Chris; Gruen, Russell L. (2014-02-18). "Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap". PLoS Medicine. 11 (2): e1001603. doi:10.1371/journal.pmed.1001603. ISSN 1549-1676. PMC 3928029. PMID 24558353.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)

[71] "Cochrane's work on Rapid Reviews in response to COVID-19". www.cochrane.org. Retrieved 2020-07-01.

[72] Norris, Susan L.; Rehfuess, Eva A.; Smith, Helen; Tunçalp, Özge; Grimshaw, Jeremy M.; Ford, Nathan P.; Portela, Anayda (2019-01-01). "Complex health interventions in complex systems: improving the process and methods for evidence-informed health decisions". BMJ Global Health. 4 (Suppl 1): e000963. doi:10.1136/bmjgh-2018-000963. ISSN 2059-7908.

[73] "Methodological Expectations of Cochrane Intervention Reviews (MECIR)". Cochrane. Retrieved 6 October 2014.

[74] "Cochrane Controlled Register of Trials (CENTRAL)". Cochrane Library. Retrieved 2020-07-01.

[75] "Revisiones Cochrane". Cochrane Library (in Spanish). Retrieved 2020-07-01.

[:6-76] "Cochrane's Future Publishing and Open Access Arrangements". Cochrane.org. 2019-07-02. Archived from the original on 2019-07-02.

[77] "Open access options for the Cochrane Database of Systematic Reviews". Cochrane. Retrieved 2019-02-24.

[78] Newman M (January 2019). "Has Cochrane lost its way?". BMJ. 364: k5302. doi:10.1136/bmj.k5302. PMID 30606713.

[79] "Cochrane crowd". crowd.cochrane.org. Retrieved 2019-02-14.

[80] Pollock A, Campbell P, Struthers C, Synnot A, Nunn J, Hill S, Goodare H, Morris J, Watts C, Morley R (November 2018). "Stakeholder involvement in systematic reviews: a scoping review". Systematic Reviews. 7 (1): 208. doi:10.1186/s13643-018-0852-0. PMC 6260873. PMID 30474560.{{cite journal}}: CS1 maint: unflagged free DOI (link)

[81] Pollock, Alex; Campbell, Pauline; Struthers, Caroline; Synnot, Anneliese; Nunn, Jack; Hill, Sophie; Goodare, Heather; Morris, Jacqui; Watts, Chris (2019-04-18). "Development of the ACTIVE framework to describe stakeholder involvement in systematic reviews". Journal of Health Services Research & Policy: 135581961984164. doi:10.1177/1355819619841647. ISSN 1355-8196.

[82] [Pre-print] "Standardised Data on Initiatives - STARDIT: Alpha Version". osf.io. doi:10.31219/osf.io/5q47h. Retrieved 2020-08-20.

[83] Newman, Melanie (2019-01-03). "Has Cochrane lost its way?". BMJ. 364: k5302. doi:10.1136/bmj.k5302. ISSN 0959-8138. PMID 30606713.

[84] Synnot, Anneliese J.; Tong, Allison; Bragge, Peter; Lowe, Dianne; Nunn, Jack S.; O’Sullivan, Molly; Horvat, Lidia; Kay, Debra; Ghersi, Davina (2019-04-29). "Selecting, refining and identifying priority Cochrane Reviews in health communication and participation in partnership with consumers and other stakeholders". Health Research Policy and Systems. 17 (1): 45. doi:10.1186/s12961-019-0444-z. ISSN 1478-4505. PMC 6489310. PMID 31036016.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)

[85] Synnot A, Bragge P, Lowe D, Nunn JS, O'Sullivan M, Horvat L, Tong A, Kay D, Ghersi D, McDonald S, Poole N, Bourke N, Lannin N, Vadasz D, Oliver S, Carey K, Hill SJ (May 2018). "Research priorities in health communication and participation: international survey of consumers and other stakeholders". BMJ Open. 8 (5): e019481. doi:10.1136/bmjopen-2017-019481. PMC 5942413. PMID 29739780.

[86] "The Cochrane-Wikipedia partnership in 2016". Cochrane. Retrieved 2019-02-24.

[87] "Welcome". training.cochrane.org. Retrieved 2019-06-25.

[88] "Testing Treatments". Cochrane Training. 2019-06-25. Archived from the original on 2019-06-25. Retrieved 2019-06-25.

[89] Cochrane (2016-01-27), What are systematic reviews?, retrieved 2019-06-25

[90] "Successful multi-language free online animated learning resource". Abstracts of the 24th Cochrane Colloquium; 23–27 October 2016, Seoul, South Korea. Wiley. 2016-10-23. doi:10.1002/14651858.CD201602.

[91] "Creating a successful online animation resource: the 'what are systematic reviews?' video". Cochrane Community. 2019-06-25. Archived from the original on 2019-06-25. Retrieved 2019-06-25.

[Cochrane_storyboard-92] "Animated Storyboard: What Are Systematic Reviews?". cccrg.cochrane.org. Cochrane Consumers and Communication. Retrieved 1 June 2016.

[93] Nunn, Jack; Synnot, Anneliese; Mcdonald, Steve; Allen, Kelly; Hill, Sophie (2015). "Building partnerships with the public by learning about Cochrane evidence". 23rd Cochrane Colloquium 2015. Archived from the original on 2015-11-09.

[94] Nunn, Jack; Hill, Sophie. "What are systematic reviews?". Retrieved 2020-08-20.

[95] "CASP Checklists". Critical Appraisal Skills Programme. Retrieved 2020-08-21.

[96] "CASP Systematic Review Checklist" (PDF). casp-uk.net. 2020-08-21. Archived from the original (PDF) on 2020-08-21. Retrieved 2020-08-21.

[97] "About Us". The Campbell Collaboration. Archived from the original on February 3, 2014. Retrieved March 26, 2014.

[98] "History - Campbell". www.campbellcollaboration.org. Archived from the original on 24 September 2016. Retrieved 2016-09-27.

[99] Tranfield D, Denyer D, Smart P (2003). "Towards a methodology for developing evidence-informed management knowledge by means of systematic review". British Journal of Management. 14 (3): 207–222. CiteSeerX 10.1.1.622.895. doi:10.1111/1467-8551.00375.

[100] Durach CF, Kembro J, Wieland A (2017). "A New Paradigm for Systematic Literature Reviews in Supply Chain Management". Journal of Supply Chain Management. 53 (4): 67–85. doi:10.1111/jscm.12145.

[101] "About us". methods.cochrane.org. Retrieved 2020-07-01.

[Hagen-Zanker20122-102] Hagen-Zanker, Jessica; Duvendack, Maren; Mallett, Richard; Slater, Rachel; Carpenter, Samuel; Tromme, Mathieu (January 2012). "Making systematic reviews work for international development research". Overseas Development Institute. {{cite web}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[103] "Environmental Evidence: Reliable evidence, informed decisions, better environment". www.environmentalevidence.org. Retrieved 2020-07-01.

[104] van der Mierden, Stevie (2019). "Software tools for literature screening in systematic reviews in biomedical research". ALTEX. doi:10.14573/altex.1902131. PMID 31113000.

[105] Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG (March 2007). "Epidemiology and reporting characteristics of systematic reviews". PLoS Medicine. 4 (3): e78. doi:10.1371/journal.pmed.0040078. PMC 1831728. PMID 17388659.{{cite journal}}: CS1 maint: unflagged free DOI (link)

[pmid176387142-106] Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D (August 2007). "How quickly do systematic reviews go out of date? A survival analysis". Annals of Internal Medicine. 147 (4): 224–33. doi:10.7326/0003-4819-147-4-200708210-00179. PMID 17638714.

[107] Savoie I, Helmer D, Green CJ, Kazanjian A (2003). "Beyond Medline: reducing bias through extended systematic review search". International Journal of Technology Assessment in Health Care. 19 (1): 168–78. doi:10.1017/S0266462303000163. PMID 12701949.

[108] Roberts I, Ker K, Edwards P, Beecher D, Manno D, Sydenham E (June 2015). "The knowledge system underpinning healthcare is not fit for purpose and must change". BMJ. 350: h2463. doi:10.1136/bmj.h2463. PMID 26041754.

[109] Altman DG (January 1994). "The scandal of poor medical research". BMJ. 308 (6924): 283–4. doi:10.1136/bmj.308.6924.283. PMC 2539276. PMID 8124111.

[110] Shapiro S (November 1994). "Meta-analysis/Shmeta-analysis". American Journal of Epidemiology. 140 (9): 771–8. doi:10.1093/oxfordjournals.aje.a117324. PMID 7977286.

[111] Page MJ, McKenzie JE, Kirkham J, Dwan K, Kramer S, Green S, Forbes A (October 2014). "Bias due to selective inclusion and reporting of outcomes and analyses in systematic reviews of randomised trials of healthcare interventions". The Cochrane Database of Systematic Reviews (10): MR000035. doi:10.1002/14651858.MR000035.pub2. PMID 25271098.

[112] Roberts, Ian. "Retraction Of Scientific Papers For Fraud Or Bias Is Just The Tip Of The Iceberg". IFL Science!. Retrieved 29 June 2015. {{cite web}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[113] Ferguson, Cat (2015-04-02). "Retraction and republication for Lancet Resp Med tracheostomy paper". Retraction Watch. Retrieved 29 June 2015. {{cite web}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[114] Ferguson, Cat (2015-03-26). "BioMed Central retracting 43 papers for fake peer review". Retraction Watch. {{cite web}}: Unknown parameter |name-list-format= ignored (|name-list-style= suggested) (help)

[115] Library, Flinders University. "Search Smart: Systematic Reviews: Methodology overview". flinders.libguides.com. Retrieved 2020-09-16.

[116] Pursell, Edward; McCrae, Niall (2020). How to Perform a Systematic Literature Review: a guide for healthcare researchers, practitioners and students. Springer Nature. ISBN 978-3-030-49672-2. OCLC 1182880684.

[117] "Half of all clinical trials have never reported results". AllTrials. 2015-08-20. Retrieved 2019-03-08.

[118] Song, F.; Parekh, S.; Hooper, L.; Loke, Y. K.; Ryder, J.; Sutton, A. J.; Hing, C.; Kwok, C. S.; Pang, C. (February 2010). "Dissemination and publication of research findings: an updated review of related biases". Health Technology Assessment (Winchester, England). 14 (8): iii, ix–xi, 1–193. doi:10.3310/hta14080. ISSN 2046-4924. PMID 20181324.

[Iacobucci_i59552-119] Iacobucci, Gareth (2016-11-04). "Nearly half of all trials run by major sponsors in past decade are unpublished". BMJ. 355: i5955. doi:10.1136/bmj.i5955. ISSN 1756-1833. PMID 27815253.

[120] Lundh, Andreas; Lexchin, Joel; Mintzes, Barbara; Schroll, Jeppe B; Bero, Lisa (2017-02-16). Cochrane Methodology Review Group (ed.). "Industry sponsorship and research outcome". Cochrane Database of Systematic Reviews. 2: MR000033. doi:10.1002/14651858.MR000033.pub3. PMID 28207928.

[121] Pidgeon, Thomas Edward; Wellstead, Georgina; Sagoo, Harkiran; Jafree, Daniyal J.; Fowler, Alexander J.; Agha, Riaz A. (2016-10). "An assessment of the compliance of systematic review articles published in craniofacial surgery with the PRISMA statement guidelines: A systematic review". Journal of Cranio-Maxillofacial Surgery. 44 (10): 1522–1530. doi:10.1016/j.jcms.2016.07.018. {{cite journal}}: Check date values in: |date= (help)

[122] Lee, Seon-Young; Sagoo, Harkiran; Whitehurst, Katharine; Wellstead, Georgina; Fowler, Alexander J.; Agha, Riaz A.; Orgill, Dennis (2016-03-01). "Compliance of Systematic Reviews in Plastic Surgery With the PRISMA Statement". JAMA Facial Plastic Surgery. 18 (2): 101. doi:10.1001/jamafacial.2015.1726. ISSN 2168-6076.

[123] Bulters, D.; Zolnourian, A.; Akhigbe, T. (2017-05-01). "Compliance of systematic reviews articles in brain arteriovenous malformation with PRISMA statement guidelines: Review of literature". Journal of Clinical Neuroscience. 39: 45–48. doi:10.1016/j.jocn.2017.02.016. ISSN 0967-5868. PMID 28246008.

[124] Lee, Seon-Young; Sagoo, Harkiran; Farwana, Reem; Whitehurst, Katharine; Fowler, Alex; Agha, Riaz (2017-12). "Compliance of systematic reviews in ophthalmology with the PRISMA statement". BMC Medical Research Methodology. 17 (1). doi:10.1186/s12874-017-0450-1. ISSN 1471-2288. PMC 5745614. PMID 29281981. {{cite journal}}: Check date values in: |date= (help)CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)

[125] Koffel, Jonathan B.; Rethlefsen, Melissa L. (2016-09-26). Thombs, Brett D (ed.). "Reproducibility of Search Strategies Is Poor in Systematic Reviews Published in High-Impact Pediatrics, Cardiology and Surgery Journals: A Cross-Sectional Study". PLOS ONE. 11 (9): e0163309. doi:10.1371/journal.pone.0163309. ISSN 1932-6203. PMC 5036875. PMID 27669416.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)

[126] Yoshii, Adriana; Plaut, Daphne A.; McGraw, Kathleen A.; Anderson, Margaret J.; Wellik, Kay E. (2009-1). "Analysis of the reporting of search strategies in Cochrane systematic reviews". Journal of the Medical Library Association : JMLA. 97 (1): 21–29. doi:10.3163/1536-5050.97.1.004. ISSN 1536-5050. PMC PMCPMC2605027. PMID 19158999. {{cite journal}}: Check |pmc= value (help); Check date values in: |date= (help)

[127] Toews, Lorraine C. (2017-07-07). "Compliance of systematic reviews in veterinary journals with Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) literature search reporting guidelines". Journal of the Medical Library Association. 105 (3): 233–239. doi:10.5195/jmla.2017.246. ISSN 1558-9439. PMC 5490700. PMID 28670210.{{cite journal}}: CS1 maint: PMC format (link)

[128] Mullins, Mary M.; DeLuca, Julia B.; Crepaz, Nicole; Lyles, Cynthia M. (2014). "Reporting quality of search methods in systematic reviews of HIV behavioral interventions (2000–2010): are the searches clearly explained, systematic and reproducible?". Research Synthesis Methods. 5 (2): 116–130. doi:10.1002/jrsm.1098. ISSN 1759-2887. PMC 5861495. PMID 26052651.{{cite journal}}: CS1 maint: PMC format (link)

[129] Briscoe, Simon (2018). "A review of the reporting of web searching to identify studies for Cochrane systematic reviews". Research Synthesis Methods. 9 (1): 89–99. doi:10.1002/jrsm.1275. ISSN 1759-2887.

[130] McIntosh, Heather M.; Loke, Yoon; Golder, Su (2008-05-01). "Poor reporting and inadequate searches were apparent in systematic reviews of adverse effects". Journal of Clinical Epidemiology. 61 (5): 440–448. doi:10.1016/j.jclinepi.2007.06.005. ISSN 0895-4356. PMID 18394536.

[131] Waffenschmidt, Siw; Koffel, Jonathan; Kirtley, Shona; Ayala, Ana Patricia; Rethlefsen, Melissa (2019-03-04). "PRISMA-S PRISMA Search Reporting Extension". doi:10.17605/OSF.IO/YGN9W. {{cite journal}}: Cite journal requires |journal= (help)

[132] [Pre-print] "Preferred Reporting Items for Systematic reviews and Meta-Analysis Search Extension (PRISMA-S) 2019: Explanation and Elaboration". osf.io. doi:10.31219/osf.io/sfc38. Retrieved 2019-03-20.

[133] Lefebvre, Carol; Foerster, Vicki; Cogo, Elise; Salzwedel, Douglas M.; Sampson, Margaret; McGowan, Jessie (2016-07-01). "PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement". Journal of Clinical Epidemiology. 75: 40–46. doi:10.1016/j.jclinepi.2016.01.021. ISSN 0895-4356. PMID 27005575.

[134] Shea, Beverley J.; Reeves, Barnaby C.; Wells, George; Thuku, Micere; Hamel, Candyce; Moran, Julian; Moher, David; Tugwell, Peter; Welch, Vivian (2017-09-21). "AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both". BMJ. 358. doi:10.1136/bmj.j4008. ISSN 0959-8138. PMID 28935701.

[135] Shea, Beverley J.; Grimshaw, Jeremy M.; Wells, George A.; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C.; Tugwell, Peter; Moher, David (2007-02-15). "Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews". BMC Medical Research Methodology. 7 (1): 10. doi:10.1186/1471-2288-7-10. ISSN 1471-2288. PMC 1810543. PMID 17302989.{{cite journal}}: CS1 maint: PMC format (link) CS1 maint: unflagged free DOI (link)

[136] Boers, Maarten; Henry, David A.; Grimshaw, Jeremy; Kristjansson, Elizabeth; Bouter, Lex M.; Wells, George A.; Hamel, Candyce; Shea, Beverley J. (2009-10-01). "AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews". Journal of Clinical Epidemiology. 62 (10): 1013–1020. doi:10.1016/j.jclinepi.2008.10.009. ISSN 0895-4356. PMID 19230606.

[137] Henry, David A.; Kristjansson, Elizabeth; Welch, Vivian; Tugwell, Peter; Moher, David; Moran, Julian; Hamel, Candyce; Thuku, Micere; Wells, George (2017-09-21). "AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both". BMJ. 358: j4008. doi:10.1136/bmj.j4008. ISSN 0959-8138. PMC 5833365. PMID 28935701.{{cite journal}}: CS1 maint: PMC format (link)

[138] Churchill, Rachel; Kleijnen, Jos; Davies, Philippa; Shea, Beverley; Reeves, Barnaby C.; Caldwell, Deborah M.; Higgins, Julian P. T.; Savović, Jelena; Whiting, Penny (2016-01-01). "ROBIS: A new tool to assess risk of bias in systematic reviews was developed". Journal of Clinical Epidemiology. 69: 225–234. doi:10.1016/j.jclinepi.2015.06.005. ISSN 0895-4356. PMC 4687950. PMID 26092286.{{cite journal}}: CS1 maint: PMC format (link)

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]

[15]

[16]

[17]

[18]

[19]

[20]

[21]

[22]

[23]

[24]

[25]

[26]

[27]

[28]

[29]

[30]

[31]

[32]

[33]

[34]

[35]

[36]

[37]

[38]

[39]

[40]

[41]

[42]

[43]

[44]

[45]

[46]

[47]

[48]

[49]

[50]

[51]

[52]

[53]

[54]

[55]

[56]

[57]

[58]

[59]

[60]

[61]

[62]

[63]

[64]

[65]

[66]

[67]

[68]

[69]

[70]

[71]

[72]

[73]

[74]

[75]

[76]

[77]

[78]

[79]

[80]

[81]

[82]

[83]

[84]

[85]

[86]

[87]

[88]

[89]

[90]

[91]

[92]

[93]

[94]

[95]

[96]

[97]

[98]

[99]

[100]