Figures

Table 1 — Study characteristics Upset Plot Framework used to evaluate surveillance systems Type of surveillance system

Table 1 — Study characteristics

Table 1. Study characteristics
Study ID	Study title	Corresponding author country	Study design type	Surveillance Type	Evaluation Framework Used
Klaucke 1988	Guidelines for Evaluating Surveillance Systems	not reported	Guidance or a descriptive framework	Public Health	Not applicable
Aenishaenslin 2021	Evaluating the Integration of One Health in Surveillance Systems for Antimicrobial Use and Resistance: A Conceptual Framework	Canada	Guidance or a descriptive framework	One Health	Not applicable
Albali 2023	Comparative Performance Evaluation of the Public Health Surveillance Systems in 6 Gulf Cooperation Countries: Cross-sectional Study	Saudi Arabia	Formal evaluation	Public Health	CDC 2001; CDC 2004
Amato 2023	Evaluation of the pilot wastewater surveillance for SARS-CoV-2 in Norway, June 2022 - March 2023	Norway	Formal evaluation	Wastewater	CDC 2001; ECDC 2014
Anonymous 2001	Updated Guidelines for Evaluating Public Health Surveillance Systems	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Arinik 2023	An Evaluation Framework For Comparing Epidemic Intelligence Systems	France	Guidance or a descriptive framework	Public Health	Not applicable
Auer 2001	Canadian Aboriginal communities: a framework for injury surveillance	Canada	Guidance or a descriptive framework	Public Health	No framework(s) or guidance document(s) were discussed
Auer 2011	The relevance of WHO injury surveillance guidelines for evaluation: learning from the Aboriginal Community-Centered Injury Surveillance System (ACCISS) and two institution-based systems	Sweden	Guidance or a descriptive framework	Public Health	Other
Azofeifa 2018	Evaluating Behavioral Health Surveillance Systems	N/A	Guidance or a descriptive framework	Public Health	No framework(s) or guidance document(s) were discussed
Babaie 2015	Performance Assessment of Communicable Disease Surveillance in Disasters: A Systematic Review	Iran	Domains, themes	Public Health	Not applicable
BaboMartins 2017	Economics of zoonoses surveillance in a One Health context: an assessment of Campylobacter surveillance in Switzerland	United Kingdom	Formal evaluation	One Health	Other
Baker 2006	Global Public Health Surveillance under New International Health Regulations	New Zealand	Formal evaluation	Public Health	CDC 2001
Bennani 2021	Evaluating Integrated Surveillance for Antimicrobial Use and Resistance in England: A Qualitative Study	United Kingdom	Formal evaluation	One Health	Other
Bingle 2005	An Evaluation of the Ontario Rapid Risk Factor Surveillance System	Canada	Guidance or a descriptive framework	Public Health	CDC 2001
Bordier 2019	One Health Surveillance: A Matrix to Evaluate Multisectoral Collaboration	Vietnam	Guidance or a descriptive framework	One Health	Not applicable
Bordier 2020	Characteristics of One Health surveillance systems: A systematic literature review	Vietnam	Domains, themes	One Health	Not applicable
Bordier 2022	Evaluation of Collaboration in a Multisectoral Surveillance System: The ECoSur Tool	Vietnam	Guidance or a descriptive framework	One Health	Not applicable
Bravata 2004	Evaluating Detection and Diagnostic Decision Support Systems for Bioterrorism Response	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Buehler 2004	Framework for Evaluating Public Health Surveillance Systems for Early Detection of Outbreaks: Recommendations from the CDC Working Group	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Buehler 2008	Evaluation of surveillance systems for early epidemic detection	unknown	Guidance or a descriptive framework	Public Health	Not applicable
Calba 2015	Surveillance systems evaluation: a systematic review of the existing approaches	France	Domains, themes	Other	Not applicable
Calba 2015	Applying participatory approaches in the evaluation of surveillance systems: A pilot study on African swine fever surveillance in Corsica	Belgium	Formal evaluation	Other	OASIS; Other
Calba 2016	The Added-Value of Using Participatory Approaches to Assess the Acceptability of Surveillance Systems: The Case of Bovine Tuberculosis in Belgium	France	Formal evaluation	Other	OASIS; Other
Cameron 2020	Quantification of the sensitivity of early detection surveillance	France	Domains, themes	Public Health	Not applicable
Choi 2008	Enhancing global capacity in the surveillance, prevention, and control of chronic diseases: seven themes to consider and build upon	Canada	Domains, themes	Public Health	Not applicable
Clara 2020	Developing monitoring and evaluation tools for event-based surveillance: experience from Vietnam	United States of America	Domains, themes	Public Health	No framework(s) or guidance document(s) were discussed
Collineau 2022	Evaluation of the French surveillance system for epidemiological surveillance of antimicrobial resistance in the community and nursing homes	France	Formal evaluation	One Health	OASIS
Corley 2012	Assessing the Continuum of Event-Based Biosurveillance Through an Operational Lens	United States of America	Guidance or a descriptive framework	Other	Not applicable
Crawley 2021	Using Timeliness Metrics to Track Progress and Identify Gaps in Disease Surveillance	United States of America	Domains, themes	Public Health	Not applicable
Cutts 1993	Surveillance for the Expanded Programme on Immunization	United Kingdom	Domains, themes	Public Health	Not applicable
Declich 1994	Public health surveillance: historical origins, methods and evaluation	Canada	Domains, themes	Public Health	Not applicable
DelRioVilas 2022	Health Surveillance Evaluation in the Policy Cycle	France	Guidance or a descriptive framework	One Health	Not applicable
Dente 2018	Integrated surveillance and risk assessment for arbovirus infections: recommendations for enhancing One Health in the Mediterranean Region: MediLabSecure Strategic Document 2018	not reported	Guidance or a descriptive framework	One Health	Not applicable
Drewe 2012	Evaluation of animal and public health surveillance systems: a systematic review	United Kingdom	Domains, themes	Other	Not applicable
Drewe 2015	SERVAL: A New Framework for the Evaluation of Animal Health Surveillance	United Kingdom	Guidance or a descriptive framework	Other	Not applicable
ElAllaki 2013	Conceptual evaluation of population health surveillance programs: Method and example	Canada	Guidance or a descriptive framework	Public Health	Not applicable
Ford 2021	Adequacy of Existing Surveillance Systems to Monitor Racism, Social Stigma and COVID Inequities: A Detailed Assessment and Recommendations	United States of America	Guidance or a descriptive framework	Public Health	CDC 2001; Other
Garcia-Vozmediano 2022	A One Health Evaluation of the Surveillance Systems on Tick-Borne Diseases in the Netherlands, Spain and Italy	Italy	Formal evaluation	One Health	Other
Goutard 2022	THE USE OF PARTICIPATORY METHODS IN THE EVALUATION OF HEALTH SURVEILLANCE SYSTEMS	France	Guidance or a descriptive framework	Other	Not applicable
Groseclose 2010	Evaluating Public Health Surveillance	not reported	Guidance or a descriptive framework	Public Health	Not applicable
Groseclose 2013	Evaluation of syndromic surveillance systems that use healthcare data	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Groseclose 2017	Public Health Surveillance Systems: Recent Advances in Their Use and Evaluation	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Hall 2007	Setting Standards and an Evaluation Framework for Human Immunodeficiency Virus/Acquired Immunodeficiency Syndrome Surveillance	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Harper 2011	Improving Aboriginal health data capture: evidence from a health registry evaluation	Canada	Formal evaluation	Public Health	CDC 2001
Haworth-Brockman 2021	One Health Evaluation of Antimicrobial Use and Resistance Surveillance: A Novel Tool for Evaluating Integrated, One Health Antimicrobial Resistance and Antimicrobial Use Surveillance Programs	Canada	Guidance or a descriptive framework	One Health	Not applicable
Hendrikx 2011	OASIS: an assessment tool of epidemiological surveillance systems in animal health and food safety	France	Guidance or a descriptive framework	Other	Not applicable
Herida 2016	Economic Evaluations of Public Health Surveillance Systems: a Systematic Review	France	Domains, themes	Public Health	Not applicable
Hoinville 2013	Proposed terms and concepts for describing and evaluating animal-health surveillance systems	United Kingdom	Domains, themes	Other	Not applicable
Innes 2022	Enhancing global health security in Thailand: Strengths and challenges of initiating a One Health approach to avian influenza surveillance	United States of America	Formal evaluation	One Health	CDC 2001; Other
Jajosky 2004	Evaluation of reporting timeliness of public health surveillance systems for infectious diseases	United States of America	Guidance or a descriptive framework	Public Health	No framework(s) or guidance document(s) were discussed
Lucero-Obusan 2022	Public health surveillance in the U.S. Department of Veterans Affairs: evaluation of the Praedico surveillance system	United States of America	Formal evaluation	Public Health	CDC 2001
Mader 2021	OASIS evaluation of the French surveillance network for antimicrobial resistance in diseased animals (RESAPATH): success factors underpinning a well-performing voluntary system	France	Formal evaluation	One Health	OASIS
Marbus 2020	Experience of establishing severe acute respiratory surveillance in the Netherlands: Evaluation and challenges	Netherlands	Formal evaluation	Public Health	CDC 2001; ECDC 2014; Other
Mitchell 2009	The development of an evaluation framework for injury surveillance systems	Australia	Guidance or a descriptive framework	Public Health	Not applicable
Morbey 2021	Evaluating multi-purpose syndromic surveillance systems - a complex problem	United Kingdom	Guidance or a descriptive framework	Public Health	Not applicable
Muellner 2018	SurF: an innovative framework in biosecurity and animal health surveillance evaluation	New Zealand	Guidance or a descriptive framework	Other	Not applicable
Paternoster 2017	The degree of One Health implementation in the west nile virus integrated surveillance in Northern Italy, 2016	Italy	Formal evaluation	One Health	Other
Pavlin 2013	Syndromic surveillance for infectious diseases	United States of America	Domains, themes	Public Health	Not applicable
Pelican 2019	Synergising tools for capacity assessment and One Health operationalisation	United States of America	Guidance or a descriptive framework	One Health	Not applicable
Peyre 2019	The RISKSUR EVA tool (Survtool): A tool for the integrated evaluation of animal health surveillance systems	France	Guidance or a descriptive framework	Other	Not applicable
Peyre 2022	Synthesis-evaluate to better inform: A way to strengthening health surveillance systems	France	Other	One Health	Not applicable
Reintjes 2007	Benchmarking national surveillance systems: a new tool for the comparison of communicable disease surveillance and control in Europe	Germany	Guidance or a descriptive framework	Public Health	Not applicable
Romano 2022	An Evaluation of Syndromic Surveillance-Related Practices Among Selected State and Local Health Agencies	United States of America	Domains, themes	Public Health	No framework(s) or guidance document(s) were discussed
Rüegg 2022	Guidance for evaluating integrated surveillance of antimicrobial use and resistance	Switzerland	Guidance or a descriptive framework	One Health	Not applicable
Sahal 2009	Communicable diseases surveillance lessons learned from developed and developing countries: Literature review	Denmark	Domains, themes	Public Health	Not applicable
Sandberg 2021	Assessment of Evaluation Tools for Integrated Surveillance of Antimicrobial Use and Resistance Based on Selected Case Studies	Denmark	Guidance or a descriptive framework	One Health	Not applicable
Sosin 2003	Draft Framework for Evaluating Syndromic Surveillance Systems	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Tegegne 2023	OH-EpiCap: a semi-quantitative tool for the evaluation of One Health epidemiological surveillance capacities and capabilities	France	Guidance or a descriptive framework	One Health	Not applicable
Thacker 1988	A METHOD FOR EVALUATING SYSTEMS OF EPIDEMIOLOGICAL SURVEILLANCE	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Thacker 1988	PUBLIC HEALTH SURVEILLANCE IN THE UNITED STATES	United States of America	Domains, themes	Public Health	Not applicable
VasconcelosGioia 2021	Informing resilience building: FAO's Surveillance Evaluation Tool (SET) Biothreat Detection Module will help assess national capacities to detect agro-terrorism and agro-crime	Italy	Guidance or a descriptive framework	Public Health	Not applicable
Velasova 2015	Evaluation of the usefulness at national level of the dairy cattle health and production recording systems in Great Britain	not reported	Formal evaluation	Other	SERVAL; Other
WorldHealthOrganization 2004	Overview of the WHO framework for monitoring and evaluating surveillance and response systems for communicable diseases	not reported	Guidance or a descriptive framework	Public Health	Not applicable
Yang 2022	Understanding occupational safety and health surveillance: expert consensus on components, attributes and example measures for an evaluation framework	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Peyre 2022	Principles for evaluation of one health surveillance: The EVA book	France	Guidance or a descriptive framework	One Health	The RISKSUR EVA tool (Survtool); Other
Ribeiro 2019	Overcoming challenges for designing and implementing the One Health approach: A systematic review of the literature	Netherlands	Domains, themes	One Health	Not applicable
Meynard 2008	Proposal of a framework for evaluating military surveillance systems for early detection of outbreaks on duty areas	French Guiana	Guidance or a descriptive framework	Public Health	Health Canada 2004; Other
Margevicius 2014	Advancing a Framework to Enable Characterization and Evaluation of Data Streams Useful for Biosurveillance	United States of America	Guidance or a descriptive framework	Public Health	Not applicable
Hitziger 2021	System Thinking and Citizen Participation Is Still Missing in One Health Initiatives ‚ Lessons From Fifteen Evaluations	Switzerland	Domains, themes	One Health	Not applicable
Ng'etich 2021	Development and validation of a framework to improve neglected tropical diseases surveillance and response at sub-national levels in Kenya	South Africa	Guidance or a descriptive framework	Public Health	Not applicable

↑ Back to top

Upset Plot

↑ Back to top

Framework used to evaluate surveillance systems

↑ Back to top

Type of surveillance system

↑ Back to top