October 6, 2017 by Eric Kirkendall
September 24, 2017 by Eric Kirkendall
To my knowledge, no organization in the U.S. has achieved as much using citizen science as the Brawley, California community and environmental justice group Comité Cívico Del Valle.
Comité Cívico, working with a network of academic, governmental, and other partners, has built a community-based air quality monitoring system consisting of 40 monitors spread across the sprawling and dangerously polluted Imperial Valley; the IVAN environmental reporting system, which allows citizens to document and report environmental problems; a task force that follows up on the problems that citizens report, and much more.
The result? Empowered, knowledgeable, and engaged residents who are committed to make their community a better and healthier place, and have the tools to do it.
Last week, Comité Cívico gained a new ally – Leonardo DiCaprio, who announced that his Leonardo DiCaprio Foundation will donate $100,000 to install and operate 20 new air monitors to monitor deadly chemical-laden particulate matter blowing from the rapidly drying Salton sea – perhaps the biggest environmental health challenge the region faces.
Also last week, perhaps inspired by Comité Cívico’s successes, the California State Legislature passed a bill, AB 617, which authorizes the deployment of community air monitoring systems in polluted communities across the state.
Knowledge is power, and Leonardo DiCaprio’s support will help empower the residents of the Imperial Valley to fight for one of the most fundamental human rights – clean air to breathe.
To learn more about community-based air monitoring, join members of Comite Civico and dozens of other MFN organizations at the FREE 4th International Conference, and check out the references at the end of this post.
How community air monitoring projects provide a data-driven model for the future (Environmental Defense Fund)
In California’s Imperial Valley, Residents Aren’t Waiting for Government to Track Pollution, Yes Magazine
Advancing Environmental Justice: A New State Regulatory Framework to Abate Community-Level Air Pollution Hotspots and Improve Health Outcomes (Goldman School of Public Policy)
CALIFORNIA’S AB 617: A NEW FRONTIER IN AIR QUALITY MANAGEMENT…IF FUNDED (Center for Clean Air Policy)
August 5, 2017 by Eric Kirkendall
This is an excellent article written by Luis Olmedo and Humberto Lugo of MFN member organization Comite Civico Del Valle, and others. Check it out and consider – could this be a roadmap for your community group?
To learn more, register for the Community-Based Air Monitoring Webinar to be held on Thursday, August 24 from 12:30 to 2:00 p.m. EDT
The Imperial County Community Air Monitoring Network: A Model for Community-based Environmental Monitoring for Public Health Action
PDF Version (723 KB)
The Imperial County Community Air Monitoring Network (the Network) is a collaborative group of community, academic, nongovernmental, and government partners designed to fill the need for more detailed data on particulate matter in an area that often exceeds air quality standards. The Network employs a community-based environmental monitoring process in which the community and researchers have specific, well-defined roles as part of an equitable partnership that also includes shared decision-making to determine study direction, plan research protocols, and conduct project activities. The Network is currently producing real-time particulate matter data from 40 low-cost sensors throughout Imperial County, one of the largest community-based air networks in the United States. Establishment of a community-led air network involves engaging community members to be citizen-scientists in the monitoring, siting , and data collection process. Attention to technical issues regarding instrument calibration and validation and electronic transfer and storage of data is also essential. Finally, continued community health improvements will be predicated on facilitating community ownership and sustainability of the network after research funds have been expended. https://doi.org/10.1289/EHP1772
Communities and regulatory agencies are discovering the utility of small, low-cost environmental sensors that are able to provide real-time information on air pollution (Jiao et al. 2016; Snyder et al. 2013; Yi et al. 2015). These sensors hold great promise for individuals, communities, schools, and other interested parties by providing timely information that can supplement regulatory data used to reduce toxic exposures and influence environmental health policy and programs. Using these new technologies presents challenges in ensuring scientific validity of the data and visualizing and communicating scientific information in a comprehensible manner.
The Imperial County Community Air Monitoring Network (the Network), one of the largest community-based air monitoring networks in the United States, is an innovative model that addresses these challenges through a community, academic, nongovernmental, and government partnership that integrates knowledge and priorities from community and academic research perspectives. In this community-engaged process, community members play key roles in determining study design, siting and deploying monitors, and data collection. The Network is now producing real-time particulate matter data from 40 low-cost sensors throughout the county.
A Community Affected by Air Pollution
Imperial County in southern California is home to a primarily Latino population (82%) and has some of the highest rates of unemployment and poverty in the nation (U.S. Census 2010). The county is mainly desert and agricultural, with a range of air pollution sources—such as field burning, the U.S.–Mexico border crossing, unpaved roads, and various industrial facilities—that contribute to periods lasting longer than 6 months when Imperial County exceeds the California standard for particulate matter (PM) with an aerodynamic diameter of 10 μm or less (PM10) (CARB 2012). Historically, Imperial far surpasses all other California counties as having the highest rates of both emergency hospital visits and hospitalizations for asthma among school-age children (CEHTP 2017). El Centro, California, located in the Imperial Valley, is the city with the fifth-worst air quality in the U.S. (ALA 2016). Exposure to PM10 is associated with increased respiratory disease, decreased lung function, and asthma attacks in susceptible individuals (Anderson et al. 2012). According to the California Air Resources Board, in 2015, the last year in which data were available, the Salton Sea air basin, where Imperial County is located, had 128 d that exceeded the state standards for PM10(https://www.arb.ca.gov/adam/topfour/topfour1.php). This finding means that, for more than one third of the year, residents may be at risk of breathing outdoor air that exceeds the maximum amount of PM that would not harm public health. Even when air quality is within state standards, the health of the population will likely suffer, as arguably no health threshold level exists for PM; for example, an analysis of daily time series data for the 20 largest U.S. cities for 1987–1994 found no threshold for particulate air pollution on daily mortality (Daniels et al. 2000), and Vaduganathan et al. found that increased levels of PM10, even below the current limits set by the European Union, were associated with excess risk for admissions for acute cardiovascular events (Vaduganathan et al. 2016).
Community Needs for Local-level Air Quality Information
Governmental regulatory air monitors are designed to measure ambient air in communities to ensure that federal and state air-quality standards for the protection of public health are met. However, regulatory monitoring does not have the spatial resolution to provide information to the public in the specific communities where they live, work, and play. Further, regulatory monitors are not designed to report on episodic elevated events (i.e., high-concentration events may be qualified as “exceptional events” and removed from regulatory consideration), which are of concern to communities due to acute health events that occur during peak concentrations.
These limitations play out in Imperial County, where understanding, awareness, and effective response to air pollution trends have been hindered by the fact that there are only five regulatory PM monitors for a county that spans over 4,000 square miles and is home to 175,000 individuals. Residents have noted that these monitors often do not seem to reflect the air quality in their local communities, voiced concerns that the monitoring data are sometimes not displayed during elevated events, and identified the need for more air monitors.
Opportunities with Next Generation Air Sensor Technology
Recent advances in small portable and personal air monitors or sensors, which are low cost in comparison with conventional monitors, potentially may provide higher temporal and spatial resolution of air quality data than currently exists from regulatory networks (Jerrett et al. 2015; Duvall et al. 2016; Han et al. 2017; Jovašević-Stojanović et al. 2015; Volckens et al. 2016). The accessible cost, ease of use, and improving accuracy of these technologies position them to play an important role in efforts by communities and researchers to identify sources and trends in air quality that may inform policies and plans to reduce emissions and exposures. Both personal and community responses to these new data can be important public health actions that may emerge from monitoring.
To address community concerns about air quality, a collaborative of community, academia, nonprofit, and government partners formed the Imperial County Community Air Monitoring Project (the Project). Funded by the National Institute for Environmental Health Science’s Research to Action Program, the Project used an innovative approach to facilitate community participation and decision-making throughout the development and deployment of the Network and to address concerns about scientific validity and sustainability.
Project Partnerships and a Community Engagement Structure
A crucial component of our approach was to establish an equitable and inclusive community engagement structure that ensured participation at multiple levels throughout the project by various community representatives. The initial step of identification of study partners occurred naturally through a long-standing relationship between Comite Civico del Valle (CCV), a community-based organization in Imperial County, and the California Environmental Health Tracking Program (CEHTP), a program of the nongovernmental Public Health Institute, in collaboration with the California Department of Public Health. The third main study partner, the Seto research group at University of Washington (UW), was identified through relationships with CEHTP, as were other academic partners affiliated with University of California at Los Angeles and George Washington University, who served in an advisory capacity. Distinct roles for the partnering organizations were established from the start. CEHTP provided epidemiological, community engagement, health education, and project-management expertise. UW provided exposure assessment expertise, equipment customization and assembly, and monitor-operation and validation capabilities. CCV provided local community knowledge and relationships and community outreach and organizing expertise, and CCV was ultimately responsible for interfacing with monitor sites and maintenance of the monitoring network. UCLA provided expertise to the community and academic partners on the health effects of air pollution, and George Washington University provided technical consultation on the monitoring of ambient particles.
The project engaged with residents in Imperial County via the establishment of a Community Steering Committee (CSC), recruitment of community participants to help site monitors, and identification of local sites to serve as hosts for the air monitors. The CSC—composed of local leaders and residents concerned about the environment—worked with the Project staff on all aspects of study design and implementation, provided feedback on data communication, and participated in the development of actions to reduce exposures and pollution sources. Government regulatory agencies (in this case, the local air pollution control agency, the California Environmental Protection Agency (California EPA), and the U.S. Environmental Protection Agency (U.S. EPA), were engaged through participation on a Technical Team, composed of local government, academic, and other technical experts. The technical team was convened semiannually to provide technical advice and expertise on the exposure assessment methodologies and calibration results. Government agencies were contacted to provide portable reference monitors for co-location studies, to provide technical assistance to communities and the researchers, and to receive feedback on community needs.
Defining the Goals for Community Air Monitoring
Components of establishing a community-based air monitoring network are shown in Figure 1. Because it was essential to have an established research question or surveillance need to guide the Project’s activities, this was determined at the start with partners to ensure responsiveness to community needs. The study partners defined broad goals for the Network that included the ability to use the air monitoring data to inform community members about air quality in real time, as well as to generate data that are appropriate for conducting spatial analysis to identify air pollution hot spots and trends. We also continued to refine the goals by incorporating priorities of the CSC and community participants, determined through individual key informant interviews and group discussions to learn about community air quality information needs, uses, sources, and barriers. In turn, these goals provided guidance as we designed the Network and prepared to share monitoring data with the community. In this manner, the study protocol was developed with significant input from the community partner. Furthermore, at that time, the project partners and CSC helped to develop a project-evaluation plan to assess how well these goals were achieved. The evaluation plan included surveys of CSC members, community participants, and other users of the air monitoring data; web analytics; and key informant interviews of project partners.
Preparing the Network Equipment and Data Collection Infrastructure
The monitor selected for this study, a modified Dylos DC1700 (Dylos Corporation), was tested in the lab and field for limits of detection, responses to particles of varying composition, ability to accurately size particles, and precision between multiple monitors at multiple field sites with different environmental conditions, such as temperature and humidity. The Dylos is a light-scattering particle counter, and as such, particle counts were converted to mass concentrations to align with health recommendations that are usually based on the latter. Algorithms to convert counts to mass were developed based on co-location of the instruments with government reference instruments in the region, modeling the relationship between counts and mass and using this relationship to estimate mass concentrations. The monitor system included the Dylos particle sensor with four size bins (>0.5 μm, >1.0 μm, >2.5 μm and >10 μm), temperature and relative humidity sensors, and a microcontroller to allow wireless real-time data transfer to the Internet. The monitor components were housed in a box with a cooling fan to sustain optimal sensor performance under Imperial County’s harsh summer conditions (Figure 2).
Monitors were validated and calibrated with reference monitors. In our case, the California EPA participated by providing access to their Calexico, California, site, where they operate federal reference and federal equivalent methods for measuring PM, as well as co-locating portable Beta-attenuation particulate matter monitors at sites that we selected for our community air monitors. Additionally, data collection and data transfer protocols were established, along with quality control plans. This process included addressing issues such as establishment of data feeds, data averaging over time, and data completion checks, as well as formatting data for display and hosting the Web services that allow the public to view the data in real time.
Designing and Deploying the Network
Monitor siting was accomplished by having community members identify, collect data about, and prioritize potential monitor locations in impacted communities throughout the county. The participants in this prioritization process included the CSC and additional community residents who were recruited for this aspect of the project. To facilitate these community members’ meaningful participation in the monitor siting process, the project team provided basic training in air monitoring science, including explanation of technical criteria (e.g., electrical power availability, wireless connection capability, absence of obstructions, secure location) for monitoring siting. This community-engaged process was used to identify locations for the first 20 monitors. An iterative process was used in which monitoring data from the first set of 20 monitors helped determine sites for the second set. The selection of the second 20 monitor locations was guided by the research staff, with input from the CSC, to ensure that monitors were located in areas where a spatially representative model could be constructed using land use regression techniques (Briggs et al. 1997). CCV played a critical role in recruitment of monitor hosts. CCV staff members were also trained to deploy the monitors and conduct routine maintenance and troubleshooting.
Producing Community-relevant and Accessible Information
Researchers and the community members discussed which air quality measures were most useful and how the data would be visualized and communicated to the public. The CSC was presented with several options for data presentation to determine the most understandable and useful approach. The existing community website and data platform titled Identifying Violations Affecting Neighborhoods (IVAN) was redesigned and built out to include the data from the Network, called IVAN Air Monitoring (IVAN-Imperial.org/air). The Project staff developed messaging about interpreting the data, information on air quality and health, and technical information on the monitors and pollution levels, which is also posted on the IVAN website.
Moving Data to Action
Ultimately, the goal of the Network is to provide data and information to community residents to help them engage in individual and community actions to improve health. CCV has extensive knowledge and expertise in outreach, education, advocacy, and organizing. By involving the CSC and other community residents throughout the Project, CCV was more readily able to engage them in ongoing actions than in the past. To support the deployment and utilization of the Network, the Project team developed a two-phase public health action-planning process in which the CSC and other community participants were trained in community action planning strategies, identified and prioritized public health concerns, and developed action plans to address those concerns. With the completion of the Network, the second phase of public health actions will focus specifically on air quality, which may include actions such as outreach to school communities about air quality and health; devising plans for schools to shelter in place during a poor-air-quality days, especially for students with asthma; sharing data trends with local officials to advocate for regulatory action; and training schools with a community monitor to use a flag system to notify the school community about the current air-quality level.
This Network was designed from the outset to be community owned and operated, which will require that the community has the resources, knowledge, and capacity to sustain it. A critical component of supporting an ongoing network is the operation and maintenance of the monitoring equipment, as well as upgrading of software and hardware as needed. As part of ongoing project activities, CCV staff has already received training and assumed responsibility for monitor installation, as well as in troubleshooting monitor hardware and software issues. Furthermore, although technical expertise from a consultant on retainer can provide periodic review to ensure the scientific accuracy of the project, the Network should not have to rely on external technical infrastructure. For example, project data were initially stored on UW data servers but have now been migrated to a cloud service provider so that ownership of the data and the server software may be transferred to the community before the conclusion of the initial grant. This step is critical to ensure sustainability of the program and accessibility of the data after the grant funding period ends. Finally, a key component of sustainability is the continuation of community action planning and community-training activities. The CSC provides an existing structure through which community members can participate directly in the outreach, dissemination, and use of air monitoring data in the broader community. CCV and the CSC can also play a role in community-member mentoring, so that the next generation is interested and prepared to operate the Network.
Who should financially sustain a community-based air monitoring network? Although the community will own the Network and has an interest in its continued operation, they have limited access to funding streams and few available resources. Government agencies may be motivated to maintain and ensure quality data from such projects, as these data help fulfill their mission to provide useful data for community members and can supplement information from regulatory monitors. One example in California is the California Air Resources Board’s Supplemental Environmental Project Policy (available from a file linked at https://www.arb.ca.gov/enf/seppolicy.htm). This policy “allows community-based projects to be funded from a portion of the penalties received during settlement of enforcement actions.” Policies like these can provide some continued support for air monitoring network sustainability.
Several main themes emerge from this project that can be applied to other settings. First, a clearly defined purpose for monitoring must exist, with an understanding of how data may inform action. Roles and responsibilities of all study partners need to be clear from the onset; if this is done correctly, it will ensure that critical functions are covered and adequately funded, it will manage expectations and avoid miscommunication, and it will identify opportunities for knowledge transfer and capacity building. The community, researchers, and government agencies all have an important role to play, and the project resources should be equitably distributed among them. Scientific information must be presented in an accurate and accessible manner and tailored to the cultural and socioeconomic attributes of the community in question. Data must be understandable and useful for the public to apply in public health campaigns. Next-generation environmental monitors, although relatively easy to install, should not be considered reliable and accurate without rigorous calibration and testing; monitors later may experience technical issues, such as connectivity problems that may affect data completeness. Further, due to dust accumulation on the lens of the particle counter, measurement drift can occur over time; therefore, a regular maintenance schedule is essential. In addition, sustaining a project after dedicated funding ends is difficult; therefore, emphasis on community involvement and training during the project period, as well as novel fundraising and interest from regulatory agencies, can ensure that the project continues to collect useful data into the future.
Current availability of real-time and neighborhood-scale data on PM levels can be used as an agent of change. Residents are now equipped with data that they can use to better identify when and where residents are safe outside; to change personal behaviors to reduce exposures; and to advocate for policy changes that more aggressively reduce PM sources. Community engagement and uses of citizen science are becoming more common in influencing public health practice (Den Broeder et al. 2016). In Imperial County, we have emphasized the importance of the development of a sustainable air-monitoring network that is community owned and operated and producing data that are valid for community and traditional research. The project has increased community knowledge and capacity about the process required to set up and maintain monitors, and community partners are now empowered to initiate and collect air data for themselves. With this new information, understanding, and capacity, the community is better prepared to engage and collaborate with government around air monitoring and policy than in the past. Increased availability of actionable independent data and technical capacity to operate the hardware and software network components allow residents to have greater control over their lives and enhance the health of their community members.
Research reported in this publication was supported by the National Institute of Environmental Health Sciences of the National Institutes of Health under Award Number R01ES022722. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
ALA (American Lung Association). State of the Air. 2016. http://www.lung.org/our-initiatives/healthy-air/sota/ [accessed 13 February 2017]
Anderson JO, Thundiyil JG, Stolbach A. 2012. Clearing the air: a review of the effects of particulate matter air pollution on human health. J Med Toxicol 8(2):166–175, PMID: 22194192, 10.1007/s13181-011-0203-1.
Briggs DJ, Collins S, Elliott P, Fischer P, Kingham S, Lebret E, et al. 1997. Mapping urban air pollution using GIS: a regression-based approach. Int J Geogr Inf Sci 11(7): 699–718, 10.1080/136588197242158.
CARB (California Air Resources Board). 2012. Air Quality Trend Summaries, http://www.arb.ca.gov/adam/trends/trends1.php [accessed 13 February 2017]
CEHTP (California Environmental Health Tracking Program) () 2017. http://www.cehtp.org[accessed 13 February 2017]
Daniels MJ, Dominici F, Zeger SL, Samet JM. 2000. Estimating particulate-matter mortality dose-response curves and threshold levels: an analysis of daily time-series for the 20 largest US cities. Am J Epidemiol 152(5):397–406, 10.1093/aje/152.5.397.
Den Broeder L, Devilee J, Van Oers H, Schuit AJ, Wagemakers A. 2016. Citizen science for public health. Health Promot Int Dec 23. pii: daw086, 10.1093/heapro/daw086.
Duvall RM, Long RW, Beaver MR, Kronmiller KG, Wheeler ML, Szykman JJ. 2016. Performance evaluation and community application of low-cost sensors for ozone and nitrogen dioxide. Kolev SD, ed. Sensors (Basel). 16(10):1698, 10.3390/s16101698.
Han I, Symanski E, Stock TH. 2017. Feasibility of using low-cost portable particle monitors for measurement of fine and coarse particulate matter in urban ambient air. J Air Waste Manag Assoc 67(3):330–340, PMID: 27690287, 10.1080/10962247.2016.1241195.
Jerrett M, Reid CE, McKone TE, Koutrakis P. 2015. Participatory and ubiquitous sensing for exposure assessment in spatial epidemiology. In Spatial Analysis in Health Geography. Kanaroglou P, Delmelle E, Paez A eds. Farnham, UK:Ashgate Publishing Ltd.
Jiao W, Hagler G, Williams R, Sharpe R, Brown R, Garver D, et al. 2016. Community Air Sensor Network (CAIRSENSE) project: evaluation of low-cost sensor performance in a suburban environment in the southeastern United States. Atmos Meas Tech 9(11):5281, 10.5194/amt-9-5281-2016.
Jovašević-Stojanović M, Bartonova A, Topalović D, Lazović I, Pokrić B, Ristovski Z, et al. 2015. On the use of small and cheaper sensors and devices for indicative citizen-based monitoring of respirable particulate matter. Environ Pollut 206:696–704, 10.1016/j.envpol.2015.08.035.
Snyder EG, Watkins TH, Solomon PA, Thoma ED, Williams RW, Hagler GS, Williams RW, Shelow D, et al. 2013. The changing paradigm of air pollution monitoring. Environ Sci Technol 47(20):11369–11377, 10.1021/es4022602.
U.S. Census. 2010. U.S. Census Bureau Quick Facts. Imperial County. http://www.census.gov/quickfacts/table/PST045215/06025,0636294,00 [accessed 13 February 2017]
Vaduganathan M, De Palma G, Manerba A, Goldoni M, Triggiani M, Apostoli P, Dei Cas L, et al. 2016. Risk of cardiovascular hospitalizations from exposure to coarse particulate matter (PM10) below the European Union Safety Threshold. Am J Cardiol 117(8):1231–1235, PMID: 26976793, 10.1016/j.amjcard.2016.01.041.
Volckens J, Quinn C, Leith D, Mehaffy J, Henry CS, Miller-Lionberg D. 2016. Development and evaluation of an ultrasonic personal aerosol sampler. Indoor Air. 27(2):409–416, 10.3390/s16101698.
Yi WY, Lo KM, Mak T, Leung KS, Leung Y, Meng ML. 2015. A survey of wireless sensor network based air pollution monitoring systems. Sensors (Basel) 15(12):31392–31427, 10.3390/s151229859
June 10, 2017 by Eric Kirkendall
As the Moving Forward Network members that do air pollution monitoring know from on-the-ground experience, EPA regulatory air monitors may show an area to have low levels of particulate matter from diesel exhaust and other air pollution when in fact, nearby hot spots can have high and dangerous levls of air pollution.
For example, while the city’s only EPA regulatory monitor showed air was relatively clean, monitoring by the Diesel Health Project around the BNSF Argentine Rail Yard in Kansas City, Kansas revealed dangerous levels of elemental carbon (an indicator of Diesel Exhaust pollution) in nearby resident’s yards, very likely from a nearby locomotive maintenance yard at which as many as 50 locomotives at a time, many running, await load testing.
Currently, measuring air pollution in overburdened neighborhoods at a high enough level of granularity to comprehensively identify hot spots is very difficult and expensive, and beyond the capabilities of most environmental justice and other community organizations.
However, research published this week shows how this can be done – and that the results are of great value. A study carried out by MFN member West Oakland Environmental Indicators Project (WOEIP), the Environmental Defense Fund, Aclima, and the University of Texas at Austin using data collected by Google Street View cars produced findings that were concerning and surprising.
Most significantly, the data shows pollution variations within single blocks in Oakland of as high as 5X, and revealed hotspots that were often very persistent and stable.
The wide range of pollution levels and the persistence of hotspots tells us something else – in many cases workers and residents are being exposed to much higher levels of pollution and hence higher health risks than they or anyone else knows. We need to build on this research to develop the capability of community-based groups to conduct this level of monitoring in overburdened neighborhoods throughout the U.S. There are children growing up in these neighborhoods who will sooner or later suffer from underdeveloped lungs, asthma, heart disease, cancer, and other health problems. The sooner we identify and clean up these hot spots, the more people we can save from air pollution’s health effects, misery, and in some cases, premature death.
To learn more, view the excellent video with commentary by WOEIP founders Margaret Gordon and Brian Beveridge or read the news articles linked below. For a deeper dive, click the last link to read the entire journal article.
Google shares Street View pollution maps, Left Lane News
Tracking Air Quality Block By Block, California Healthline
High-Resolution Air Pollution Mapping with Google Street View Cars: Exploiting Big Data, (complete study) Environmental Science and Technology
February 20, 2017 by Eric Kirkendall
Information is power, and no community organization has done more to create power for the people than MFN member Comite Civico del Valle (CCV), headquartered in the Imperial Valley of Southern California. Among its many accomplishments, Comite Civico, founded 30 years ago, has worked with partners to set up a sophisticated air monitoring system and a world-class online environmental reporting system that provides detailed and actionable information on environmental health hazards.