Skip to main content
Advertisement
  • Loading metrics

Applying user-centered design to improve drinking water consumer confidence reports: A Baltimore case study

  • Mary A. Fox ,

    Contributed equally to this work with: Mary A. Fox, Vidisha Agarwalla

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Supervision, Writing – original draft, Writing – review & editing

    mfox9@jhu.edu

    Affiliations Department of Health Policy and Management, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America, Department of Environmental Health and Engineering, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America, Risk Sciences and Public Policy Institute, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America

  • Vidisha Agarwalla ,

    Contributed equally to this work with: Mary A. Fox, Vidisha Agarwalla

    Roles Formal analysis, Investigation, Methodology, Visualization

    Affiliation Civilla, Detroit, Michigan, United States of America

  • Kayla R. Iuliano ,

    Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

    ‡ KRI, JHM, KEN and TAB also contributed equally to this work.

    Affiliation Department of Epidemiology, Geisel School of Medicine at Dartmouth College, Hanover, New Hampshire, United States of America

  • J. Harry Munroe ,

    Roles Methodology, Writing – original draft, Writing – review & editing

    ‡ KRI, JHM, KEN and TAB also contributed equally to this work.

    Affiliation IBM Innovation Studio, Washington, District of Columbia, United States of America

  • Keeve E. Nachman ,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – original draft, Writing – review & editing

    ‡ KRI, JHM, KEN and TAB also contributed equally to this work.

    Affiliations Department of Health Policy and Management, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America, Department of Environmental Health and Engineering, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America, Risk Sciences and Public Policy Institute, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America

  • Thomas A. Burke

    Roles Conceptualization, Funding acquisition, Methodology, Supervision

    ‡ KRI, JHM, KEN and TAB also contributed equally to this work.

    Affiliations Department of Health Policy and Management, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America, Risk Sciences and Public Policy Institute, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, United States of America

Abstract

The US Environmental Protection Agency is revising its policy on drinking water quality reports for consumers. These reports are intended to enhance the public’s “right to know” and to spur action to protect and promote safe water. However, these reports are known to be highly technical and difficult to access compromising their communication value. This study engaged a 10-person focus group to gather evidence on how these reports can be improved. We applied user-centered design principles to understand public drinking water consumer information needs and preferences and to develop new communication tools and methods. Through a set of in-depth interviews, we learned that most participants were unaware of the report until introduced to it during the study. The focus group participants voiced preferences for: better ways to convey technical information; more health information; a clearer understanding of costs and billing; and neighborhood or household level water quality information. Following the interviews, we convened two rounds of small group meetings to create new report designs and to review and refine the designs. The focus group developed a one-page summary statement, water contaminant trend charts, an interactive map, and other recommendations on ways to improve dissemination of the report. The project results, focus group recommendations and designs were submitted to the US Environmental Protection Agency for consideration as the policy for these reports is finalized. We believe these findings provide valuable insights into water quality communication challenges and that this approach is widely applicable and can be informative for water utilities as they prepare future reports.

Introduction

Racial, ethnic, and income-based inequities in drinking water quality are pervasive in many US cities [1, 2]. Disparities in rates of drinking water violations have been observed in non-white and low-income communities, suggesting the potential for differential exposure and health risk [3]. Public knowledge of unsafe drinking water conditions can have a dramatic effect in generating the political will to protect water supplies and public health. For example, a key element of the Flint, Michigan lead contamination event, and the national attention that accompanied it, was an awareness among its drinking water consumers of the contamination. Authorities failed to fully investigate the health issues and citizens took matters into their own hands, exposing the crisis [4]. This public knowledge and pressure ultimately forced regulatory intervention to address the problem. Unfortunately for many low-income communities of color, information about drinking water violations can be elusive.

The 1996 amendments to the Safe Drinking Water Act were designed to provide hundreds of millions of American public water users with information about their drinking water. The amendments required water utilities to issue annual “consumer confidence” reports (CCRs) to their customers; the final legislation regulating CCRs christened them the “centerpiece of public right-to-know” under the Safe Drinking Water Act [5]. While the intent of these reports was to bolster consumer awareness of potential issues related to their water quality, research on CCRs as communication tools has shown that they are unclear about water quality safety and overly complex as defined by the CDC’s Clear Communication Index [68]. In 2018, an additional amendment to the Safe Drinking Water Act required EPA to improve the “readability, clarity, and understandability of the information presented in consumer confidence reports” by October 2020 [9]. When EPA failed to act, the National Resources Defense Council (NRDC) filed a lawsuit to force the EPA to revise the CCR regulations [10]. This successful suit resulted in a consent decree; the proposed rule revisions were released for comment in April 2023, with a final rule expected in 2024 [11]. This work was developed to provide input to EPA’s revisions emphasizing consumer needs and preferences to create new approaches to consumer confidence reports. The study aims to improve the communication potential of CCRs to enhance community awareness and empower consumers to reduce the harmful impacts of drinking water contaminants.

Currently CCRs are required to include at least eight elements: 1) water system name and contact information and public participation opportunities; 2) the source(s) of water; 3) definitions including Action Level (AL); Maximum Contaminant Level (MCL), Maximum Contaminant Level Goal (MCLG), Treatment Technique (TT); 4) the detected contaminant table; 5) information on monitoring for Cryptosporidium, radon and other contaminants (if detected); 6) compliance with National Primary Drinking Water Regulations; 7) if applicable, variances or exemptions granted to the water system; and 8) required additional information (such as, information to vulnerable populations about Cryptosporidium; statements on nitrate, lead and arsenic [12]). CCRs vary in presentation; this variability may be driven in part by the size of the water system and nature of the analytical results to be reported. Some use a letter style while others have visual components including photos or infographics (see examples in the supplemental materials S1 and S2 Text). Research over the past decade continues to find that CCRs require college-level reading ability [6, 8].

Given the limitations of the current CCR approach, this study explored how consumer needs and preferences could be harnessed to shape new ideas for drinking water quality reporting. Baltimore and other cities have experienced drinking water quality challenges over many years [4, 13]. Ideally, every CCR would be tailored to the information needs of the population served by the water system. It is particularly important to improve this type of communication in Baltimore because it has increasing rates of water violations and increasing racial, language and ethnic vulnerability [3]. As researchers and public health practitioners we seek to develop work that supports our local community. We focused this work on public drinking water users in Baltimore with the following objectives:

  1. Describe public drinking water consumer information needs and preferences; and
  2. Propose new visual and other communication tools and methods responsive to those needs and preferences to improve CCRs.

Methods

Overview

The study was funded by the Bloomberg American Health Initiative as a one-year pilot project beginning in July 2021. This study was conducted during the emergency phase of the COVID-19 pandemic and all interactions were virtual necessitating an oral consent process. The study protocol was reviewed and approved by the Johns Hopkins Bloomberg School of Public Health IRB in September 2021 (#17052). This qualitative study applied user-centered design principles by engaging public water supply users in design thinking about the Baltimore CCR [14]. Participant interactions in the form of interviews and small group meetings each lasting about 1 hour were conducted over Zoom from December 2021 to June 2022. Participants were paid twenty-five dollars for each interaction.

Participant recruitment

Participants were recruited through outreach to community groups affiliated with SOURCE, a community engagement and service-learning center at the Bloomberg School of Public Health. Through SOURCE, the principal investigator was connected to leaders of several community groups with environmental health interests. Those leaders then suggested potential study participants. A recruitment email was sent to potential participants. People responding to the recruitment email were screened to ensure eligibility (Baltimore City residents over 18 years of age). This process began on December 13, 2021 and continued until ten participants were enrolled (end date March 11, 2022).

User-centered design process

User- or human-centered design is an iterative process starting with the people you are designing for and ending with new solutions tailor-made to suit their needs [14]. User-centered design is used to design interventions that better serve the community. This approach has yielded much success in areas as diverse as emergency department clinician systems and community smoking cessation counseling [15, 16]. The study protocol adapted the process defined and applied by colleagues at the Maryland Institute College of Art’s (MICA) Center for Social Design [17, 18]. This design process allowed public water supply users in Baltimore City to create new ways to convey water quality information. The adapted process was carried out through three sequential interactions including in-depth individual interviews and two sets of small group meetings, further described below.

In-depth interviews

The first interaction was an individual interview with each participant to review and gather consumer feedback on the Baltimore CCR. The individual interview was selected as the first interaction with an aim to gather a range of views without having to share limited meeting time with others. It also allowed the study team and each participant to become acquainted. The interview had three components: questions about the participant’s awareness and previous use of the CCR; a general evaluation of the report’s contents and selection of important report elements; and participant’s preferences for report delivery (See S3 Text). The oral consent process was completed at the beginning of the interview and documented in a secure electronic file by the Principal Investigator. The interviews were conducted by the same two-person team (Principal Investigator and social designer Co-Investigator). Each interview was recorded and automatically transcribed. The recorded interviews were reviewed by the Co-Investigator to check and correct the transcripts when necessary. The Principal Investigator prepared a spreadsheet to compile the interview data by transferring the interview discussion guide questions into several worksheets (yes/no questions, most important required elements, most important optional elements and preferred delivery methods). At the end of all 10 interviews, the Principal Investigator compiled and summarized the interview responses using the spreadsheet. (Data from the interviews is provided in S1 Data).

Small group meetings to identify and prototype CCR solutions

The second participant interaction was a set of small group meetings with multiple participants together to develop new design ideas for CCRs that would address the feedback gathered in the interviews. We selected a small group meeting method to establish a collaborative setting to allow the participants to interact and work together to design and recommend changes to address their critique of the CCR. Three small group meetings were scheduled based on participant availability. Each small group meeting was facilitated by the same two-person team (Principal Investigator and social designer Co-Investigator). At each meeting, the interview results were reviewed, and discussion centered on identifying new visual ways to present information for the important report elements participants identified in the interviews (see S3 Text, Interaction 2). The meeting discussions generated visual design ideas and other recommendations. After these meetings, the study team reviewed the visual design ideas and selected several to prototype based on what could be visually represented as well as the time constraints of the study funding. For example, participants recommended a website be developed with an interactive map showing water sampling results and videos explaining the CCR. As a one-year pilot study we lacked resources to develop the recommended website. We did prepare a mock-up of a map to represent the interactive map idea. All recommendations were included in the final technical report (S4 Text). Following the first set of group meetings, the study team developed prototype designs.

For the third participant interaction, another set of small group meetings was organized to review and refine the prototype designs. Two small group meetings were scheduled based on participant availability. At each meeting, the prototype designs were reviewed and participant input on edits and revisions to the prototypes was gathered (see S3 Text, Interaction 3). Participant comments were used to refine and revise the prototypes for inclusion in the final technical report (S4 Text).

Results

Participant and study area demographics

Nine of the ten participants were Black or African American and seven were female. They collectively represented neighborhoods from the south, west and north areas of Baltimore. All were adults over age 18, three were retired. Baltimore City is 62% Black and 53% female with about 62% labor participation [19]. Baltimore City also has a lower percentage of population with a high school diploma (87%) than the state of Maryland (91%) or the nation as a whole (89%) which highlights the CCR reading-level accessibility issue [19].

In-depth interviews

All 10 participants completed an in-depth interview. Most (7 of 10) of participants were not aware of the CCR until they were introduced to the Baltimore City CCR during the study. They also reported that they found the Baltimore CCR to be technical and difficult to read, seemingly written for scientists instead of water consumers. Quotes from two participants illustrate these points (interview quotes lightly edited for clarity):

“… there’s a lot of background information but also a lot of technical information which I guess was kind of explained by the background but was a little bit hard to figure out.”

“… the scientists, you know, the people who went to school for chemistry maybe they all know. It is not easy for a person like me to understand.

On the other hand, 6 of 10 participants thought the Baltimore CCR covered most of what they wanted to know. Participants were very interested in the health information, as expressed below:

“…[I’m] concerned that this contaminated water can affect people with compromised immune systems, which is very important… the facts about the health concerns [are] really crucial to everybody

“Knowing what kind of water we have, and how it can be to people that have sickness in a body and shouldn’t drink it was like wow!”

More information on infrastructure improvements and costs was requested. One source of cost concern was differences in billing for Baltimore City and County residents. (The City water system supplies the County). Study participants expressed interest in more specific information on the water in their homes and neighborhoods and the health effects of contaminants particularly for vulnerable populations.

After collecting information on first impressions the interview probed other questions about the CCR contents. US EPA has identified a number of required and optional elements for CCRs and participants were asked to identify three items from each list that were most important to them (listing of the required and optional elements are included in the S3 Text). The most important required elements identified by the focus group were: identifying the source(s) of water (item 2), the detected contaminant table (item 4) and other required information such as explanation of contaminants, statements about lead, nitrate and arsenic (item 8). The most important optional elements identified were: a brief summary statement (optional item 3), the cost of making water safe and maintaining infrastructure (optional item 5), and customer education about water quality concerns in their service area (optional item 8).

Of the current approved delivery methods (see section 1C of S3 Text), 7 of 10 participants reported a preference for receiving a paper copy by mail to ensure report dissemination; others preferred an email-based delivery. Several participants voiced concern that many consumers could not access an electronic report, lacking a computer or internet service. Participants also suggested that the CCR information should be publicized widely on both traditional and social media outlets. Another participant suggested developing a school-based curriculum to prepare future report readers, calling it a “trickle-up approach.” (See S1 Data).

Small group meetings: Solutions to improve CCRs

All 10 participants attended the first set of small group meetings and groups had 2 or 6 participants each. Only nine participants were able to attend the second set of small group meetings (groups of 4 or 5 participants); one participant could not attend and provided written input.

In small groups, participants then envisioned solutions and offered recommendations building on their interview comments. Several information preferences were identified that informed the solutions and recommendations. The preferences addressed participant perceptions of information complexity (see 1 and 2 below) as well as suggesting additional information to be included (see 3 and 4 below):

  1. Create a report for lay audiences to counter information overload and the technical nature of the water sampling results;
  2. Clarify water costs and billing to understand perceived disparities;
  3. Provide neighborhood- and home-specific information; and
  4. Provide more health information and information on contaminant trends over time.

To better reach the lay audience, or more specifically multiple audiences with differing education and information gathering habits, the participants developed several solutions that can be implemented in CCRs and through other means. Taken in combination, the participants outlined a multi-component information dissemination approach, including: a) a summary to be sent by mail; b) a website to find the full CCR with details and short videos to explain the water treatment process and water sampling procedures; c) distribution of the CCR in various forms of media (noted in previous section); and d) more community outreach including distribution of home water test kits and regular contact with residents at community events such as neighborhood association meetings.

Five prototypes were drafted from participant input: a one-page summary; a factsheet with tips about common water concerns; water contaminant trend charts; a water treatment process diagram; and an interactive map illustration. A first draft of each prototype was reviewed at the first set of small group meetings to gather further input or revisions. The participants generally liked the prototypes with some refinements requested. For example, participants asked that water discoloration be added as a topic on the factsheet and different shaped icons were suggested for the interactive map illustration. Additional discussion about water costs clarified that the concern was not simply about how much the water system spends on treatment or new infrastructure (included on the one-page summary) but a question about how billing is done in different service areas. The investigators did not have access to service-area details and no changes were made to the prototype, but the specific billing concern was included in the written project report (S4 Text). Selected prototypes are presented below and could be adapted by water utilities including the Baltimore Department of Public Works for their current website and future CCRs.

Summary statement prototype with violation. The participants created a prototype summary statement addressing preferences 1 and 2 above, see Fig 1. The prototype includes text at the top of the page with the key message of the report–in this case, indicating that a violation occurred and that immediate action was taken to correct the problem. The remaining page space is devoted to five sub-sections with high-level summary information explaining: contaminants detected; common tap water issues; some detail on the violation(s) that occurred; the major categories of spending; and highlights of infrastructure improvement.

Interactive map illustration.

The resource constraints of the project precluded the development of a fully functional interactive map; instead, Fig 2 represents an illustration or mock-up of what such a map might look like addressing preference 3. The map plots important water system features, such as water filtration and treatment plants, and icons for each neighborhood and other landmarks. If the icon for a neighborhood is selected, the residents envisioned a pop-up box or link to the current water sampling results. The participants were aware that changes in water sampling procedures might be needed to develop neighborhood-level information. The Baltimore Department of Public Works has an interactive map currently on its website that tracks water main breaks and repairs [20]; the drinking water quality prototype could build on that existing map.

Contaminant trend chart with health information.

To address preference 4 for trend and health information, trend charts were prototyped (Fig 3). Two potential displays, either in bar- or line-chart form were developed. The charts track trends over several years and each includes space for text describing related information about the trend observed for a contaminant and potential health risks related to exposure to that contaminant. Data shown in the prototype charts was taken from past Baltimore CCRs [21].

Discussion

This study gathered Baltimore water consumer input on the annual CCR, the primary communication tool used by water utilities. The consumers in the focus group recognized the potential of the CCR and corroborated prior findings regarding challenges with its interpretation. Over the course of the study we employed two methods, individual interviews and small group meetings, to gather consumer feedback on the CCR and then address the feedback with new design and dissemination recommendations. Our focus groups yielded specific ideas for improving the CCR content that reflected local issues (e.g., billing differences between City and County). The study identified important information for EPA as it develops and finalizes the rule revisions and for the water utility in developing upcoming CCRs.

Our study had important limitations. With 10 participants we did not have complete geographic representativeness. The recruitment strategy started with leaders of local environmental interest groups. We expect that the participants had greater interest in the topic than other Baltimore residents. While that likely benefited the study in terms of participant engagement and retention, their concerns and recommendations (and therefore our results) may not reflect the interests of other residents. This study focused on CCRs from the consumer’s perspective. Others have explored CCRs from the water utilities’ perspective, e.g., Evans and Carpenter (2019) and Nicholas and Vedachalam (2021) [8, 22].

It is important to consider feedback from consumers for designing the content requirements of CCRs. In working on the proposed CCR Rule, EPA has solicited feedback from tribal governments, the National Drinking Water Advisory Council, as well as states, community water systems, and a public interest group [11]. While these groups represent a diverse array of stakeholders, we are still missing perspectives from the vast majority of American public water consumers.

We leveraged user-centered design to help understand the needs and views of water consumers in Baltimore. Through our work we found that these tools are useful in communicating science to the general public and allow for a deeper understanding of community perspectives. Involving the lived experience of community members allows for the inclusion of perspectives otherwise difficult to acquire. We believe that many of our findings provide insights into water quality and science communication challenges that are applicable nationwide. Using user-centered design shows promise in ensuring interventions and policies meet the needs of the community. We also recognize that our efforts may have yielded some lessons that are unique to Baltimore, introducing some uncertainty in the generalizability of the findings. We believe that additional research in other communities would be warranted to uncover values and needs that are specific to those localities.

This work was designed with a basis in current practices and structures of water quality management, but some focus group preferences went beyond that, such as their interest in household level information. At present, there is limited tap water sampling for lead at the household level, e.g., according to the Lead and Copper Rule a public water system serving more than 100,000 people must sample water for lead testing at 100 home or building taps under the standard protocol [23]. To fully realize household-level water quality reporting new protocols and systems would be required.

In seeking other examples of water quality reports to identify communication approaches, we found several international reports that included features responsive to our focus group’s preferences: namely by providing information on trends in contaminant levels over time and providing granular water results at a local level. In the United Kingdom, many residents can access their water company website, and enter their postcode, to receive their local results [24]. In Ireland and Victoria, Australia, water quality results are shared based on sampling location [25, 26]. Reports from Victoria, Australia also shared information on contaminant trends [25]. Such reports provide tangible examples of how the focus group’s suggestions can be incorporated into water quality reports.

Conclusions

The proposed revisions to the CCR rule were posted on April 5, 2023 [11]. The proposal addresses the report’s contents, required additional health information and established requirements for reporting of SDWA compliance monitoring data. The proposed revisions include providing a summary statement, as our focus group recommended.

While the focus group participants expressed concern and sometimes alarm about the health information in the Baltimore CCR (see above section with quotes from the in-depth interviews), most also found the CCR informative. All participants thought the information should be shared more widely and particularly with water users lacking access to the electronic report. As US EPA continues work on the revised rule for CCRs, we have a unique opportunity to influence this critical policy to enhance awareness and understanding of drinking water quality. We shared the project findings with the local water utility and submitted formal comments to US EPA on the proposed rule revisions. We hope this work provides the agency and water utilities with practical ideas for understanding water consumer preferences that will enhance report content to truly foster “consumer confidence” in the next iteration of drinking water quality reports.

Acknowledgments

We appreciate the participants for sharing their time and knowledge with us. We thank Ms. Becky Slogeris for contributing to the initial planning and development of the project.

References

  1. 1. Ruckart PZ, Ettinger AS, Hanna-Attisha M, Jones N, Davis SI, Breysse PN. The Flint Water Crisis: A Coordinated Public Health Emergency Response and Recovery Initiative. J Public Health Manag Pract. 2019;25 Suppl 1, Lead Poisoning Prevention(Suppl 1 LEAD POISONING PREVENTION):S84-S90. pmid:30507775
  2. 2. Allaire M, Wu H, Lall U. National trends in drinking water quality violations. Proc Natl Acad Sci U S A. 2018;115(9):2078–83. pmid:29440421
  3. 3. Fedinick KP, Tayor S, Roberts M. Watered Down Justice 2019 [Available from: https://www.nrdc.org/resources/watered-down-justice.]
  4. 4. Edwards M, Parks J, Mantha A. Flint Water Study Updates 2015 [Available from: http://flintwaterstudy.org/2015/09/our-sampling-of-252-homes-demonstrates-a-high-lead-in-water-risk-flint-should-be-failing-to-meet-the-epa-lead-and-copper-rule/.]
  5. 5. United States Environmental Protection Agency (US EPA). National Primary Drinking Water Regulations: Consumer Confidence Reports Final Rule. Federal Register. 1998;63(160):44512–36.
  6. 6. Phetxumphou K, Roy S, Davy BM, Estabrooks PA, You W, Dietrich AM. Assessing clarity of message communication for mandated USEPA drinking water quality reports. Journal of Water and Health. 2015;14(2):223–35.
  7. 7. US EPA. Consumer Confidence Report (CCR) Rule Retrospective Review Summary. In: Water, Office of Water and Drinking Water, editor. Washington, DC: U.S. Environmental Protection Agency; 2012. [Available from: https://www.epa.gov/sites/default/files/2014-05/documents/epa816s12004.pdf.]
  8. 8. Nicholas W, Vedachalam S. Poor accessibility of water utilities’ consumer confidence reports. Util Policy. 2021;72.
  9. 9. US Congress. America’s Water Infrastructure Act of 2018. Public Law 115–2702018.
  10. 10. Natural Resource Defense Council (NRDC). Natural Resources Defense Council v. Regan. 2021. [Available from: https://casetext.com/case/nat-res-def-council-v-regan.]
  11. 11. US EPA. National Primary Drinking Water Regulations: Consumer Confidence Report Rule Revisions 2023 [Available from: https://www.regulations.gov/document/EPA-HQ-OW-2022-0260-0015].
  12. 12. US EPA. Best practices factsheet: Consumer confidence report. 2015. [Available from: https://www.epa.gov/sites/default/files/2015-09/documents/epa816f15002.pdf.]
  13. 13. News NBC. ’I’m scared to give it to my kids’: Baltimore’s water issues are symptoms of a growing national problem. NBC News; 2023. [Available from: https://www.nbcnews.com/news/us-news/baltimore-national-water-problems-epa-rcna62762.]
  14. 14. Altman M, Huang TTK, Breland JY. Design Thinking in Health Care. Prev Chronic Dis. 2018;15:E117.
  15. 15. Strauss AT, Morgan C, El Khuri C, Slogeris B, Smith AG, Klein E, et al. A Patient Outcomes–Driven Feedback Platform for Emergency Medicine Clinicians: Human-Centered Design and Usability Evaluation of Linking Outcomes Of Patients (LOOP). JMIR Hum Factors. 2022;9(1):e30130. pmid:35319469
  16. 16. Core 77. Notable Strategy & Research Award: HealthiAir: Core 77; 2018 [Available from: https://designawards.core77.com/Strategy-Research/72446/HealthiAir.]
  17. 17. Eberhart A, Slogeris B, Sadreameli SC, Jassal MS. Using a human-centered design approach for collaborative decision-making in pediatric asthma care. Public Health. 2019;170:129–32. pmid:31035123
  18. 18. MICA. Center for Social Design 2023 [Available from: https://www.mica.edu/research/center-for-social-design/.]
  19. 19. US Census Bureau. Quick Facts, Baltimore City, Maryland 2022 [Available from: https://www.census.gov/quickfacts/fact/table/baltimorecitymaryland,US/PST045222.]
  20. 20. Baltimore City Department of Public Works. Broken Water Main Location and Status Map: Baltimore City Department of Public Works; 2023 [Available from: https://baltimoredpw.maps.arcgis.com/apps/webappviewer/index.html?id=8b941f07167243e385a1e260cd82576a.]
  21. 21. Baltimore City Department of Public Works. Annual Water Quality Report: City of Baltimore; 2023 [Available from: https://publicworks.baltimorecity.gov/water-quality-reports.]
  22. 22. Evans J, Carpenter AT. Utility approaches to evaluating the effectiveness of consumer confidence reports. Util Policy. 2019;58:136–44.
  23. 23. US EPA. Lead and Copper Rule: A Quick Reference Guide. 2008. [Available from: https://nepis.epa.gov/Exe/ZyPDF.cgi?Dockey=60001N8P.txt.]
  24. 24. Thames Water. Check your water quality: Thames Water Utilities Limited; 2023 [Available from: https://www.thameswater.co.uk/help/water-quality/check-your-water-quality#/search.]
  25. 25. Yarra Valley Water. Yarra Valley Water: Drinking Water Quality Report, 2021–2022. Victoria, Australia; 2022. [Available from: https://www.yvw.com.au/about-us/reports/water-quality-reports.]
  26. 26. Ireland Environmental Protection Agency. Drinking Water Quality in Public Supplies, 2021. 2022. [Available from: https://www.epa.ie/publications/compliance—enforcement/drinking-water/annual-drinking-water-reports/drinking-water-quality-in-public-supplies-2021.php.]