Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Estrogenic activity of mixtures in the Salish Sea: The use of high throughput toxicity data with chemical information from fish bile and other matrices

  • Maya Faber ,

    Contributed equally to this work with: Maya Faber, C. Andrew James, Louisa B. Harding, Ruth M. Sofield

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Environmental Sciences Department, Western Washington University, Bellingham, Washington, United States of America, Center for Urban Waters, University of Washington Tacoma, Washington, United States of America

  • C. Andrew James ,

    Contributed equally to this work with: Maya Faber, C. Andrew James, Louisa B. Harding, Ruth M. Sofield

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Center for Urban Waters, University of Washington Tacoma, Washington, United States of America

  • Louisa B. Harding ,

    Contributed equally to this work with: Maya Faber, C. Andrew James, Louisa B. Harding, Ruth M. Sofield

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Validation, Writing – review & editing

    Affiliation Washington Department of Fish and Wildlife, Olympia, Washington, United States of America

  • Denis A. M. da Silva,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Environmental and Fisheries Sciences Division, Northwest Fisheries Science Center, National Marine Fisheries Service, National Oceanic and Atmospheric Administration, Seattle, Washington, United States of America

  • Ruth M. Sofield

    Contributed equally to this work with: Maya Faber, C. Andrew James, Louisa B. Harding, Ruth M. Sofield

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    ruth.sofield@wwu.edu

    Affiliation Environmental Sciences Department, Western Washington University, Bellingham, Washington, United States of America

Abstract

A subset of anthropogenic chemicals known as contaminants of emerging concern (CECs), are released into aquatic environments through human activities. CECs occur in mixtures, and some may share a common mode of action such as estrogen receptor agonism, which lead to reproductive disturbances in fish. In this study, the estrogenic activity of mixtures was assessed with in vitro high throughput data, which expanded the number of chemicals included in the evaluation. Data were compiled from 16 studies, analyzing 387 CECs (19 estrogen agonists detected), across various matrices including water, wastewater treatment plant effluent, fish and mussel tissue, and fish bile. Novel estrogenic mixture thresholds in water and bile were developed. In one application of the bile thresholds, field sites with elevated exogenous estrogenic activity were identified; thresholds were qualitatively validated using field measures of organism response. Using validated water and bile thresholds in a second application, samples were evaluated to identify mixtures with high, medium, and low estrogenic activity, and individual chemicals were prioritized from those mixtures. Prioritized chemicals were identified as drivers of estrogenic activity (individually exceeding the threshold) or as major or minor contributors (resulting in an exceedance only when combined with other chemicals). Among fish bile samples with medium or high estrogenic activity, 62% of mixture response was explained by chemical drivers rather than mixtures of contributing chemicals. The primary drivers were: estrone, 17β-estradiol, and to some extent, estriol. Bisphenol A was identified as a major contributor.

Introduction

Anthropogenic activities related to agriculture, urbanization, and industrialization introduce a diverse array of chemicals into the aquatic environment. Contaminants of emerging concern (CECs) constitute a subset of anthropogenic chemicals that are inadequately understood in terms of their environmental occurrence and toxicological impact and typically lack regulation [1]. CECs are increasingly recognized for their potential to cause adverse effects in aquatic organisms. One category of CECs, endocrine disrupting chemicals (EDCs), has been frequently investigated because the endocrine system is conserved across most vertebrate species [2], and disruption can impact development [3,4], reproduction [57], and behavior [8].

Estrogenic endocrine disrupting chemicals (e-EDCs) are a subclass of EDCs that are of concern because of their ability to mimic endogenous estrogens and interact with the estrogen receptor, thereby disrupting estrogen receptor signaling [9]. Exogenous estrogens present in the environment, both natural (e.g., 17β-estradiol (E2), estrone (E1), estriol (E3)) and synthetic (e.g., 17α-ethynylestradiol (EE2)), are considered e-EDCs, as are anthropogenic chemicals such as industrial phenolic compounds (e.g., bisphenol A (BPA), octylphenol, and 4-nonylphenol) [10]. There is substantial evidence of impacts from e-EDC exposures [7,9,11,12]. Laboratory and field exposure to e-EDCs at environmentally relevant concentrations have been associated with vitellogenin (Vtg) induction (a common biomarker of exposure) in male fish and juveniles [7,13,14]. e-EDC exposures have also been associated with reproductive impairments, including compromised gamete and sperm quality, disrupted reproductive timing, reduced reproductive success, and gonadal intersex [7,12,15,16].

In the environment, chemicals occur as complex mixtures. Traditional toxicological methods employed to establish water quality benchmarks focus on single-chemical evaluations. However, effects can be higher when co-occurring chemicals are considered, especially those with shared modes of action [6,1719]. Therefore, even when individual chemical concentrations are below effects thresholds, the combined effects of chemicals in mixtures may result in a biological response [20,21].

Assessing the effects of chemical mixtures in the environment is challenging because of the interactions between co-occurring contaminants and the constantly changing mixture composition [17,19,21]. New Approach Methodologies (NAMs), such as in vitro effect-based methods, estimate total estrogenic activity of an environmental sample, but do not differentiate between individual contributing chemicals. Another common approach for estimating mixture effects is the 17β-estradiol equivalency quotient (EEQ) [7,9,22] which predicts estrogenic mixture activity by summing the normalized concentrations of individual e-EDCs using estradiol equivalency factors (EEFs) derived from assays like the Yeast Estrogen Screen [7,9]. However, EEFs have only been developed for a small number of chemicals, including steroidal estrogens and some phenolic chemicals that can mimic estrogens [7,9], which is limiting, considering the substantial number and diverse types of CECs that are potentially estrogenic [23]. Emerging NAMs, such as in vitro high-throughput screening (HTS) assays, use automated technology to screen large numbers of chemicals for a specific biological activity [24]. In vitro HTS information can fill data gaps such as the limited availability of EEFs [25], and can be used to assess chemicals with shared modes of action which is particularly valuable for mixture evaluation.

Large-scale in vitro HTS programs known as Tox21 [26,27] and ToxCast [28], hereafter referred to collectively as ToxCast, capture information from in vitro HTS bioassays. ToxCast includes in vitro HTS data for over 9,000 chemicals for more than 300 unique signaling pathways, including data for several chemicals lacking traditional health or environmental effects data [29]. In ToxCast assays, primarily mammalian cells or isolated proteins are exposed to chemicals, and changes in biological activity, such as receptor agonism or antagonism, or generalized disruption leading to cytotoxicity [30], are measured [2,18]. The biological target identified as the most well-represented in ToxCast is the estrogen receptor (ER), with extensive assay coverage [29]. Additionally, within the suite of chemicals tested in ToxCast, e-EDCs are common. Recent studies have provided evidence that the use of ER agonist assays in ToxCast can be effective for identifying e-EDCs [23,3032]. For example, Judson et al. [23] created a model using ToxCast data to predict ER agonist activity for over a thousand chemicals, which correctly identified ER agonists known to perturb the ER pathway (e.g., receptor binding, receptor dimerization, DNA binding, RNA transcription, protein production, and ER-induced proliferation) suggesting the model may be used to identify new e-EDCs. While ToxCast assays are primarily mammalian-based, Dreier et al. [31] found that ToxCast ER agonist assays were useful in predicting reproductive outcomes in fish, specifically Vtg induction.

Exposure-activity ratios (EARs) offer another application of ToxCast data. EARs are ratios of chemical concentrations in the environment and the chemical-specific response measured in the ToxCast assays [29,33]. The preferred assay response measure is the activity concentration at cutoff (ACC) [18,29,34,35], which is the minimum concentration of an individual chemical that can produce a measurable response in an in vitro assay [29,3638]. A chemical is of concern if the EAR exceeds an established threshold, suggesting the potential for biological activity in vivo [34]. EARs are a valuable tool for risk-based evaluations of individual chemicals, enabling efficient and cost effective screening and prioritization of chemicals [1,34,3941]. Additionally, EARs can be used in assessing chemical mixtures with a focus on all modes of action or specific modes of action depending on which assay results are used in the calculation of EARs [18,34,35,42].

In previous research applying EARs for chemical screening and prioritization, data was typically from a single environmental matrix, predominantly water. One exception is work conducted in Puget Sound, WA, the second largest estuary in the United States. James et al. [1] compiled chemical occurrence data from multiple environmental matrices, including marine water, wastewater treatment plant (WWTP) effluent, and fish and mussel tissues to screen and prioritize individual CECs. The use of multiple matrices provides a more complete understanding of chemical occurrence and concentration. This is in part because some chemicals evaluated in this work were only analyzed in certain matrices. Also, in general, chemicals will distribute differently across matrices based on their chemical and physical properties and, in the case of biota, based on what species was analyzed as different species have different toxicokinetics, geographic distributions, and life histories. Although not considered in the previous work [1], various tissues within species accumulate chemicals differently. For example, there is preferential accumulation of e-EDCs in fish bile because they are often eliminated through biliary excretion [4346]. This physiological process led to higher concentrations of e-EDCs observed in fish bile compared to other tissues such as plasma, muscle, brain, skin, and gill [47,48]. Despite the recognition of the importance of various sampling matrices, thresholds for estrogenic chemical mixtures in different matrices remain undeveloped.

The aim of the present study was to develop, apply, and validate a methodology for assessing the estrogenic potential of e-EDCs in mixtures in the marine environment, utilizing ToxCast data. Estrogenic EAR (e-EAR) thresholds were developed in water and bile relative to in vitro HTS data focused solely on estrogenic activity. In the first application of the e-EAR thresholds for bile, sites were identified where elevated exogenous estrogenic exposures may be occurring. Since this is the first effort to identify fish bile thresholds, a qualitative validation was conducted using published field measures of organism response related to exogenous estrogen exposures (in vivo), including Vtg induction in male fish and reproductive maturity of females. In a separate application, environmental samples were compared to water or bile-based thresholds to classify samples based on the mixture’s estrogenic potential. Individual chemicals from those mixtures were then prioritized for additional monitoring and study. This work complements the previous James et al. [1] individual chemical prioritization by considering estrogenic responses in mixtures and including additional biological samples from fish bile.

Experimental methods

Environmental monitoring data.

Regional chemical monitoring data from the Salish Sea were compiled from 16 individual studies from local, state, and federal sources (S1 Table). The Salish Sea is an inland sea that includes the marine waterways and watersheds of both British Columbia, Canada and Washington, United States [49]. This study focused on the Washington Salish Sea, which encompasses the Strait of Juan de Fuca, Puget Sound, and a portion of the Strait of Georgia. Data were from multiple environmental matrices, including water, WWTP effluent, mussel tissue (whole body), fish tissue (whole body/filet), and fish bile collected from 2008 to 2021. For clarity, whole body and filet tissues are hereafter referred to as “tissue”; when bile is the tissue of interest, it is referred to as “bile”. The use of multiple studies maximized the amount of data available for analysis and geographic coverage of contaminant occurrence data. As sampling was not coordinated under a single sampling program, the study designs, analytical methods, and suite of analyzed chemicals varied and were not always focused on e-EDCs. Methods from James et al. [1] were followed for quality assurance and blank correction for all data (S1 Text).

The compiled dataset included more than 1,000 samples and 387 unique compounds, such as hormones (n = 29), per- and polyfluoroalkyl substances (PFAS; n = 40), phthalates (n = 7), bisphenols (n = 5), antibiotics (n = 53), flame retardants (n = 30), and pharmaceuticals and personal care products (n = 86), with different compounds measured depending on the sample and matrix (S2 Table). Marine water samples (n = 134) were collected from estuarine, nearshore, and pelagic environments. WWTP effluent samples (n = 9) were collected from five facilities in Puget Sound. Tissue samples were collected from bay mussels (Mytilus trossulus; n = 75) and multiple species of fish, including Smallmouth bass (Micropterus dolomieu; n = 9), Pacific staghorn sculpin (Leptocottus armatus; n = 5), Pacific herring (Clupea pallasii; n = 20), subadult resident and juvenile Chinook salmon (Oncorhynchus tshawytscha; n = 74 and 34, respectively), English sole (Parophrys vetulus; n = 123), Pacific sand lance (Ammodytes personatus; n = 10), Quillback rockfish (Sebastes maliger; n = 1), and Brown rockfish (Sebastes auriculatus; n = 18). Bile samples were collected from English sole (n = 500). Samples were marine or estuarine except the Smallmouth bass collected from an estuary-adjacent freshwater lake and select juvenile Chinook salmon samples collected from five upstream freshwater sites. Information on permits obtained for this work can be found in S1 Table.

Bile samples were collected from male and female English sole by the Washington Department of Fish and Wildlife from 18 locations within the Salish Sea from 2011–2019 (Fig 1). Fish bile samples were analyzed for e-EDCs at the National Oceanic and Atmospheric Administration’s Northwest Fisheries Science Center according to da Silva et al. [50]. Prior to the analysis, samples were deconjugated via enzymatic hydrolysis with β-glucuronidase/sulfatase to obtain the total analyte concentration including the glucuronide- and sulfate-conjugated metabolites [50,51]. Other potential minor conjugation forms, such as glucoside- and glutathione-conjugated e-EDCs, were not evaluated by this method. Each batch of fish bile analysis for e-EDCs were validated based on Sloan et al. [52]. To avoid the confounding presence of endogenous steroidal hormones, female samples were omitted from the EAR-based evaluation of estrogenic activity as they will typically exhibit physiologically relevant levels of steroidal estrogens; this would confound the interpretation of the effects of external steroidal estrogen exposure which was the goal of this study. Relevant data not previously published (S1 Table) was made available in the Dryad repository (https://doi.org/10.5061/dryad.mcvdnck9x).

thumbnail
Fig 1. Marine sites sampled by Washington Department of Fish and Wildlife for English Sole bile in the Salish Sea.

SG: Strait of Georgia, VI: Vendovi Island, PS: Port Susan, PG: Port Gardner Bay, HC: Hood Canal, PM: Port Madison, WPN: West Point North, WPS: West Point South, EH: Eagle Harbor, ME: Myrtle Edwards, BH: Bell Harbor, DW: Duwamish Waterway, BR: Bremerton, HW: Commencement Bay-Hylebos Waterway, BW: Commencement Bay-Blair Waterway, TFW: Commencement Bay-Thea Foss Waterway, CI: Carr Inlet, NQ: Nisqually. Orange triangles indicate sites with field measures of organism response [53], such as vitellogenin (Vtg) induction in male fish and reproductive maturity of females, and orange squares indicate sites without field measures of organism response (as described below).

https://doi.org/10.1371/journal.pone.0323865.g001

Estrogenic predictions of chemical mixtures using ToxCast in vitro HTS data

The development of a method to assess the estrogenic potential of e-EDCs in mixtures in marine environment included several steps. The first three steps were preparatory, laying the foundation for threshold development, and included ER agonist selection, EAR calculations, and comparison of EARs to EEQs.

Selection of ER agonist assays in ToxCast for identifying e-EDCs

A total of 18 ER agonist assays were used (S3 Table). Sixteen assays were identified by Judson et al. [23] and two additional assays present in the updated ToxCast database (invitroDBv3.5_database) were identified as ER agonist assays by Maloney et al. [54] (S3 Table). All 18 assays targeted only one specific molecular initiating event [55], the activation of the ER receptor. ER antagonism was excluded from this study because including antagonism could reduce or obscure the activation of the estrogen receptor and limit our ability to identify the estrogenic chemicals.

To distinguish between estrogen agonism and false-positive results caused by assay interference [30,36], the results from the ER agonist pathway model were used to predict the probability that an assay response was associated with the estrogen receptor and not a result of assay interference [23]. The model uses ToxCast data to generate an area-under-the-curve (AUC) which summarizes estrogen receptor activity for each chemical. The AUCs are scaled relative to the highly potent EE2, which is assigned an AUC of 1. In our study, chemicals exhibiting activity in ER agonist assays but having AUC scores ≤ 0.01 were considered non-estrogenic and were excluded from further analysis [23,56]. Twenty chemicals that were detected in the Salish Sea and active in ToxCast ER agonist assays but not evaluated by Judson et al. [23] were manually evaluated based on measured response in ToxCast assays and results from the Collaborative Estrogen Receptor Activity Prediction Project (CERAPP) [56] (S2 Text).

Exposure-activity ratio (EAR) calculations

EARs (Eq 1) were calculated for each sample and each chemical identified as an e-EDC based on its activity in one or more of the 18 ER agonist assays. The extent of the estrogenic response of an individual e-EDC was quantified by estimating the 5th percentile of the logarithmic ACC (ACC5; log µM) across the active ER agonist assays for that e-EDC. Not all e-EDCs have ACC data for all 18 ER agonist assays, therefore the 5th percentile was calculated based on available data and then converted to µg/L. The ACC5, has been used as a conservative response measure in vitro, and is regarded as a cautious estimate of effects concentrations in vivo [57].

(1)

For water and WWTP effluent samples, the measured environmental concentration in Eq 1 was directly measured. For mussel and fish tissue, the measured tissue concentrations were converted to an estimated water concentration using bioconcentration factors (BCFs) predicted with OPERA (OPEn saR App) models available through CompTox or with Burkhard [58] for PFAS compounds, as available (see James et al. [1]). For the six e-EDCs detected in tissue, OPERA-predicted BCFs that were within the CompTox reported global applicability domain were utilized [59,60]. For bile samples, because of the absence of water to bile BCF values for many e-EDCs of interest, the measured concentrations were used directly, and separate bile-based threshold values were calculated as described below.

EARACC5 values for each chemical in a sample were summed to calculate an EARmix for each sample (Eq 2), assuming the additivity of effects [6163].

(2)

i = the individual chemicals in the mixture that are active in at least one of the selected assays.

Response data from ToxCast assays were extracted using the ToxEval R package [64] and Toxicity Explorer [65]. Response data were filtered using data quality flags following Corsi et al. [34], which were implemented to limit false positive or negative results [29] (S2 Text). Calculation of the EARACC5 and EARmix was carried out using dplyr [66] and Excel, and visualizations were created using ggplot2 [67] and the ToxEval R package [64].

EARmix and 17β-estradiol equivalency quotients comparisons

To verify the accuracy of EARmix in estimating the estrogenic activity of chemical mixtures, comparisons were made against EEQs calculated with well-established EEFs from Vega-Morales et al. [9] where the EEFs are scaled relative to E2. For the comparison, EEQmix and EARmix were calculated with English sole male fish bile data because this dataset was the most extensive (n = 354) and consistently included analysis of steroidal estrogens.

EEQs were calculated by multiplying the measured concentration of an individual chemical in a bile sample by its chemical-specific EEF (Eq 3). For mixtures, EEQmix was calculated as the sum of EEQ[i]s across all e-EDCs present in a bile sample (Eq 4).

(3)(4)

where i = individual chemical information, and EEF is the median estradiol equivalency factor for chemical i from Vega-Morales et al [9].

A Spearman’s rank correlation was conducted between the EARmix and EEQmix to verify their congruence in capturing estrogenic activity. The ratio was then calculated for each bile sample. The median ratio for all bile samples was used to translate EAR-based thresholds (e-EAR thresholds) from EEQ-based thresholds (see Eq 5).

Development of e-EAR thresholds

Two sets of e-EAR threshold values, one set for water (water-based thresholds) and one set for bile (bile-based thresholds), were developed based on the no observed effect concentration (NOEC) of 0.005 µg/L E2 and lowest observed effect concentration (LOEC) of 0.025 µg/L E2 for Vtg induction in adult male zebrafish (Danio rerio) exposed to E2 [68]. The thresholds for water (NOECEAR and LOECEAR), were calculated with Eq 5. The thresholds for bile (NOECbEAR and LOECbEAR) were calculated with Eq 6. The range of available bile-water bioaccumulation factors (BCFbw; 4000 [69] – 13000 [70]) for E2 in juvenile rainbow trout (Oncorhynchus mykiss) was used, resulting in a range for the bile-based thresholds.

(5)(6)

For the NOECEAR and NOECbEAR, the NOEC replaced the LOEC in Eq 5 and 6.

The estrogenic potential of field-collected samples was assessed by comparing their EARmix values to the relevant e-EAR thresholds, where bile samples were compared to the bile-based thresholds and all other matrices (water, wastewater, and tissue back-calculated to a water concentration) were compared to the water-based thresholds. This sample categorization approach is similar to other studies that have used NOEC and LOEC values to categorize samples into high-, medium-, and low-risk groups using EEQmix values [71,72]. It is important to emphasize that these thresholds are not intended to be used for regulatory decisions but instead as tools to evaluate the possible estrogenic activity of chemical mixtures.

Application and qualitative validation of bile-based thresholds for site classification

Bile chemistry data from 18 sites (with n = 6–57 samples/site) were grouped and used to calculate the site-specific 95th percentile of the EARmix values, representing the upper end of the exposure distribution at each site [73,74]. Sites were classified in the first application of bile-based thresholds by comparing these values with the NOECbEAR and LOECbEAR ranges (Fig 2). Specifically, sites with 95th percentile EARmix values above LOECbEAR values were considered high potential for estrogenic effects but given the range of available BCFbws for threshold calculations, confidence levels varied depending on the magnitude of exceedance; 95th percentile EARmix values above the highest LOECbEAR, were classified as high potential with high certainty of estrogenic effects and within the range of LOECbEARs were high potential with low certainty. The other classifications included medium potential for estrogenic effects when the 95th percentile EARmix was between the lowest NOECbEAR and the lowest LOECbEAR; and low potential below the lowest NOECbEAR (Fig 2).

thumbnail
Fig 2. Classification regions for bile sampling sites based on the potential to cause estrogenic effects.

Classification was determined by the 95th percentile of EARmix, and calculated for each of 18 sites. Regions are distinguished by the highest LOECbEAR (a), lowest LOECbEAR (b), and the lowest NOECbEAR (c). Classification regions (e.g., low or medium potential for estrogenic effects) are described in the text. Abbreviations: EARmix (sum of the 5th percentile of the exposure-activity ratios for chemicals in a mixture), LOECbEAR and NOECbEAR (bile-based thresholds for estrogenic potential based on the lowest and no observed effect concentrations, respectively).

https://doi.org/10.1371/journal.pone.0323865.g002

The bile-based EAR thresholds were qualitatively validated through comparison with field measures of organism response, including percent male Vtg induction, and females with altered reproductive timing (percentage of females in vitellogenic, ripe, or spawning condition outside the normal spawning season). The average percent male Vtg induction and females with altered reproductive timing was compared to the 95th percentile of the EARmix and the corresponding site classification at each site. EARmix was considered aligned with measures of organism response when sites with high or medium potential for estrogenic effects corresponded to increased percent Vtg induction or female altered reproductive timing, and lower potential aligned with minimal organism responses. Note that bile samples were collected between 2011 and 2019, while biological observations were collected between 1997 and 2001. To our knowledge, there have not been large scale changes in stressors between those two time periods that would invalidate the comparison. However, we acknowledge the potential that changes we are unaware of may have altered contaminant loadings.

Application of e-EAR thresholds to prioritize samples and individual chemical constituents in mixtures

EARmix values calculated for each sample from all sample matrices were compared against the e-EAR thresholds to classify samples according to their estrogenic activity as the second application of the thresholds. Water, WWTP effluent, and tissue samples, were compared to the set of water-based thresholds (NOECEAR and LOECEAR). For bile samples, the threshold ranges used for site classification were not applied. Instead, the lowest LOECbEAR and lowest NOECbEAR were used as a conservative approach and to maintain consistency with the use of water-based thresholds for individual chemical prioritization, since water-based thresholds did not involve a threshold range. For clarity, the term LOEC threshold is used to reference both the lowest LOECbEAR for bile samples and the LOECEAR for all other sample types, and the NOEC threshold refers to the lowest NOECbEAR for bile samples and the NOECEAR for all other sample types. Samples were categorized as having low estrogenic activity (EARmix < NOEC threshold), medium estrogenic activity (LOEC threshold > EARmix ≥ NOEC threshold), or high estrogenic activity (EARmix ≥ LOEC threshold). As a sensitivity analysis of how applying the lowest threshold within the bile threshold ranges affected our results, the outcome obtained by utilizing the highest LOECbEAR in place of the lowest LOECbEAR was also evaluated.

Samples with medium or high estrogenic activity were further evaluated to prioritize individual chemical constituents for future monitoring and evaluation based on their contribution. Focus was placed on e-EDCs contributing at least 1% towards the mixture response. A chemical was a “driver” of the estrogenic activity if that chemical individually exceeded the threshold; a “major contributor” if it did not individually exceed the threshold but contributed ≥ 1% to the mixture response; or “minor contributor” if it contributed < 1%. A chemical may be categorized as a driver and contributor or assigned to multiple priority categories because different samples may result in conflicting assignments. In cases when chemicals were classified in multiple categories, they were assigned to the higher priority category.

A decision tree for the e-EDC prioritization framework is included (Fig 3). The prioritization categories for e-EDCs are:

thumbnail
Fig 3. Decision flow diagram for e-EDC chemical constituent prioritization framework.

Dotted line around box indicates that this evaluation was not completed for this work (see James et al. [1]). Abbreviations: AUC (area under the curve), LOQmin (minimum level of quantification), EARACC5 (5th percentile of the exposure-activity ratios for an individual chemical across 18 estrogen receptor agonist assays), EARmix (sum of EARACC5 for all chemicals in a mixture), LOECEAR and NOECEAR (water-based thresholds for estrogenic potential, corresponding to the lowest observed effect concentration and no observed effect concentration, respectively), and LOECbEAR are NOECbEAR (bile-based thresholds for estrogenic potential based on the lowest and no observed effect concentration, respectively).

https://doi.org/10.1371/journal.pone.0323865.g003

  • High Priority: e-EDCs in mixtures with an EARmix ≥ LOEC threshold; and either the EARACC5 ≥ LOEC threshold and is identified as a driver, or the chemical contributes ≥ 1% toward mixture response and is a major contributor. If an individual chemical does not individually exceed the LOEC threshold or contribute ≥ 1% toward the mixture response, but does individually exceed the NOEC threshold, it is a Watch List chemical and a minor contributor.
  • Watch List: e-EDCs in mixtures with an EARmix between the NOEC threshold and LOEC threshold; and either the EARACC5 ≥ NOEC threshold and is identified as a driver, or the chemical contributes ≥ 1% toward mixture response and is a major contributor.
  • Low Priority: e-EDCs in mixtures that were active in ER agonist assays but EARmix < NOEC threshold or contributed < 1% of mixture response.
  • Insufficient Information: Insufficient information to assess chemicals as e-EDCs. This category includes CECs that were detected in environmental samples but were not assessed in ToxCast ER agonist assays. Although not evaluated in this work, this also includes chemicals that were analyzed for and not detected. The absence of detection does not preclude the potential to cause estrogenic effects at concentrations below the limit of detection.

Results

Identification of e-EDCs using ToxCast ER agonist assay results

Of the 387 chemicals analyzed, 221 were detected in at least one sample (S2 Table). Among the detected chemicals, 157 were evaluated against the ToxCast ER agonist assays; the remaining CECs were either not tested in ToxCast or not tested in the relevant ToxCast assays. Out of those tested in the relevant assays, 68 were active and 89 were inactive (S4 Table). The 68 active chemicals were further evaluated to remove false-positive responses and CECs exhibiting insufficient activity with the ER using either AUC scores or through manual evaluation (S2 Text). This resulted in a final set of 19 active chemicals (Table 1). The 19 e-EDCs were from various chemical classes, as described in James et al. [1] including hormones (n = 9), bisphenols (n = 4), alkylphenols (n = 3), phthalates (n = 2), and one PFAS.

thumbnail
Table 1. Chemical classification, minimum and maximum concentrations, and detection frequency (DF) of e-EDCs detected in the Salish Sea.

https://doi.org/10.1371/journal.pone.0323865.t001

Chemical mixtures and the occurrence and distribution of e-EDCs in environmental monitoring samples

The monitoring data demonstrates the presence of complex mixtures of CECs in the Salish Sea. Individual samples contained as many as 55 unique chemicals in a mixture (e.g., in a WWTP effluent sample), with 49 of these chemicals not identified as e-EDCs based on the measurement and activity in the 18 ER assays (S5 Table). From each matrix, the maximum number of e-EDCs detected together in a sample were two in marine water, six in WWTP effluent, three in mussel tissue, four in fish tissue, and six in fish bile (S5 Table). Due to the opportunistic nature of including datasets from several monitoring campaigns, the analysis of e-EDCs varied across sampling matrices. For example, the analysis of steroidal estrogens was limited to fish bile and WWTP effluent samples. The detection frequency of e-EDCs also varied across matrices. The 19 e-EDCs that were detected, their concentration ranges, and corresponding detection frequencies for each sample matrix are presented in Table 1.

In addition to different matrices, samples were collected from different aquatic species. Biological samples from either whole body or edible filet tissues were collected from eight fish species and one shellfish species, representing different diets, habitats, and thus, varying exposure profiles. The variation in chemical occurrence and concentration across different species is included in S6 Table.

EEQmix to EARmix comparison and determination of e-EAR thresholds

EEQmix and EARmix values were calculated using chemistry data for 354 male bile samples. The values were strongly correlated (Spearman’s rank correlation coefficient of ρ = 0.98 (p < 0.01, n = 354;S1 Fig)). Of the chemicals detected in samples from this study, the ToxCast EARmix approach identified 19 as e-EDCs compared to seven, using the EEF approach [7].

e-EAR thresholds were determined based on the relationship between EEQmix and EARmix. Using the five e-EDCs detected in bile that had an EEF, the ratio was 27 (S2 Fig). This was used to calculate a NOECEAR and LOECEAR of 0.14 and 0.68, respectively. The bile-based thresholds were estimated by applying the range of E2 BCFbw values to the water-based thresholds resulting in a range of NOECbEAR values from 540 to 1800; and LOECbEAR values from 2700 to 8800. These ranges are depicted in Fig 2.

Classification of sampling locations using bile data and validation of e-EAR thresholds

All 18 bile sampling locations, including the eight sites that did not have field measures of organism response for the validation exercise, were classified for potential estrogenic effects using the 95th percentile EARmix (Fig 4). Two sites (Eagle Harbor and Commencement Bay-Thea Foss Waterway) were below the lowest NOECbEAR and were classified as low potential for estrogenic effects; 11 sites (Port Susan, Hood Canal, Duwamish Waterway, Bremerton, Strait of Georgia, Vendovi Island, Port Madison, West Point North, West Point South, Commencement Bay-Hylebos Waterway, and Commencement Bay-Blair Waterway) were considered medium potential; three (Port Gardner, Myrtle Edwards, and Nisqually) were characterized as high potential-low certainty; and two sites (Bell Harbor and Carr Inlet) were considered high potential-high certainty based on EARmix (Fig 4). Summary statistics of EARmix for all 18 bile sampling locations can be found in supplemental information S7 Table.

thumbnail
Fig 4. Distribution of EARmix values for sites with field measures of organism response from Johnson et al. [53], and sites without field data.

Site classification is based on regions which are determined by the highest LOECbEAR, lowest LOECbEAR, and lowest NOECbEAR, indicated by dashed lines. Box and whisker plot shows the median, first/third quartile, and a distance of 1.5 times the interquartile range. Data outside of the box and whisker plot are marked with a closed circle. The remaining symbols represent the 95th percentile of the EARmix, with each symbol representing the corresponding categorization. The number in parenthesis represents the number of samples collected at that site. Abbreviations: EARmix (sum of the 5th percentile of the exposure-activity ratios for chemicals in a mixture), LOECbEAR and NOECbEAR (bile-based thresholds for estrogenic potential based on the lowest and no observed effect concentrations, respectively), Wwy (waterway).

https://doi.org/10.1371/journal.pone.0323865.g004

Overall, comparisons between the 95th percentile of the EARmix and at least one field measure of organism response were consistent, validating the e-EAR thresholds and the use of EARmix as a measure of endocrine disruption. For example, there was alignment observed at 8 of 10 sites: three of four high potential sites had the among the highest percentage of male Vtg induction, all four medium potential sites had intermediate percentages of male Vtg induction, and one of the two low potential sites had no males expressing Vtg. Additionally, two high potential sites had high percentages of females with altered reproductive timing (Table 2).

thumbnail
Table 2. Heatmap illustrating the classification of sample sites with field measures of organism response.

https://doi.org/10.1371/journal.pone.0323865.t002

Categorization of sample mixtures and prioritization of chemical constituents

In the second application of the e-EAR thresholds, the estrogenic activity of all sample mixtures was predicted irrespective of sample collection location. None of the e-EDC mixtures measured in marine water or tissue samples exceeded the water-based thresholds, suggesting low estrogenic activity from the chemicals considered in this investigation (Figs 5A and 5B). However, steroidal estrogens, which are important drivers of estrogenic activity, were not analyzed in marine water and tissue samples, so it is possible that estrogenic activity was underestimated in these samples.

thumbnail
Fig 5. Distribution of EARmix values for each matrix: (A) marine water, (B) tissues (C) WWTP effluent, and (D) fish bile.

Box and whisker plot shows the median, first/third quartile, and a distance of 1.5 times the interquartile range. The closed circles represent the EARmix values for each sample, and n is the number of samples with detected e-EDCs. For tissues samples (B), concentrations were back-calculated to water concentrations; steroidal estrogens were not included in the analysis of fish and mussel tissue or marine water. NOECEAR and LOECEAR thresholds for marine water, tissues, and WWTP effluent are represented by dotted and dashed lines (A, B, C). The lowest NOECbEAR and lowest LOECbEAR thresholds for bile are represented by dashed lines, and the threshold ranges for bile are represented by the shaded regions (D). Abbreviations: EARmix (sum of the 5th percentile of the exposure-activity ratios for chemicals in a mixture), LOECEAR and NOECEAR (water-based thresholds for estrogenic potential, corresponding to the lowest observed effect concentration and no observed effect concentration, respectively), and LOECbEAR are NOECbEAR (bile-based thresholds for estrogenic potential based on the lowest and no observed effect concentration, respectively), WWTP (wastewater treatment plant).

https://doi.org/10.1371/journal.pone.0323865.g005

Among the nine WWTP effluent samples, which represented a worst-case exposure scenario, six had detectable e-EDCs. One sample exceeded the LOECEAR of 0.68 (high estrogenic activity) and three samples exceeded the NOECEAR of 0.14 (medium estrogenic activity) (Fig 5C).

Of the 354 bile samples from male English sole, 47 (13%) had EARmix values above the lowest LOECbEAR (EARmix ≥ 2700) and were classified as high estrogenic activity (Fig 5D). Eighty-six (24%) had EARmix values between the lowest LOECbEAR and lowest NOECbEAR (540 ≤ EARmix < 2700) and were classified as medium estrogenic activity (Fig 5D).

Prioritization of chemical constituents based on measurements in WWTP effluent

The chemicals responsible for the four WWTP effluent sample exceedances are presented in Fig 6. E1, E2, and BPA were all important in driving or contributing to estrogenic response and so identified as High Priority. There were minor contributions (<1%) from androsterone, desogestrel, 17α-estradiol, butyl benzyl phthalate, dibutyl phthalate, and 4-nonylphenol in selected samples.

thumbnail
Fig 6. Stacked bar plot with exposure-activity ratios (EARs) for wastewater treatment plant (WWTP) effluent samples exceeding the LOECEAR (A) or NOECEAR (B).

The EARACC5 for each chemical and sum of the EARACC5 (EARmix) for the mixture are shown. The dotted and dashed line is the LOECEAR, and the dashed line is the NOECEAR. Minor contributions from androsterone, desogestrel, butyl benzyl phthalate, dibutyl phthalate, and 4-nonylphenol are not visualized because the values are too small to be discernible. WWTP are anonymized sites in Puget Sound represented by 1-4. Abbreviations: EARACC (the 5th percentile of the activity cutoff concentrations from ER agonist assays), EARmix (sum of the EARACC for chemicals in a mixture), LOECEAR and NOECEAR (water-based thresholds for estrogenic potential, corresponding to the lowest observed effect concentration and no observed effect concentration, respectively).

https://doi.org/10.1371/journal.pone.0323865.g006

Prioritization of chemical constituents based on measurements in bile

Based on the lowest LOECbEAR exceedances in bile samples, E1, E2, E3, and BPA were classified as High Priority e-EDCs. One or more of these chemicals were identified in 47 bile samples with an EARmix ≥ lowest LOECbEAR and classified as high estrogenic activity (S3 Fig). Eighty-seven percent of samples with high estrogenic activity had at least one driver, with 34% of those samples having one, 59% having two, and 7% having three drivers. In all cases, the driver(s) were steroidal estrogens (E1, E2, and/or E3). BPA was a major contributor in one of the 47 samples. As a sensitivity analysis, a less conservative evaluation using the highest LOECbEAR as the threshold (EARmix ≥ 8800) resulted in 28 samples exceeding the LOECbEAR, with 23 samples having at least one driver. In this scenario, based on the bile samples, E3 would be downgraded to a contributor and BPA would no longer be a major contributor, and so not a High Priority e-EDC.

An additional 86 bile samples had an EARmix between the lowest NOECbEAR and lowest LOECbEAR, suggesting medium estrogenic activity (S4 Fig). E1 or E2 were the only drivers; E3 and BPA were major contributors. There were minor contributions (<1%) from 4-tert-octylphenol, bisphenol AF, bisphenol F, and bisphenol S in select samples identified with high and medium estrogenic activity.

Overall, in 51% of bile and WWTP effluent samples above the NOEC threshold and 88% above the LOEC threshold, the mixture surpassed the threshold because of a single chemical alone rather than a mixture of chemicals.

Discussion

EARmix as a measure of estrogenic activity

Expanding the utilization of ToxCast data to assess chemical mixtures with a common mode of action was a key focus of this study. To meet this objective, the use of EARmix as a measure of estrogenic activity was first confirmed based on a comparison with the well-established EEQmix [7,9,75,76]. The results demonstrated a strong correlation between EARmix and EEQmix, supporting the use of EARmix as a metric for assessing estrogenic activity. The advantage in using EARmix compared to EEQmix is that it integrates data from multiple assays measuring various endpoints along the endocrine signaling pathway and EARs are available for more chemicals compared to EEQs. These considerations underscore the benefits of using EARmix derived from in vitro programs, particularly since live animal testing is becoming more restricted [77,78].

Limitations and considerations for assessing estrogenic activity of mixtures

There are several potential considerations when estimating estrogenic activity of environmental samples. First, not all potential e-EDCs were measured in each sample or sample matrix evaluated in this work. For example, steroidal estrogens were not measured in any of the marine water, mussel, or fish tissue samples. This is in part because steroidal estrogens commonly occur below analytical detection limits in these matrices. Since the majority of estrogenic activity is attributable to steroidal estrogens [7,79,80], assessments where steroidal estrogen data is lacking would underestimate total estrogenic activity. Future work should also consider the challenge of distinguishing endogenous estrogen levels from exogenous exposure, as with any naturally occurring compound.

Additionally, the scope of evaluation is limited to those chemicals currently represented in ToxCast. For example, legacy contaminants such as polychlorinated biphenyls, hydroxylated-polycyclic aromatic hydrocarbons, and polybrominated diphenyl ethers, which have been documented in tissue samples from the region [81,82] and are weakly estrogenic [83,84], were not included because they remain largely untested in ToxCast [85]. Consequently, it is probable that legacy pollutants are present and actively contribute toward estrogenic activity in marine species (e.g., Commencement Bay–Thea Foss Waterway).

This study prioritized e-EDCs based on their direct agonism of the ER, as measured in the selected ER agonist assays from ToxCast. Consequently, this methodology does not capture chemicals that indirectly affect estrogen receptor signaling through alternative modes of action. For example, trenbolone acetate, a Low Priority e-EDC, is an androgen that is fed to livestock to promote growth and can enter the aquatic environment through agricultural runoff [86]. The metabolite, 17β-trenbolone, acts as a weak ER agonist, but can also antagonistically impact estrogen signaling [23] by accelerating E2 clearance, leading to decreased endogenous E2 levels in female fish [87]. Additionally, chemicals that do not individually act like estrogen agonists may synergistically amplify the effects of E2 on the ER signaling pathway. For instance, the ToxCast data indicates that perfluorooctane sulfonate (PFOS) and perfluorooctanoic acid (PFOA) are not direct estrogen agonists. Sonthithai et al. [88] similarly found no in vitro estrogenic activity individually for PFOS or PFOA; however, co-exposure with E2 resulted in enhanced effects of E2, demonstrating that chemicals need not directly interact with the ER to influence the ER signaling pathway.

With respect to site-level classification, sample size may be a limitation that influenced results. For example, at the Nisqually site, bile samples were obtained from only 13 fish, and the 95th percentile of the EARmix was disproportionally influenced by a single sample (Fig 4).

Bile-based threshold development and validation

Another objective of this work was to develop and validate meaningful threshold values for measurements of chemical concentrations in bile. Many e-EDCs accumulate in bile, which provides an opportunity to characterize exposures that are not detectable in other tissues [47]. For example, exogenous estrogens tend to concentrate as glucuronide and sulfate conjugates in fish bile [45,69,89], and their total concentration (i.e., free and conjugated) measured in fish bile is an effective way to characterize recent environmental exposures [46,9092]. However, in order to interpret the significance of chemical concentrations in bile, tissue-specific thresholds are needed. These were developed in this study.

The development of e-EAR thresholds was based on traditional measures of toxicity (i.e., NOECs and LOECs; used as benchmarks for endocrine disruption [71]). Despite recognized limitations of NOECs and LOECs [9395], they remain a practical choice due to their availability and application in similar studies [71,72,96]. To validate bile-based thresholds, measures of e-EDC exposure in an organism, percent male Vtg induction and percent female altered reproductive timing, were used.

EARmix along with percent male Vtg induction and percent female altered reproductive timing serve as distinct lines of evidence reflecting e-EDC exposure, capturing information across varying timescales. e-EDC concentrations in bile reflect recent environmental exposures. Therefore, EARmix, derived from measured biliary e-EDC concentrations, is sensitive to rapid biliary turnover, making it reflective of recent exposure and so is a temporally dynamic measure [91,97,98]. Vtg induction in males is also temporal with detectable presence within a few days of exposure and can persist in the bloodstream for months [5,99]. Vtg induction is commonly used as a bioindicator of exposure and a warning sign [100] for more significant estrogenic effects, like altered reproductive timing, reduced fertility or fecundity, and intersex gonads [9,68]. Both Vtg induction and EARmix offer insights primarily into episodic exposures, whereas changes in female reproductive timing may indicate prolonged or chronic exposures.

For the validation, a qualitative assessment was used rather than statistical analysis because the field measures used for validation were collected during a different time period. Considering the time difference between data collection periods, perfect alignment was not expected; however, 8 of 10 sites showed reasonably close agreement. Specifically, the site classified as high potential-high certainty, Bell Harbor, exhibited higher proportions of males with Vtg induction and females with altered reproductive timing, while sites classified as medium potential showed notably lower proportions, and sites with low potential had minimal evidence of estrogenic effects from field observations.

For the eight sites lacking field measured data, we recommend further investigation and data collection, particularly at Carr Inlet, which has the highest 95th percentile of the EARmix. Carr Inlet is located in a low-development area with minimal impervious surfaces and the absence of known point sources, yet it likely receives non-point source wastewater inputs via on-site sewage systems which could explain the elevated exposures along with other hydrodynamic factors. Given the complex geography and bathymetry of the Salish Sea, wastewater treatment plant effluent distribution is influenced by factors such as stratification and the hydraulic residence time in embayments. As such, WWTP-associated contaminants such as E1 and E2 may be present at relatively high concentrations in less-urbanized embayments that otherwise receive little direct wastewater inputs. Field measures of exogenous exposure at Carr Inlet would help validate the high EARmix and support source investigation.

High priority and watch list e-EDCs

Four CECs (E1, E2, E3, and BPA) were identified as High Priority e-EDCs in the current study. In James et al. [1], BPA was identified as High Priority based on its presence in WWTP effluent and fish tissue, and E1 and E2 were deemed High Priority based on their presence in undiluted WWTP effluent alone (i.e., as a worst-case scenario). In this study, E1 and E2 were prioritized based on their presence in both WWTP effluent and bile samples, incorporating a biologically relevant measure and removing the worst-case scenario designation based solely on WWTP effluent concentrations. Additionally, the inclusion of bile chemistry data enabled the evaluation of previously undetected chemicals like E3, also prioritized as a High Priority chemical in this study. E1, E2, and E3 were identified as individual drivers in the majority of bile samples exceeding the thresholds. Of the bile samples exceeding the LOECbEAR, 57% included contributions to the EARmix from multiple steroidal estrogens. This suggests that mixtures of steroidal estrogens are commonly responsible for the estrogenic activity, emphasizing the need to further explore potential effects of these e-EDCs in combination.

BPA was the only CEC included as a High Priority e-EDC because of its contribution toward mixture response rather than as an individual driver. BPA is a high production volume chemical and a common component in many industrial products, spanning from clothing to food industry [101]. It is widespread in the natural environment, and found in surface water, effluent discharges, and wildlife [101]. In this study, BPA was present in marine water, WWTP effluent, mussel and fish tissue, and fish bile (Table 1). BPA was present at higher concentrations and detection frequencies in fish bile than whole body/fillet fish tissue, aligning with previous findings that BPA and alkylphenols concentrate in fish bile [47,48,89]. These results underscore the value of utilizing fish bile to assess e-EDC exposures. Moreover, a recent review highlighted the versatility of fish bile data as a biomarker for environmental pollutants, extending beyond estrogenic chemicals to include contaminants such as PAHs and their metabolites, metals, pesticides, pharmaceuticals, resin acids, hepatotoxins, and PFAS [91].

In the second application of the e-EAR thresholds, the prioritization of individual chemicals measured in bile relied upon two bile-based thresholds (i.e., the lowest NOECbEAR and LOECbEAR), as opposed to three thresholds (i.e., highest LOECbEAR, lowest LOECbEAR, lowest NOECbEAR) and resulting ranges used for site classification (Fig 2). Two thresholds were selected for individual chemical prioritization to maintain consistency with the water-based prioritization method. Opting for the lowest threshold values within the ranges proved more sensitive, with E3 upgraded to a driver rather than contributor, and the High Priority classification of BPA supported with a marine sample rather than just WWTP effluent. This choice of the most conservative threshold aligns with the study’s objectives, as the results are not intended for regulatory action but rather for focusing future investigations.

Low priority and insufficient information chemicals

Fifteen e-EDCs were categorized as Low Priority because they contributed less than 1% toward estrogenic response in mixtures that exceeded the threshold (Table 1). This is caused by low concentrations and/or low potency, compared to the High Priority chemicals. For instance, 17α-Estradiol (αE2), a stereoisomer of E2, is illustrative of a Low Priority e-EDC with high potency and low measured environmental concentrations. In the ER model, αE2 has a higher AUC (1.06) than E2 (0.94), indicating a greater likelihood to interact with the estrogen receptor [23]. Additionally, the absence of bile data for αE2 represents a gap in chemistry data that may have impacted its categorization [102]. Given the lack of commercially available analysis of αE2 in biological samples, the increased development and availability of methods for its quantification are recommended.

The 14 Low Priority e-EDCs with lower potencies than αE2 and E2 based on Judson et al. [23] are alkylphenols (e.g., octylphenol and 4-nonylphenol), alternative bisphenols (e.g., bisphenol S, bisphenol F, and bisphenol AF), phthalates, PFOSA, and other classes of hormones besides estrogens. The estrogenic potency of these chemicals, as measured by ACC5 values, ranged between 86 and 200,000 times lower than E2 (S4 Table). Although results suggest that the Low Priority e-EDCs are not drivers or major contributors toward ER agonism, they may exert effects through alternative modes of action. For instance, betamethasone and prednisone are synthetic corticosteroids frequently used to treat inflammatory and immune diseases in human and veterinary medicine [103]. They primarily act through glucocorticoid receptor agonism [103]. Future work should consider additional modes of action beyond ER agonism. based on the methods outlined here.

In some instances, chemicals are a lower priority here than in James et al. [1] where a single mode of action was not the focus. In the current work, betamethasone, prednisone, PFOSA, and butyl benzyl phthalate were categorized as Low Priority e-EDCs, whereas they were previously prioritized as High Priority CECs [1]. Similarly, αE2, 4-nonylphenol, dibutyl phthalate, and trenbolone acetate, were classified as Low Priority e-EDCs, but were Watch List CECs in James et al. [1]. This difference in categorization can be attributed to the ability of chemicals to elicit biological responses through multiple modes of action as accounted for in James et al. [1]. In cases where different prioritization approaches result in conflicting classifications, our recommendation is to retain these chemicals in the highest prioritization category. For a current list of recommended CEC prioritizations see the Figshare repository (https://doi.org/10.6084/m9.figshare.26195573).

CECs in the Insufficient Information category were not evaluated because data associated with either their potential to interact with the ER pathway or their environmental occurrence was lacking. This included 61 chemicals that have not been evaluated with ToxCast ER agonist assays (S8 Table). As more bioactivity information becomes available, these 61 chemicals should be re-evaluated. There were also CECs that were active in ER agonist assays but were not detected in the environment above the limit of quantification (LOQ); these may be of concern at levels below the LOQ. One such chemical is EE2, one of the most potent estrogenic chemicals [104], which was analyzed but not detected above the LOQ in WWTP effluent or bile. Recent monitoring of EE2 in marine water had an LOQ of approximately 5 ng/L [105], which would result in an EARACC5 greater than the NOECEAR threshold, suggesting that it could contribute to an estrogenic response. Therefore, continued improvements to analytical techniques are necessary, and chemicals like EE2 and transformation products should continue to be monitored in the environment.

Conclusion

This study developed a novel approach to evaluate the estrogenic activity of CEC mixtures in various environmental sample types collected from the Washington State Salish Sea, including fish bile. Estrogenic activity was assessed using in vitro HTS data from ToxCast and EARmix calculations, which aligned with traditional measures of estrogenicity. New e-EAR thresholds were established for mixtures in water and fish bile, enabling the biological interpretation of fish bile concentrations. Qualitative validation of thresholds with field measures, such as Vtg induction and altered reproductive timing, supported the utility of bile-based thresholds and highlighted the importance of prioritizing areas with high-potential for estrogenic effects like Carr Inlet for further investigation. This study also demonstrated that a small number of chemicals, particularly natural estrogens (E1, E2, and E3) contribute most to estrogenic activity. Wastewater is a primary pathway by which these natural estrogens enter the aquatic environment, so alterations to WWTP [106] and on-site sewage system [107] operations and infrastructure may be one approach to reduce their environmental impacts. Considering the transformation of E1, E2, and E3 in the environment and within organisms [63,108111], managing these steroidal estrogens collectively is recommended. Overall, this study strengthened regional prioritization efforts, used to inform environmental management decisions and future investigations. This work also demonstrated the broader applicability of in vitro HTS data for evaluating estrogenic activity in chemical mixtures across multiple matrices, offering a versatile methodology that can be adapted to other ecosystems, matrices, and modes of action.

Supporting information

S1 Table. Summary of sampling campaigns that were included in this study.

https://doi.org/10.1371/journal.pone.0323865.s001

(DOCX)

S2 Table. Analysis and detection counts of all CECs in water, WWTP effluent, mussel tissue, fish tissue, and English sole bile.

https://doi.org/10.1371/journal.pone.0323865.s003

(XLSX)

S3 Table. Summary of ToxCast assays related to the estrogen receptor agonist signaling pathway.

Unless stated otherwise, ER agonists assays were identified by Judson et al. (2015).

https://doi.org/10.1371/journal.pone.0323865.s004

(DOCX)

S5 Table. Mixture complexity of Salish Sea samples.

https://doi.org/10.1371/journal.pone.0323865.s007

(XLSX)

S6 Table. Median, minimum, and maximum chemical concentrations (ng/g) per e-EDC per species and tissue type.

https://doi.org/10.1371/journal.pone.0323865.s008

(XLSX)

S1 Fig. Scatterplot and Spearman’s rank correlation coefficient between EEQ and EARACC5 calculated for male fish bile samples (n = 354).

https://doi.org/10.1371/journal.pone.0323865.s009

(TIF)

S2 Fig. Density plot of the distribution of EARmix:EEQmix values.

https://doi.org/10.1371/journal.pone.0323865.s010

(TIF)

S7 Table. EAR summary statistics for each bile sampling site.

https://doi.org/10.1371/journal.pone.0323865.s011

(XLSX)

S3 Fig. Stacked bar plot with exposure-activity ratios (EARs) for each bile sample with EARs exceeding the LOECEAR.

Stacked bar plot with exposure-activity ratios (EARs) for each bile sample with EARs exceeding the LOECbEAR, represented by the red dashed line. The sample labels include the site ID abbreviation (as described in Fig 1), collection year, and a letter to distinguish samples. The EARACC5 for each chemical and the overall EARmix for the sample are shown. The dotted and dashed line represents the lowest NOECbEAR, and the dashed line represents the lowest LOECbEAR calculated using the lowest BCFbw. The shaded regions represent the range of calculated possible threshold values based on range of BCFbw values.

https://doi.org/10.1371/journal.pone.0323865.s012

(TIF)

S4 Fig. Stacked bar plot with exposure-activity rations (EARs) for each bile sample with EARs between the NOECEAR and LOECEAR.

Stacked bar plot with exposure-activity ratios (EARs) for each bile sample with EARs between the LOECbEAR and the NOECbEAR, represented by the black dashed line. The sample labels include the site ID abbreviation (as described in Fig 1), collection year, and a letter to distinguish samples. The EARACC5 for each chemical and the overall EARmix for the sample are shown. The the shaded region represents the range of calculated possible NOEC threshold values based on range of BCFbw values.

https://doi.org/10.1371/journal.pone.0323865.s013

(TIF)

S8 Table. Chemicals with insufficient information.

https://doi.org/10.1371/journal.pone.0323865.s014

(XLSX)

Acknowledgments

We would like to acknowledge and thank the Puget Sound Ecosystem Monitoring Program (PSEMP) Toxics Work Group who contributed to the early development of this work. Irv Schultz, Jennie Bolton, and Jonelle Gates from the National Oceanic and Atmospheric Administration, Northwest Fisheries Science Center’s Environmental Chemistry Program provided analysis of the bile samples reported herein. Additionally, Irv Schultz and Julann Spromberg (National Oceanic and Atmospheric Administration) provided valuable review comments. We would also like to thank Richard Judson (Environmental Protection Agency) for his input on identifying estrogen agonists, guidance on calculating the measure of estrogenic activity, and assistance in understanding the estrogen receptor agonist pathway model.

References

  1. 1. James CA, Sofield R, Faber M, Wark D, Simmons A, Harding L, et al. The screening and prioritization of contaminants of emerging concern in the marine environment based on multiple biological response measures. Sci Total Environ. 2023;886:163712. pmid:37156386
  2. 2. LaLone CA, Villeneuve DL, Doering JA, Blackwell BR, Transue TR, Simmons CW, et al. Evidence for Cross Species Extrapolation of Mammalian-Based High-Throughput Screening Assay Results. Environ Sci Technol. 2018;52(23):13960–71.
  3. 3. Colborn T, vom Saal FS, Soto AM. Developmental effects of endocrine-disrupting chemicals in wildlife and humans. Environ Health Perspect. 1993;101(5):378–84.
  4. 4. Deich C, Kanwischer M, Jähne M, Waniek JJ. Patterns of estrogenic activity in the Baltic Sea. Chemosphere. 2020;240:124870. pmid:31550586
  5. 5. Blazer VS, Walsh HL, Shaw CH, Iwanowicz LR, Braham RP, Mazik PM. Indicators of exposure to estrogenic compounds at Great Lakes Areas of Concern: species and site comparisons. Environ Monit Assess. 2018;190(10):577. pmid:30191322
  6. 6. Nilsen E, Smalling KL, Ahrens L, Gros M, Miglioranza KSB, Picó Y, et al. Critical review: Grand challenges in assessing the adverse effects of contaminants of emerging concern on aquatic food webs. Environ Toxicol Chem. 2019;38(1):46–60. pmid:30294805
  7. 7. Vajda AM, Barber LB, Gray JL, Lopez EM, Woodling JD, Norris DO. Reproductive disruption in fish downstream from an estrogenic wastewater effluent. Environ Sci Technol. 2008;42(9):3407–14. pmid:18522126
  8. 8. Oshima Y, Kang IJ, Kobayashi M, Nakayama K, Imada N, Honjo T. Suppression of sexual behavior in male Japanese medaka (Oryzias latipes) exposed to 17β-estradiol. Chemosphere. 2003;50(3):429–36.
  9. 9. Vega-Morales T, Sosa-Ferrera Z, Santana-Rodríguez JJ. Evaluation of the presence of endocrine-disrupting compounds in dissolved and solid wastewater treatment plant samples of Gran Canaria Island (Spain). Biomed Res Int. 2013;2013:790570. pmid:24163820
  10. 10. Ismail NAH, Wee SY, Aris AZ. Multi-class of endocrine disrupting compounds in aquaculture ecosystems and health impacts in exposed biota. Chemosphere. 2017;188:375–88. pmid:28892772
  11. 11. Kavlock RJ, Ankley GT. A perspective on the risk assessment process for endocrine-disruptive effects on wildlife and human health. Risk Anal. 1996;16(6):731–9. pmid:8972105
  12. 12. Kidd KA, Blanchfield PJ, Mills KH, Palace VP, Evans RE, Lazorchak JM, et al. Collapse of a fish population after exposure to a synthetic estrogen. Proc Natl Acad Sci U S A. 2007;104(21):8897–901. pmid:17517636
  13. 13. Azizi-Lalabadi M, Pirsaheb M. Investigation of steroid hormone residues in fish: A systematic review. Process Safety and Environmental Protection. 2021;152:14–24.
  14. 14. Lange A, Katsu Y, Miyagawa S, Ogino Y, Urushitani H, Kobayashi T, et al. Comparative responsiveness to natural and synthetic estrogens of fish species commonly used in the laboratory and field monitoring. Aquat Toxicol. 2012;109:250–8. pmid:22000336
  15. 15. Canesi L, Fabbri E. Environmental Effects of BPA: Focus on Aquatic Species. Dose Response. 2015;13(3):1559325815598304. pmid:26674307
  16. 16. Lahnsteiner F, Berger B, Kletzl M, Weismann T. Effect of bisphenol A on maturation and quality of semen and eggs in the brown trout, Salmo trutta f. fario. Aquat Toxicol. 2005;75(3):213–24. pmid:16159676
  17. 17. Schoenfuss HL, Furlong ET, Phillips PJ, Scott T-M, Kolpin DW, Cetkovic-Cvrlje M, et al. Complex mixtures, complex responses: Assessing pharmaceutical mixtures using field and laboratory approaches. Environ Toxicol Chem. 2016;35(4):953–65. pmid:26561986
  18. 18. Alvarez DA, Corsi SR, De Cicco LA, Villeneuve DL, Baldwin AK. Identifying Chemicals and Mixtures of Potential Biological Concern Detected in Passive Samplers from Great Lakes Tributaries Using High-Throughput Data and Biological Pathways. Environ Toxicol Chem. 2021;40(8):2165–82. pmid:34003517
  19. 19. Dyer S, St J Warne M, Meyer JS, Leslie HA, Escher BI. Tissue residue approach for chemical mixtures. Integr Environ Assess Manag. 2011;7(1):99–115. pmid:21184571
  20. 20. Rodea-Palomares I, Gao Z, Weyers A, Ebeling M. Risk from unintentional environmental mixtures in EU surface waters is dominated by a limited number of substances. Sci Total Environ. 2023;856(Pt 2):159090. pmid:36181796
  21. 21. Thrupp TJ, Runnalls TJ, Scholze M, Kugathas S, Kortenkamp A, Sumpter JP. The consequences of exposure to mixtures of chemicals: Something from “nothing” and “a lot from a little” when fish are exposed to steroid hormones. Sci Total Environ. 2018;619–620:1482–92. pmid:29734624
  22. 22. Jarošová B, Bláha L, Giesy JP, Hilscherová K. What level of estrogenic activity determined by in vitro assays in municipal waste waters can be considered as safe?. Environ Int. 2014;64:98–109. pmid:24384232
  23. 23. Judson RS, Magpantay FM, Chickarmane V, Haskell C, Tania N, Taylor J, et al. Integrated Model of Chemical Perturbations of a Biological Pathway Using 18 In Vitro High-Throughput Screening Assays for the Estrogen Receptor. Toxicol Sci. 2015;148(1):137–54. pmid:26272952
  24. 24. Krewski D, Acosta D Jr, Andersen M, Anderson H, Bailar JC 3rd, Boekelheide K, et al. Toxicity testing in the 21st century: a vision and a strategy. J Toxicol Environ Health B Crit Rev. 2010;13(2–4):51–138. pmid:20574894
  25. 25. Villeneuve DL, Coady K, Escher BI, Mihaich E, Murphy CA, Schlekat T, et al. High-throughput screening and environmental risk assessment: State of the science and emerging applications. Environ Toxicol Chem. 2019;38(1):12–26. pmid:30570782
  26. 26. Richard AM, Huang R, Waidyanatha S, Shinn P, Collins BJ, Thillainadarajah I, et al. The Tox21 10K Compound Library: Collaborative Chemistry Advancing Toxicology. Chem Res Toxicol. 2021;34(2):189–216. pmid:33140634
  27. 27. Tice RR, Austin CP, Kavlock RJ, Bucher JR. Improving the human hazard characterization of chemicals: a Tox21 update. Environ Health Perspect. 2013;121(7):756–65. pmid:23603828
  28. 28. Judson RS, Houck KA, Kavlock RJ, Knudsen TB, Martin MT, Mortensen HM, et al. In vitro screening of environmental chemicals for targeted testing prioritization: the ToxCast project. Environ Health Perspect. 2010;118(4):485–92. pmid:20368123
  29. 29. Blackwell BR, Ankley GT, Corsi SR, DeCicco LA, Houck KA, Judson RS, et al. An “EAR” on Environmental Surveillance and Monitoring: A Case Study on the Use of Exposure-Activity Ratios (EARs) to Prioritize Sites, Chemicals, and Bioactivities of Concern in Great Lakes Waters. Environ Sci Technol. 2017;51(15):8713–24. pmid:28671818
  30. 30. Judson R, Houck K, Martin M, Richard AM, Knudsen TB, Shah I, et al. Editor’s Highlight: Analysis of the Effects of Cell Stress and Cytotoxicity on In Vitro Assay Activity Across a Diverse Chemical and Assay Space. Toxicol Sci. 2016;152(2):323–39. pmid:27208079
  31. 31. Dreier DA, Denslow ND, Martyniuk CJ. Computational analysis of the ToxCast estrogen receptor agonist assays to predict vitellogenin induction by chemicals in male fish. Environ Toxicol Pharmacol. 2017;53:177–83. pmid:28645054
  32. 32. Judson RS, Houck KA, Watt ED, Thomas RS. On selecting a minimal set of in vitro assays to reliably determine estrogen agonist activity. Regul Toxicol Pharmacol 2017;91:39–49.
  33. 33. Blackwell BR, Ankley GT, Bradley PM, Houck KA, Makarov SS, Medvedev AV, et al. Potential Toxicity of Complex Mixtures in Surface Waters from a Nationwide Survey of United States Streams: Identifying in Vitro Bioactivities and Causative Chemicals. Environ Sci Technol. 2019;53(2):973–83. pmid:30548063
  34. 34. Corsi SR, De Cicco LA, Villeneuve DL, Blackwell BR, Fay KA, Ankley GT, et al. Prioritizing chemicals of ecological concern in Great Lakes tributaries using high-throughput screening data and adverse outcome pathways. Sci Total Environ. 2019;686:995–1009. pmid:31412529
  35. 35. Loken LC, Corsi SR, Alvarez DA, Ankley GT, Baldwin AK, Blackwell BR, et al. Prioritizing Pesticides of Potential Concern and Identifying Potential Mixture Effects in Great Lakes Tributaries Using Passive Samplers. Environ Toxicol Chem. 2023;42(2):340–66. pmid:36165576
  36. 36. Fay KA, Villeneuve DL, Swintek J, Edwards SW, Nelms MD, Blackwell BR, et al. Differentiating Pathway-Specific From Nonspecific Effects in High-Throughput Toxicity Data: A Foundation for Prioritizing Adverse Outcome Pathway Development. Toxicol Sci. 2018;163(2):500–15. pmid:29529260
  37. 37. Filer DL, Kothiya P, Setzer RW, Judson RS, Martin MT. tcpl: the ToxCast pipeline for high-throughput screening data. Bioinformatics. 2017;33(4):618–20. pmid:27797781
  38. 38. Judson R, Richard A, Dix DJ, Houck K, Martin M, Kavlock R, et al. The toxicity data landscape for environmental chemicals. Environ Health Perspect. 2009;117(5):685–95. pmid:19479008
  39. 39. Elliott SM, Route WT, DeCicco LA, VanderMeulen DD, Corsi SR, Blackwell BR. Contaminants in bald eagles of the upper Midwestern U.S.: A framework for prioritizing future research based on in-vitro bioassays. Environ Pollut 2019;244:861–70.
  40. 40. Malev O, Lovrić M, Stipaničev D, Repec S, Martinović-Weigelt D, Zanella D, et al. Toxicity prediction and effect characterization of 90 pharmaceuticals and illicit drugs measured in plasma of fish from a major European river (Sava, Croatia). Environ Pollut. 2020;266(Pt 3):115162. pmid:32771868
  41. 41. Rose LD, Akob DM, Tuberty SR, Corsi SR, DeCicco LA, Colby JD, et al. Use of high-throughput screening results to prioritize chemicals for potential adverse biological effects within a West Virginia watershed. Sci Total Environ. 2019;677:362–72. pmid:31059879
  42. 42. Ankley GT, Berninger JP, Blackwell BR, Cavallin JE, Collette TW, Ekman DR, et al. Pathway-Based Approaches for Assessing Biological Hazards of Complex Mixtures of Contaminants: A Case Study in the Maumee River. Environ Toxicol Chem. 2021;40(4):1098–122. pmid:33270248
  43. 43. Allard A-S, Gunnarsson M, Svenson A. Estrogenicity in bile of juvenile rainbow trout as measure of exposure and potential effects of endocrine disruptors. Environ Toxicol Chem. 2004;23(5):1187–93. pmid:15180369
  44. 44. Gibson R, Tyler CR, Hill EM. Analytical methodology for the identification of estrogenic contaminants in fish bile. Journal of Chromatography A. 2005;1066(1–2):33–40.
  45. 45. Legler J, Jonas A, Lahr J, Vethaak AD, Brouwer A, Murk AJ. Biological measurement of estrogenic activity in urine and bile conjugates with the in vitro ER-CALUX reporter gene assay. Environmental Toxicology and Chemistry. 2002;21(3):473–9.
  46. 46. Wu M, Pan C, Yang M, Xu B, Lei X, Ma J, et al. Chemical analysis of fish bile extracts for monitoring endocrine disrupting chemical exposure in water: Bisphenol A, alkylphenols, and norethindrone. Environ Toxicol Chem. 2016;35(1):182–90. pmid:26206390
  47. 47. Lv Y-Z, Yao L, Wang L, Liu W-R, Zhao J-L, He L-Y, et al. Bioaccumulation, metabolism, and risk assessment of phenolic endocrine disrupting chemicals in specific tissues of wild fish. Chemosphere. 2019;226:607–15. pmid:30954895
  48. 48. Ferreira-Leach AMR, Hill EM. Bioconcentration and distribution of 4-tert-octylphenol residues in tissues of the rainbow trout (Oncorhynchus mykiss).
  49. 49. Sobocinski KL. State of the Salish Sea. G. Broadhurst and N.J.K. Baloy (Contributing Eds.): 2021.
  50. 50. da Silva DAM, Buzitis J, Reichert WL, West JE, O’Neill SM, Johnson LL, et al. Endocrine disrupting chemicals in fish bile: a rapid method of analysis using English sole (Parophrys vetulus) from Puget Sound, WA, USA. Chemosphere. 2013;92(11):1550–6. pmid:23683869
  51. 51. Harding LB, Schultz IR, da Silva DAM, Ylitalo GM, Ragsdale D, Harris SI, et al. Wastewater treatment plant effluent alters pituitary gland gonadotropin mRNA levels in juvenile coho salmon (Oncorhynchus kisutch). Aquat Toxicol. 2016;178:118–31. pmid:27475653
  52. 52. Sloan CA, Anulacion B, Baugh KA, Bolton JL, Boyd D, Chittaro PM. Quality Assurance Plan for Analyses of Environmental Samples for Polycyclic Aromatic Hydrocarbons, Persistent Organic Pollutants, Dioctyl Sulfosuccinate, Estrogenic Compounds, Steroids, Hydroxylated Polycyclic Aromatic Hydrocarbons, Stable Isotope Ratios, and Lipid Classes. 2019.
  53. 53. Johnson LL, Lomax DP, Myers MS, Olson OP, Sol SY, O’Neill SM, et al. Xenoestrogen exposure and effects in English sole (Parophrys vetulus) from Puget Sound, WA. Aquat Toxicol. 2008;88(1):29–38. pmid:18423645
  54. 54. Maloney EM, Villeneuve DL, Jensen KM, Blackwell BR, Kahl MD, Poole ST, et al. Evaluation of Complex Mixture Toxicity in the Milwaukee Estuary (WI, USA) Using Whole-Mixture and Component-Based Evaluation Methods. Environ Toxicol Chem. 2023;42(6):1229–56. pmid:36715369
  55. 55. Escher BI, Aїt-Aїssa S, Behnisch PA, Brack W, Brion F, Brouwer A, et al. Effect-based trigger values for in vitro and in vivo bioassays performed on surface water extracts supporting the environmental quality standards (EQS) of the European Water Framework Directive. Sci Total Environ. 2018;628–629:748–65. pmid:29454215
  56. 56. Mansouri K, Abdelaziz A, Rybacka A, Roncaglioni A, Tropsha A, Varnek A, et al. CERAPP: Collaborative Estrogen Receptor Activity Prediction Project. Environ Health Perspect. 2016;124(7):1023–33. pmid:26908244
  57. 57. Schaupp CM, LaLone CA, Blackwell BR, Ankley GT, Villeneuve DL. Leveraging ToxCast data and protein sequence conservation to complement aquatic life criteria derivation. Integr Environ Assess Manag. 2023;19(1):224–38. pmid:35393744
  58. 58. Burkhard LP. Evaluation of Published Bioconcentration Factor (BCF) and Bioaccumulation Factor (BAF) Data for Per- and Polyfluoroalkyl Substances Across Aquatic Species. Environ Toxicol Chem. 2021;40(6):1530–43. pmid:33605484
  59. 59. Tebes-Stevens C, Patel JM, Koopmans M, Olmstead J, Hilal SH, Pope N, et al. Demonstration of a consensus approach for the calculation of physicochemical properties required for environmental fate assessments. Chemosphere. 2018;194:94–106. pmid:29197820
  60. 60. Williams AJ, Grulke CM, Edwards J, McEachran AD, Mansouri K, Baker NC, et al. The CompTox Chemistry Dashboard: a community data resource for environmental chemistry. J Cheminform. 2017;9(1):61. pmid:29185060
  61. 61. Filby AL, Neuparth T, Thorpe KL, Owen R, Galloway TS, Tyler CR. Health impacts of estrogens in the environment, considering complex mixture effects. Environ Health Perspect. 2007;115(12):1704–10. pmid:18087587
  62. 62. Nirmalakhandan N, Arulgnanendran V, Mohsin M, Sun B, Cadena F. Toxicity of mixtures of organic chemicals to microorganisms. Water Research. 1994;28(3):543–51.
  63. 63. Thorpe KL, Cummings RI, Hutchinson TH, Scholze M, Brighty G, Sumpter JP, et al. Relative potencies and combination effects of steroidal estrogens in fish. Environ Sci Technol. 2003;37(6):1142–9. pmid:12680667
  64. 64. DeCicco LA, Corsi SR, Blackwell BR, Villeneuve DL, Ankley GT. toxEval: Evaluation of measured concentration data using the ToxCast high-throughput screening database or a user-defined set of concentration benchmarks. 2022.
  65. 65. Faber M. Toxicity Explorer. https://faberm.shinyapps.io/ToxicityExplorerDRAFT/. 2022. Accessed 2022 September 15.
  66. 66. Wickham H, François R, Henry L, Müller K. dplyr: A grammar of data manipulation. R Package Version. 2015. p156.
  67. 67. Wickham H. ggplot2: elegant graphics for data analysis. New York, NY: Springer. 2009.
  68. 68. Brion F, Tyler CR, Palazzi X, Laillet B, Porcher JM, Garric J, et al. Impacts of 17beta-estradiol, including environmentally relevant concentrations, on reproduction after exposure during embryo-larval-, juvenile- and adult-life stages in zebrafish (Danio rerio). Aquat Toxicol. 2004;68(3):193–217. pmid:15159048
  69. 69. Larsson DGJ, Adolfsson-Erici M, Parkkonen J, Pettersson M, Berg AH, Olsson P-E, et al. Ethinyloestradiol — an undesired fish contraceptive?. Aquatic Toxicology. 1999;45(2–3):91–7.
  70. 70. Gibson R, Smith MD, Spary CJ, Tyler CR, Hill EM. Mixtures of estrogenic contaminants in bile of fish exposed to wastewater treatment works effluents. Environ Sci Technol. 2005;39(8):2461–71. pmid:15884336
  71. 71. Baldwin AK, Corsi SR, De Cicco LA, Lenaker PL, Lutz MA, Sullivan DJ, et al. Organic contaminants in Great Lakes tributaries: Prevalence and potential aquatic toxicity. Sci Total Environ. 2016;554–555:42–52. pmid:26950618
  72. 72. Jobling S, Williams R, Johnson A, Taylor A, Gross-Sorokin M, Nolan M, et al. Predicted exposures to steroid estrogens in U.K. rivers correlate with widespread sexual disruption in wild fish populations. Environ Health Perspect. 2006;114 Suppl 1(Suppl 1):32–9. pmid:16818244
  73. 73. Cade BS, Noon BR. A gentle introduction to quantile regression for ecologists. Frontiers in Ecology and the Environment. 2003;1(8):412–20.
  74. 74. Meador JP, Collier TK, Stein JE. Use of tissue and sediment‐based threshold concentrations of polychlorinated biphenyls (PCBs) to protect juvenile salmonids listed under the US Endangered Species Act. Aquatic Conservation. 2002;12(5):493–516.
  75. 75. Körner W. Development of a sensitive E-screen assay for quantitative analysis of estrogenic activity in municipal sewage plant effluents. Science Total Environment. 1999;225(1–2):33–48.
  76. 76. Körner W, Bolz U, Süssmuth W, Hiller G, Schuller W, Hanf V, et al. Input/output balance of estrogenic active compounds in a major municipal sewage plant in Germany. Chemosphere. 2000;40(9–11):1131–42. pmid:10739055
  77. 77. Parliament E. European Parliament resolution on a coordinated Union-level action plan to facilitate the transition to innovation without the use of animals in research, regulatory testing and education.
  78. 78. Grimm D. EPA plan to end animal testing splits scientists. Science. 2019;365(6459):1231. pmid:31604217
  79. 79. Barber LB, Brown GK, Nettesheim TG, Murphy EW, Bartell SE, Schoenfuss HL. Effects of biologically-active chemical mixtures on fish in a wastewater-impacted urban stream. Sci Total Environ. 2011;409(22):4720–8. pmid:21849205
  80. 80. Körner W, Spengler P, Bolz U, Schuller W, Hanf V, Metzger JW. Substances with estrogenic activity in effluents of sewage treatment plants in southwestern Germany. 2. Biological analysis. Environmental Toxicol Chemistry. 2001;20(10):2142–51.
  81. 81. West JE, O’Neill SM, Ylitalo GM. Time Trends of Persistent Organic Pollutants in Benthic and Pelagic Indicator Fishes from Puget Sound, Washington, USA. Arch Environ Contam Toxicol. 2017;73(2):207–29. pmid:28528416
  82. 82. da Silva DAM, Gates JB, O’Neill SM, West JE, Ylitalo GM. Assessing hydroxylated polycyclic aromatic hydrocarbon (OHPAH) metabolites in bile of English sole (Parophrys vetulus) from Puget Sound, WA, USA by liquid chromatography/tandem mass spectrometry (LC-MS/MS). Sci Total Environ. 2023;865:161229. pmid:36586683
  83. 83. Nomiyama K, Nomura Y, Takahashi T, Uchiyama Y, Arizono K, Shinohara R. Hydroxylated polychlorinated biphenyls (OH-PCBs) induce vitellogenin through estrogenic activity in primary-cultured hepatocytes of the Xenopus laevis. Chemosphere. 2010;78(7):800–6. pmid:20060147
  84. 84. Andersson PL, Blom A, Johannisson A, Pesonen M, Tysklind M, Berg AH, et al. Assessment of PCBs and hydroxylated PCBs as potential xenoestrogens: In vitro studies based on MCF-7 cell proliferation and induction of vitellogenin in primary culture of rainbow trout hepatocytes. Arch Environ Contam Toxicol. 1999;37(2):145–50. pmid:10398763
  85. 85. Filer D, Patisaul HB, Schug T, Reif D, Thayer K. Test driving ToxCast: endocrine profiling for 1858 chemicals included in phase II. Curr Opin Pharmacol. 2014;19:145–52. pmid:25460227
  86. 86. Bartelt-Hunt SL, Snow DD, Kranz WL, Mader TL, Shapiro CA, Donk SJ van, et al. Effect of growth promotants on the occurrence of endogenous and synthetic steroid hormones on feedlot soils and in runoff from beef cattle feeding operations. Environ Sci Technol. 2012;46(3):1352–60. pmid:22242694
  87. 87. Schultz IR, Nagler JJ, Swanson P, Wunschel D, Skillman AD, Burnett V, et al. Toxicokinetic, toxicodynamic, and toxicoproteomic aspects of short-term exposure to trenbolone in female fish. Toxicol Sci. 2013;136(2):413–29. pmid:24072461
  88. 88. Sonthithai P, Suriyo T, Thiantanawat A, Watcharasit P, Ruchirawat M, Satayavivad J. Perfluorinated chemicals, PFOS and PFOA, enhance the estrogenic effects of 17β-estradiol in T47D human breast cancer cells. J Appl Toxicol. 2016;36(6):790–801. pmid:26234195
  89. 89. Pettersson M, Adolfsson-Erici M, Parkkonen J, Förlin L, Asplund L. Fish bile used to detect estrogenic substances in treated sewage water. Sci Total Environ. 2006;366(1):174–86. pmid:16139329
  90. 90. Leppänen H, Marttinen S, Oikari A. The use of fish bile metabolite analyses as exposure biomarkers to pulp and paper mill effluents. Chemosphere. 1998;36(12):2621–34.
  91. 91. de Souza HM, de Almeida RF, Lopes AP, Hauser-Davis RA. Review: Fish bile, a highly versatile biomarker for different environmental pollutants. Comp Biochem Physiol C Toxicol Pharmacol. 2024;278:109845. pmid:38280442
  92. 92. Yang J, Li H, Ran Y, Chan K. Distribution and bioconcentration of endocrine disrupting chemicals in surface water and fish bile of the Pearl River Delta, South China. Chemosphere. 2014;107:439–46. pmid:24582358
  93. 93. Landis WG, Chapman PM. Well past time to stop using NOELs and LOELs. Integr Environ Assess Manag. 2011;7(4):vi–viii. pmid:21932339
  94. 94. Murado MA, Prieto MA. NOEC and LOEC as merely concessive expedients: two unambiguous alternatives and some criteria to maximize the efficiency of dose-response experimental designs. Sci Total Environ. 2013;461–462:576–86. pmid:23756217
  95. 95. Warne MSJ, van Dam R. NOEC and LOEC Data Should No Longer Be Generated or Used. Australasian J Ecotoxicology. 2008.
  96. 96. Tanaka Y, Nakamura K, Yokomizo H. Relative robustness of NOEC and ECx against large uncertainties in data. PLoS One. 2018;13(11):e0206901. pmid:30485303
  97. 97. Hauser-Davis RA, Bastos FF, Tuton B, Chávez Rocha R, Saint’ Pierre T, Ziolli RL, et al. Bile and liver metallothionein behavior in copper-exposed fish. J Trace Elem Med Biol. 2014;28(1):70–4. pmid:24210855
  98. 98. Richardson DM, Gubbins MJ, Davies IM, Moffat CF, Pollard PM. Effects of feeding status on biliary PAH metabolite and biliverdin concentrations in plaice (Pleuronectes platessa). Environ Toxicol Pharmacol. 2004;17(2):79–85. pmid:21782717
  99. 99. Hiramatsu N, Matsubara T, Fujita T, Sullivan CV, Hara A. Multiple piscine vitellogenins: biomarkers of fish exposure to estrogenic endocrine disruptors in aquatic environments. Marine Biology. 2006;149(1):35–47.
  100. 100. Hutchinson TH, Ankley GT, Segner H, Tyler CR. Screening and testing for endocrine disruption in fish-biomarkers as “signposts,” not “traffic lights,” in risk assessment. Environ Health Perspect. 2006;114 Suppl 1(Suppl 1):106–14. pmid:16818255
  101. 101. Corrales J, Kristofco LA, Steele WB, Yates BS, Breed CS, Williams ES, et al. Global Assessment of Bisphenol A in the Environment: Review and Analysis of Its Occurrence and Bioaccumulation. Dose Response. 2015;13(3):1559325815598308. pmid:26674671
  102. 102. Prokai-Tatrai K, Bonds D, Prokai L. Simultaneous Measurement of 17β-Estradiol, 17α-Estradiol and Estrone by GC-Isotope Dilution MS/MS. Chromatographia. 2010;71(3–4):311–5. pmid:20625535
  103. 103. Macikova P, Groh KJ, Ammann AA, Schirmer K, Suter MJ-F. Endocrine disrupting compounds affecting corticosteroid signaling pathways in Czech and Swiss waters: potential impact on fish. Environ Sci Technol. 2014;48(21):12902–11. pmid:25269596
  104. 104. MIyagawa S, Sato T, Iguchi T. 17α-Ethinylestradiol. Handbook of Hormones. Elsevier. 2021. p. 1007–8. https://doi.org/10.1016/b978-0-12-820649-2.00279-5
  105. 105. Meador JP, James CA, Ball SC, McIntyre JK. Wastewater effluent discharge assessment - impact to marine organisms. 2022.
  106. 106. Liu Z, Lu G, Yin H, Dang Z, Rittmann B. Removal of natural estrogens and their conjugates in municipal wastewater treatment plants: a critical review. Environ Sci Technol. 2015;49(9):5288–300. pmid:25844648
  107. 107. Guyader ME, Warren LD, Green E, Bertram R, Proudian AP, Kiesling RL, et al. Trace organic contaminant (TOrC) mixtures in Minnesota littoral zones: Effects of on-site wastewater treatment system (OWTS) proximity and biological impact. Sci Total Environ. 2018;626:1157–66. pmid:29898522
  108. 108. Ankley GT, Feifarek D, Blackwell B, Cavallin JE, Jensen KM, Kahl MD, et al. Re-evaluating the Significance of Estrone as an Environmental Estrogen. Environ Sci Technol. 2017;51(8):4705–13. pmid:28328210
  109. 109. Dammann AA, Shappell NW, Bartell SE, Schoenfuss HL. Comparing biological effects and potencies of estrone and 17β-estradiol in mature fathead minnows, Pimephales promelas. Aquat Toxicol. 2011;105(3–4):559–68. pmid:21939616
  110. 110. Tapper MA, Kolanczyk RC, LaLone CA, Denny JS, Ankley GT. Conversion of Estrone to 17β-Estradiol: A Potential Confounding Factor in Assessing Risks of Environmental Estrogens to Fish. Environ Toxicol Chem. 2020;39(10):2028–40. pmid:33448467
  111. 111. Yu W, Du B, Yang L, Zhang Z, Yang C, Yuan S, et al. Occurrence, sorption, and transformation of free and conjugated natural steroid estrogens in the environment. Environ Sci Pollut Res Int. 2019;26(10):9443–68. pmid:30758794