Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Probabilistic approach for assessing cancer risk due to benzo[a]pyrene in barbecued meat: Informing advice for population groups

  • Lea Sletting Jakobsen ,

    Contributed equally to this work with: Lea Sletting Jakobsen, Stylianos Georgiadis

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    leaja@food.dtu.dk

    Affiliation National Food Institute, Technical University of Denmark, Kgs. Lyngby, Denmark

  • Stylianos Georgiadis ,

    Contributed equally to this work with: Lea Sletting Jakobsen, Stylianos Georgiadis

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliations National Food Institute, Technical University of Denmark, Kgs. Lyngby, Denmark, Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kgs. Lyngby, Denmark

  • Bo Friis Nielsen,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kgs. Lyngby, Denmark

  • Bas G. H. Bokkers,

    Roles Methodology, Resources, Writing – review & editing

    Affiliation National Institute for Public Health and the Environment (RIVM), Bilthoven, Netherlands

  • Elena Boriani,

    Roles Writing – review & editing

    Affiliation National Food Institute, Technical University of Denmark, Kgs. Lyngby, Denmark

  • Lene Duedahl-Olesen,

    Roles Methodology, Resources, Writing – review & editing

    Affiliation National Food Institute, Technical University of Denmark, Kgs. Lyngby, Denmark

  • Tine Hald,

    Roles Methodology, Writing – review & editing

    Affiliation National Food Institute, Technical University of Denmark, Kgs. Lyngby, Denmark

  • Maarten J. Nauta,

    Roles Methodology, Writing – review & editing

    Affiliation National Food Institute, Technical University of Denmark, Kgs. Lyngby, Denmark

  • Anders Stockmarr,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kgs. Lyngby, Denmark

  • Sara M. Pires

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation National Food Institute, Technical University of Denmark, Kgs. Lyngby, Denmark

Abstract

Background

Consumption of meat prepared by barbecuing is associated with risk of cancer due to formation of carcinogenic compounds including benzo[a]pyrene (BaP). Assessment of a population’s risk of disease and people’s individual probability of disease given specific consumer attributes may direct food safety strategies to where impact on public health is largest. The aim of this study was to propose a model that estimates the risk of cancer caused by exposure to BaP from barbecued meat in Denmark, and to estimate the probability of developing cancer in subgroups of the population given different barbecuing frequencies.

Methods

We developed probabilistic models applying two dimensional Monte Carlo simulation to take into account the variation in exposure given age and sex and in the individuals’ sensitivity to develop cancer after exposure to BaP, and the uncertainty in the dose response model. We used the Danish dietary consumption survey, monitoring data of chemical concentrations, data on consumer behavior of frequency of barbecuing, and animal dose response data.

Findings

We estimated an average extra lifetime risk of cancer due to BaP from barbecued meat of 6.8 × 10−5 (95% uncertainty interval 2.6 × 10−7 − 7.0 × 10−4) in the Danish population. This corresponds to approximately one to 4,074 extra cancer cases over a lifetime, reflecting wide uncertainty. The impact per barbecuing event on the risk of cancer for men and women of low body weight was higher compared to higher bodyweight. However, the difference due to sex and bodyweight between subgroups are dwarfed by the uncertainty.

Interpretation

This study proposes a model that can be applied to other substances and routes of exposure, and allows for deriving the change in risk following a specific change in behaviour. The presented methodology can serve as a valuable tool for risk management, allowing for the formulation of behaviour advice targeted to specific sub-groups in the population.

Introduction

Based on an assessment of the available scientific literature, the International Agency for Research on Cancer concluded in 2015 that consumption of processed meat increases the risk of cancer in humans [1]. Processing of meat corresponds to production or cooking practices in which meat is transformed to enhance organoleptic properties, digestibility and preservation including smoking, curing and various heat treatments. The compounds that are considered responsible for the carcinogenicity of processed meat are formed during these processes [2], and include polycyclic aromatic hydrocarbons (PAHs) that constitute a large group of compounds that are formed during incomplete combustion of organic matter. If meat is prepared over open flame (e.g. barbecuing), fat or meat-juice drips onto the hot coals, wood, etc., and PAHs, formed in the smoke, adhere to the surface of the meat [3, 4]. Sixteen PAHs have been found to be genotoxic/mutagenic and/or carcinogenic in toxicological studies [57], benzo[a]pyrene (BaP) being the most studied PAH and classified as carcinogenic to humans (group 1) by a genotoxic mode of action [8].

To limit the population’s exposure to BaP and other carcinogenic PAHs from barbecued meat, the European Commission has implemented official mitigation strategies that include a legally enforced maximum limit of 5 μg/kg in commercial prepared heat treated meat [9], monitoring of concentration of PAH in meat barbecued in restaurants or other commercial settings, and guidance on how to adjust processing to decrease contamination. In Denmark, the National Food Authority further advises the population to limit consumption of barbecued meat and if barbecuing, to avoid charred meat [10]. Current mitigation strategies are commonly based on deterministic approaches to risk assessment. These define variables as point estimates, usually conservative estimates, aimed at ensuring protection of the population. However, the output of such risk assessment does not provide information on which subgroups of the population could be higher risk, or of the variability and uncertainty of these estimates [11]

To allow risk managers to act with precision, the variability (the inherent difference between e.g. individuals in a population, concentrations in samples or any other property of the system being studied) must be described, and the impact of variability on the population’s and the individual’s risk of disease quantified. At the same time, quantification of the uncertainty (the lack of knowledge of a true value or relationship between values) in the risk estimates allows risk managers to judge how probable the size of the risk is for individuals in the population.

Additionally, in the case of food processing practices, consumers are ultimately their own risk managers and access to information on the probability of a harmful effect given their food consumption patterns will allow them to make more informed choices on food consumption behavior, e.g. frequency of consumption of barbecued meat [12].

Stochasticity may be the option to provide this information by describing the parameters in the risk assessment algorithm that are variable and/or uncertain by probability distributions [11]. Probabilistic risk assessment in food safety is an established and applied research area in quantitative microbial risk assessment [13] and in exposure assessments to chemicals [14, 15]. Probabilistic chemical risk assessments are still emerging, with methodologies developed such as the Integrated Probabilistic Risk Assessment(IPRA) [1618] and tools such as the Aproximate Probabilistic-tool (APROBA) [1921]. These take into account the uncertainty and variability in order to quantify the degree of conservatism in risk assessments for regulatory purposes.

The aim of this study was to develop a probabilistic model to estimate the extra lifetime risk (in terms of increased probability) of exposure to chemical contaminants in food, using BaP exposure from consumption of barbecued meat and fish as a case study, applying the available data representative of the Danish population. The specific objectives were to estimate the extra lifetime risk of cancer caused by the exposure to BaP from barbecued meat; 1) in the total adult Danish population and 2) in subgroups of the population and as a function of the frequency of events of consuming barbecued meat.

We took into account the variation in consumer behaviour and the variation in individual’s sensitivity to develop cancer after exposure to BaP, as well as the uncertainty in the conversion between the human and animal species and in the dose response relationship. We applied second order Monte Carlo simulation in order to keep separated the uncertainty domain from the variability domain, as they are inherently different properties, which must be taken into account in the interpretation of the results [11, 22].

Materials and methods

To address both objectives, we applied an event-based simulation scheme for the exposure assessment and a model extrapolation approach for estimating the risk of developing cancer. Fig 1 presents an overview of the model-structure. The data used and the modelling approaches applied for the exposure assessment and cancer risk estimation are described in the following. All algorithms and simulations were developed and performed in R version 3.3.1 [23].

thumbnail
Fig 1. Conceptual overview of the risk model.

The human exposure to benzo[a]pyrene (BaP) from barbecued meat consumed per event of barbecuing (BBQ event) was converted to an equivalent animal exposure in order to be combined with a dose-response relationship obtained from an animal study to estimate the extra lifetime risk of developing cancer.

https://doi.org/10.1371/journal.pone.0207032.g001

Exposure assessment

In the following, the data and modelling approaches applied for the exposure assessment is described.

Meat consumption.

We accounted for exposure to BaP through both meat and fish consumption. For simplicity, we refer to those as barbecued “meat”. Meat consumption data were obtained from the Danish National Survey on Diet and Physical Activity (DANSDA) from 2011-2013 [24], consisting of 7 day food-records from 3,804 individuals, along with sex, age (4-75 years old) and bodyweight for each individual. This survey is considered representative of the Danish population. We considered the food consumption of the adult population, i.e. from 16 years old and up to 75; a total of 1,461 men and 1,572 women. Individual meat consumption in DANSDA are given for 6 meals per day, but we only considered meat consumptions from dinner-eating occasions, which is typically a warm meal, as a proxy for lunch or dinner. We assumed that consumption of barbecued meat occurs in at most one meal per day. Only food consumption of individuals with reported bodyweight and only dinners with non-zero total consumption were considered. Each individual in the survey was assigned to a weight-class based on the 33rd and 67th quantiles of the observed body-weights in the consumption survey (Table 1). The number of weight classes (three) was chosen based on relevant group sizes from the study data, i.e. further subdivision would limit the number of participants in each class. For each weight class, the meat consumption in g/meal was described by a distinct gamma distribution (S1 Table). The empirical and fitted gamma cumulative density functions of each meat type are shown in Fig 2. To allocate a simulated individual to a weight-class, the relation between age, sex and bodyweight was evaluated based on the data in DANSDA. Different options for the relation were evaluated and the following was selected: (1) where β1 = −14.476, β2 = −0.829 and β3 = 36.406 (adjusted R-squared is 0.971 and residual standard error is 13.265). The error term, ϵ, is assumed to follow a normal distribution. The weight of an individual was simulated through Eq (1), with the standard deviation of the error term in the regression formula estimated by the residual standard error.

thumbnail
Fig 2. Cumulative distribution functions of meat consumption in g/meal for each sex and weight class.

A: The theoretical cumulative distribution functions of the fitted gamma distributions. B: The empirical and theoretical cumulative distribution functions of meat consumption for each sex and weight class. The red line in each graph represents the gamma distribution fitted to the meat consumptions. The black lines depict the empirical distributions and the black marks represent the observed consumed amounts of meat.

https://doi.org/10.1371/journal.pone.0207032.g002

Combination of meat types consumed.

For each event of consuming barbecued meat, we assumed that one individual would eat a maximum of two different meat types (S2 Table). In order to derive the frequency of type of meat consumed if only one meat is consumed (S3 Table) or the possible meat combinations as well as the partial consumption when two meat types are consumed (S4 Table), the consumption data were coupled with a survey conducted by Coop Denmark A/S in 2013 with 1,009 Danish respondents aged between 15 and 74 years [25].

Frequency of consumption of barbecued meat.

We assumed that all individuals in the Danish population who eat meat, eat barbecued meat at least once a year. Thus, the fraction of the population never consuming barbecued meat is the same as that of never eating meat, which was estimated to be 4% based on a consumer survey by Coop Denmark A/S [26]. We obtained information on the frequency of consuming barbecued meat from a consumer survey on barbecuing behaviour of 100 Danish households from a suburb to Copenhagen, Denmark [27]. Families consisted of 2-6 people each, either adults only or adults with children, an overall age range of 1-89 years, and equal distribution of men (50.3%) and women (49.7%). No information on the bodyweight of the participants was provided. Out of the 100 households, 76 (equal to 189 individuals) provided qualitative information on how often the household was barbecuing, which we translated into an annual number of consumption events. The scenarios for barbecuing frequency that we considered for the Danish population were: 1) less than once per month, i.e. 1-11 times per year; 2) at least once per month but less than once per week, i.e. 12-51 times per year; 3) at least once per week, i.e. 52-365 times per year. The median value for each scenario was selected to represent the scenario. The fraction of the Danish population belonging to each scenario was estimated based on the data from the 76 families (Table 2).

thumbnail
Table 2. Frequency of events of consuming barbequed meat per year for fractions of the Danish population.

https://doi.org/10.1371/journal.pone.0207032.t002

Concentration of BaP in meat types.

The concentration of BaP in meat after barbecuing (in μg/kg) was obtained for 407 samples of meat (242 from Denmark obtained from [28] and from unpublished monitoring data of commercially barbecued meat from 2012-2015; 136 from UK [29, 30]; and 29 from Sweden [31]). Eight meat and fish types were considered: beef (including veal), minced beef (burger patty), pork, pork sausages, lamb, poultry (mainly chicken), fish (mainly salmon) and shellfish. The concentration data from each country were combined for each food type, assuming that the data then reflects the variation in concentration of BaP under different conditions. Values for many samples were below the limit of detection (LOD) of the analytical method applied. After barbecuing all foods will be contaminated with BaP [32]. Therefore, apparent zeros were not regarded as “true zeros”, but rather as an expression of a low level of contamination between 0 μg/kg and the LOD. Note that LoD is not unique, but it varies across samples. The BaP concentrations for each food type were consequently described by a log-normal distribution as depicted in Fig 3 (S5 Table). To estimate the parameters of the log-normal distributions, we formulated the likelihood function taking the censoring at the various LODs into account [33]. However, for minced beef, we applied a 2-component lognormal mixture model on the censored data, since a single component lognormal described the data inadequately [34]. The maximum a posteriori estimation was used to assess the parameters of the 2-component lognormal mixture model, choosing appropriate priors.

thumbnail
Fig 3. Empirical and theoretical cumulative distribution functions for concentration of benzo[a]pyrene in each meat type.

The red lines in each graph represent the log-normal distributions fitted to the concentrations. The black lines depict the empirical distributions and the black marks represent the observed concentrations of benzo[a]pyrene (in μg/kg) of each sample of each meat type.

https://doi.org/10.1371/journal.pone.0207032.g003

Demographics.

To estimate the population exposure, we generated the sex and age distribution of the Danish population aged 16-75 years from the official statistics for the fourth quarter of 2017 (S1 Fig).

Modelling exposure.

To derive the population or subgroup risk, we estimated the yearly BaP exposure yi (in μg/kg bodyweight) through simulation of Bi barbecue events per year and per individual i by: (2) where Kib is the total number (Kib = 1, 2) of meat types consumed during a barbecue event b (b = 1, …, Bi) by individual i; xibk is the amount of meat k (k = 1, …, Kib) consumed by individual i at event b; cibk is the concentration of BaP in meat k consumed by individual i at event b; and wi is the bodyweight of individual i.

To simulate the Danish population, we generated the sex and age of individuals from the demographics data (S1 Fig). The bodyweight of the individuals was simulated through the regression model (Eq 1) and the individuals were assigned to a weight class (Table 1). For each individual, a number of barbecue events Bi among the possible scenarios was simulated (Table 2). For each barbecue event the consumed meat types and their partial consumption (S2, S3 and S4 Tables) were simulated independently of the individual’s weight class, while the total meat consumption was generated from the gamma distribution (S1 Table) defined for the weight class of the individual. The BaP concentration was randomly sampled from the log-normal distribution of the consumed meat types in (S5 Table). We simulated the exposure of 10,000 individuals to make up the population exposure distribution.

To estimate the exposure in the subgroups model as a function of the frequency of consuming barbecued meat, we also applied Eq (2), but now for each value of Bi from 1 to 100 (i.e. one event of consuming barbecued meat per year to 100 events per year). These simulations were performed for a “typical” individual of each weight class (low, medium, high) of each sex (i.e. 6 different subgroups), where the median bodyweight of each weight class (Table 1) represents the bodyweight wi (Eq 2) of an individual of this weight class. Similar to the population model, the total meat consumption of the individual was generated from the appropriate gamma distribution, along with the consumed meat types and their partial consumption, and the BaP concentration from the appropriate log-normal distribution. The yearly exposure was simulated for 5,000 individuals of each weight class.

Estimation of the extra lifetime risk of cancer

We applied a model extrapolation approach based on the integrated probabilistic risk assessment methodology for carcinogens [18, 35], to estimate the extra lifetime risk (in terms of increased probability) of cancer due to exposure to BaP from barbecued meat. Model extrapolation refers to the extrapolation of a dose response relationship beyond the observable range of doses used in the given dose response study. In the following, the data and modelling approaches applied for the cancer risk estimation is described.

Intra- and inter-species conversion.

In order to combine the human exposure (expressed as rate in μg/kg bodyweight) with an animal dose response relationship, the human exposure was converted to an equivalent animal exposure rate. In the conversion, intra- and interspecies difference was taken into account by multiplying the human exposure, yi, with conversion factors (CF) (also referred to elsewhere as extrapolation-, assessment- or uncertainty factors) describing these differences: (3) where expanimal,i is the animal exposure corresponding to individual i, CFintra,i is a conversion factor taking into account the inter-individual differences in the human population, CFinter,allometric and CFinter,TKTD are conversion factors taking into account the interspecies difference between humans and the animal species, mice in this study (see section below for details).

Conversion factors.

Conversion factors were used to express the animal exposure, expanimal,i, converted from the human exposure, yi. The conversion factors were described by probability distributions (Table 3). The intraspecies conversion factor (CFintra) accounts for the variation in sensitivity to the chemical between individuals in the human population. Since the size of the intraspecies variation is generally unknown, the geometric standard deviation, GSDCFintra is considered uncertain, which is reflected by a distribution around the GSD [18]. The interspecies difference is performed in two steps; 1) allometric scaling to correct the exposure that is expressed as a rate (i.e. dose per kg bodyweight) for differences in bodysize between humans and animals (CFinter,allometric) by: (4) where bwhuman is the median of the bodyweights reported in DANSDA for either the overall population or the defined subgroups, bwanimal is the weight of a mouse and assumed to be 30 grams, and AP is the allometric power [18], which is considered to be uncertain and expressed by a probability distribution. The second step accounts for the remaining interspecies difference relating to differences in toxicokinetics and -dynamics (CFinter,TKTD) between humans and animals, which is also assumed to be uncertain [18]. Due to lack of substance specific estimates, default distributions for CFintra, CFinter,allometric and CFinter,TKTD were applied [18] (Table 3).

thumbnail
Table 3. Model parameters and distributional assumptions.

https://doi.org/10.1371/journal.pone.0207032.t003

Dose-response relationship.

To derive the relationship between exposure to BaP and the risk of developing cancer, we used data on tumor formation in mice orally exposed to either of two coal tar mixtures [36]. The BaP content measured in the coal tar mixtures [37] was used as the dose. The number of all tumor bearing animals was used as response variable (S6 Table). Hence, we assumed that the composition of the PAH mixture present in barbecued meat is similar to the composition of PAH in the coal tar mixture, and subsequently that BaP is a surrogate for the total potency of all PAHs present in the coal tar mixtures. We performed dose-response modelling on the data using PROAST version 65.5 [38] developed in R [23]. The usual suit of models were fitted to the data and of the models accepted [39], we chose the most sensitive to estimate the extra lifetime risk, ERBaP, associated with the lifetime exposure to BaP, i.e. the model yielding the lowest BMDL10 (the benchmark dose lower limit, i.e. the 5th percentile of the distribution of doses at which 10% of the study animals get a tumor), which was the two-stage model: (5) where ERBaP is the extra lifetime risk of cancer due to BaP, expanimal is the animal exposure, b is the potency parameter and c is the shape parameter (Table 3). The model parameters b and c were generated by bootstrapping within PROAST [38].

Modelling risk.

As the human exposure distribution represents variability between individuals, CFinter,allometric, CFinter,TKTD and two-stage model parameters, b and c, represent uncertainty and CFintra represent both, two dimensional Monte Carlo simulation was performed to keep variability between consumers and uncertainty in the dose response separated [22]. For each individual in either the population or subgroups model, variability in the sensitivity to the chemical (CFintra) remained the same over the uncertainty iterations. In the subgroup model, the simulated values representing the uncertainty in CFs are the same for each subgroup. Simulations were performed with 10,000 and 5,000 iterations in the variability dimension and 2,000 and 1,000 iterations in the uncertainty dimension for the population risk model and subgroup risk model, respectively. The simulation algorithms for both models are given in S1 Algorithms.

Results

The simulated yearly exposure to BaP through consumption of barbecued meat in the Danish population (Eq 2) varied substantially between individuals, with a median of 0.07 μg/kg bodyweight and a 95th percentile of 0.29 μg/kg bodyweight. Fig 4 shows the yearly exposure to BaP on a log10 scale for the non-zero estimated values (i.e. 96.03% of the simulated population). This reflects the variability in the population in terms of frequency and amount of consumption of barbecued meat. While most of the population is estimated to have a low yearly exposure to BaP through barbecuing, some individuals appear to be highly exposed. Individuals with exposure above -0.3 on the log10 scale correspond to the 97.5th percentile of the Danish population.

thumbnail
Fig 4. Population exposure to benzo[a]pyrene (in μg/kgbodyweight/year) from barbecued meat on the log10 scale.

https://doi.org/10.1371/journal.pone.0207032.g004

With regards to the simulated exposure per barbecue event, men of low body weight had on average 9.1% and 20.2% higher exposure per event compared to men in the medium and high bodyweight classes, respectively (Fig 5A). Likewise, women in the low bodyweight class had on average 9.5% and 21.6% higher exposure per event of consuming barbecued meat compared to women belonging to the medium and high bodyweight classes, respectively (Fig 5B).

thumbnail
Fig 5. Exposure to benzo[a]pyrene (in μg/kgbodyweight/year) as a function of events of consuming barbecued meat per year.

A: Men, B: Women. Mean, 2.5th and 97.5th percentiles of the exposure simulated for 5,000 individuals per subgroup and per number of events from 1 to 100 per year.

https://doi.org/10.1371/journal.pone.0207032.g005

The mean extra lifetime risk of cancer due to exposure to BaP from barbecued meat in the Danish population was estimated to be 6.8 × 10−5 (median), with a 95% uncertainty interval of 2.6 × 10−7 − 7.0 × 10−4. The uncertainty distribution of the mean extra lifetime risk on a log10 scale is shown in Fig 6. The range reflects the uncertainty propagated from the model extrapolation and species conversion and translates into approximately 1 to 4,074 extra cancer cases (395 for the median of the mean risk) over a lifetime in the Danish population.

thumbnail
Fig 6. Uncertainty distribution of the mean extra lifetime risk of cancer due to exposure to benzo[a]pyrene from barbecued meat in the Danish population on the log10 scale.

The distribution represents the uncertainty of the mean extra lifetime risk in the Danish population. Each value of the mean extra lifetime risk (2,000 uncertainty iterations) is the average of the 10,000 individuals (variability) for a fixed setting of the uncertainty.

https://doi.org/10.1371/journal.pone.0207032.g006

The mean extra lifetime risk of cancer as a function of number of events of consumption of barbecued meat simulated for each sex and subgroup shows that men are at a higher risk than women of the corresponding bodyweight class, reflecting the differences in exposure (Fig 7A and 7B). The difference in risk between subgroups is attenuated by the allometric scaling. However, it is evident from our results that the uncertainty in the estimates makes the quantification of the health risk due to consumption of barbecued meat in the subgroups very imprecise, thus the variability among subgroups seems to be dwarfed by the uncertainty.

thumbnail
Fig 7. Uncertainty distribution of the mean extra lifetime risk of cancer as a function of events of consuming barbecued meat (BBQ events) for each sex and weight class.

A: Men, B: Women. For each barbecue event, the uncertainty distribution of the mean risk is represented by the mean, median, 5th and 95th percentiles. Each value of the mean extra lifetime risk (500 uncertainty iterations) is the average of the 5,000 individuals (variability) in each subgroup for a fixed setting of the uncertainty. Green dashed lines represent the median of the mean risk from the population model.

https://doi.org/10.1371/journal.pone.0207032.g007

The median of the mean extra lifetime risk estimated for the total population is indicated by the dashed line in each plot of Fig 7A and 7B. The number of consumption events to exceed the mean population risk is 26, 28 and 28 per year for men of low, medium and high body weight, respectively, and 31, 34 and 40 for women of low, medium and high body weight, respectively (Table 4). In the parenthesis in Table 4, the number of events for the 97.5th percentile to exceed the mean extra lifetime risk is given. It is for example seen that if men of low bodyweight consume barbecued meat three times per year they are 97.5% certain to exceed the median of the mean extra lifetime risk of the total population.

thumbnail
Table 4. Number of barbecuing events per year for the median (and 97.5th percentile) of the mean extra risk for each subgroup to exceed the median of the mean population risk.

https://doi.org/10.1371/journal.pone.0207032.t004

Discussion

Our study proposes a probabilistic approach to assess cancer risk as a function of consumer attributes. In this analysis, the frequency of consuming barbecued meat was modelled by applying an event-based simulation scheme for the exposure estimation, combined with a model extrapolation approach for the hazard characterization. Our model takes into account the inter-individual variation in the exposure and sensitivity to develop cancer after exposure to BaP in the population, and quantifies the uncertainties associated with the hazard characterization.

To account for the variability in the population in terms of different factors (e.g. food consumption habits, bodyweight, etc.) makes it possible to estimate the fraction of a (sub)population that is subject to a specific risk level. By probabilistically assessing exposure in an event-based manner, our approach allows for an assessment of individuals’ current practices (in this case frequency of consuming barbecued meat) and the associated probability of an adverse health effect (in this case developing cancer).

We estimated that the extra lifetime risk of cancer due to exposure to BaP from barbecued meat in the Danish population is between 1.7 × 10−7 (2.5th percentile) and 4.5 × 10−4 (97.5th percentile). Thus, the uncertainty makes quantification of the cancer risk due to barbecuing in both the population and subgroup models very imprecise. The implication of this in a policy making perspective is that the assessment of the health risk from barbecuing is imperfect. To imply a precautionary principle, the (95% uncertainty) interval indicates that a risk exceeding a one in a million or one in 100,000 extra risk of cancer over a lifetime, which is typically used as an acceptable risk, cannot be excluded [6, 40]. It should further be noted that the BaP concentrations in three of the most consumed meat types (pork, sausages and minced meat (S3 and S4 Tables)) are often exceeding the legally enforced maximum limit of 5 μg/kg (Fig 3).

By combining the population and subgroup models, we found that e.g. men and women of low bodyweight consuming barbecued meat 26 and 31 times per year, respectively, are above the median of the mean population risk (Table 4). However, information on the consumption frequency to exceed any other risk level of interest (e.g. the 95th percentile of the mean population risk, or a fixed risk level such as one in a million) may be derived from the model. Again, the variability between subgroups seems to be dwarfed by the large uncertainty.

The uncertainty interval only reflects the uncertainty propagated from the two-stage dose-response model and the inter- and intra-species conversion. Applying the model extrapolation approach (contrary a linear extrapolation) allowed for propagating the uncertainty in the cancer risk estimation; propagating the model uncertainty and the uncertainty in the exposure would improve our study, but would also naturally add to the range of uncertainty.

Our results support the opinion of the European Food Safety Agency that a (precise, i.e. with a small uncertainty interval) cancer risk estimate cannot be derived when low risks are concerned, why cancer risks from chemical dietary exposures in the European Union are now assessed by a Margin of Exposure (MOE) approach (i.e. a ratio of the BMDL to the observed exposure below 10,000 constitutes a concern to human health) [4042].

Comparison with other studies

Other exposure and risk assessments of BaP exposure from food including barbecued meat have been performed e.g. [43, 44]. In the two most relevant studies conducted in Scandinavia, population exposure to BaP was assessed deterministically for Sweden [32] and Norway [45], both assuming a 70 kg bodyweight. Exposure to BaP from barbecued meat to be 0.0062 μg/kg bodyweight per year and 2.665 μg/kg bodyweight per year. These values are approximately 11 times lower and 38 times higher, respectively, than our exposure estimate (0.07 μg/kg bodyweight per year). The discrepancies in exposure among these three studies can be explained by the different model assumptions in the number of events per year, the amounts of meat consumed per event and the BaP concentrations in the consumed meat. The Norwegian study applied a conservative approach where BaP concentrations in meat types where intended to be the highest identified in the literature [45]; which most likely results in the 38 times higher exposure estimate.

No quantitative estimates of the risk were reported in [32] and [45], however MOEs of 5,000,000 and 13,611, respectively, were calculated using the above reported exposures (expressed per day) and a BMDL for a 10% incidence of 100 μg/kg bodyweight/day as estimated by JECFA [6] based on the same animal study that we used. If assuming a linear extrapolation from JECFA’s BMDL, the BaP exposures in [32] and [45] result in risk estimates of less than 10−7 and 7.3 × 10−6, respectively. It should be noted that the latter is one ninth lower than our estimated median of the mean extra lifetime risk (6.8 × 10−5) despite the exposure in [45] being 38 times higher and the assumption of the linear extrapolation, which is usually considered a conservative approach. This can partly be explained by the approach and assumptions applied in JECFAs modelling of the BMDL; i.e. based on the same animal study, EFSA arrived at a BMDL of 70 μg/kg bodyweight/day [7], from which a risk of 1.04 × 10−5 can be derived by linear extrapolation. The risk estimate is still within our 95% uncertainty interval, but indicates that an assumption of linearity below the observable dose range is not necessarily conservative, highlighting the importance of quantifying the uncertainty in the dose response relationship, as also suggested in [18].

Another recent study also presented probabilistic estimates of concentration of PAH’s including BaP in meat and bread, predicted by use of a meta-analysis approach in which key factors (e.g. cooking method, time, temperature, meat cuts etc.) influencing the formation of the compounds were identified in the literature, analysed and taken into account [46]. While it is very relevant to take those factors into account in exposure modelling of process contaminants, the advantage of our concentration datasets is that they are obtained from a wide range of barbecue settings, both private, commercial and experimental, and thus the fitted distributions should represent the possible range of concentrations of BaP in barbecued meat and reflect the influence of various factors. However, if such dataset is not available, the approach proposed in [46] is recommended. The concentration levels predicted in [46] were combined with consumption data to estimate exposure in the US population [47]; exposure to BaP from barbecued beef was reported to 0.15 μg/kg bw/year, assuming a 70 kg bodyweight, which is considerably higher than our estimate.

It is relevant to discuss our findings in relation to epidemiological evidence on the association between BaP and/or barbecued meat consumption and the risk of cancer. However, this evidence is sparse. To our knowledge, a single case control study identified a positive statistical significant association between BaP in processed red meat and rectal cancer, however no quantification of the risk by the incremental increase in exposure was reported [48]. The same study did not find an association between colorectal cancer and exposure to grilled/barbecued meat. It has been speculated whether the statistical power in observational studies is large enough to be able to detect cancer risks in the same magnitude as our results, especially when exposures occur via mulitple routes [49]. The multi-causal nature of cancer may hamper the ability to detect a statistical significant association between a single compound or cooking method, also taking into account residual confounding and the risk of misclassification bias [50].

Assumptions and limitations

Due to lack of data, several assumptions were made in this study. These may affect the representativeness of the input distributions, but were not translated into a quantitative estimate of uncertainty. All assumptions are listed in Table 5, as is the potential impact these assumption may have on the estimations.

thumbnail
Table 5. List of assumptions and potential impact on the estimates.

https://doi.org/10.1371/journal.pone.0207032.t005

Besides the listed assumptions, our study suffered from various limitations. An important limitation in the population model is the data used to inform on the frequency of consuming barbecued meat in the Danish population. These data are only based on qualitative information from 76 families living in a suburbian area (in houses rather than highrise buildings) and we do not know how representative the sample is of the total Danish population. Besides, we assumed that only vegetarians (estimated 4% of the Danish population) do not consume barbecued meat. However, the proportion of the population not consuming barbecued meat may very well be influenced by other factors such as access to a barbecue etc. For comparison, a Norwegian survey on barbecuing behaviour including 1,003 participants reported 26% barbecuing more than 17 times/year, 34% barbecuing 6-17 times/year and 27% barbecuing less than 6 times per year [45]. In comparison, our data seem to overestimate the barbecuing frequency and thus also the population risk. To our knowledge, no other data on the frequency of consuming barbecued meat in the Danish population are available. Diets change over time and will impact the lifetime risk of individuals. The consumption data derived from DANSDA do not reflect this variation over time of the individual, which is a limitation of the dataset. However, we simulate the variation in the annual exposure of the (sub)populations, which then represents a snapshot of the (sub)population’s exposure. In this way the change in diet over time is taken into account and is reflected in the extra life time risk of the population.

In Eq (1), which determines the weight of the simulated individual based on sex and age, there is a tendency of the residuals not being completely symmetrical, which means that the variability in the generated population is not fully accounted for. Also other factors besides sex and age could be considered when estimating an individuals weight, e.g. height.

Furthermore, our models suffered from the challenge of combining data from a vast range of sources. This inflicts inconsistency e.g. in the categorization of meat types consumed and meat types sampled for BaP content. Also, this combination of datasets adds to the overall uncertainty of the final estimates.

We only considered BaP in this study. However, a variety of carcinogenic PAHs are formed during barbecuing, together with other carcinogenic compounds such as heterocyclic aromatic amines, and thus the risk of cancer due to consumption of barbecued meat is likely higher [52]. EFSA and others have concluded that BaP is not a good surrogate for other PAH’s [7, 47], so probabilistic modelling of each of the other PAHs would be necessary to include them in our study. We also did not consider exposure to BaP (or other PAHs) from other sources. The main sources of BaP and other PAHs from foods in Denmark are cereals, vegetables and milk; the mean exposure from all food sources is 1.41 μg/kg bodyweight per year, assuming a 70 kg bodyweight [28]. This suggests that the contribution of barbecued meat to the total dietary exposure is approximately 5%. Smoking and air pollution are other major sources of BaP exposure [53]. Therefore, other dietary sources, smoking and the environment likely contribute greatly to the cancer risk. Since our dose response relationship is not linear, it would be relevant to assess the “acceptable” frequency of consuming barbecued meat taking these background exposures into consideration. Likewise, a risk assessment of the aggregated exposure to PAH and other carcinogenic compounds in barbecued meat would give a more comprehensive estimate of the cancer risk; an assessment of the risk from other food sources via our proposed event-based simulation approach would improve our study and provide valuable information on the relative contribution to the risk of cancer in the various subpopulations from different foodgroups.

Future application of the model

Our model defined subgroups by predicting meat consumption based on information on sex, age and bodyweight obtained from the Danish national food consumption survey. In future applications, the approach can be adapted to further define subgroups on the basis of other characteristics (e.g. socio-economics status, genetics, etc.). Because this approach is able to quantify and characterize the variability in a population, it allows for the formulation of mitigation strategies that are targeted to subgroups of higher risk. It also allows for more effective risk communication, which can be customized to these specific groups by accounting for their current behaviour [12, 54].

Conclusion

This study showed that the risk of cancer due to exposure to BaP in barbecued meat may not be negligible for highly exposed individuals. The proposed model can be applied to other assessments and allows for deriving the change in risk following a specific change in behaviour. We argue that in the future it can serve as a valuable tool for risk managers as it enables them to advise a change in behaviour according to a specific risk level that may be found acceptable in a given population.

Supporting information

S1 Fig. Age and sex demographics of the Danish population.

https://doi.org/10.1371/journal.pone.0207032.s001

(PDF)

S1 Table. Parameters for the gamma distributions of meat consumption.

https://doi.org/10.1371/journal.pone.0207032.s002

(PDF)

S2 Table. Frequency of consuming one or two types of meat per eating occasion.

https://doi.org/10.1371/journal.pone.0207032.s003

(PDF)

S3 Table. Frequency of type of meat consumed, if one meat per meal is consumed.

https://doi.org/10.1371/journal.pone.0207032.s004

(PDF)

S4 Table. Frequency of type of meat and fraction of total meat consumed, if two meat types are consumed.

https://doi.org/10.1371/journal.pone.0207032.s005

(PDF)

S5 Table. Parameters for the censored log-normal distributions of concentration of Bap in barbecued meat.

https://doi.org/10.1371/journal.pone.0207032.s006

(PDF)

S6 Table. Dose response data of BaP in coal tar mixtures and tumor bearing mice from [36] as reported in [37] and [7].

https://doi.org/10.1371/journal.pone.0207032.s007

(PDF)

References

  1. 1. Bouvard V, Loomis D, Guyton KZ, Grosse Y, Ghissassi FEl, Benbrahim-Tallaa L, et al. Carcinogenicity of consumption of red and processed meat. The Lancet Oncology. 2015;16(16):1599–1600. pmid:26514947
  2. 2. Demeyer D, Mertens B, De Smet S, Ulens M. Mechanisms Linking Colorectal Cancer to the Consumption of (Processed) Red Meat: A Review. Critical Reviews in Food Science and Nutrition. 2016;56:2747–2766. pmid:25975275
  3. 3. Jägerstad M, Skog K. Genotoxicity of heat-processed foods. Mutation Research/Fundamental and Molecular Mechanisms of Mutagenesis. 2005;574:156–172. pmid:15914214
  4. 4. Duedahl-Olesen L, Aaslyng M, Meinert L, Christensen T, Jensen AH, Binderup ML. Polycyclic aromatic hydrocarbons (PAH) in Danish barbecued meat. Food Control. 2015;57:169–176.
  5. 5. Scientific Committee on Food. Opinion of the Scientific Committee on Food on the risk to human health of Polycyclic Aromatic Hydrocarbons in food. European Commission Health and Consumer Protection Directorate-General SCF/CS/CNTM/PAH/29 Final; 2002. Available from: https://ec.europa.eu/food/sites/food/files/safety/docs/sci-com_scf_out153_en.pdf.
  6. 6. Joint FAO/WHO Expert Committe on Food Additives (JECFA). Evaluation of certain contaminants in food: sixty-fourth report of the Joint FAO/WHO Expert Committee on Food Additives. Geneva: World Health Organization; 2006. Available from: http://apps.who.int/iris/handle/10665/43258.
  7. 7. European Food Safety Authority (EFSA). Scientific Opinion of the Panel on Contaminants in the Food Chain on a request from the European Commission on Polycyclic Aromatic Hydrocarbons in Food. The EFSA Journal. 2008;724:1–114.
  8. 8. International Agency for Research on Cancer (IARC). Benzo[a]pyrene. IARC monographs on the evaluation of carcinogenic risks to humans, volume 100F Chemical agents and related occupations. 2012; p. 1–144.
  9. 9. European Commission. Commission Regulation (EU) No 835/2011 of 19 August 2011 amending Regulation (EC) No 1881/2006 as regards maximum levels for polycyclic aromatic hydrocarbons in foodstuffs. Official Journal of the European Union. 2011;215(4):4–8.
  10. 10. Danish Veterinary and Food Administration. Sådan undgår du tjærestoffer (PAH) i din mad. In Danish; 2016. Available from: https://www.foedevarestyrelsen.dk/Selvbetjening/Guides/Kend_kemien/Sider/Saadan-undgaar-du-tjaerestoffer-PAH-i-din-mad.aspx [cited 2018-04-15].
  11. 11. US Environmental Protection Agency (USEPA). Risk Assessment Forum White Paper: Probabilistic Risk Assessment Methods and Case Studies. EPA/100/R-09/001A. Washington D.C.: Risk Assessment Forum, Office of the Science Advisor, USEPA; 2014.
  12. 12. Frewer LJ, Fischer ARH, Brennan M, Bánáti D, Lion R, Meertens RM, et al. Risk/Benefit Communication about Food—A Systematic Review of the Literature. Critical Reviews in Food Science and Nutrition. 2016;56(10):1728–1745. pmid:25575335
  13. 13. Havelaar AH, Evers EG, Nauta MJ. Challenges of quantitative microbial risk assessment at EU level. Trends in Food Science & Technology. 2008;19:S26–S33.
  14. 14. European Food Safety Authority (EFSA). Guidance on the Use of Probabilistic Methodology for Modelling Dietary Exposure to Pesticide Residues. EFSA Journal. 2012;10(10):2839.
  15. 15. van Donkersgoed G, Christodoulou D, Crépet A, D’Addezio L, Desvignes V, Ericsson BG, et al. Cumulative dietary exposure to a selected group of pesticides of the triazole group in different European countries according to the EFSA guidance on probabilistic modelling. Food and Chemical Toxicology. 2015;79:13–31. pmid:25125392
  16. 16. Van Der Voet H, Slob W. Integration of probabilistic exposure assessment and probabilistic hazard characterization. Risk Analysis. 2007;27(2):351–371. pmid:17511703
  17. 17. van der Voet H, van der Heijden GWAM, Bos PMJ, Bosgra S, Boon PE, Muri SD, et al. A model for probabilistic health impact assessment of exposure to food chemicals. Food and Chemical Toxicology. 2009;47(12):2926–2940. pmid:19150381
  18. 18. Slob W, Bakker MI, te Biesebeek JD, Bokkers BGH. Exploring the Uncertainties in Cancer Risk Assessment Using the Integrated Probabilistic Risk Assessment (IPRA) Approach. Risk Analysis. 2014;34(8):1401–1422. pmid:24766324
  19. 19. Chiu WA, Slob W. A Unified Probabilistic Framework for Dose Response Assessment of Human Health Effects. Environmental Health Perspectives. 2015;123(12).
  20. 20. Bokkers BGH, Mengelers MJ, Bakker MI, Chiu WA, Slob W. APROBA-Plus: A probabilistic tool to evaluate and express uncertainty in hazard characterization and exposure assessment of substances. Food and Chemical Toxicology. 2017;110:408–417. pmid:29074418
  21. 21. International Programme on Chemical Safety (IPCS). Guidance document on evaluating and expressing uncertainty in hazard characterization—2nd edition. Geneva: World Health Organization; 2018. Available from: http://apps.who.int/bookorders.
  22. 22. Nauta MJ. Separation of uncertainty and variability in quantitative microbial risk assessment models. International Journal of Food Microbiology. 2000;57:9–18.
  23. 23. R Core Team. R: A language and environment for statistical computing.; 2015. Available from: http://www.r-project.org/.
  24. 24. Pedersn AN, Rosenlund MR, Sørensen LM, Matthiessen J. Kostvaner, sundhedsadfærd og vægtstatus blandt 55-64-årige og 65-75-årige danskere. In Danish, English abstract. National Food Institute, Technical University of Denmark.; 2017. Available from: http://www.forskningsdatabasen.dk/en/catalog/2370993112.
  25. 25. Coop Denmark A/S. Grillen øger mængden ad kød; 2013. Available from: https://coopanalyse.dk/analyse/grillen-%C3%B8ger-m%C3%A6ngden-af-k%C3%B8d [cited 2017-05-01].
  26. 26. Roland T, Poulsen D, Steenberg M, Belitz M, Falk J. Danskernes Madvaner—2016. In Danish.; 2016. Available from: https://om.coop.dk/Upload/om.coop.dk/Publikationer/analyser/DanskernesMadvaner2016_CoopAnalyse.pdf [cited 2017–05-01].
  27. 27. Aaslyng MD, Duedahl-Olesen L, Jensen K, Meinert L. Content of heterocyclic amines and polycyclic aromatic hydrocarbons in pork, beef and chicken barbecued at home by Danish consumers. Meat Science. 2013;93:85–91. pmid:22910802
  28. 28. Petersen A, Fromberg A, Andersen JH, Sloth JJ, Granby K, Duedahl-Olesen L, et al. Chemical Contaminants, Food monitoring 2004-2011. Søborg: National Food Institute, Technical University of Denmark; 2015. Available from: www.food.dtu.dk.
  29. 29. Rose M, Holland J, Dowding A, Petch S, White S, Fernandes A, et al. Investigation into the formation of PAHs in foods prepared in the home to determine the effects of frying, grilling, barbecuing, toasting and roasting. Food and Chemical Toxicology. 2015;78:1–9. pmid:25633345
  30. 30. Food Standards Agency. Investigation of the formation of PAHs in foods prepared in the home and from catering outlets to determine the effects of frying, grilling, barbecuing, toasting and roasting, Report no. FD 06/13. York: Food Standards Agency; 2007. March.
  31. 31. National Food Agency Sweden (Livsmedels Verket). Halt av polycykliska aromatiska kolvaten (PAH) i livsmedel—metfetter, spannmålsprodukter, kosttillskott, chokold, grillat kott och grontsager. Sammenstallning av analyseresultat 2008-2013. In Swedish.; 2013. Available from: https://www.livsmedelsverket.se/globalassets/publikationsdatabas/rapporter/2013/2013_livsmedelsverket_28_pah_i_livsmedel_2008-2013.pdf [cited 2017-02-07].
  32. 32. Abramsson-Zetterberg L, Darnerud O, Wretling S. Low intake of polycyclic aromatic hydrocarbons in Sweden: Results based on market basket data and a barbecue study. Food and Chemical Toxicology. 2014;74:107–111. pmid:25261863
  33. 33. Lawless J. Statistical Models and Methods for Lifetime Data. 2nd ed. Hoboken, NJ, USA: John Wiley & Sons, Inc.; 2003.
  34. 34. McLachlan G, Peel D. Finite Mixture Models. Shewhart WA, Wilks SS, editors. Wiley Series in Probability and Statistics. Hoboken NJ, USA: John Wiley & Sons, Inc.; 2000. Available from: http://doi.wiley.com/10.1002/0471721182.
  35. 35. Slob W, Bokkers BGH, Van Der Heijden GWAM, van der Voet H, Van Der Voet H. Integrated Probabilistic Risk Assessment (IPRA) for carcinogens: A first exploration. RIVM Report 320121002/2011. Bilthoven: National Institute for Public Health and the Environment (RIVM); 2011.
  36. 36. Culp S, Gaylor DW, Sheldon WG, Goldstein LS, Beland FA. A comparison of the tumors induced by coal tar and benzo[a]pyrene in a 2-year bioassay. Carcinogenesis. 1998;19(1):117–124. pmid:9472702
  37. 37. Schneider K, Roller M, Kalberlah F, Schuhmacher-Wolz U. Cancer risk assessment for oral exposure to PAH mixtures. Journal of Applied Toxicology. 2002;22(1):73–83. pmid:11807932
  38. 38. Slob W, Cotton R. Proast 65.5: Benchmark Dose modelling. Bilthoven; 2016.
  39. 39. European Food Safety Authority (EFSA). Guidance of the scientific committee on a request from EFSA on the use of the benchmark dose approach in risk assessment. The EFSA Journal. 2009;1150:1–72.
  40. 40. Barlow S, Renwick AG, Kleiner J, Bridges JW, Busk L, Dybing E, et al. Risk assessment of substances that are both genotoxic and carcinogenic. Report of an International Conference organized by EFSA and WHO with support of ILSI Europe. Food and Chemical Toxicology. 2006;44:1636–1650.
  41. 41. European Food Safety Authority (EFSA). Opinion of the Scientific Committee on a request from EFSA related to A Harmonised Approach for Risk Assessment of Substances Which are both Genotoxic and Carcinogenic. EFSA Journal. 2005;3(10):282.
  42. 42. Benford D, Bolger PM, Carthew P, Coulet M, Dinovi M, Leblanc JC, et al. Application of the Margin of Exposure (MOE) approach to substances in food that are genotoxic and carcinogenic. Food and Chemical Toxicology. 2010;48:S2–S24. pmid:20113851
  43. 43. Alomirah H, Al-Zenki S, Al-Hooti S, Zaghloul S, Sawaya W, Ahmed N, et al. Concentrations and dietary exposure to polycyclic aromatic hydrocarbons (PAHs) from grilled and smoked foods. Food Control. 2011;22:2028–2035.
  44. 44. Xia Z, Duan X, Qiu W, Liu D, Wang B, Tao S, et al. Health risk assessment on dietary exposure to polycyclic aromatic hydrocarbons (PAHs) in Taiyuan, China. Science of The Total Environment. 2010;408(22):5331–5337. pmid:20800879
  45. 45. Vitenskapskomiteen for Mattryghet (VKM). Vurdering af helserisiko ved konsum av grillet mat. In Norwegian, English summary.; 2007. Available from: https://vkm.no/download/18.d44969415d027c43cf13d2b/1501076859247/dccfd1091c.pdf [cited 2017-05-05].
  46. 46. Pouzou JG, Costard S, Zagmutt FJ. Probabilistic estimates of heterocyclic amines and polycyclic aromatic hydrocarbons concentrations in meats and breads applicable to exposure assessments. Food and Chemical Toxicology. 2018;
  47. 47. Pouzou JG, Costard S, Zagmult FJ. Probabilistic assessment of dietary exposure to heterocyclic amines and polycyclic aromatic hydrocarbons from consumption of meats and breads in the United States. Food and Chemical Toxicology. 2018;
  48. 48. Miller PE, Lazarus P, Lesko SM, Cross AJ, Sinha R, Laio J, et al. Meat-related compounds and colorectal cancer risk by anatomical subsite. Nutrition and Cancer. 2013;65(2):202–226. pmid:23441608
  49. 49. Tornqvist M, Paulsson B, Vikstrom AC, Granath F. Approach for cancer risk estimation of acrylamide in food on the basis of animal cancer tests and in vivo dosimetry. Journal of Agricultural and Food Chemistry. 2008;56(15):6004–6012. pmid:18624431
  50. 50. Hogervorst JGF, Baars BJ, Schouten LJ, Konings EJM, Goldbohm RA, van den Brandt PA. The carcinogenicity of dietary acrylamide intake: a comparative discussion of epidemiological and experimental animal research. Critical reviews in toxicology. 2010;40(6):485–512. pmid:20170357
  51. 51. McAfee AJ, McSorley EM, Cuskelly GJ, Moss BW, Wallace JMW, Bonham MP, et al. Red meat consumption: An overview of the risks and benefits. Meat Science. 2010;84(1):1–13. pmid:20374748
  52. 52. Ahmad Kamal NH, Selamat J, Sanny M. Simultaneous formation of polycyclic aromatic hydrocarbons (PAHs) and heterocyclic aromatic amines (HCAs) in gas-grilled beef satay at different temperatures. Food Additives & Contaminants: Part A. 2018;35(5):848–869.
  53. 53. Amarillo AC, An I, Busso T, Carreras H. Exposure to polycyclic aromatic hydrocarbons in urban environments: Health risk assessment by age groups. Environmental Pollution. 2014;195:157–162. pmid:25240188
  54. 54. Morgan MG. Risk analysis and Management. Scientific American. 1993;269:24–30.