Since electronic cigarette (ECIG) introduction to American markets in 2007, vaping has surged in popularity. Many, including women of reproductive age, also believe that ECIG use is safer than traditional tobacco cigarettes and is not hazardous when pregnant. However, there are few studies investigating the effects of ECIG exposure on the developing embryo and nothing is known about potential effects on craniofacial development. Therefore, we have tested the effects of several aerosolized e-cigarette liquids (e-cigAM) in an in vivo craniofacial model, Xenopus laevis, as well as a mammalian neural crest cell line. Results demonstrate that e-cigAM exposure during embryonic development induces a variety of defects, including median facial clefts and midface hypoplasia in two of e-cigAMs tested e-cigAMs. Detailed quantitative analyses of the facial morphology revealed that nicotine is not the main factor in inducing craniofacial defects, but can exacerbate the effects of the other e-liquid components. Additionally, while two different e-cigAMs can have very similar consequences on facial appearances, there are subtle differences that could be due to the differences in e-cigAM components. Further assessment of embryos exposed to these particular e-cigAMs revealed cranial cartilage and muscle defects and a reduction in the blood supply to the face. Finally, the expression of markers for vascular and cartilage differentiation was reduced in a mammalian neural crest cell line corroborating the in vivo effects. Our work is the first to show that ECIG use could pose a potential hazard to the developing embryo and cause craniofacial birth defects. This emphasizes the need for more testing and regulation of this new popular product.
Citation: Kennedy AE, Kandalam S, Olivares-Navarrete R, Dickinson AJG (2017) E-cigarette aerosol exposure can cause craniofacial defects in Xenopus laevis embryos and mammalian neural crest cells. PLoS ONE 12(9): e0185729. https://doi.org/10.1371/journal.pone.0185729
Editor: Michael Klymkowsky, University of Colorado Boulder, UNITED STATES
Received: July 6, 2017; Accepted: September 18, 2017; Published: September 28, 2017
Copyright: © 2017 Kennedy et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This study was supported by NIDCR 5R56DE026024-02 to Olivares-Navarrete and Dickinson co-PIs. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
E-cigarettes (ECIGs) are battery-powered nicotine delivery systems that are advertised as a safe alternative to tobacco smoking [1–3]. The ECIG device contains a reservoir filled with an e-liquid that is heated by an atomizer to produce an aerosol that is inhaled by the user. These e-liquids are comprised of nicotine, flavor additives, and compounds that aid in delivery . While ECIGs were initially marketed as a tobacco cessation tool, they have since become a global trend for recreational use. The number of young people using ECIGs has increased by almost 10 -fold over the past five years , and the rates of ECIG use among women in the USA are also substantially increasing . Most concerning is that some pregnant women use ECIGs  , believing that they are safer than traditional tobacco cigarettes [7, 9] and only associated with minor health hazards . However, little is known about the effects of ECIG aerosol mixtures (e-cigAM) on human health, and even less is known about the potential impact on the developing embryo.
It is well established that traditional cigarette smoking can increase the risk for craniofacial defects such as cleft palate [11–17]. Based on studies in animal models, at least some of these defects can be attributed to the teratogenic effects of the chemicals that are present in cigarette smoke [18–21]. On the other hand, it is less clear whether other chemicals produced by ECIG use could also perturb facial development.
The main components of e-liquids are nicotine, propylene glycol, vegetable glycerin, water and many different flavor additives, . The federal government has only just recently begun to regulate the composition of these e-liquids , in part due to the inaccuracy in ingredients reported by manufacturers and their unknown effects on human health [5, 23, 24]. For example, the heating process of propylene glycol can produce toxicants such as acrolein, formaldehyde, and benzene, while glycerin can decompose to form reactive aldehydes [25, 26] [27–29]. Additional compounds such as hemiformals, glycidol, dihydroxyacetone, and vinyl alcohol isomers have been found in chemical analysis of ECIG aerosols, all of which can have adverse human health effects . Even more concerning is the endless numbers of flavor compounds in e-liquids, many of which are aromatic aldehydes such as benzaldehyde and vanillin . While the effects of these aldehydes on their own are not clear, oxidation upon heating can convert them to benzoic acid and benzene which are known carcinogens . Further, additives that give a “buttery” or “creamy” flavor can produce another potentially dangerous compound when heated called diacetyl [33–35]. Occupational exposure to diacetyl in food production facilities that produce microwave popcorn, cookies, cereal, chocolate, and coffee can cause bronchiolitis obliterans, commonly known as “popcorn lung”  [37–39]. This lung disease is characterized by fibroproliferative airway lesions and decrements in lung function [39, 40]. Thus, despite the public perception that flavor compounds are safe for human health, there is growing evidence that aerosolization could convert such seemingly safe compounds to chemicals that in fact pose potential human health hazards.
Not only could aerosolized e-liquid exposure be a health risk to an adult user but also to an unborn child. There are currently only a few studies that have tested the effects of ECIGs on developing embryos, but those that have indicate a potential hazard could exist. For example, zebrafish larvae exposed to aerosols produced by a tobacco flavored e-liquid result in heart defects . In developing mice, the same flavored ECIG aerosol, results in the reduction of neurodevelopmental gene expression, especially growth factors, in the frontal cortex . We also know that propylene glycol exposure alone can also cause a range of developmental defects, including smaller size, in zebrafish embryos .
In order to determine if the chemicals produced by ECIG aerosolization affects embryonic development, specifically craniofacial formation, we have turned to the developmental model Xenopus laevis. This species is amenable to screening studies since they are free living, large in size, develop rapidly, and can be obtained in great numbers  add more refs. Further, Xenopus is emerging as an effective model to understand craniofacial development [45–52]. The orofacial region is readily visible, unlike other model vertebrates where head flexure obscures easy viewing of the face, making evaluation of craniofacial development faster and easier . Further, we have also developed a quantitative method to assess X. laevis orofacial morphology that can uncover subtle differences in orofacial shape and size [53–56].
In the present study we investigate whether chemicals produced by e-liquid aerosolization can adversely affect embryonic development, in particular craniofacial formation. Here, specific ECIG aerosol mixtures (e-cigAMs) that perturb orofacial morphology, cranial cartilage and muscle development as well as reduce cranial blood formation were identified. The same particular e-cigAMs also reduce the expression of vascular and cartilage differentiation factors and cell vitality in mammalian neural crest cells. The results emphasize the need for further testing of e-liquids, since they could cause serious craniofacial birth defects such as cleft palate.
Materials and methods
Aerosolized e-liquid mixtures (E-cigAM) was prepared by attaching a 1.6 ohm atomizer (Aspire K2 Quick Starter Kit, 1.8 mL tank) into a syringe pump (NE-8000, New Era Pump Systems Inc., Farmingdale, NY) and aerating ECIG vapor into 1 mL of phosphate buffered saline (PBS) for cell studies, and 1 mL of 0.1X Modified Barth’s Saline Solution (MBS) for in-vivo studies (Fig 1A). E-cigAMs were generated using Lab Grade or a variety of flavored e-liquids (Table 1). The topography used to generate the e-cigAM was based on recent reports of topography of experienced users . Briefly, a series of 10 3.5-second puffs (55 mL) with 30 second intervals between each puff was considered one “vaping session”. The e-cigAM solutions were then diluted in cell culture media or 0.1X Modified Barth’s Saline Solution (MBS) to achieve the desired experimental concentrations. E-cigAM was prepared the day before use and stored at -80° Celsius until needed.
(A) Preparation of e-cigAM stock solution. ECIG vapor was aerated into 1 mL of 0.1X MBS by a 1.6 ohm atomizer attached to a syringe pump following a topography profile of: 3.5-second puffs (55 mL)with 30 second intervals between each puff for a series of 10. (B) Experimental set-up for X.laevis embryos. Embryos were arrayed in 6-well culture dishes in a 1:100 dilution of e-cigAM in 0.1X MBS. (C) E-cigAM exposure paradigm for qualitative and quantitative analysis. Embryos were exposed to e-cigAM from the 2-cell stage (1.5 hpf) to stage 43 (87 hpf).
X. laevis embryo e-cigAM exposures
Embryos were collected using standard procedures  approved by the VCU Institutional Animal Care and Use Committee (IACUC protocol number 5AD20261). Eggs were collected from two different females for each biological replicate. Experiments were set up in a laminar flow hood using semi-sterile conditions, in which autoclaved 0.1X Modified Barth’s Saline solution (MBS, pH 7.8), and UV-sterilized well dishes and transfer pipettes were used. In treatment paradigm 1, embryos were arrayed in 4 mL of 0.1X MBS in a 6-well culture dish with 40 μL (1:100 dilution) of e-cigAM stock solutions (Table 1). The media and e-cigAM was refreshed the next day. At stage 35 (50 hours post fertilization, hpf), embryos were transferred to 15 mm Petri dishes containing the same 1:100 dilution of e-cigAM stock solution in 0.1X MBS for a final volume of 15 mL. For craniofacial tissue analyses, e-cigAM exposures began at stage 22–24 (24–26 hpf) using the same procedures. All embryos were maintained at 23°C in an Echotherm incubator (Torrey Pines Scientific, cat #: IN30) throughout treatment until stage 43 or 45 for further analysis (88–98 hpf; Fig 1B and 1C).
Quantifying orofacial shape and size
Once embryos reached stage 43 (88 hpf), they were fixed in 4% paraformaldehyde (PFA) overnight at 4°C. A sterile disposable No. 15 scalpel (VWR, cat. no: 82029–856) and Dumont No. 5 forceps (Fisher, cat. no: NC9404145) were used to make two cuts to isolate the head; first, at the posterior end of the gut and then second just behind the gills. Isolated heads were then mounted in small holes in a custom made clay-lined dish containing Phosphate Buffered Saline Solution with Tween (PBT) . The faces were imaged using a Discovery.V8 stereoscope fitted with a GmbH digital camera (Zeiss). AxioVision40 V.126.96.36.199 software (Zeiss) and ImageJ (NIH) were used to perform all standard measurements. Such measurements included the: 1) intercanthal distance, which is the distance between the eyes, measured in Axiovision software, 2) face height, which is the distance between the top of the eyes and the top of the cement gland at the midline, measured in Axiovision software, 3) mouth roundness, which is the inverse aspect ratio of (4area)/(major axis2) applied to mouth outlines, measured in ImageJ, and 4) dorsal mouth angle, which is the angle created by drawing lines from the dorsal midline of the mouth to each labial commissure, measured in ImageJ. For all facial measurements, Student’s t-test assuming unequal variance between each e-cigAM group and controls was performed using VassarStats to determine statistical relationships. For bar graphs, data collected for the e-cigAM exposure groups were scaled so that the controls equaled 100 for graphical comparison. Error bars represent standard error calculated in Excel. Whisker plots were created using SigmaPlot software and whiskers represent minimum and maximum data points.
A total of 33 landmarks were placed on tadpole faces using the Pointpicker plugin of ImageJ (NIH) (S1 Fig). Landmarks 1–5 were placed on the midline of the mouth and the face between the top of the cement gland and the top of the eyes. Landmarks 6–17 outlined each eye. Landmarks 18–27 completed the outline of the midface region from the center of the eyes to the top of the cement gland, eliminating variation due to forebrain or cement gland size. Landmarks 22–33 outlined the mouth opening. Landmark coordinates were analyzed in MorphoJ 1.05f  via Procrustes superimposition to remove information concerning scale or size, position, and orientation. To study statistical relationships among all e-cigAM exposure groups and controls, a canonical variate analysis of Procrustes fit landmark data was performed and visualized as a bivariate plot. Discriminate function analysis was also performed to examine statistical relationships between each e-cigAM exposure group and its respective control. These were represented as transformation grids, in which the flat end of the vector represented average landmark position in control embryos, and the round end of the vector represented average landmark position in e-cigAM exposed embryos. Scale factor was set to 10.
Analysis of blood distribution
Differentiated red blood cells were visualized using benzidine-peroxidase staining . Benzidine forms a blue precipitate upon oxidation by the heme group of hemoglobin in the presence of hydrogen peroxide and thus serves as a histochemical stain specific for differentiated red blood cells. A 4X benzidine stock was made consisting of 2% glacial acetic acid and 0.4% benzidine (Sigma #B-3503) in distilled water. This solution was stored at 4°C in the dark. Embryos were immersed in 4 mL of 1X benzidine/acetic acid solution (diluted in distilled water) for 5 minutes. To initialize the color reaction, 40 μl of 30% hydrogen peroxide was added directly to the 1X benzidine/acetic acid solution containing the embryos. Cranial vasculature was clearly visible in control embryos after 5 minutes of the reaction and they were photographed immediately using a Discovery V8 stereoscope fitted with an Axiovision digital camera (Zeiss).
Analysis of jaw cartilages and muscle
Cartilages were labeled with Alcian Blue using standard protocols with some modifications . Briefly, stage 45 (98 hpf) tadpoles were fixed in Bouin’s fixative overnight at 4°C and then washed in 70% ethanol until clear of any yellow color. They were then immersed in Alcian Blue mixture (0.1mg/ml Alcian Blue in 1 part acetic acid: 4 parts ethanol) for 3–4 days at room temperature. Embryos were washed in 1% HCL in 70% ethanol for 1–2 days and cleared in 2% potassium hydroxide and glycerol.
Muscles were visualized using Phalloidin. Embryos at stage 45 (98 hpf) were fixed overnight in 4% PFA at 4°C followed by 3 washes (1 hour each) in PBT. Embryos were then labeled with Alexa Fluor 488 Phalloidin (1:100; Thermofisher, cat. no: A12379) for two days at 4°C and counterstained with Hoechst 33342 Solution to label nuclei (1:10,000; Thermo Fisher Scientific, cat. no: 62249). Embryos were imaged in 90% glycerol in PBT using a Nikon C2 confocal microscope. Z-stacks were created with a step size of 2 μm, for a total thickness between 200–400 μm. Using Elements software, Z-stacks were converted to maximum projection images for ventral views or volume rendered, rotated and 2D snapshot created for frontal views.
Neural crest cell cultures
Murine cranial neural crest cells (O9-1, MilliporeSigma, St. Louis, MO) were seeded on hESC-qualified reduced growth factor basement membrane matrix (Geltrex®, Thermo Fisher Scientific, cat. No: A1569601) and culture in complete embryonic stem cell medium (MilliporeSigma, cat. No: ES-101-B). Cells were cultured to confluence and subsequently plated onto Geltrex® coated 24 well plates at a density of 20,000 cells/cm2. e-cigAM was diluted 1:100, 1:1000 and 1:10000 in culture media and this media was refreshed every 24 hours.
Cell health and viability was assessed with AlamarBlue® (Thermo Fisher Scientific, cat. No: 10-230-102). Briefly, 100 uL of AlamarBlue® was added to each well and incubated for 4 hours. After incubation, 100 uL of medium was removed and fluorescence intensity (560 nm EX/590 nm EM) was assessed. After measurement, fresh medium was added to each well with their respective e-cigAM treatments and dilutions.
Osteoblastic and chondrogenic differentiation was induced by culturing the neural crest cells for 12 days in osteoblastic and chondrogenic induction medium respectively (Lonza, Basel, Switzerland). Cells were plated in Geltrex® coated 24 well plates at 20,000 cells/cm2 in complete embryonic stem cells medium, osteogenic induction medium, and chondrogenic induction medium. Different dilutions of selected e-cigAM were added at plating and every 48 hours with fresh medium.
mRNA levels was assessed using quantitative RT-PCR. RNA was extracted from the cells using TRIzol® (Life Technologies) following manufacturer’s directions. RNA was reverse transcribed into cDNA using a High Capacity cDNA Kit (Life Technologies). Quantitative PCR was performed by combining established primers (available upon request) with PowerUp SYBR® Green Master Mix (ThermoFisher) and utilizing a CFX Connect Real-Time PCR Detection System (Biorad).
Data (six replicates per group) were analyzed by ANOVA and Student’s t-test with Bonferroni’s correction for multiple comparisons. P < 0.05 was considered to be significant.
1. "Lab Grade” e-cigAM containing only nicotine, propylene glycol, and vegetable glycerin have minor effects on orofacial development
Our first goal was to test aerosols generated from a “Lab Grade” e-liquid which contained only nicotine, propylene glycol (PG), and vegetable glycerin (VG) on the developing craniofacial region. We tested several dilutions of aerosolized e-liquid mixtures (e-cigAM) generated from the Lab Grade e-liquid with 0, 18, or 24 mg/mL concentrations of nicotine on embryos over an early developmental period (Fig 1C, treatment 1 paradigm). Unexposed controls were reared in 0.1X MBS and resembled wild type embryos (Fig 2A). Results revealed that a 1:10 dilution elicited very severe effects and lethality at high concentrations of nicotine (Fig 2B–2F). Similarly, a 1:50 dilution also caused lethality at high nicotine concentrations (not shown). At a 1:100 dilution we noted little lethality and minor defects in the shape of the mouth that was worse in embryos exposed to the Lab Grade e-cigAMs containing higher nicotine concentrations (Fig 2G–2K). Xenopus embryos treated with this dilution were also smaller consistent with reported effects of nicotine on human embryos (reviewed in [62, 63]). There were no noticeable effects on development when embryos were exposed to 1:1000 dilutions of Lab Grade e-cigAMs (not shown). These experiments indicated that a 1:100 dilution of e-cigAM could have a concentration of nicotine that is physiologically relevant to humans. Therefore, we used this dilution in all further experiments.
(A-K) Representative frontal views of (A) untreated control, (B-F) 1:10, or (G-K) 1:100 dilutions of lab grade e-cigAMs containing (B,G) 0 mg/ml, (C,H) 6 mg/ml, (D,I’) 12 mg/ml, (E,J) 18 mg/ml, or (F,K) 24 mg/ml concentration of nicotine. Mouth outlined in red dots. (L) Canonical variateanalysis of controls and 1:100 dilution of Lab Grade e-cigAMs. Black = untreated controls, pink = Lab Grade e-cigAM with 0 mg/ml nicotine, blue = Lab Grade e-cigAM with 18 mg/ml nicotine, green = Lab Grade e-cigAM with 24 mg/ml. Table includes Procrustes distances (PD) and p-values. Significant p-values in bold with asterisks. Wireframe graphs represent shape changes associated with position on graph. Canonical variate 1 = 66.0% variance, Canonical variate 2 = 21.5% variance. (M) Discriminant function analysis of controls compared to Lab Grade e-cigAM with (i) 0 mg/ml, (ii)18 mg/ml, or (iii) 24 mg/ml concentration of nicotine. Flat end of vector is average landmark position of controls, round end is average landmark position of Lab Grade e-cigAMs. Procrustes distances (PD) and p-values below graphs. (N) Measurements of intercanthal distance, face height, dorsal mouth angle, and mouth roundness of controls (black), and 1:100 dilutions of e-cigAMs containing 0 mg/ml (pink), 18 mg/ml (blue), or 24 mg/ml (green) concentration of nicotine. Controls were set to 100 and exposure groups normalized to it. Student’s t-test assuming unequal variance was performed on non-normalized data. Error bars represent standard error. Asterisks indicate significant difference when compared to controls. Alpha value for all statistical analyses = 0.02. cg = cement gland.
To assess changes in the shape of the orofacial region in embryos treated with 1:100 Lab Grade e-cigAM, we utilized geometric morphometrics. Thirty-three landmarks were chosen to best represent the shape of the orofacial region and incorporated features such as the position of the eyes and mouth (S1 Fig). Landmark data was then aligned by Procrustes fit to eliminate information about size and orientation, and analyzed using multivariate statistical analyses. We first performed a canonical variate analysis, which translates variance into components known as canonical variates and maximizes differences among groups by reducing the within-group variance . When represented as a bivariate plot, statistical relationships among groups can be visualized such that groups that are highly different from each other will have a larger distance between them on the plot, large Procrustes distances, and small p-values. Embryos treated with Lab Grade e-cigAM containing 18 mg/mL of nicotine (blue circle) overlapped with the untreated controls (black circle) on the canonical variate analysis plot, suggesting a high degree of similarity in facial shape (Fig 2L). On the other hand, embryos treated with Lab Grade e-cigAM containing 0mg/mL (pink circle) or 24mg/mL (green circle) of nicotine were clearly discriminated from controls (Fig 2L).
In order to more specifically assess the differences in orofacial shape between embryos exposed to each Lab Grade e-cigAM compared to controls, we next performed a discriminant function analysis. In this pairwise analysis, results are represented as vectors diagrams, such that the flat end of the vector represents the average landmark position in control embryos, and the closed circle end represents the average landmark position in embryos exposed to each Lab Grade e-cigAM. The length of the vectors represents the magnitude of shape change, and warping of the transformation grid highlights regions of the most significant changes. The transformation grid of facial landmarks from embryos exposed to Lab Grade e-cigAM containing 0 mg/mL and 18mg/ml of nicotine revealed subtle shifts but were not deemed significant (p values above 0.01, Fig 2Mi, Mii). Embryos exposed to Lab Grade e-cigAM with 24 mg/mL of nicotine exhibited significant shifts in the position of mouth and ventral facial landmarks as well as warping of the transformation grid in the lower portion of the face (Fig 2Miii). Together, the Canonical variate and discriminant analyses suggest that Lab Grade e-cigAM containing 24 mg/ml of nicotine resulted in minor but significant changes in the shape of the orofacial region.
The morphometric analysis revealed some overall orofacial shape changes, especially surrounding the mouth, in the embryos treated with Lab grade e-cigAM with high nicotine. The shape of the mouth depends upon the amount palate and midface tissue and therefore we next performed additional measures of mouth shape. Normally, embryos have a broad oval shaped mouth while embryos with less midface tissue have rounder mouths. Mouth roundness was assessed using the inverse aspect ratio: (4area)/(major axis2). In addition, we also measured the dorsal mouth angle; that is the angle which is created when lines are drawn from the dorsal midline of the mouth to each labial commissure (S1 Fig). An angle that is more acute can be indicative of a median cleft and/or a rounder mouth that can form when palate tissues are reduced. Embryos exposed to all Lab Grade e-cigAMs had rounder mouths (0mg/ml = 31.01%, p< 0.0001; 18mg/ml = 64.04%, p< 0.0001; 24 mg/ml = 31.43%, p< 0.0001, Fig 2N, S2 Fig), and more acute dorsal mouth angles (0mg/ml = 8.70%, p = 0.0002; 18mg/ml = 10.63%, p< 0.0001; 24 mg/ml = 4.71%, p< 0.0001; Fig 2N, S2 Fig). These results demonstrate that the faces of Lab Grade e-cigAM treated embryos do all have minor changes in the shape of the mouth, reflecting a possible reduction of midface tissues.
Morphometric and mouth shape analyses effectively revealed orofacial shape changes but these measures do not reveal changes in size. Therefore, the intercanthal distance (the distance between the eyes) and the facial height (distance from the top of the cement gland to the top of the eyes) were measured (S1 Fig). Embryos exposed to all Lab Grade e-cigAMs had slightly but statistically decreased intercanthal distances (0mg/ml = 8.47%, p< 0.0001; 18mg/ml = 8.55%, p< 0.0001; 24mg/ml = 9%, p< 0.0001; Fig 2N, S2 Fig), but no significant changes in the face height (p’s = 0.149; 0.241; 0.670 respectively; Fig 2N, S2 Fig). These results suggest that each of the Lab Grade e-cigAMs, even in the absence of nicotine, resulted in slightly narrower midfaces.
Taken together, these quantitative analyses support our qualitative observations that Lab Grade e-cigAMs induce some subtle defects in orofacial morphology, especially surrounding the mouth, that were more significant at the highest concentration of nicotine.
2. E-cig AMs containing flavors differentially affect craniofacial development
In addition to PG, VG, and nicotine, a variety of flavor additives are added to e-liquids. Therefore, we asked whether various e-cigAMs containing flavor additives could have differential effects on craniofacial development. E-cigAMs derived from six e-liquids were randomly chosen with different numbers or types of flavors, different or unknown PG/VG ratios and different levels of nicotine (summarized in Table 1). The goal of this section is not to determine which components of the e-liquids are toxic, but rather to identify whether some e-liquids could dramatically affect craniofacial development.
Embryos exposed to e-cigAM A-D exhibited only subtle orofacial defects, and largely resembled untreated controls and embryos treated with the Lab grade e-cigAMs (Fig 3A–3E). On the other hand, e-cigAMs E and F resulted in a much more distinct craniofacial phenotype, in which the lenses were protruding and the face appeared narrower, particularly the midface (Fig 3F and 3G). The mouth also appeared rounder in these embryos, with a median oral cleft in the “upper lip” region that extended into the roof of the oral cavity (Fig 3F and 3G, arrowheads) in 20% of embryos treated with e-cigAM E (n = 40; 2 replicates; Fig 3F) and 70% of embryos exposed to E-liquid F (n = 50; 3 biological replicates; Fig 3G).
(A-G) Representative frontal views of (A) untreated controls, (B) embryos exposed to e-cigAM A, (C) embryos exposed to e-cigAM B, (D) embryos exposed to e-cigAM C, (E) embryos exposed to e-cigAM D, (F) embryos exposed to e-cigAM E, and (G) embryos exposed to e-cigAM F. Mouth outlined in red dots. (H) Canonical variate analysis of controls and e-cigAMs A-F. Black = untreated controls, red = e-cigAM A, purple = e-cigAM B, yellow = e-cigAM C, green = e-cigAM D, blue = e-cigAM E, pink = e-cigAM F. Wireframe graphs represent shape changes associated with position on graph. Canonical variate 1 = 68.8% variance, Canonical variate 2 = 15.8% variance. (I-N) Discriminant function analysis of controls compared to e-cigAMs A-F. Flat end of vector is average landmark position of controls, round end is average position of e-cigAMs. Procrustes distances (PD) and p-values below graphs. (O-T) Measurement of intercanthal distance, faces height, mouth angle, and mouth roundness of controls and e-cigAMs A-F. Controls were set to 100 and exposure groups normalized to it. Student’s t-test assuming unequal variance was performed on non-normalized data. Error bars represent standard error. Asterisks indicate significant difference when compared to controls. Alpha value for all statistical analyses = 0.02. cg = cement gland.
While our qualitative observations identified two e-cigAMs that resulted in dramatic craniofacial defects, we next aimed to more thoroughly quantify these observations. First, to address the overall changes in the shape of the orofacial region, we utilized geometric morphometric analysis of e-cigAM exposed embryos and controls. Canonical variate analysis showed that control embryos (black circle) were not obviously discriminated from embryos treated with e-cigAMs A-D on the plot (Fig 3H) and these had small Procrustes distances (Table 2). On the other hand, embryos exposed to e-cigAMs E (blue circle) and F (pink circle) were more easily discriminated from the other treatment groups (Fig 3H). Further, these two groups were statistically different than their respective controls and had the largest Procrustes distances (Table 2).
Discriminant function analysis of embryos exposed to e-cigAMs A-D compared to their control counterparts generated minimal shifts in landmark positions and small Procrustes distances (Fig 3I–3L). This suggests that shape changes induced by these e-cigAMs were small compared to controls, consistent with the canonical variate analysis and qualitative observations. On the other hand, the discriminant function analysis of embryos exposed to e-cigAM E or F resulted in significant shifts in most landmark positions and a large Procrustes distances compared to the control embryos (Fig 3M and 3N). The landmark shifts and warping indicate an overall thinner face and triangular rather than oval mouth shape in these two groups (Fig 3M and 3N).
In summary, the canonical variate and discriminant function analyses indicate that embryos exposed to e-cigAMs E or F resulted in dramatic changes in overall face shape, consistent with the midface hypoplasia and median clefts observed. On the other hand, e-cigAMs A-D exposure lead to little or no overall changes in face shape.
To address changes in the size of the midface and more specifically assess changes in mouth shape, we measured intercanthal distance, facial height, dorsal mouth angle, and mouth roundness as described above in section 1. Embryos treated with e-cigAM A had a slightly smaller intercanthal distance (2%; p< 0.0001) and no significant change in the face height (p = 0.473), dorsal mouth angle (p = 0.149), or mouth roundness (p = 0.033; Fig 3O, S3 Fig). These results suggest only minor changes in the faces of these embryos. Embryos treated with e-cigAM B had no difference in the intercanthal distance (p = 0.265), face height (p = 0.319) dorsal mouth angle (p = 0.074), or mouth roundness (p = 0.016; Fig 3P, S3 Fig), suggesting they were also not much different from their respective controls. Exposure to e-cigAM C induced a 12% (p< 0.0001) reduction in intercanthal distance, but no significant change in facial height (p = 0.964; Fig 3Q, S3 Fig). The mouth had a dorsal mouth angle 9.5% more acute and was 44% more round and in e-cigAM C exposed embryos compared to controls (p< 0.0001; Fig 3Q, S3 Fig). Thus, while morphometrics revealed little difference in the shape of the face after exposure to this e-cigAM, these results show that the face is smaller with specific changes in the shape of the mouth (Compare Fig 3H, 3K and 3Q, S3 Fig). Embryos treated with e-cigAM D had a slightly smaller intercanthal distance (7%; p = 0.001; Fig 3R, S3 Fig) and no significant change in the face height (p = 0.319) or dorsal mouth angle (p = 0.012). The mouths of e-liquid D treated embryos had an 82% increase in roundness (p<0.0001; Fig 3R, S3 Fig). Here again, these results show that the face is smaller with specific changes in the shape of the mouth despite the fact that morphometrics revealed little difference in the overall shape of the face. E-cigAM E induced an 18% (p< 0.0001) reduction in intercanthal distance, and a 10% increase in facial height (p = 0.001; Fig 3S, S3 Fig). E-cigAM E exposure resulted in mouths that were 20% more acute (p< 0.0001) and 77% more round (Fig 3S, S3 Fig). These results are consistent with changes in facial shape identified by morphometric analysis. Embryos treated with e-cigAM F had a much smaller intercanthal distance (40%; p< 0.0001) and a 9% increase in the face height (p = 0.002; Fig 3T, S3 Fig). Dorsal mouth angle was 25% more acute in e-liquid F (p<0.0001) and 144% more round (p<0.0001) than controls (Fig 3T, S3 Fig). These results are also consistent with the shape changes in the face as identified by geometric morphometric analyses.
We also tested these e-cigAMs over a different time window (Fig 1, treatment 2) where embryos were exposed from stage 24–45 (26–97 hpf). By doing this we could determine if the e-cigAMs effects were mainly due to perturbations during early developmental events such as gastrulation and neural tube formation. When embryos were exposed to e-cigAM A-D during treatment 2, little or no change in orofacial morphology was observed (not shown). However, when embryos were exposed to either e-cigAM E or F over treatment 2 the same dramatic orofacial phenotype with median clefts was observed (not shown). These results indicate that the effects of these two e-cigAMs could be specific to later developmental events such as facial prominence growth, differentiation and local cellular movements during prominence fusion.
In summary, exposure to e-cigAMs E and F generated dramatic changes in facial dimensions and shape, while the other flavored e-cigAMs (A-D) had only minor or negligible effects on the orofacial size and shape.
3. E-cigAMs E and F result in orofacial defects even in the absence of nicotine but high nicotine can exacerbate craniofacial abnormalities in e-cigAM E
The e-cigAMs tested thus far all contained nicotine, however we noted varying effects. Therefore, we postulated that the primary cause of the orofacial malformations was not simply nicotine exposure. We hypothesized that the other components such as flavors, PG and VG could be major contributors to the orofacial defects. Therefore, we next asked whether orofacial malformations could occur when nicotine was absent from e-cigAMs. Further, we were also interested in whether nicotine could exacerbate the effects elicited by the other components. To test these questions, embryos exposed to e-cigAMs E and F with and without nicotine were compared.
Embryos exposed to e-cigAM E with nicotine (e-cigAM E+) or without (e-cigAM E-) had orofacial defects, and neither group resembled controls (see representative control in Fig 3). Those embryos having a median cleft occurred at approximately the same frequencies (18% and 20% respectively, n = 40, 2 biological replicates for each experiment). However, defects in embryos treated with e-cigAM E+ appeared to to be slightly more severe than embryos treated with e-cigAM E-, and there was a slightly higher rate of lethality in this group (10%, compared to 7.5% in e-cigAM E-; Fig 4A and 4B).
(A,B) Representative frontal views of embryos exposed to (A) e-cigAM E- containing 0 mg/mL of nicotine or (B) e-cigAM E+ containing 18 mg/mL of nicotine. Mouth outlined in red dots. (C) Canonical variate analysis of controls (black), e-cig-AM E- (grey), and e-cigAM E+ (blue). Wireframe graphs represent shape changes associated with position on graph. Canonical variate 1 = 94.6% variance, Canonical variate 2 = 5.4% variance. (D) Discriminant Function analysis of e-cigAM E- compared to e-cigAM E+. Procrustes distances (PD) and p-values below graph. (E) Measurements of intercanthal distance, face height, mouth angle, and mouth roundness in e-cig-AM E- (grey), and e-cigAM E+ (blue). (F,G) Representative frontal views of embryos exposed to (F) e-cigAM F- containing 0 mg/mL nicotine or (G) e-cigAM F+ containing 6 mg/mL nicotine. (H) Canonical variate analysis of controls (black), e-cig-AM F- (grey), and e-cigAM F+ (pink). Wireframe graphs represent shape changes associated with position on graph. Canonical variate 1 = 79.8% variance, Canonical variate 2 = 20.2% variance. (I) Discriminant Function analysis of e-cigAM F- compared to e-cigAM F+. (J) Measurements of intercanthal distance, face height, mouth angle, and mouth roundness in e-cig-AM F- (grey), and e-cigAM F+ (pink). For bar graphs of size and shape measurements, controls were set to 100 and exposure groups normalized to it. Student’s t-test assuming unequal variance was performed on non-normalized data. Asterisks indicate significant difference when compared to controls. Alpha value = 0.02.
Quantitative analyses comparing the orofacial shapes from embryos treated with e-cigAM E+ and e-cigAM E- confirmed our observations. The canonical variate plot indicates that the e-cigAM E+ (blue circle) and e-cigAM E- (grey circle) groups were discriminated from the controls (black circle) (Procrustes distances = 0.194 and 0.190 respectively; p’s< 0.0001; Fig 4C). These results indeed suggest that components in e-cigAM E cause orofacial defects even in the absence of nicotine. In addition, embryos treated with e-cigAM E+ (blue circle) and e-cigAM E- (grey circle) were discriminated from each other (Procrustes distance = 0.050; p = 0.012; Fig 4C), suggesting that nicotine exacerbates the orofacial shape changes caused by e-cigAM E (Fig 4C). A DFA comparing e-cigAM E+ and ecigAM E- indicated that overall the landmarks placements between these groups were significantly different (procrustes distance = 0.049, p = 0.006, Fig 4D). Notable landmark shifts were apparent in the ventral region of the face and around the mouth (Fig 4D). Consistently, there was a 7% decrease in mouth angle (p = 0.0003) and a 24% increase in mouth roundness (p< 0.0001) when embryos were exposed to the nicotine-containing e-cigAM E+ compared to e-cigAM E- (Fig 4E, S4 Fig). On the other hand, there was no statistical difference in intercanthal distance or facial height between embryos treated with nicotine containing e-cigAM E (p = 0.850, 0.864, respectively; Fig 4E,S4 Fig). Thus, while there is no difference in the size of the midface, the overall facial shape, especially around the mouth was different in e-cigAM E+ and ecigAM E- treated embryos. These results indicate that nicotine does exacerbate the craniofacial abnormalities.
Embryos exposed to e-cigAM F with nicotine (e-cigAM F+) and without nicotine (e-cigAM F-) had orofacial defects that appeared very similar, and did not resemble the controls (see representative control in Fig 3 and Fig 4F and 4G). In addition, 70% of embryos in both groups also exhibited median facial clefts (n = 50, 3 biological replicates; Fig 4F and 4G). In these two groups we could not discern any obvious difference; however, there was a slightly higher rate of lethality when exposed to e-cigAM F+ (14% compared to 4% in e-cigAM F-). A canonical variate plot indicates that the e-cigAM F+ (pink circle) and e-cigAM F- (grey circle) groups are discriminated from the controls (black circle) (procrustes distance = 0.2817, 0.311, respectively; p< 0.0001; Fig 4H). This suggests that even in the absence of nicotine, this e-cigAM F contains compounds that can cause orofacial defects. Embryos treated with e-cigAM F+ (pink circle) and e-cigAM F- (grey circle) overlapped and were not discriminated from each other (Procrustes distance = 0.034, p = 0.059; Fig 4H). A DFA comparison also revealed little shifting of landmark positions, accompanied by a low Procrustes distance, high p-value indicating no statistical difference between these groups (procrustes distance = 0.035, p = 0.055; Fig 4I). Additionally, there was no significant difference in intercanthal distance, face height, mouth angle, or mouth roundness of embryos treated with e-cigAM F with and without nicotine (p = 0.0658, 0.441, 0.830, 0.870, respectively; Fig 4J, S4 Fig). Taken together, these data suggests that the nicotine in this e-cigAM does not significantly contribute to orofacial defects (Fig 4). Note that in this e-liquid the reported nicotine concentration is low (6mg/ml) which may account for this result.
4. Orofacial shape in embryos exposed to ecigAM E differs from those exposed to e-cigAM F
Given the similarities in the orofacial phenotypes of embryos exposed to e-cigAM E or F, we also compared the shape changes in these groups. To do this a morphometric analyses of embryos with a phenotype were analyzed for overall changes in orofacial shape. First, a canonical variate analysis of embryos treated e-cigAM E and F with and without nicotine was performed. Results demonstrated that embryos exposed to e-cigAM E+ were for the most part discriminated from e-cigAM F+ on the bivariate plot (compare dark pink and dark blue circles). Some overlap existed due to one outlying embryo however these groups were statistically different (Fig 5A). Embryos exposed to e-cigAM E- were clearly discriminated from e-cigAM F- on the bivariate plot (compare light pink and light blue circles) and these groups were also significantly different (Fig 5A).
A) Canonical variate analysis. Comparison of e-cigAM E with nicotine (e-cigAM E+) or without nicotine (e-cigAM E-) and e-cigAM F with nicotine (e-cigAM F+) or without nicotine (e-cigAM F-). Dark blue = e-cigAM E+, light blue = e-cigAM E-, dark pink = e-cigAM F+, light pink = e-cigAM F-. Wireframe graphs represent shape changes associated with position on graph. Table contains Procrustes distance (PD) and p-values. Significant p-values are bolded and denoted with an asterisk. Canonical variate1 = 74.2% variance, canonical variate 2 = 11.0% variance. B) Discriminant Function Analysis of (i) e-cigAM E- compared to e-cigAM F-, (ii) e-cigAM E+ compared to e-cigAM F+. Flat end of vector is average landmark position of either e-cigAM E- or e-cigAM E+, round end is average position of e-cigAM F- or F+. Red dots are landmarks with little to no obvious change in position. Alpha value for all statistical analyses = 0.02.
To more clearly visualize the specific differences in orofacial shape between e-cigAM E and F exposure groups a Discriminant function analyses was performed. When embryos from e-cigAM E- and e-cigAM F- were compared there were large shifts in landmarks throughout the face (black landmarks) and only minor shifts (red landmarks) at the midline of the face, dorsal mouth and at the periphery lateral to the mouth. We noted comparable results when embryos from e-cigAM E+ and e-cigAM F+ were compared. There were again minor shifts (red landmarks) at the midline of the face, dorsal mouth and at the periphery lateral to the mouth and larger shifts in landmarks throughout the face (black landmarks). These results suggest that both e-cigAM E and F without and without nicotine had similar effects on a very specific region of the midface accounting for the similarity in the qualitative phenotype but also caused very disparate effects on the rest of the embryonic face.
5. Exposure to either ecigAM E or F causes defects in cranial cartilage, muscle and blood distribution
Thus far, our analysis indicates that exposure to e-cigAM E and F cause quite dramatic changes in craniofacial morphology. We next wondered what specific tissues and structures might be perturbed that could account for such morphological changes. To determine this, we examined the major tissues comprising the jaw, namely muscle and cartilage as well as the blood supply to the face. These tissues are best examined at stage 45 (98hpf) when they are well formed. However, our treatment 1 paradigm resulted in variable but significant embryonic death by stage 45. Therefore, in this analysis we exposed embryos to e-cigAM E and F during a specific timeframe during which the orofacial region is developing (24–98 hpf, treatment 2 paradigm) to 1) ensure adequate numbers for analysis and 2) to more specifically test the effects of these e-cigAMs on orofacial development.
5A) e-cigAM E or F exposure causes defects in cranial cartilages.
The branchial and jaw cartilages that together form the cranial cartilage provide important structural support and allow for a functional mouth. At stage 45 (98 hpf), the anterior most infrarostral (ir) cartilage articulates with the paired Meckel’s (mk) cartilages on the upper jaw (Fig 6A and 6B). The ethmoid plate (eth) that supports the palate is present dorsal to the upper jaw structures (Fig 6A and 6B). At this time, the lower jaw is characterized by a separation of the paired cerathoyal (ch) cartilages by the basihyal (bh) cartilage at the midline. Finally, three pairs of branchial cartilages (ba) are present at this time (Fig 6A and 6B).
(A-F) Cartilage labeling with Alcian Blue in representative embryos showing frontal views and lateral views in controls, e-cigAM E and F treated. Arrowheads are at right angles to the branchial cartilages. Arrows indicate the more obtuse angle of the infrarostral cartilages. (G-L) F-actin labeling of muscle (green) and Hoescht’s nuclear stain (blue) in representative embryos showing ventral views and frontal views in controls, e-cigAM E and F treated. Arrowheads indicate defects noted in the ih in I, and the lm in K and L. Arrows indicate defects in the gh in I J, K and L. M-R) Blood cell labeling with benzidine-peroxidase in blue of representative embryos showing frontal views and lateral views in controls, e-cigAM E and F treated. Arrows indicate deficicy in the mab in P and R. Abbreviations: ba’s = branchial cartilages, ch = cerathoyal, Mk = Meckel’s, ir = infrarostral, eth = ethmoid, qha = quadratohyoangularis, oh = orbitohyoideus, lm = levator mandibulae, ih = interhyoideus, gh = geniohyoideus, cbs = constrictors branchialium, mab = musculoabdominal vein, aa3 = third aortic arch, cg = cement gland.
Embryos treated with either e-cigAM E or F, shared similar cartilage defects. For example, there was a reduction in the cranial cartilages (Fig 6A–6D, n = 20, 2 biological replicates) and the paired Meckel’s cartilages articulated with the infrarostral at a more acute angle in embryos treated with e-cigAM E or F when compared to their respective controls (Fig 6C and 6E, arrows). In addition, the branchial cartilages were positioned more perpendicular to the midline and this was more dramatic in embryos treated with e-cigAM E (Fig 6C and 6E, arrowheads are directed perpendicular to cartilage to show difference). Lateral views also indicated that the ethmoid plate is reduced in embryos exposed to e-cigAM E, and missing in embryos exposed to e-cigAM F (Fig 6D and 6F, arrows).
In summary, exposure to e-cigAMs E or F results in some similar abnormalities of the cranial musculature as well as some distinct differences specific to each e-cigAM.
5B) e-cigAM E or F exposure causes defects in cranial muscle.
Since the cranial cartilages were abnormal in embryos exposed to e-cigAMs E and F, we hypothesized that the muscles in the heads of these embryos might also be malformed. At stage 45 (98 hpf), the cranial muscles are composed of paired quadratohyoangularis (qha) and orbitohyoideus (oh) in the lower jaw and levator mandibulae (lm) in the upper jaw and the interhyoideus (ih) muscle extends laterally between these muscles. The paired geniohyoideus (gh) muscles are anchored anteriorly and extend over the interhyoideus (ih) to insert into the gill structures. Finally, the constrictors branchialium II,III, and IV (cbs) extend across the posterior part of the gills (Fig 6G and 6H) .
Embryos exposed to e-cigAMs E or F shared some similar defects, including the overall appearance of smaller muscle groups and changes in the spacing and arrangement of muscles (Fig 6G–6L). For example, in ventral views of the head we noted narrower geniohyoideus (gh) muscles that run anteroposteriorly at the midline (Fig 6I and 6K, arrows) that was especially apparent in embryos treated with e-cigAM E (Fig 6I). Exposure to this e-cigAM also resulted in disorganized interhyoideus (ih) muscle banding (Fig 6I, arrowhead) and missing constrictors branchialium (cbs; Fig 6I). Embryos exposed to e-cigAM F had smaller quadratohyoangularis (qha), orbitohyoideus (oh; Fig 6K), and levator mandibulae (lm) muscles (Fig 6K, arrowhead).
To more easily assess the muscle morphology after e-cigAM treatments, three dimensional images were created which could be rotated to view the muscles from different angles (see snapshots of the frontal views Fig 6H, 6J and 6L) From such images we noted that the geniohyoidus (gh) muscles in embryos treated with either e-cigAM E or F appeared to be in the correct location, but were much thinner than in the controls (Fig 6J and 6L arrows). In addition, it was clear that exposure to e-cigAM F resulted in severely reduced or missing levator mandibulae (lm) muscles (Fig 6L).
In summary, exposure to e-cigAMs E or F can cause similar abnormalities of the cranial musculature as well as differences specific to each e-cigAM.
5C) e-cigAM E or F exposure causes a reduction in cranial blood cells.
The blood supply carries oxygen throughout the body with the initiation of the heartbeat at stages 33–35 (44–46 hpf) [66, 67]. To determine if hemoglobin containing red blood cells reached the jaw after e-cigAM E and F exposures, we utilized benzidine-peroxidase labeling . At stage 45 (98 hpf), red blood cell labeling was typically observed in high abundance in the heart and in regions consistent with the location of the aortic arches and the gills (Fig 6M and 6N). Erythrocytes were also present in two bilaterally symmetrical bands and more anteriorly around the mouth consistent with the location of the musculoabdominal vein (mab; Fig 6M and 6N). However, in embryos exposed to e-cigAMs E or F, blood cell labeling was decreased in the head in 100% of embryos (n = 20; 2 replicates; Fig 6M–6R). For example, in both groups of treated embryos, there was a clear reduction in the amount of blood cells associated with the third aortic arch and the musculoabdominal vein compared to controls (Fig 6O–6R, arrows). The blood cells that could be visualized in e-cigAM exposed embryos were observed in the same pattern as controls and did not appear diffuse (Fig 6O–6R). It could be argued that the lack of blood in the anterior region of the head is due to impaired heart function. However, blood was observed throughout the trunk and tail of these embryos in a similar manner to controls and we observed a heart beat in the e-cigAM E and F treated embryos (not shown).
In summary, our data reveals that e-cigAM E or F exposure affects the development of multiple orofacial tissues which could in turn accompany or cause the morphological abnormalities that we observed.
6. E-cigAM E or F result in misexpression of cartilage and vascular genes in mammalian neural crest cells
Our results have demonstrated that embryos exposed to e-cigAM E or F had malformed cranial cartilage and a reduction in orofacial blood cells. To determine if these e-cigAMs could also affect mammalian systems in a similar way, their effects were tested in a murine neural crest cell line (O9-1). To do accomplish this, the expression levels of genes known to be critical to vascular and cartilage differentiation were assessed. Cells were stimulated to differentiate into osteoblast and chondrocytes with osteogenic and chondrogenic differentiation medium, and then exposed to e-cigAM E or F with nicotine at various dilutions for 12 days. Controls consisted of cells cultured on complete embryonic stem cell media as control and cells treated with PBS alone. Following e-cigAM exposure, murine neural crest cells were harvested, the RNA was extracted and qRT-PCR was performed (Fig 7A). Results revealed that the levels of the vascular differentiation marker, vegf, was statistically decreased in a dose dependent manner when exposed to both e-cigAM E or F (p value = < 0.05, 6 biological replicates, Fig 7B and 7C). Similarly, cartilage differentiation markers fgf2, sox9 and col2a1 were also statistically decreased when exposed to either e-cigAM E or F (p values = < 0.05, 6 biological replicates, Fig 7B and 7C). These results indeed suggest that cartilage and vascular differentiation may be perturbed in these neural crest cells.
A) Experimental design. B,C) qRT-PCR showing normalized expression levels of vegf, fgf2, sox9 and Col2a1 in cells treated with e-cigAM E (B) and e-cigAM F(C). D,E) Alamar Blue assay showing relative fluorescence after 24 and 72 hours e-cigAM E (B) and e-cigAM F (C) treatment. Asterisks indicate significance.
We next wondered whether e-cigAMs could affect more generally neural crest cell health utilizing an Alamar Blue assay. In healthy metabolizing cells, a reducing environment is maintained where the Alamar Blue reagent, resazurin, is reduced to a fluorescent resorufin that can then be measured. A decrease in relative fluorescence would therefore indicate unhealthy, metabolocally less active cells. Cells were treated as described above where ES cell media was added along with e-cigAM E or F and fluorescence measured (Fig 7A). Results revealed that both e-cigAM E and F resulted in a decrease in metabolic activity in a dose dependent manner (p values = < 0.05, 6 biological replicates; Fig D,E).
Together, this data demonstrates that e-cigAM E or F could affect differentiation and viability of mammalian neural crest cells.
ECIG use has become a popular trend and it is believed by much of the general public to be a safer alternative to smoking [69–71]. Further, many women who vape during pregnancy do not believe it will harm the developing embryo and is not equatable to smoking cigarettes . However, there is very little scientific data to support or dispel these ideas. Our work is the first to show that indeed ECIGs could perturb embryonic development, specifically craniofacial formation. Further, these effects seem to be translatable to mammalian systems. Thus, the data presented here emphasizes the need for more research focused on testing these popular products.
There are nearly 500 brands of e-liquids, and over 7,000 flavors  available from online providers and locally owned shops. It is this wide selection of flavors and brands that contributes to the appeal for ECIG consumers [2, 73]. While the number of options and flavors continues to increase, the impacts of heating the multitude of PG, VG and flavor combinations lags behind. Here, we have only scratched the surface in testing e-liquids; however, we have shown that 6 e-liquids can have differential effects on craniofacial development. Specifically, the aerosolized product of two of these e-liquids caused severe craniofacial abnormalities including a median cleft, whereas others resulted in only minor effects. Such disparate effect of different e-liquids has also been demonstrated in other systems. For example, four e-liquids consistently induced higher rates of cytotoxicity than other e-liquids in lung epithelial cells . These four e-liquids had flavor components called Banana Pudding, Cinnamon, Menthol and Kola. Similarly, tests of a wide range of e-liquids in various types of cultured cells, including human embryonic stem cells, also revealed cytotoxic differences . In this study the most highly cytotoxic e-liquids varied considerably and contained flavors such as berries, butterscotch and cinnamon. Further, they showed that such e-liquids do not affect all cell types in the same way. Our results showed that two e-liquids that caused severe craniofacial defects in embryos share common flavor additives, berries/strawberry and cream. In addition, we demonstrated that these two e-liquids had some subtle yet different effects on the shape of the face and the development of the cranial muscle and cartilage. Thus, we contribute to a growing body of data establishing that different chemicals produced in the aerosolization of e-liquids can have differential effects and these effects can vary across cell types. This is especially important when considering the embryo, where cells are continuously changing during the complex process of development. This accentuates the impossible need for testing e-liquids case by case and in whole animal systems. To complicate this further, not only are studies necessary to uncover the single most dangerous e-liquid components but also whether there is a potential for combinatorial effects.
Our goal in this study was to determine if e-cigAMs could affect craniofacial development and which tissues they might specifically affect. We determined that embryos exposed to two e-cigAMs (E and F) had dramatic craniofacial defects including eye abnormalities, midface hypoplasia, and a median cleft. These defects were accompanied by reductions in cranial cartilage and muscle, as well as a deficiency in the amount of blood cells in the facial tissue. While these craniofacial tissue types each have very different developmental origins they are each intimately tied to the development of the cranial neural crest [76, 77]. This developmental link would ensure that the skeletal, muscular and vascular jaw elements develop in concert, which in turn is critical for proper functionality [77, 78]. Certainly, we also determined that mammalian neural crest cell differentiation and metabolic activity were depressed when exposed to the same e-cigAMs that dramatically affect the embryos. Therefore our future work is directed toward determining how chemicals produced in the aerosolization of e-liquids affects developmental processes and whether neural crest specifically could be most sensitive.
In this study we hypothesize that the effects of the ECIG aerosols on Xenopus development are translatable to human embryos. Specifically, we believe that when a pregnant women vapes, the fetus would be exposed to a similar concentration of chemicals as the Xenopus embryos treated with e-cigAMs. Our first set of experiments, utilizing the “Lab Grade” e-cigAM containing only nicotine and carrier compounds, were utilized to determine relevant levels of nicotine. Most studies have demonstrated that human embryos exposed to nicotine alone have low birth weight and minor morphological defects [62, 63]. Consistently, we determined that a 1:100 dilution of “Lab Grade” e-cigAM resulted in smaller embryos with only minor craniofacial defects. These results suggest, based on the effects of nicotine, that Xenopus embryos treated with diluted e-cigAM could experience the same level of ECIG exposure as a human embryo. Future experiments in our labs will measure nicotine and other chemicals in the e-cigAMs as well as the amount of nicotine in Xenopus embryos to better establish human translational relevance.
Our study is the first to show that exposure to ECIGs can have adverse effects on craniofacial development. This is of particular importance, since ECIGs are generally perceived by the public as “safe” for recreational use and only associated with mild effects when used during pregnancy. The work we have done here contradicts this perception and has the potential to inform public policy regarding the distribution and regulation of the ECIG market.
S1 Fig. Landmark and measurements performed in the study.
(A) Landmarks (red dots) numbered in order of placement. (B) Measurements included face height (fh, green), intercanthal distance (id, red), dorsal mouth angle (dma, purple) and mouth roundness (mr, yellow dots outlining the mouth).
S2 Fig. Whisker plots of the face measurements from embryos treated with “Lab Grade” e-cigAM.
Whisker plots are shown for intercanthal distance, face height, dorsal mouth angle and mouth roundness. The median is represented by the line through the box, the top whisker represents the maximum value and the bottom whisker represents the minimum value. Asterisks represent statistically significant differences.
S3 Fig. Whisker plots of face measurements from embryos treated with flavored e-cigAM.
Whisker plots are shown for intercanthal distance, face height, dorsal mouth angle and mouth roundness for each e-cigAM A-F. The median is represented by the line through the box, the top whisker represents the maximum value and the bottom whisker represents the minimum value. Asterisks represent statistically significant differences.
S4 Fig. Whisker plots of face measurements from embryos treated with e-cigAM E and F.
Whisker plots are shown for intercanthal distance, face height, dorsal mouth angle and mouth roundness in the comparison of e-cigAM E and F with and without nicotine. The median is represented by the line through the box, the top whisker represents the maximum value and the bottom whisker represents the minimum value. Asterisks represent statistically significant differences.
This work was funded by a Grant awarded by the NIH National Institute of Dental and Craniofacial Research (Grant number: 5R56DE026024-02) to Rene Olivares-Navarrete and Amanda Dickinson. The authors would also like to acknowledge Chesapeake Tschaenn and Deborah Howton for specimen collection and frog husbandry (Dickinson lab). Finally we would like to especially thank Alison Breland and Tom Eissenberg for their insight into the human use of ECIGs and the needs for testing these products in embryos.
- 1. Rom O, Pecorelli A, Valacchi G, Reznick AZ. Are E-cigarettes a safe and good alternative to cigarette smoking? Ann N Y Acad Sci. 2015;1340:65–74. pmid:25557889.
- 2. Breland A, Soule E, Lopez A, Ramoa C, El-Hellani A, Eissenberg T. Electronic cigarettes: what are they and what do they do? Annals of the New York Academy of Sciences. 2017;1394(1):5–30. Epub 2016/01/17. pmid:26774031; PubMed Central PMCID: PMCPMC4947026.
- 3. Breland AB, Spindle T, Weaver M, Eissenberg T. Science and electronic cigarettes: current data, future needs. Journal of addiction medicine. 2014;8(4):223–33. Epub 2014/08/05. pmid:25089952; PubMed Central PMCID: PMCPMC4122311.
- 4. FDA. Vaporizers, e-cigarettes, and other electronic nicotine delivery systemds (ENDS) 2017 [cited 2017 May 25]. Available from: https://www.fda.gov/tobaccoproducts/labeling/productsingredientscomponents/ucm456610.htm.
- 5. Singh T, Arrazola RA, Corey CG, Husten CG, Neff LJ, Homa DM, et al. Tobacco Use Amonog Middle and High School Students- United States, 2011–2015. Centers for Disease Control and Prevention, 2016.
- 6. McMillen R, Gottlieb M, Shaefer R, Winickoff J, Klein J. Trends in Electronic Cigarette Use Among U.S. Adults: Use is Increasing in Both Smokers and Nonsmokers. Nicotine Tobacco Research. 2015;17(10):1195–202. pmid:25381306
- 7. Wagner NJ, Camerota M, Propper C. Prevalence and Perceptions of Electronic Cigarette Use during Pregnancy. Matern Child Health J. 2017. pmid:28084577.
- 8. Oncken C, Ricci KA, Kuo CL, Dornelas E, Kranzler HR, Sankey HZ. Correlates of Electronic Cigarettes Use Before and During Pregnancy. Nicotine Tob Res. 2017;19(5):585–90. pmid:28403454.
- 9. Mark KS, Farquhar B, Chisolm MS, Coleman-Cowger VH, Terplan M. Knowledge, Attitudes, and Practice of Electronic Cigarette Use Among Pregnant Women. Journal of addiction medicine. 2015;9(4):266–72. pmid:25974378.
- 10. Ashford K, Wiggins A, Butler K, Ickes M, Rayens MK, Hahn E. e-Cigarette Use and Perceived Harm Among Women of Childbearing Age Who Reported Tobacco Use During the Past Year. Nurs Res. 2016;65(5):408–14. pmid:27579508.
- 11. van Rooij IA, Wegerif MJ, Roelofs HM, Peters WH, Kuijpers-Jagtman AM, Zielhuis GA, et al. Smoking, genetic polymorphisms in biotransformation enzymes, and nonsyndromic oral clefting: a gene-environment interaction. Epidemiology. 2001;12(5):502–7. pmid:11505167.
- 12. Wyszynski DF, Duffy DL, Beaty TH. Maternal cigarette smoking and oral clefts: a meta-analysis. Cleft Palate Craniofac J. 1997;34(3):206–10. pmid:9167070.
- 13. Shi M, Christensen K, Weinberg CR, Romitti P, Bathum L, Lozada A, et al. Orofacial cleft risk is increased with maternal smoking and specific detoxification-gene variants. Am J Hum Genet. 2007;80(1):76–90. pmid:17160896; PubMed Central PMCID: PMCPMC1785306.
- 14. Gunnerbeck A, Edstedt Bonamy AK, Wikstrom AK, Granath F, Wickstrom R, Cnattingius S. Maternal snuff use and smoking and the risk of oral cleft malformations—a population-based cohort study. PLoS One. 2014;9(1):e84715. pmid:24454740; PubMed Central PMCID: PMCPMC3893163.
- 15. Yildirim M, Seymen F, Deeley K, Cooper ME, Vieira AR. Defining predictors of cleft lip and palate risk. J Dent Res. 2012;91(6):556–61. pmid:22496123.
- 16. Honein MA, Devine O, Grosse SD, Reefhuis J. Prevention of orofacial clefts caused by smoking: implications of the Surgeon General's report. Birth Defects Res A Clin Mol Teratol. 2014;100(11):822–5. pmid:25045059; PubMed Central PMCID: PMCPMC4559232.
- 17. Martelli DR, Coletta RD, Oliveira EA, Swerts MS, Rodrigues LA, Oliveira MC, et al. Association between maternal smoking, gender, and cleft lip and palate. Braz J Otorhinolaryngol. 2015;81(5):514–9. pmid:26277833.
- 18. Zhao Z, Reece EA. Nicotine-induced embryonic malformations mediated by apoptosis from increasing intracellular calcium and oxidative stress. Birth Defects Res B Dev Reprod Toxicol. 2005;74(5):383–91. pmid:16193507.
- 19. Kang P, Svoboda KK. Nicotine inhibits palatal fusion and modulates nicotinic receptors and the PI-3 kinase pathway in medial edge epithelia. Orthod Craniofac Res. 2003;6(3):129–42. pmid:12962196; PubMed Central PMCID: PMCPMC2862388.
- 20. Bnait KS, Seller MJ. Ultrastructural changes in 9-day old mouse embryos following maternal tobacco smoke inhalation. Exp Toxicol Pathol. 1995;47(6):453–61. pmid:8871084.
- 21. Joschko MA, Dreosti IE, Tulsi RS. The teratogenic effects of nicotine in vitro in rats: a light and electron microscope study. Neurotoxicol Teratol. 1991;13(3):307–16. pmid:1886540.
- 22. Administration FaD. Deeming Tobacco Products to be Subject to the Federal Food, Drug, and Cosmetic Act, as Amended by the Family Smoking Prevention and Tobacco Control Act; Restrictions on the Sale and Distriubution of Tobacco Products and REquired Warning Statements for Tobacco Products. In: Services DoHaH, editor. 2016.
- 23. Peace MR, Baird TR, Smith N, Wolf CE, Poklis JL, Poklis A. Concentration of Nicotine and Glycols in 27 Electronic Cigarette Formulations. J Anal Toxicol. 2016;40(6):403–7. 10.1093/jat/bkw037. pmid:27165804; PubMed Central PMCID: PMCPMC4946633.
- 24. McCarthy M. Attorneys general from 29 US states urge tougher e-cigarette regulations. BMJ. 2014;349:g5154. pmid:25122480.
- 25. Burstyn I. Peering through the mist: systematic review of what the chemistry of contaminants in electronic cigarettes tells us about health risks. BMC Public Health. 2014;14:18. pmid:24406205; PubMed Central PMCID: PMCPMC3937158.
- 26. Kienhuis AS, Soeteman-Hernandez LG, Bos PM, Cremers HW, Klerx WN, Talhout R. Potential harmful health effects of inhaling nicotine-free shisha-pen vapor: a chemical risk assessment of the main components propylene glycol and glycerol. Tob Induc Dis. 2015;13(1):15. pmid:26120296; PubMed Central PMCID: PMCPMC4482188.
- 27. Werley MS, McDonald P, Lilly P, Kirkpatrick D, Wallery J, Byron P, et al. Non-clinical safety and pharmacokinetic evaluations of propylene glycol aerosol in Sprague-Dawley rats and Beagle dogs. Toxicology. 2011;287(1–3):76–90. pmid:21683116.
- 28. Fowles JR, Banton MI, Pottenger LH. A toxicological review of the propylene glycols. Crit Rev Toxicol. 2013;43(4):363–90. pmid:23656560.
- 29. Shen X, Hindle M, Byron PR. Effect of energy on propylene glycol aerosols using the capillary aerosol generator. Int J Pharm. 2004;275(1–2):249–58. pmid:15081155.
- 30. Jensen RP, Strongin RM, Peyton DH. Solvent Chemistry in the Electronic Cigarette Reaction Vessel. Scientific reports. 2017;7:42549. pmid:28195231; PubMed Central PMCID: PMCPMC5307352.
- 31. Tierney PA, Karpinski CD, Brown JE, Luo W, Pankow JF. Flavour chemicals in electronic cigarette fluids. Tob Control. 2016;25(e1):e10–5. pmid:25877377; PubMed Central PMCID: PMCPMC4853541.
- 32. Pankow JF, Kim K, McWhirter KJ, Luo W, Escobedo JO, Strongin RM, et al. Benzene formation in electronic cigarettes. PLoS One. 2017;12(3):e0173055. pmid:28273096; PubMed Central PMCID: PMCPMC5342216.
- 33. Zaccone EJ, Goldsmith WT, Shimko MJ, Wells JR, Schwegler-Berry D, Willard PA, et al. Diacetyl and 2,3-pentanedione exposure of human cultured airway epithelial cells: Ion transport effects and metabolism of butter flavoring agents. Toxicol Appl Pharmacol. 2015;289(3):542–9. pmid:26454031; PubMed Central PMCID: PMCPMC4739639.
- 34. Rigler MW, Longo WE. Emission of diacetyl (2,3 butanedione) from natural butter, microwave popcorn butter flavor powder, paste, and liquid products. Int J Occup Environ Health. 2010;16(3):291–302. pmid:20662421.
- 35. Curwin BD, Deddens JA, McKernan LT. Flavoring exposure in food manufacturing. J Expo Sci Environ Epidemiol. 2015;25(3):324–33. pmid:25052692; PubMed Central PMCID: PMCPMC4520397.
- 36. Bailey RL, Cox-Ganser JM, Duling MG, LeBouf RF, Martin SB Jr., Bledsoe TA, et al. Respiratory morbidity in a coffee processing workplace with sentinel obliterative bronchiolitis cases. Am J Ind Med. 2015;58(12):1235–45. pmid:26523478; PubMed Central PMCID: PMCPMC4715657.
- 37. Kreiss K, Gomaa A, Kullman G, Fedan K, Simoes EJ, Enright PL. Clinical bronchiolitis obliterans in workers at a microwave-popcorn plant. N Engl J Med. 2002;347(5):330–8. pmid:12151470.
- 38. Cavalcanti Zdo R, Albuquerque Filho A, Pereira C, Coletta E. Bronchiolitis associated with exposure to artificial butter flavoring in workers at a cookie factory in Brazil. J Bras Pneumol. 2012;38(3):395–9. pmid:22782611
- 39. Holden VK, Hines SE. Update on flavoring-induced lung disease. Curr Opin Pulm Med. 2016;22(2):158–64. pmid:26761629.
- 40. Brass DM, Gwinn WM, Valente AM, Kelly FL, Brinkley CD, Nagler AE, et al. The Diacetyl-exposed Human Airway Epithelial Secretome: New Insights Into Flavoring Induced Airways Disease. Am J Respir Cell Mol Biol. 2017. pmid:28248570.
- 41. Palpant NJ, Hofsteen P, Pabon L, Reinecke H, Murry CE. Cardiac development in zebrafish and human embryonic stem cells is inhibited by exposure to tobacco cigarettes and e-cigarettes. PLoS One. 2015;10(5):e0126259. pmid:25978043; PubMed Central PMCID: PMCPMC4433280.
- 42. Lauterstein DE, Tijerina PB, Corbett K, Akgol Oksuz B, Shen SS, Gordon T, et al. Frontal Cortex Transcriptome Analysis of Mice Exposed to Electronic Cigarettes During Early Life Stages. Int J Environ Res Public Health. 2016;13(4):417. pmid:27077873; PubMed Central PMCID: PMCPMC4847079.
- 43. Massarsky A, Abdel A, Glazer L, Levin ED, Di Giulio RT. Exposure to 1,2-Propanediol Impacts Early Development of Zebrafish (Danio rerio) and Induces Hyperactivity. Zebrafish. 2017. pmid:28266909.
- 44. Wheeler GN, Liu KJ. Xenopus: an ideal system for chemical genetics. Genesis. 2012;50(3):207–18. pmid:22344814.
- 45. Dickinson AJ. Using frogs faces to dissect the mechanisms underlying human orofacial defects. Semin Cell Dev Biol. 2016;51:54–63. pmid:26778163; PubMed Central PMCID: PMCPMC4798872.
- 46. Dickinson AJ, Lowery LA. Xenopus as a model for developmental biology. Semin Cell Dev Biol. 2016;51:53. pmid:26987579.
- 47. Adams DS, Uzel SG, Akagi J, Wlodkowic D, Andreeva V, Yelick PC, et al. Bioelectric signalling via potassium channels: a mechanism for craniofacial dysmorphogenesis in KCNJ2-associated Andersen-Tawil Syndrome. J Physiol. 2016;594(12):3245–70. pmid:26864374; PubMed Central PMCID: PMCPMC4908029.
- 48. Devotta A, Juraver-Geslin H, Gonzalez JA, Hong CS, Saint-Jeannet JP. Sf3b4-depleted Xenopus embryos: A model to study the pathogenesis of craniofacial defects in Nager syndrome. Developmental biology. 2016;415(2):371–82. pmid:26874011; PubMed Central PMCID: PMCPMC4914463.
- 49. Gouignard N, Maccarana M, Strate I, von Stedingk K, Malmstrom A, Pera EM. Musculocontractural Ehlers-Danlos syndrome and neurocristopathies: dermatan sulfate is required for Xenopus neural crest cells to migrate and adhere to fibronectin. Dis Model Mech. 2016;9(6):607–20. pmid:27101845; PubMed Central PMCID: PMCPMC4920151.
- 50. Dubey A, Saint-Jeannet JP. Modeling human craniofacial disorders in Xenopus. Curr Pathobiol Rep. 2017;5(1):79–92. pmid:28255527; PubMed Central PMCID: PMCPMC5327820.
- 51. Griffin JN, Sondalle SB, Del Viso F, Baserga SJ, Khokha MK. The ribosome biogenesis factor Nol11 is required for optimal rDNA transcription and craniofacial development in Xenopus. PLoS Genet. 2015;11(3):e1005018. pmid:25756904; PubMed Central PMCID: PMCPMC4354908.
- 52. Deniz E, Jonas S, Hooper M, J NG, Choma MA, Khokha MK. Analysis of Craniocardiac Malformations in Xenopus using Optical Coherence Tomography. Scientific reports. 2017;7:42506. Epub 2017/02/15. pmid:28195132; PubMed Central PMCID: PMCPMC5307353.
- 53. Kennedy AE, Dickinson AJ. Quantification of orofacial phenotypes in Xenopus. J Vis Exp. 2014;(93):e52062. pmid:25407252; PubMed Central PMCID: PMCPMC4353423.
- 54. Kennedy AE, Dickinson AJ. Quantitative analysis of orofacial development and median clefts in Xenopus laevis. Anat Rec (Hoboken). 2014;297(5):834–55. pmid:24443252.
- 55. Tahir R, Kennedy A, Elsea SH, Dickinson AJ. Retinoic acid induced-1 (Rai1) regulates craniofacial and brain development in Xenopus. Mech Dev. 2014;133:91–104. pmid:24878353.
- 56. Wahl SE, Kennedy AE, Wyatt BH, Moore AD, Pridgen DE, Cherry AM, et al. The role of folate metabolism in orofacial development and clefting. Developmental biology. 2015;405(1):108–22. pmid:26144049; PubMed Central PMCID: PMCPMC4546841.
- 57. Spindle TR, Breland AB, Karaoghlanian NV, Shihadeh AL, Eissenberg T. Preliminary results of an examination of electronic cigarette user puff topography: the effect of a mouthpiece-based topography measurement device on plasma nicotine and subjective effects. Nicotine Tob Res. 2015;17(2):142–9. pmid:25239957; PubMed Central PMCID: PMCPMC4838000.
- 58. Sive H, Grainger R, Harland R. Early Development of Xenopus laevis: a laboratory manual: Cold Spring Harbor Laboratory Press; 2000.
- 59. Klingenberg CP. MorphoJ: an integrated software package for geometric morphometrics. Mol Ecol Resour. 2011;11(2):353–7. pmid:21429143.
- 60. Hemmati-Brivanlou A, Thomsen GH. Ventral mesodermal patterning in Xenopus embryos: expression patterns and activities of BMP-2 and BMP-4. Dev Genet. 1995;17(1):78–89. pmid:7554498.
- 61. Taylor DJ, Yoffe JR, Brown DM, Woolley DE. Histamine H2 receptors on chondrocytes derived from human, canine and bovine articular cartilage. Biochem J. 1985;225(2):315–9. pmid:2983667; PubMed Central PMCID: PMCPMC1144592.
- 62. Wickstrom R. Effects of nicotine during pregnancy: human and experimental evidence. Current neuropharmacology. 2007;5(3):213–22. Epub 2007/09/01. PubMed Central PMCID: PMCPMC2656811. pmid:19305804
- 63. Bruin JE, Gerstein HC, Holloway AC. Long-term consequences of fetal and neonatal nicotine exposure: a critical review. Toxicol Sci. 2010;116(2):364–74. pmid:20363831; PubMed Central PMCID: PMCPMC2905398.
- 64. Rea Darlington. Canonical Variate Analysis and Related Techniques. Review of Educational Research. 1973;43(4):433–54.
- 65. Ziermann JM, Mitgutsch C, Olsson L. Analyzing developmental sequences with Parsimov—a case study of cranial muscle development in anuran larvae. J Exp Zool B Mol Dev Evol. 2014;322(8):586–606. pmid:24692269.
- 66. Warkman AS, Krieg PA. Xenopus as a model system for vertebrate heart development. Semin Cell Dev Biol. 2007;18(1):46–53. pmid:17194606; PubMed Central PMCID: PMCPMC1868678.
- 67. Levine AJ, Munoz-Sanjuan I, Bell E, North AJ, Brivanlou AH. Fluorescent labeling of endothelial cells allows in vivo, continuous characterization of the vascular development of Xenopus laevis. Developmental biology. 2003;254(1):50–67. pmid:12606281.
- 68. Conlon F. Benzidine-peroxidase staining for blood (Conlon lab): Xenbase; 2011 [cited 2017 May 30]. Available from: http://wiki.xenbase.org/xenwiki/index.php/Benzidine-peroxidase_staining_for_blood_(Conlon_lab).
- 69. Xu Y, Guo Y, Liu K, Liu Z, Wang X. E-Cigarette Awareness, Use, and Harm Perception among Adults: A Meta-Analysis of Observational Studies. PLoS One. 2016;11(11):e0165938. pmid:27861501; PubMed Central PMCID: PMCPMC5115669.
- 70. Pu J, Zhang X. Exposure to advertising and perception, interest, and use of e-cigarettes among adolescents: findings from the US National Youth Tobacco Survey. Perspect Public Health. 2017:1757913917703151. pmid:28379069.
- 71. Huerta TR, Walker DM, Mullen D, Johnson TJ, Ford EW. Trends in E-Cigarette Awareness and Perceived Harmfulness in the U.S. Am J Prev Med. 2017;52(3):339–46. pmid:27890516.
- 72. Zhu SH, Sun JY, Bonnevie E, Cummins SE, Gamst A, Yin L, et al. Four hundred and sixty brands of e-cigarettes and counting: implications for product regulation. Tob Control. 2014;23 Suppl 3:iii3–9. pmid:24935895; PubMed Central PMCID: PMCPMC4078673.
- 73. Yingst JM, Veldheer S, Hammett E, Hrabovsky S, Foulds J. A method for classifying user-reported electronic cigarette liquid flavors. Nicotine Tob Res. 2017. pmid:28064201.
- 74. Rowell TR, Reeber SL, Lee SL, Harris RA, Nethery RC, Herring AH, et al. Flavored E-cigarette Liquids Reduce Proliferation and Viability in the CALU3 Airway Epithelial Cell Line. Am J Physiol Lung Cell Mol Physiol. 2017:ajplung 00392 2016. pmid:28428175.
- 75. Bahl V, Lin S, Xu N, Davis B, Wang YH, Talbot P. Comparison of electronic cigarette refill fluid cytotoxicity using embryonic and adult models. Reprod Toxicol. 2012;34(4):529–37. pmid:22989551.
- 76. Hanken J, Gross JB. Evolution of cranial development and the role of neural crest: insights from amphibians. J Anat. 2005;207(5):437–46. pmid:16313386; PubMed Central PMCID: PMCPMC1571565.
- 77. Rinon A, Lazar S, Marshall H, Buchmann-Moller S, Neufeld A, Elhanany-Tamir H, et al. Cranial neural crest cells regulate head muscle patterning and differentiation during vertebrate embryogenesis. Development (Cambridge, England). 2007;134(17):3065–75. pmid:17652354.
- 78. Schmidt J, Piekarski N, Olsson L. Cranial muscles in amphibians: development, novelties and the role of cranial neural crest cells. J Anat. 2013;222(1):134–46. pmid:22780231; PubMed Central PMCID: PMCPMC3552420.