DNA methyltransferases establish methylation patterns in cells and transmit these patterns over cell generations, thereby influencing each cell's epigenetic states. Three primary DNA methyltransferases have been identified in mammals: DNMT1, DNMT3A and DNMT3B. Extensive in vitro studies have investigated key properties of these enzymes, namely their substrate specificity and processivity. Here we study these properties in vivo, by applying novel statistical analysis methods to double-stranded DNA methylation patterns collected using hairpin-bisulfite PCR. Our analysis fits a novel Hidden Markov Model (HMM) to the observed data, allowing for potential bisulfite conversion errors, and yields statistical estimates of parameters that quantify enzyme processivity and substrate specificity. We apply this model to methylation patterns established in vivo at three loci in humans: two densely methylated inactive X (Xi)-linked loci ( and ), and an autosomal locus (), where methylation densities are tissue-specific but moderate. We find strong evidence for a high level of processivity of DNMT1 at and , with the mean association tract length being a few hundred base pairs. Regardless of tissue types, methylation patterns at are dominated by DNMT1 maintenance events, similar to the two Xi-linked loci, but are insufficiently informative regarding processivity to draw any conclusions about processivity at that locus. At all three loci we find that DNMT1 shows a strong preference for adding methyl groups to hemi-methylated CpG sites over unmethylated sites. The data at all three loci also suggest low (possibly 0) association of the de novo methyltransferases, the DNMT3s, and are consequently uninformative about processivity or preference of these enzymes. We also extend our HMM to reanalyze published data on mouse DNMT1 activities in vitro. The results suggest shorter association tracts (and hence weaker processivity), and much longer non-association tracts than human DNMT1 in vivo.
Citation: Fu AQ, Genereux DP, Stöger R, Burden AF, Laird CD, Stephens M (2012) Statistical Inference of In Vivo Properties of Human DNA Methyltransferases from Double-Stranded Methylation Patterns. PLoS ONE7(3): e32225. https://doi.org/10.1371/journal.pone.0032225
Editor: Pierre-Antoine Defossez, Université Paris-Diderot, France
Received: May 23, 2011; Accepted: January 24, 2012; Published: March 19, 2012
Copyright: © 2012 Fu et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was funded by the National Institutes of Health Grants HD002274 and GM077464 to C.D.L. (http://www.nih.gov/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
DNA methyltransferases establish methylation patterns in cells and transmit these patterns over cell generations, thereby influencing each cell's epigenetic states. (See  for an overview of methyltransferases, and Supplementary Material of  for an introduction to DNA methylation aimed at non-biologists.) Three primary DNA methyltransferases have been identified in mammals: DNMT1, DNMT3A and DNMT3B ,. Whereas the DNMT3s are mostly responsible for establishing methylation patterns during early development and are therefore commonly known as the de novo methyltransferases, DNMT1 is mostly responsible for maintaining existing methylation patterns over somatic cell divisions, and is therefore commonly known as the maintenance methyltransferase .
A central component of the widely accepted model for the maintenance of DNA methylation in eukaryotes is processive actions of the maintenance methyltransferase DNMT1 at hemimethylated CpG dyads shortly after DNA replication (Figure 1; ). This model relies on two properties of DNMT1: substrate specificity (i.e., acting in different ways or at different rates on different types of substrate) and processivity (i.e., associating consecutively at multiple sites along the DNA). These are key properties of DNA methyltransferases and many other DNA-binding enzymes , , and both properties have been investigated extensively in vitro.
Newly synthesized daughter strands (red, mostly, and pale green) are initially unmethylated. Following DNA replication, DNMT1 (purple) binds to the hemimethylated CpG dyads, perhaps with the aid of the replication protein complex (yellow), which includes proteins PCNA and UHRF1 . DNMT1 is proposed to move processively along the molecule from the 5′ end to the 3′ end of the daughter strand. Note that the leftmost CpG dyad at the top is hemimethylated, because DNMT1 has not reached it yet. Methylation by DNMT1 is not perfect (e.g., the CpG in pale green remains unmethylated), because DNMT1 either fails to add methyl groups (denoted by letter M) to its associated CpG dyads, or is unassociated with the DNA at those sites.
Regarding substrate specificity, in vitro experiments show that DNMT1 preferentially adds methyl groups to the cytosines in daughter-strand CpGs that pair with methylated, rather than unmethylated, parent-strand CpGs (i.e., hemimethylated CpG dyads), thus maintaining methylation at these CpG sites over cell generations . Such a preference for hemimethylated CpG dyads was predicted for maintenance methyltranferases as early as 1968 , and is now commonly measured in terms of the “hemi-preference ratio”. This ratio represents the relative rates with which an enzyme methylates hemimethylated and unmethylated CpG dyads. Reported estimates for DNMT1 in humans and mice, generally from in vitro experiments, vary widely from 2- to 200-fold, depending on the DNA sequence context, experimental conditions and enzyme preparation .
Regarding processivity, in vitro experiments suggest that mouse DNMT1 acts processively, binding to DNA and then remaining active over a stretch of consecutive nucleotides , . Both human and mouse orthologs of DNMT1 have been found to associate with the DNA replication machinery, which includes proteins PCNA and UHRF1 , . The DNMT1s are thus poised to methylate cytosines shortly after their incorporation into the nascent daughter DNA strand. However, experiments indicate that both mouse and human orthologs can also processively modify hemimethylated dyads in synthetic DNAs in the absence of the replication machinery –. This result suggests that the interaction of the human and mouse orthologs with the replication machinery may not be essential to enzyme activities.
De novo methyltranferases DNMT3A and 3B  are also important in the preservation of appropriate epigenetic states in human and mouse somatic cells . The absence of these methyltransferases can lead to abnormal phenotypes , . In vitro experiments have also investigated substrate specificity and processivity of these enzymes. Regarding substrate specificity, in contrast to DNMT1, neither DNMT3A nor 3B show preference for adding methyl groups to hemimethylated CpG dyads over unmethylated dyads , . Studies of possible processivity of the DNMT3s are less extensive than for DNMT1. In vitro experiments have demonstrated non-processive behavior of mouse DNMT3A but highly processive behavior of mouse DNMT3B , and processive behavior of human DNMT3A .
Despite the availability of significant in vitro data, important questions remain to be addressed regarding the in vivo properties of the DNA methyltransferases. Here, we investigate in vivo substrate preferences and levels of processivity of human DNMT1 and DNMT3s by analyzing double-stranded DNA methylation patterns established in vivo, measured using hairpin-bisulfite PCR , . Previous analyses of some of these double-stranded patterns ,  yielded estimates of CpG site-specific rates of maintenance methylation and parent- and daughter-strand de novo methylation. However, these previous analyses aimed at quantifying the outcome of the methylation process, without consideration of the enzymes invovled. Here, we develop a novel Hidden Markov Model (HMM) to account for the properties of the DNMTs responsible for the methylation process. Our HMM includes parameters that capture both substrate specificity and processivity of each enzyme, and hence allows inference of these parameters from observed data. In addition to these in vivo analyses, we also apply the HMM (suitably modified) to re-analyze several published in vitro data sets, and compare with our in vivo results.
An important feature of our analyses is that they are based on a statistical model, which quantifies processivity as a probability, thus allowing for statistically testing whether processivity exisits, and which assesses the statistical uncertainty in the estimate of this probability, thus facilitating comparison of inferred levels of processivity among data sets. Our HMM also explicitly accounts for potential measurement errors in the observed data; these errors have been generally unaccounted for in other in vivo and in vitro studies. Additionally, this HMM can also be used to infer the set of enzymatic activities that most likely gave rise to each observed methylation pattern, and to infer, probabilistically, which strand in each double-stranded methylation pattern is the parent strand, and which is the daughter strand (this information is not directly measurable in the hairpin-bisulfite experiment), allowing for investigation of strand-specific behavior of these enzymes (Figure 2).
Each pattern contains a pair of parent and daughter strands; which is the parent strand and which is the daughter strand is not known directly. Our HMM infers probabilistically the strand assignments for each pattern. These posterior probabilities are shown in green for the indicated parent and daughter strand assignment (indicated by letters P and D in green). These patterns from our FMR1 data contain long runs of hemimethylated CpG dyads with their methyl groups present on the same strand. The top two most likely explanations, among all possible explanations, are shown for each pattern. Symbols indicate possible states and activities of the methyltransferases. Not all symbols are used here. The effect of these four patterns on parameter estimation is further shown in Supplementary Figure 13 in Materials S1.
A hidden Markov model (HMM) for processivity and other properties of the DNMTs
We model the observed double-stranded methylation patterns as having arisen from a process where the methyltransferases (DNMT1 and the DNMT3s) were either associated or not associated with the DNA at a CpG site. We model these association/non-association states as a Markov process along the DNA. The model for the observed data based on these unobserved (“hidden”) states is then a Hidden Markov Model (HMM ). For in vivo data, we cannot rule out that other (perhaps unidentified) enzymes than DNMT1 and the DNMT3s may have also contributed to the observed methylation patterns. To allow for this, our references to DNMT1 could be interpreted broadly as referring to the enymes whose activities are primarily maintenance methylation, and references to DNMT3s could be interpreted broadly as enzymes whose activities are primarily de novo methylation.
More specifically, the hidden Markov process in the HMM can be decomposed into three independent Markov processes: the first representing association of DNMT1, which we assume to act only on the daughter strand , the second representing the association of the DNMT3s on the parent strand, and the third representing the association of the DNMT3s on the daughter strand. We use the subscripts , and to refer to each of these processes. We characterize each Markov process by two transition probabilities: the reassociating probability per bp, , that unassociated molecules of the methyltransferase become associated with DNA over 1 bp, and the dissociating probability per bp, , that associated molecules of the methyltransferase become unassociated from DNA over 1 bp. The transition probability matrix over 1 bp for each Markov process can then be written as in Eq. (1).(1)The transition probability matrix between two CpG sites bp apart is then .
Under this parameterisation, two events contribute to the probability of a methyltransferase staying associated at two consecutive sites 1 bp apart (i.e., the bottom right entry in ): (i) processivity, whereby the methyltransferase stays associated from site 1 to site 2 without ever dissociating from DNA. This happens with probability ; and (ii) dissociation-reassociation events, whereby the methyltransferase is associated at site 1, then “falls off”, but becomes re-associated with DNA at site 2. This happens with probability . We quantify the strength of processivity, which corresponds to event (i), by the dissociating probability : the value corresponds to “no processivity”, where the methyltransferase dissociates from DNA at every base pair and the association state is independent at each site (i.e., the two rows of are identical); values of correspond to processive behaviour, and the smaller the value of , the stronger the processivity. This parameter translates into the expected length of each association tract of bp, which is a more conventional measure of processivity and quantifies processivity directly in terms of tract length. Because concerns only enzyme molecules that are already associated, this mean length of association tracts excludes multiple dissociation-reassociation events at consecutive CpG sites, which could be mistaken for processivity. Similarly, the expected length of non-association tracts, which are gaps between association tracts, has mean bp. Unlike , the reassociating probability could be driven principally by concentrations of unassociated methyltransferase molecules in the nucleus.
In addition to these parameters relating to processivity, our model also has parameters for the methylation activities of the methyltransferases when they are associated with DNA, and parameters for the measurement errors that can result from bisulfite conversion (see Materials and Methods for detail). Together these parameters, the “emission probabilities” of the HMM, describe how association or non-association states of methyltransferases give rise to observed methylation states on the pairs of parent and daughter strands, subject to measurement errors (see Materials and Methods for detail). We allow the methyltransferases to methylate daughter CpGs at associated hemi-methylated sites with probability for DNMT1 (or for the DNMT3s) and at associated unmethylated sites with probability for DNMT1 (or for the DNMT3s). The ratios and are termed the “hemi-preference ratios” for DNMT1 and the DNMT3s, respectively. For the parent strand, we make the simpler assumption that the DNMT3s always add a methyl group to the associated CpG.
The above model is very general, allowing for a complex combination of behaviors of the methyltransferases. In applications, it can be helpful to constrain this model in various ways, either to deal with data collected from particular experimental conditions, or to make parameters more identifiable. For example, imposing the constraint yields a more parsimonious model in which the DNMT3s always methylate the associated daughter-strand CpG. This is the model we use for most analyses presented here. However, to attempt to estimate the hemi-preference ratio for the DNMT3s, we impose a different constraint and onto the general model. This constraint reflects the setting where DNMT1 is the primary maintenance enzyme, and helps to distinguish the DNMT1 process and the daughter-strand process of the DNMT3s, which would have been indistinguishable otherwise (see Materials and Methods for detail). To analyze the in vitro data on DNMT1 under the same model, we estimate parameters only associated with the DNMT1 process, and fix the reassociating probabilities and to be 0 and the dissociating probabilities and to be 1; these constraints reflect the in vitro setting where the DNMT3s are absent.
We fit the HMM to the data in a Bayesian inference framework , using Markov chain Monte Carlo (MCMC) to produce samples from the joint posterior distribution of all parameters in the model given the data (see Materials S1 for details, including specification of relevant prior distributions). At the core of our implementation is the standard forward-backword algorithm in each MCMC iteration for computing the joint likelihood of the parameters given observed methylation patterns. The computational complexity of the forward-backward algorithm for all patterns across CpG sites in each MCMC iteration is , where 8 () is the number of hidden states at each site, with 2 being the two states (associated and unassociated) of each Markov process. We summarize the posterior distributions of the parameters from the Bayesian inference by the posterior median and 80% credible intervals (80% CIs; 10- and 90-percentiles); 80% intervals were used, rather than more conventional 95% intervals, to reduce the impact of the heavy tails of some distributions. This inference procedure accounts for the uncertainty in the data regarding which enzymatic activities produced each observed double-stranded pattern by using a dynamic programming algorithm to sum over all possibilities, weighting each possibility by its probability (Figure 2; see also Materials S1).
Runs of hemi-methylated dyads provide information on processivity
As mentioned above, both processivity and multiple dissociation-reassociation events may give rise to runs of fully methylated dyads. When the observed patterns contain only runs of fully or un-methylated dyads, we cannot tell these two mechanisms apart. Presence of hemimethylated dyads (“hemis” hereinafter) provides additional information. Whereas randomly-distributed hemis in the data suggest that the methyltransferases may have been associated with or dissociated from the dyads randomly, clustered hemis suggest nonrandom enzyme activities. In particular, runs of hemis of the same orientation (i.e., methylated CpGs appearing on the same strand), if observed more often than expected by chance, provide evidence for processivity. For example, the in vitro data on mouse DNMT1 from Goyal et al.  (their Fig. 3A) shows multiple very long runs of hemi-methylated sites of the same orientation. Some of these runs contain as many as 20 hemimethylated dyads, with the parent strands being methylated prior to the reaction with DNMT1. These long runs are extremely unlikely if DNMT1 were to associate with the DNA independently at each site. In our in vivo data, similar runs of hemis, although much shorter, also suggest the presence of processivity: indeed a permutation test based on correlations at adjacent CpG sites produces a value of 0.002, suggesting that these runs of hemis occur more often than expected by chance; see Supplementary Figure 1 in Materials S1. Observations like this motivated the HMM described above, and results from the HMM confirm that these runs of hemi-methylated sites are likely due to DNMT1 being unassociated with the DNA for several sites in succession (see Figure 2 for the top two explanations our HMM inferred for four patterns collected at the locus).
Strong processivity and high hemi-preference ratio of in vivo human DNMT1 at two inactive X (Xi)-linked loci
The methylation patterns at the and loci share many similarities: 77–82% of the CpG sites are fully methylated, whereas only 6–9% are hemimethylated, some of which form a few relatively long runs of hemimethylated dyads (Table 1). Analyses of these two data sets under our HMM also produce similar estimates of the key parameters.
We find that the methylation patterns at both of these Xi-linked loci provide strong evidence for substantial processivity of DNMT1: the estimated dissociating probability for the DNMT1 process, , is concentrated on small values near 0 (Table 2; Figure 4(A1)). To investigate the robustness of the estimates, we further ran our HMM on the data with different prior distributions assigned to . The estimates were similar across these runs (Supplementary Figure 2 in Materials S1). These estimates of at these two loci imply a mean association tract length of around 600 bp, which is equivalent to about 90 CpG sites (note that there is considerable uncertainty in these estimates, and the 80% CIs span almost 200–2000 bp; Table 2). This inferred length is much greater than the genomic regions covered by our data (142 bp at and 122 bp at ; Table 1), as it reflects the expect length of DNMT1 association, had we measured methylation over a much longer genomic region (Figures 2 and 3). Interpreting estimated processivity in terms of tract length allows us to compare our estimates directly with other estimates reported in the literature. On the other hand, we estimate at both loci with strong evidence that the reassociating probability is not high, with the median being 0.12 at and 0.07 at and the 80% CIs being narrow (Table 2; also see Supplementary Figures 3 and 4 in Materials S1). This estimate is also robust to different priors (Supplementary Figure 5 in Materials S1). The high association tract length and low reassociating probability for these two hypermethylated loci imply that strong processivity, rather than random association, of DNMT1 accounts for most of the runs of fully methylated CpG dyads.
From top to bottom, each row indicates for DNMT1 on the daughter strand, for the DNMT3s on the parent strand, and for the DNMT3s on the daughter strand. (A1)–(A3) are estimated for the locus. Estimates for , the other Xi-linked locus, show similar distributions and are not displayed here. (B1)–(B3) are estimated for the autosomal locus in the fat tissue. Estimates for the same locus in the blood tissue show similar distributions and are not displayed here. (C) is estimated from the data in Goyal et al. , one of the four in vitro data sets on mouse DNMT1 we analyze here. Dark lines indicate the density of a uniform (0,1) prior distribution. Except for the plots in red, which have most probability mass around small values, all the other plots are displayed on the same support of (0,1).
Recall that our HMM also allows that DNMT1, when associated with the DNA, adds a methyl group to the daughter strand with probability if the parent strand is methylated, and with probability if the parent strand is unmethylated. We estimate to be close to 1 at both loci (Table 2) and to be just a few percent, with the median being 0.02 at and 0.06 at (Table 2), consistent with a very low (not excluding 0) level of de novo activity by DNMT1. These estimates indicate that DNMT1 acting in vivo has a strong preference for hemi-methylated CpG dyads over unmethylated dyads. Our estimates of the hemi-preference ratio (58 for and 15 for ) fall within the aforementioned range of estimates obtained in vitro (2–200-fold), but the posterior distributions exclude the lower end of this range (Supplementary Figures 3 and 4 in Materials S1). Note that, because the data do not exclude very small values for , they also cannot exclude extremely large values for the hemi-preference ratio. For this reason Table 2 gives 80% lower confidence bounds, but not upper bounds for this quantity.
Low association level of in vivo human DNMT3s at two Xi-linked loci
At both Xi-linked loci, we estimated that the average frequency of association ( and ) of the DNMT3s is at most a few percent, if non-zero, on either the post-replication parent strand or the daughter strand (Table 2). Such a low average level of association is consistent with a low reassociating probability for the DNMT3s: the estimated reassociating probability of the DNMT3s is also not much different from 0 on either strand (Table 2). Because only a limited number of observed methylation events could be attributed to the DNMT3s, there is not much information regarding their processivity or hemi-preference ratio. The posterior distributions of the dissociating probabilities and of the DNMT3s are not much different from the uniform prior distribution we assumed (Figure 4(A2)–(A3)), indicating that the data were not informative enough to alter this prior. Thus, these results suggest that the DNMT3s were not very active during the process the observed methylation patterns were formed, and that our data at the two Xi-linked loci are not informative about the processivity, or the lack thereof, of the DNMT3s. Moreover, when we estimated, with additional constraints in the HMM, the hemi-preference ratio for the DNMT3s from the data (Materials S1), we found that its posterior distribution is essentially the same as its prior (Supplementary Figure 6 in Materials S1), which indicates that our data are uninformative also about the preference ratio of the DNMT3s.
Behavior of in vivo human methyltransferases at autosomal locus
Compared with the two Xi-linked loci, the human promoter region is much less methylated and is tissue-specific in the data considered here: the overall methylation density is 18% in the adipose tissues (fat) and 42% in the peripheral blood leukocytes (blood), much lower than 85% at and 82% at . However, most of the methylated CpG dyads are fully methylated: the percentages of fully methylated and hemimethylated dyads are only 16% and 4%, respectively, in fat, and 40% and 5%, respectively, in blood (Table 1). These two data sets also contain only a few short runs of hemimethylated dyads (Table 1). Our analysis of these data shows that, although the promoter region is sparsely methylated in these tissues, DNMT1 still plays the major role and the rate of maintenance methylation is close to 1 (Table 1; Supplementary Figures 7 and 8 in Materials S1). However, the data are uninformative about what types of process (processive or multiple dissocation-reassociation events) gave rise to this high maintenance methylation rate.
Specifically, the data are uninformative about the dissociating probability and reassociating probability of DNMT1 in fat and blood, as the posterior distributions of both parameters cover the entire support of (0,1) (Table 2; Figure 4(B1); Supplementary Figures 7 and 8 in Materials S1). Furthermore, we estimated the maintenance activity probability of DNMT1 to be very close to 1 and its de novo activity probability to be very close to 0 (Table 2; also see Supplementary Figures 7 and 8 in Materials S1). Thus, the estimated hemi-preference ratio of DNMT1 at is essentially consistent with that at the Xi-linked loci: this ratio is significantly higher than 1, supporting a preference for hemimethylated CpG sites (Table 2). The median and lower-bound estimates of this ratio at the locus is much wider in fat (80% CI: 157–3536) than that in blood, which again suggests that the estimation of this ratio is sensitive to the estimation of the de novo activity probability of DNMT1, and that this ratio can be much higher than the values available in existing literature.
Similar to the and data, the data are also uninformative about the DNMT3s on either strand: the posterior distributions of the dissociating probabilities and are not substantially different from the uniform prior distribution (Table 2; Figure 4(B2)–(B3)). This uninformativeness may have stemmed also from a low level of enzyme activities: the average association frequencies and are not substantially different from 0.
Estimates and impact of measurement errors
Bisulfite conversion used in the experiment can give rise to two types of measurement errors ,  (also see Materials and Methods for details on how we define and incorporate these errors in our analysis). In all the analyses here, we fixed the probability of failure of bisulfite conversion, , to be as in our previous analysis . We estimated the probability of inappropriate bisulfite conversion, , by taking advantage of the result that this probability has little variation across CpGs in our data set . Our estimates for are essentially the same in all the data sets, with the posterior median being 2% and narrow 80% CIs (Table 2; also see Supplementary Figure 9 in Materials S1 for the posterior distribution of estimated for the locus). This appreciable error rate is expected under the low-molarity bisulfite-conversion protocol  used to collect our data. Note that the results on processivity and substrate preference given above are robust to different assumptions on the measurement error rates: indeed, setting the error rates to be 0 did not qualitatively impact our inference of the hemi-preference ratio or processivity, except producing a slight reduction in the estimated hemi-preference ratio (Supplementary Figure 10 and Table 1 in Materials S1).
Another source of possible measurement errors is PCR crossover, which can occur during PCR amplification with probability less than 1% per molecule , leading to ascertained patterns that are hybrids of two molecules . A crossover between one densely methylated and one sparsely methylated molecule may produce a methylation pattern with one of its ends being mostly hemimethylated dyads, and could affect statistical inference on processivity. Take the data for example. The probability of having at least 1 of 169 patterns produced by a single crossover is 80% under a binomial distribution. Therefore, pattern #82 from this data set (Figure 2), one of the four most informative patterns and the only pattern with a long run of hemimethylated dyads at an end, may have arisen from a crossover. The other three patterns in Figure 2 have runs of hemimethylated dyads in the middle of the pattern. If these runs were due to crossovers, two events would have had to occur for each molecule. The probability of having at least 1 out of 169 patterns produced by two crossovers is at most 2%. Removing pattern #82 and re-analyzing the rest of the data produced results nearly identical to those for the complete data set (Supplementary Figure 11 in Materials S1). We conclude that PCR crossover errors likely have a negligible impact on our analysis.
Strong processivity of in vitro mouse DNMT1
Most previous studies of DNTM1 were conducted in vitro and investigated mouse DNMT1 , , , . These studies did not consider bisulfite-conversion errors, nor did they distinguish genuine processivity from multiple dissocation-reassociation events at consecutive sites. As explained earlier, these data, containing long runs of as many as 20 hemimethylated dyads, suggest a high level of processivity. We re-analyzed double-stranded methylation patterns from Goyal et al.  and Vilkaitis et al.  under our HMM, setting the association levels of the DNMT3s to 0, and obtained estimates for the processivity of purified mouse DNMT1 acting in vitro (Supplementary Figure 12 in Materials S1; estimates summarized in Supplementary Table 2 in Materials S1). Consistent with the more descriptive analyses in Goyal et al.  and Vilkaitis et al. , our statistical analyses also estimated a high level of processivity from these in vitro data on mouse DNMT1, with narrow 80% CIs indicating strong evidence from the data (Figure 5).
Each curve is the posterior distribution of the (A) mean association (processivity) and (B) non-association tract lengths on the scale. Vertical lines indicate the boundaries of the 80% CIs. Black curves indicate estimates from our in vivo human FMR1 data. Magenta and green curves are based on our re-analysis of the in vitro mouse DNMT1 data in Goyal et al.  and Vilkaitis et al.  (Supplementary Figure 12 in Materials S1).
Although both in vivo and in vitro data show strong levels of processivity, there are noticeable quantitative differences between the two sets of estimates: our estimates from these published in vitro data suggest a shorter mean association tract length (Figures 4 and 5A) and a much longer mean non-association tract length (Figure 5B) than do our estimates of human DNMT1 in vivo (see numeric summaries in Table 2 here and Supplementary Table 2 in Materials S1). These disparities could be due to differences between human DNMT1 and mouse DNMT1, as well as to differences among the experimental conditions in these studies. Disparities could also result from differences between in vivo and in vitro conditions, indicating a role for the replication machinery in modulating enzyme activities. Inferences here and elsewhere – suggest that the replication machinery is not essential for preserving the association of maintenance methyltranferases with the DNA once they are bound. The replication machinery may, however, play a role in keeping unbound DNMT1 poised to re-associate with DNA. This could explain the much shorter non-association tract length and the longer stretches of processive activity inferred here from patterns established in vivo.
In this article, we have developed a novel hidden Markov model to infer complex methyltransferase activities from double-strand methylation patterns established in single molecules. This model complements our earlier model  that focuses on estimating the CpG site-specific rates of methylation events, regardless of the methyltransferases. Under our HMM, we can estimate reassociating and dissociating probabilities of the enzymes, as well as probabilities of maintenance and de novo activities, inferring association/non-association tract lengths and hemi-preference ratio. Whereas it is possible that the DNMTs may carry out methylation activities in multiple passes during a round of DNA replication, the processivity our HMM infers here is effectively the “cumulative” processivity. It is also unclear how to incorporate multiple passes of methylation with an unknown number of passes into the statistical modeling. Our model is applicable to in vivo data for which possibly both DNMT1 and the DNMT3s were at work. It is also applicable to in vitro data in which only one type of methyltransferase was present. Since the core of our implementation of the inference of our HMM is the standard forward-backward algorithm, the computing time needed for analyzing these data is linearly proportional to the number of patterns and to the number of CpG sites.
Applying our model to four in vivo human data sets collected at three loci, we find strong evidence for a high level of processivity of DNMT1 at two Xi-linked loci, with the mean association tract lengths being a few hundred to a few thousand bp, whereas the methylation patterns at the autosomal locus are not informative about processivity. Due to a limited number of loci studied, it is unclear whether the strong processivity of DNMT1 is associated only with the inactive X chromosome. Additionally, the locus may not be representative of autosomal loci, because the data were derived from tissue that is composed of different types (adipose tissue contains adipocyte precursors, blood vessels, and stromal cells besides the mature adipocytes). Although the methylation patterns at the locus have different densities in the two tissue types, our analysis shows that most of the methylation events at this locus are the maintenance methylation activities due to DNMT1 in both tissue types. At all loci examined here DNMT1 showed a strong preference for hemi-methylated CpG sites over unmethylated sites (point estimates ranged from 15 to 628; obtaining precise estimates is difficult because the denominator of the hemi-preference ratio is the probability of de novo methylation events, and these events are rare in our in vivo data dominated by maintenance methylation events).
Our analysis of in vivo data suggests low contributions from the DNMT3s in these in vivo somatic cells. To study the properties of the DNMT3s, an alternative is to analyze double-stranded methylation patterns from in vitro experiments. Such data are indeed available at least for DNMT3A , . However, structure analysis suggested that DNMT3A may form a tetramer with DNMT3L, in the form of DNMT3L-DNMT3A-DNMT3A-DNMT3L, which may bind to more than one CpG in a single binding event . We (AQF and MS) are currently extending our HMM to allow for such possibility and carrying out additional analysis for these DNMT3A data in separate work.
Materials and Methods
Additional details of the Hidden Markov model
Emission probabilities for modeling activities of methyltransferases associated with. DNA.
Consider the -th CpG site on the -th double-stranded methylation pattern. Let be the methylation state of the post-replication parent CpG at this site and be that of the daughter CpG. Also let , and be the association or non-association states of the Markov process of DNMT1 at the daughter CpG, and of the DNMT3s at the parent CpG and the daughter CpG, respectively. The emission probabilities, given as , are conditional probabilities and computed for the -th site as in Table 3.
Each entry in Table 3 sums over two states: methylation and no methylation at the pre-replication parent CpG, with probability and , respectively. For example, consider the following entry near the bottom right of Table 3, . In this case, DNMT1 and the DNMT3s are both associated with the CpG dyad, with the former at the daughter CpG (i.e., ) and the latter at the parent CpG (i.e., , ). Either of two events occurred for the formation of the observed fully methylated CpG dyad (i.e., ): (i) DNMT1 carried out a maintenance methylation event on the daughter CpG of the dyad where the parent CpG had been methylated before replication. This event has probability ; or (ii) the dyad, unmethylated before replication with probability , became methylated de novo on the daughter strand by DNMT1 with probability and on the parent strand by the DNMT3s with probability 1. This double de novo methylation event has total probability .
We made two assumptions in the calculation of the emission probabilities: (i) measurement errors did not occur in the collection of our data; relaxation of this assumption to incorporate error is described below; and (ii) there is no active removal of methyl groups on the parent strand when DNA is replicated , , , , which means that a CpG methylated before replication remains methylated after replication. Although active removal of methyl groups has been reported during early development, in cancer cells (see  for review), and for transcriptionally active loci under perturbation , , this phenomenon seems uncommon, if it occurs at all, in somatic cells in normal individuals, which are the cell types we study here.
To distinguish between the DNMT1 process and the DNMT3 process on the daughter strand, in the simplest version of the HMM we draw on the existing evidence that the two classes of methyltransferases exhibit different substrate preferences , , , , , . When the DNMT3s are associated with the daughter strand, we assume that they add a methyl group with probability 1 () at both hemimethylated and unmethylated CpGs. That is, association is synonymous to methylation for the DNMT3s on the daughter strand. In contrast, when DNMT1 is associated with the daughter strand, we allow it to methylate CpGs at hemimethylated sites and at unmethylated sites with different probabilities and , respectively, with the ratio being the hemi-preference ratio. To also estimate the hemi-preference ratio for the DNMT3s on the daughter strand, , we use a different set of constraints, namely and (Materials S1).
Incorporating measurement errors due to bisulfite conversion.
We consider two types of measurement errors due to bisulfite conversion , : failure of bisulfite conversion, which occurs with probability per CpG, and inappropriate bisulfite conversion, which occurs with probability per CpG (see definitions in Table 4). We assume that these errors occur independently across CpGs and DNA strands . Denote and as the observed methylation states at the parent and daughter CpGs, respectively, on the -th methylation pattern at the -th CpG dyad, with possible measurement error. Emission probabilities accounting for these measurement errors are:(3)where and are functions of measurement error probabilities and (Table 4), whereas is previously defined as the emission probability without measurement error (Table 3).
Software implementing the HMM.
The models and analyses presented here are implemented in the computer program MethylHMM, which can be downloaded from http://stephenslab.uchicago.edu/software.html. This program includes also all the data sets analyzed here.
Human in vivo double-stranded methylation data
We used hairpin-bisulfite PCR  to collect double-stranded methylation patterns of single molecules from the promoter region of genes and , two loci on the inactive X chromosome, and gene on Chromosome 7. Molecular barcodes and batchstamps were used to help identify and remove contaminant and redundant methylation patterns . To capture the variation in methylation patterns across cells, we collected multiple patterns from each individual sampled (Table: 1). Each pattern (see examples in Figure 2) consists of methylation states at CpG sites on the parent and daughter strands at this locus in an individual cell, with no direct information as to which is the parent strand and which is the daughter. The and data were collected on the hypermethylated, inactivated X chromosome in somatic lymphocytes from human females. The data were collected from fat tissues (abdomen and breast) and peripheral blood leukocytes. The data were previously analyzed in Fu et al.  under a different statistical model that assumed the methylation events at different CpG sites to be independent. The data were publised in Stöger . Features of the loci and summary statistics of the methylation data are presented in Table 1.
We are grateful to Brooks Miner for contributions to data collection, to Albert Jetsch for the discussion on the structure of DNMT3A binding complex and sharing with us double-stranded methylation data produced in his lab, and to Editor Pierre-Antoine Defossez, two anonymous reviewers and Guillaume Filion for careful reading of our manuscript and constructive comments that have greatly improved our manuscript.
Conceived and designed the experiments: AQF DPG CDL MS. Analyzed the data: AQF MS. Contributed reagents/materials/analysis tools: AQF. Wrote the paper: AQF DPG CDL MS. Commented on manuscript: RS Contributed the G6PD data: AFB.
- 1. Jones PA, Liang G (2009) Rethinking how DNA methylation patterns are maintained. Nat Rev Genet 10: 805–811.PA JonesG. Liang2009Rethinking how DNA methylation patterns are maintained.Nat Rev Genet10805811
- 2. Fu AQ, Genereux DG, Stöger R, Laird CD, Stephens M (2010) Statistical inference of transmission fidelity of DNA methylation patterns over somatic cell divisions in mammals. Ann Appl Stat 4: 871–892.AQ FuDG GenereuxR. StögerCD LairdM. Stephens2010Statistical inference of transmission fidelity of DNA methylation patterns over somatic cell divisions in mammals.Ann Appl Stat4871892
- 3. Bestor TH, Laudano A, Mattaliano R, Ingram VM (1988) Cloning and sequencing of a cDNA encoding DNA methyltransferase of mouse cells: The carboxyl-terminal domain of the mammalian enzymes is related to bacterial restriction methyltransferases. J Mol Biol 203: 971–983.TH BestorA. LaudanoR. MattalianoVM Ingram1988Cloning and sequencing of a cDNA encoding DNA methyltransferase of mouse cells: The carboxyl-terminal domain of the mammalian enzymes is related to bacterial restriction methyltransferases.J Mol Biol203971983
- 4. Okano M, Xie S, Li E (1998) Cloning and characterization of a family of novel mammalian DNA (cytosine-5) methyltransferases. Nat Genet 19: 219–220.M. OkanoS. XieE. Li1998Cloning and characterization of a family of novel mammalian DNA (cytosine-5) methyltransferases.Nat Genet19219220
- 5. Kornberg A, Baker T (2005) DNA Replication. pp. 101–112.A. KornbergT. Baker2005DNA Replication.101112University Science Books, second edition. University Science Books, second edition.
- 6. Jeltsch A (2006) On the enzymatic properties of Dnmt1: speci_city, processivity, mechanism of linear diffusion and allosteric regulation of the enzyme. Epigenetics 1: 63–66.A. Jeltsch2006On the enzymatic properties of Dnmt1: speci_city, processivity, mechanism of linear diffusion and allosteric regulation of the enzyme.Epigenetics16366
- 7. Meselson M, Yuan R (1968) DNA restriction enzyme from E. coli. Nature 217: 1110–1114.M. MeselsonR. Yuan1968DNA restriction enzyme from E. coli.Nature21711101114
- 8. Leonhardt H, Page AW, Weier HU, Bestor TH (1992) A targeting sequence directs DNA methyltransferase to sites of DNA replication in mammalian nuclei. Cell 71: 865–873.H. LeonhardtAW PageHU WeierTH Bestor1992A targeting sequence directs DNA methyltransferase to sites of DNA replication in mammalian nuclei.Cell71865873
- 9. Sharif J, Muto M, Takebayashi S, Suetake I, Iwamatsu A, et al. (2007) The SRA protein Np95 mediates epigenetic inheritance by recruiting Dnmt1 to methylated DNA. Nature 450: 908–912.J. SharifM. MutoS. TakebayashiI. SuetakeA. Iwamatsu2007The SRA protein Np95 mediates epigenetic inheritance by recruiting Dnmt1 to methylated DNA.Nature450908912
- 10. Vilkaitis G, Suetake I, Klimašauskas S, Tajima S (2005) Processive methylation of hemimethylated CpG sites by mouse Dnmt1 DNA methyltransferase. J Biol Chem 280: 64–72.G. VilkaitisI. SuetakeS. KlimašauskasS. Tajima2005Processive methylation of hemimethylated CpG sites by mouse Dnmt1 DNA methyltransferase.J Biol Chem2806472
- 11. Goyal R, Reinhardt R, Jeltsch A (2006) Accuracy of DNA methylation pattern perservation by the Dnmt1 methyltransferase. Nucleic Acids Res 34: 1182–1188.R. GoyalR. ReinhardtA. Jeltsch2006Accuracy of DNA methylation pattern perservation by the Dnmt1 methyltransferase.Nucleic Acids Res3411821188
- 12. Schermelleh L, Haemmer A, Spada F, Rösing N, Meilinger D, et al. (2007) Dynamics of Dnmt1 interaction with the replication machinery and its role in postreplicative maintenance of DNA methylation. Nucleic Acids Res 35: 4301–4312.L. SchermellehA. HaemmerF. SpadaN. RösingD. Meilinger2007Dynamics of Dnmt1 interaction with the replication machinery and its role in postreplicative maintenance of DNA methylation.Nucleic Acids Res3543014312
- 13. Spada F, Haemmer A, Kuch D, Rothbauer U, Schermelleh L, et al. (2007) DNMT1 but not its interaction with the replication machinery is required for maintenance of DNA methylation in human cells. J Cell Biol 176: 565–571.F. SpadaA. HaemmerD. KuchU. RothbauerL. Schermelleh2007DNMT1 but not its interaction with the replication machinery is required for maintenance of DNA methylation in human cells.J Cell Biol176565571
- 14. Feng J, Zhou Y, Campbell SL, Le T, Li E, et al. (2010) Dnmt1 and Dnmt3a maintain DNA methylation and regulate synaptic function in adult forebrain neurons. Nat Neurosci 13: 423–430.J. FengY. ZhouSL CampbellT. LeE. Li2010Dnmt1 and Dnmt3a maintain DNA methylation and regulate synaptic function in adult forebrain neurons.Nat Neurosci13423430
- 15. Robertson KD, Wolffe AP (2000) DNA methylation in health and disease. Nat Rev Genet 1: 11–19.KD RobertsonAP Wolffe2000DNA methylation in health and disease.Nat Rev Genet11119
- 16. Hansen RS, Stöger R, Wijmenga C, Stanek AM, Canfield TK, et al. (2000) Escape from gene silencing in ICF syndrome: evidence for advanced replication time as a major determinant. Hum Mol Genet 9: 2575–2587.RS HansenR. StögerC. WijmengaAM StanekTK Canfield2000Escape from gene silencing in ICF syndrome: evidence for advanced replication time as a major determinant.Hum Mol Genet925752587
- 17. Li E, Bestor T, Jaenisch R (1996) Targeted mutation of the DNA methyltransferase gene results in embryonic lethality. Cell 69: 915–926.E. LiT. BestorR. Jaenisch1996Targeted mutation of the DNA methyltransferase gene results in embryonic lethality.Cell69915926
- 18. Gowher H, Jeltsch A (2001) Enzymatic properties of recombinant Dnmt3a DNA methyltransferase from mouse: the enzyme modifies DNA in a non-processive manner and also methylates non-CpG sites. J Mol Biol 309: 1201–1208.H. GowherA. Jeltsch2001Enzymatic properties of recombinant Dnmt3a DNA methyltransferase from mouse: the enzyme modifies DNA in a non-processive manner and also methylates non-CpG sites.J Mol Biol30912011208
- 19. Gowher H, Jeltsch A (2002) Molecular enzymology of the catalytic domains of the Dnmt3a and Dnmt3b DNA methyltransferases. J Biol Chem 277: 20409–20414.H. GowherA. Jeltsch2002Molecular enzymology of the catalytic domains of the Dnmt3a and Dnmt3b DNA methyltransferases.J Biol Chem2772040920414
- 20. Holz-Schietinger C, Reich N (2010) The inherent processivity of the human de novo methyltransferase 3a (DNMT3A) is enhanced by DNMT3L. J Biol Chem 285: 29091–29100.C. Holz-SchietingerN. Reich2010The inherent processivity of the human de novo methyltransferase 3a (DNMT3A) is enhanced by DNMT3L.J Biol Chem2852909129100
- 21. Laird CD, Pleasant ND, Clark AD, Sneeden JLS, Hassan KMA, et al. (2004) Hairpin-bisulfite PCR: assessing epigenetic methylation patterns on complementary strands of individual DNA molecules. Proc Natl Acad Sci USA 101: 204–209.CD LairdND PleasantAD ClarkJLS SneedenKMA Hassan2004Hairpin-bisulfite PCR: assessing epigenetic methylation patterns on complementary strands of individual DNA molecules.Proc Natl Acad Sci USA101204209
- 22. Miner BE, Stöger RJ, Burden AF, Laird CD, Hansen RS (2004) Molecular barcodes detect redundancy and contamination in hairpin-bisulfite PCR. Nucleic Acids Res 32: e135.BE MinerRJ StögerAF BurdenCD LairdRS Hansen2004Molecular barcodes detect redundancy and contamination in hairpin-bisulfite PCR.Nucleic Acids Res32e135
- 23. Genereux DP, Miner BE, Bergstrom CT, Laird CD (2005) A population-epigenetic model to infer site-specific methylation rates from double-stranded DNA methylation patterns. Proc Natl Acad Sci USA 102: 5802–5807.DP GenereuxBE MinerCT BergstromCD Laird2005A population-epigenetic model to infer site-specific methylation rates from double-stranded DNA methylation patterns.Proc Natl Acad Sci USA10258025807
- 24. Durbin R, Eddy S, Krogh A, Mitchison G (1998) Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids. Cambridge University Press. R. DurbinS. EddyA. KroghG. Mitchison1998Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic AcidsCambridge University Press
- 25. Liu JS (2004) Monte Carlo Strategies in Scientific Computing. Springer. pp. 105–152.JS Liu2004Monte Carlo Strategies in Scientific ComputingSpringer105152
- 26. Genereux DP, Johnson WC, Burden AF, Stöger R, Laird CD (2008) Errors in the bisul_te conversion of DNA: modulating inappropriate- and failed-conversion frequencies. Nucleic Acids Res 36: e150.DP GenereuxWC JohnsonAF BurdenR. StögerCD Laird2008Errors in the bisul_te conversion of DNA: modulating inappropriate- and failed-conversion frequencies.Nucleic Acids Res36e150
- 27. Burden AF, Manley NC, Clark AD, Gartler SM, Laird CD, et al. (2005) Hemimethylation and non-CpG methylation levels in a promoter region of human LINE-1 (L1) repeated elements. J Biol hem 280(15): 14413–14419.AF BurdenNC ManleyAD ClarkSM GartlerCD Laird2005Hemimethylation and non-CpG methylation levels in a promoter region of human LINE-1 (L1) repeated elements.J Biol hem280151441314419
- 28. Bestor TH, Ingram VM (1983) Two DNA methyltransferases from murine erythroleukemia cells: purification, sequence specificity, and mode of interaction with DNA. Proc Natl Acad Sci USA 80: 5559–5563.TH BestorVM Ingram1983Two DNA methyltransferases from murine erythroleukemia cells: purification, sequence specificity, and mode of interaction with DNA.Proc Natl Acad Sci USA8055595563
- 29. Hermann A, Goyal R, Jeltsch A (2004) The Dnmt1 DNA-(cytosine-C5)-methyltransferase methylates DNA processively with high preference for hemimethylated target sites. J Biol Chem 279: 48350–48359.A. HermannR. GoyalA. Jeltsch2004The Dnmt1 DNA-(cytosine-C5)-methyltransferase methylates DNA processively with high preference for hemimethylated target sites.J Biol Chem2794835048359
- 30. Jurkowska RZ, Anspach N, Urbanke C, Jia D, Reinhardt R, et al. (2008) Formation of nucleoprotein filaments by mammalian DNA methyltransferase Dnmt3a in complex with regulator Dnmt3L. Nucleic Acids Res 36: 6656–6663.RZ JurkowskaN. AnspachC. UrbankeD. JiaR. Reinhardt2008Formation of nucleoprotein filaments by mammalian DNA methyltransferase Dnmt3a in complex with regulator Dnmt3L.Nucleic Acids Res3666566663
- 31. Rajavelu A, Jurkowska RZ, Fritz J, Jeltsch A (2011) Function and disruption of DNA Methyltransferase 3a cooperative DNA binding and nucleoprotein _lament formation.A. RajaveluRZ JurkowskaJ. FritzA. Jeltsch2011Function and disruption of DNA Methyltransferase 3a cooperative DNA binding and nucleoprotein _lament formation.
- 32. Jia D, Jurkowska RZ, Zhang X, Jeltsch A, Cheng X (2007) Structure of Dnmt3a bound to Dnmt3l suggests a model for de novo DNA methylation. Nature 449: 248–251.D. JiaRZ JurkowskaX. ZhangA. JeltschX. Cheng2007Structure of Dnmt3a bound to Dnmt3l suggests a model for de novo DNA methylation.Nature449248251
- 33. Fu AQ (2008) Models and Inference of Transmission of DNA Methylation Patterns in Mammalian Somatic Cells. AQ Fu2008Models and Inference of Transmission of DNA Methylation Patterns in Mammalian Somatic Cells.Ph.D. thesis, University of Washington. Ph.D. thesis, University of Washington.
- 34. Law JA, Jacobsen SE (2010) Establishing, maintaining and modifying DNA methylation patterns in plants and animals. Nat Rev Genet 11: 204–220.JA LawSE Jacobsen2010Establishing, maintaining and modifying DNA methylation patterns in plants and animals.Nat Rev Genet11204220
- 35. Métivier R, Gallais R, Tiffoche C, Le Péron C, Jurkowska RZ, et al. (2008) Cyclical DNA methylation of a transcriptionally active promoter. Nature 452: 45–52.R. MétivierR. GallaisC. TiffocheC. Le PéronRZ Jurkowska2008Cyclical DNA methylation of a transcriptionally active promoter.Nature4524552
- 36. Kangaspeska S, Stride B, M´etivier R, Polycarpou-Schwarz M, Ibberson D, et al. (2008) Transient cyclical methylation of promoter DNA. Nature 452: 112–116.S. KangaspeskaB. StrideR. M´etivierM. Polycarpou-SchwarzD. Ibberson2008Transient cyclical methylation of promoter DNA.Nature452112116
- 37. Arber W (1974) DNA modification and restriction. Prog Nucleic Acid Res Mol Biol 23: 185–188.W. Arber1974DNA modification and restriction.Prog Nucleic Acid Res Mol Biol23185188
- 38. Smith SS, Hardy TA, Baker DJ (1987) Human DNA (cytosine-5)methyltransferase selectively methylates duplex DNA containing mispairs. Nucleic Acids Res 15: 6899–6916.SS SmithTA HardyDJ Baker1987Human DNA (cytosine-5)methyltransferase selectively methylates duplex DNA containing mispairs.Nucleic Acids Res1568996916
- 39. Stöger R (2006) In vivo methylation patterns of the leptin promoter in human and mouse. Epigenetics 1: 155–162.R. Stöger2006In vivo methylation patterns of the leptin promoter in human and mouse.Epigenetics1155162