Calculation of the free energy of protein folding and delineation of its pre-organization are of foremost importance for understanding, predicting and designing biological macromolecules. Here, we introduce an energy smoothing variant of parallel tempering replica exchange Monte Carlo (REMS) that allows for efficient configurational sampling of flexible solutes under the conditions of molecular hydration. Its usage to calculate the thermal stability of a model globular protein, Trp cage TC5b, achieves excellent agreement with experimental measurements. We find that the stability of TC5b is attained through the coupled formation of local and non-local interactions. Remarkably, many of these structures persist at high temperature, concomitant with the origin of native-like configurations and mesostates in an otherwise macroscopically disordered unfolded state. Graph manifold learning reveals that the conversion of these mesostates to the native state is structurally heterogeneous, and that the cooperativity of their formation is encoded largely by the unfolded state ensemble. In all, these studies establish the extent of thermodynamic and structural pre-organization of folding of this model globular protein, and achieve the calculation of macromolecular stability ab initio, as required for ab initio structure prediction, genome annotation, and drug design.
Citation: Kentsis A, Gindin T, Mezei M, Osman R (2007) Calculation of the Free Energy and Cooperativity of Protein Folding. PLoS ONE 2(5): e446. doi:10.1371/journal.pone.0000446
Academic Editor: Hilal Lashuel, Swiss Federal Institute of Technology Lausanne (EPFL), Switzerland
Received: January 17, 2007; Accepted: April 20, 2007; Published: May 16, 2007
Copyright: © 2007 Kentsis et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: National Institutes of Health Medical Scientist Training Program, Grant DK 43046.
Competing interests: The authors have declared that no competing interests exist.
The importance of accurately defining the molecular ensembles of proteins was recognized early by Levinthal, who concluded that folding of a random coil by way of a diffusive search of its combinatorially vast conformational space is incompatible with the biological energies and timescales of protein folding . Consequently, either the conformational space of unfolded proteins deviates from that of a random coil, or the conformational search is not entirely diffusive, being guided by folding pathway(s), leading to proposals of hierarchical (thermodynamic) and framework (kinetic) folding models, respectively –. The extent to which these two fundamental mechanisms cooperate in the biological attainability of the folding search is unknown.
Structured unfolded states have been observed in a variety proteins –. However, it is unknown whether these macroscopically observed structures correspond to the conformations of individual residues, or to an average of microscopic configurational states that are composed of groups of residues. The former is consistent with the random, albeit conformationally biased (statistical) coil model of the unfolded state, and means that efficient folding is achieved largely by way of kinetic pathways. The latter is not, and implies that the unfolded state is thermodynamically pre-organized. Establishment of the extent of such pre-organization determines the relative contribution of the hierarchical (thermodynamic) and framework (kinetic) folding mechanisms, and is thus of major importance for understanding, predicting and designing biological macromolecules.
Study of this question has been made difficult by the spectroscopic limits of resolving microscopic ensemble sub-states that exist under the conditions of physiologic temperature, pressure, and hydration . Such resolution is achievable theoretically by using molecular mechanics calculations, but is practically limited by the computational limits of simulating proteins in water under physiological conditions. These limits stem precisely from the dependence of conformational sampling of flexible solutes on the molecular properties of the solvent. Conventionally, these limitations are overcome through the implicit treatment of solvent effects, as in the approximation of Born . However, its tested implementations do not appear to reproduce the thermodynamics and structures of natural proteins under physiologic conditions , though recently introduced algorithms appear to be more accurate –.
Usage of Monte Carlo (MC) algorithms that utilize simultaneous changes of many conformational variables, such as loop torsion MC and replica exchange MC (REM), has shown promise in efficiently calculating convergent ensembles of proteins in aqueous solution –. However, application of loop torsion MC to protein folding depends on the analytical solutions of the loop closure problem, currently available for six polypeptide torsions . REM or parallel tempering MC achieves changes of all conformational variables in aqueous solution through the use of global updates such as molecular dynamics (MD), but requires prohibitively large numbers of replicas in order to generate sufficient energy overlaps, as required by the Metropolis criterion , . This Metropolis limit derives from the statistics of energy fluctuations, whereby the energy overlap between adjoining replicas required for efficient MC exchange scales as n−½, where n is the number of degrees of freedom, which are mostly of bulk water molecules. Recently, partial REM and REM with solute tempering (REST) have been developed to extend the Metropolis limit of REM for the simulations of protein folding in aqueous solution , . Both do so by reducing the effective number of the degrees of freedom that contribute to the Metropolis energy criterion.
Here, we introduce another such variant, termed replica exchange MC with energy smoothing (REMS), that does so by manipulating the energy expression itself. We show that in spite of deforming the free energy surface to some extent, REMS yields apparently canonical free energy distributions in the energetic regime of biological systems. Consequently, we apply REMS to simulate the thermal folding of a small globular protein, the 20-residue Trp cage TC5b, under the near physiologic conditions of molecular hydration. We show that such an approach can be used for efficient and accurate calculation of protein stability ab initio, at least with respect to the folding of TC5b. And finally, by using self-consistent clustering and machine graph learning, we examine the origin of cooperativity and thermal stability of various structural motifs in this model protein. As a result, we offer a demonstration of the extent of thermodynamic and structural pre-organization of protein folding, important for understanding the mechanics of this phenomenon, with implications for a variety of problems, such as those that require calculations of free energies including structure prediction, genome annotation, and drug design.
Results and Discussion
Canonical molecular ensembles in water using REMS
TC5b is a small globular protein, consisting of several natural and redesigned structural motifs (Fig. 1). To generate a set of molecular ensembles of the thermal folding of TC5b, we equilibrated 32 replicas of TC5b in explicit water at 273–363 K, corresponding to the temperature range of experimentally measured thermal stability of TC5b . This approach differs from earlier replica exchange simulations of TC5b –, in particular by using periodic boundary conditions that are large enough (60×60×60 Å3) to accommodate a fully extended TC5b in explicit water, a 100 ps MD trajectory phase prior to replica exchange to achieve equilibration (Fig. 2A), and a 2 ps thermalization time during exchange to prevent quenching (Fig. 2B).
The structure is composed of an N-terminal α-helix with its α-helical/secondary Q5:K8 salt bridge (red), type I β-turn S13-S14-G15 with its β-turn/tertiary D9:R16 salt bridge (blue), and a hydrophobic core that includes both α-helical Y3:W6 and tertiary W6:P19 interactions (gold mesh).
A. Instantaneous potential energy (U) as a function of MD time during evolution of the 273 K replica in the canonical NVT ensemble prior to initiating REMS, demonstrating its equilibration, as reflected in the energetic stability during the last 50 ps. B. Instantaneous potential energy (U) as a function of MD time upon replica exchange from 276 to 273 K, demonstrating thermalization in less than 2 ps. C. Average potential energy 〈U〉 of 273 K replica as a function of energy smoothing time (ts). As ts approaches 2000 fs, the standard deviation of <U> approaches the fluctuation of the energy distribution in that time domain. At ts = 200 fs, energy-smoothed 〈U〉 of REMS is statistically indistinguishable from the instantaneous U used during conventional REM; double-sided p = 0.73. Bars represent ±1σ.
We used a smoothing time of 200 fs for the calculation of the Metropolis criterion during REMS (Methods), since the smoothed energy at this time shows small fluctuations, and most importantly, preserves approximately Boltzmann-weighted sampling. The difference between smoothed and near instant mean energies is less than 2.8 kcal/mol, and is not significantly different from that at shorter and near instant time intervals (Student's t-test p = 0.73; Fig. 2C), less than 10% of the total energy of the system. Usage of such energy smoothing leads to a distribution of and a mean potential energy of water (Fig. 3B) as well as temperature dependent heat capacity of water (Fig. 3C) which are statistically indistinguishable from those of exactly canonical simulations. On the other hand, usage of extremely long smoothing time of 600 fs leads to a gross underestimation of water's heat capacity, consistent with significant deviation from canonical sampling (Fig. 3C). Approximately canonical REMS with smoothing time of 200 fs leads to efficient replica exchange with mean exchange probabilities of about 30% (Fig. 4A); conventional REM of this system in explicit water being limited by Metropolis statistics of less than 1% (data not shown). Evolution of the calculated 32 ensembles for more than 4,000 exchanges with mean transition probabilities of about 30% means that the highest and lowest temperature replicas are exchanged on average more than 40 times, as confirmed by tracking the initial lowest and highest temperature replicas, containing the predominantly native and unfolded states, respectively, as they diffuse in temperature space in the course of the simulation (Fig. 4B). Consequently, the final simulation exceeds the apparent computational time constant of self-diffusion of TC5b by nearly three orders of magnitude (Fig. 4C), consistent with the simulation's convergence .
A. Histograms of potential energies (U) of different temperature replicas, demonstrating energy overlaps between adjoining temperature REMS replicas, as required for efficient MC exchange. B. Comparison of histograms of potential energies (U) of water ensembles at 273 K calculated using canonical MD (NVT) and REMS. Usage of REMS yields statistically indistinguishable mean energies and slightly increased energy fluctuations, as compared to those of canonical MD simulations, as shown by their normal fits (solid curves). C. Heat capacities at constant volume (CV) of pure water at different temperatures, as obtained experimentally (solid squares), and calculated using canonical MD (dotted diamonds) and REMS (dashed circles). Usage of REMS with extremely long smoothing time of 600 fs (REMS*, solid stars) leads to a significant underestimation of the heat capacity of water at low temperature. Sizes of symbols represent ±1σ.
A. Mean probabilities 〈P〉 of MC exchange between adjoining replicas xn and xm as a function of temperature, demonstrating that usage of REMS leads to efficient replica exchange. B. Exchanges of replicas in the temperature space, tracking the initial lowest (red dashed) and highest (blue solid) containing the predominantly native and unfolded states, respectively, as they diffuse in temperature space in the course of the simulation. C. Divergence of the normalized difference (Δ) of fraction of formed hydrophobic core W6:P19 (closed squares), hydrophobic core Y3:W6 (open circles), salt bridge D9:R16 (closed stars), α-helical Y3:L7 (solid circles) and the β-turn D9:S14 (open squares) hydrogen bonds between initial and final structures as a function of replica exchange for the 363 K replica. These measure were chosen because their non-local nature should be most sensitive to initial configuration memory effects. The total length of REMS simulation exceeds the apparent computational time constant of self-diffusion by nearly three orders of magnitude.
Calculation of thermal stability of TC5b
In order to examine the origin of thermal stability of TC5b, we calculated the apparent stabilities of various conformational motifs of TC5b as a function of temperature (Fig. 5). Their choice was guided by the naturally occurring secondary and tertiary structural elements, as well as those that were specifically redesigned in TC5b  (Fig. 1). At 273 K, REMS calculated conformational ensemble of TC5b is largely folded, with nearly all molecules forming the N-terminal α-helix, the β-turn, the C-terminal polyprolyl helix (Fig. 5A), and tertiary and secondary hydrophobic cores (Fig. 5B). In contrast to the average NMR structure, the β-turn hydrogen bond and salt bridge, as well as the α-helical hydrogen bonds are largely (~90%) but not persistently formed. On the other hand, the α-helical salt bridge is formed only in half of the ensemble (Fig. 5B), in agreement with the experimental observations of TC5b , –.
A. Fraction of formed α-helix L2YIQWLK8 (dashed black), β-turn S14 (solid green), and polyprolyl helix P18 (dotted blue), as defined using self-consistent clustering and enumeration of their backbone dihedral angles. Note that P18 remains unchanged in its backbone conformation due to its definition in CHARMM. Individual α-helical residues have varying thermal stability, with the more N-terminal ones being less stable, consistent with the existence of α-helical fraying. B. Fraction of formed α-helical salt/secondary bridge Q5:K8 (solid red), α-helical hydrogen bond Y3:L7 (dotted red), β-turn/tertiary salt bridge D9:R16 (solid blue), β-turn hydrogen bond D9:S14 (dashed green), tertiary hydrophobic core W6:P19 and Y3:P19 (solid and dashed black), and secondary hydrophobic core Y3:W6 (dashed red), as defined by using self-consistent clustering and enumeration of their distances. Note that the α-helical salt/secondary bridge is only partially formed at low temperature, even though the rest of the structure is nearly fully folded by other measures. Similarly, the secondary hydrophobic core Y3:W6 persists even at high temperature, where the rest of the protein is largely unfolded by other measures. Importantly, substantial amount of residual native structure persists at high temperature. C. Fraction of formed mean α-helical structure (dashed black), mean β-turn structure (solid green), mean tertiary structure (solid black) in the REMS calculated ensembles, and native fraction measured experimentally using chemical shift dispersion (squares), as adapted from the first study of TC5b .
Stabilities of both local and non-local structural motifs exhibit an apparently sigmoid melting transition (Fig. 5). In particular, the N-terminal α-helix melts with an apparent melting temperature of 300–310 K, depending on the exact residue monitored, consistent with the presence of N-terminal fraying, wherein the helical residues closer to the terminus are less stable (Fig. 5A). Similarly, the β-turn melts with an apparent melting temperature of about 310 K (Fig. 5A), associated with the destabilization of the tertiary core and the β-turn/tertiary salt bridge (Fig. 5B). Calculation of the overall melting temperature of TC5b, by using mean ensemble conformational statistics, where all conformational motifs are equally weighted, yields an apparent value of approximately 310 K (Fig. 5C), in good agreement with the experimentally measured value of 315 K . This finding differs from those of earlier replica exchange simulations of TC5b, which overestimated the apparent melting temperature by about 100 K, possibly because of continuum Born solvation , or constricted boundary conditions . However, it is important to note that our study is limited by the use of a single (CHARMM) force field and initial (native) conditions, which may bias and limit sampling, respectively.
Unfolded state ensemble
Experimental studies of TC5b indicate a substantial amount of residual structure in the unfolded state ensemble at high temperature . Our calculated high temperature ensemble also exhibits such structures, in particular possessing up to about 10% β-turn, 20% α-helical content, and 30% tertiary hydrophobic core (Fig. 5). Remarkably, nearly 60% of molecules in the high temperature ensemble contain the secondary hydrophobic core (Fig. 5B), in agreement with the experimental findings of such residual structure, as observed by using both NMR and fluorescence spectroscopies , . This residual structure may arise from the persistence of various native-like conformations (isolated α-helical turn or hydrophobic core) in different molecules of the unfolded state ensemble that is otherwise non-native and heterogeneous. Conversely, this residual structure may be due to configurations of groups of conformations (associated α-helix and hydrophobic core) in an unfolded state ensemble that is relatively homogeneous with respect to these native-like configurations. Though indistinguishable macroscopically, these characteristically composed molecular ensembles diverge in the ways they affect protein folding and stability.
Graph manifold learning of the unfolded state ensemble
In order to discover the origin of residual structure at high temperature, we applied a graph-based approach designed to learn the natural coordinates of highly dimensioned data. By embedding the molecular ensemble in a graph based on geometric similarity, and projecting the individual structures onto a manifold that preserves nearest-neighbor geometric relations of this graph, we are able to distinguish globally organized configurations, termed mesostates, from groups of structures comprised of unrelated conformations (Methods). Indeed, the high temperature manifold is comprised of several such mesostates, including configurations of secondary structures such as the N-terminal α-helix and the β-turn, as well as more complex configurations that contain both the α-helix and the tertiary hydrophobic core, for example (Fig. 6). These configurations are not due to the use of the NMR structure as the starting configuration for REMS, as the latter's memory is lost after about 30 replica exchanges and the final ensemble is evolved for more than 4,000 exchanges (Fig. 4B&C). Instead, these configurations appear to pre-organize the unfolded state ensemble for folding by virtue of arranging individual interactions and conformations in the context of native-like mesostates. This pre-organization is likely inherent to the polypeptide sequence of TC5b, as suggested by energy minimization calculations of fragments of TC5b .
Mapping of the unfolded state ensemble, as calculated using the 363 K replica, onto the two top coordinates of its locally linear embedding space (open black circles), and the two top coordinates of its principal component projection (solid green circles). Principle component analysis fails to discern mesostate structure of the unfolded state ensemble, with the entire ensemble located near the origin of the PCA projection. On the other hand, displacement along the manifold from the origin of the LLE map coincides with the formation of native-like mesostates, containing: 1) α-helical/secondary salt bridge (red), 2) β-turn/tertiary salt bridge (blue), 3) α-helix and α-helical hydrophobic core, and 4) nearly native configurations with both the α-helix and the tertiary hydrophobic core.
Folding cooperativity and pre-organization
In order to estimate the extent of pre-organization of the thermal folding of TC5b by the residual structure of the high temperature ensemble, we calculated the apparent cooperativities of forming pairs of conformations into configurations, as expressed by the probabilities of forming these configurations conditional on the formation of their constituent conformations (Table 1). The conditional probabilities of forming these four-body interactions are related to the mesostate organization of the thermal folding reaction. Consistent with the presence of configurations containing the N-terminal α-helix in the high temperature ensemble (Fig. 6), the apparent conditional probability of forming both the α-helical hydrogen bond and the α-helical salt bridge exceeds the expected probability of forming this configuration assuming independence of its constituent conformations by more than a factor of 10 (Table 1). Similar effect is observed for the apparent cooperativities of formation of other configurations, involving both the secondary and tertiary hydrophobic cores and β-turn (Table 1). This surprising phenomenon is likely due to the thermodynamic coupling between the formation of individual native-like conformations and their organized configurations, such that native-like conformations are adopted essentially in the context of topologically native configurations.
Apparent coupling between local (conformational) and non-local (configurational) contacts has been noted earlier during the folding of Gō lattice polymers, where its origins were related to the details of the potential energy function defining the native state –. As the Gō protein model is supplemented with backbone interactions, local backbone conformations can lead to progressive non-local organization . The finding of analogous conformational-configurational coupling during the folding of TC5b (Table 1), where on the other hand the folding process is defined by an atomic polypeptide in the context of a semi-empirical, classical force field (Methods), suggests that such coupling is inherent to the properties of the hydrated polypeptide itself.
The apparent cooperativity between forming concomitant α-helical and tertiary hydrophobic cores of TC5b exceeds the expected non-cooperative value by nearly a factor of 3 (Table 1). Because the formation of both α-helical and tertiary hydrophobic cores defines most of the native topology of TC5b (Fig. 1), this suggests that the residual unfolded state structure in the form of native-like configurations and mesostates at high temperature (Fig. 6) is responsible for most of the folding search. This phenomenon is similar to the pre-organization of α-helix formation in hydrated polyalanine , for which the microscopically pre-organized unfolded state contributes as much as half to the folding search , . Altogether, the findings of such extensive pre-organization of both secondary structures as well as globular proteins suggest that the apparent biological efficiency of protein folding is due in large part to the thermodynamic pre-organization, as opposed to kinetic guidance. This pre-organization acts to reduce the conformational space available to the diffusive search of the unfolded state ensembles that are pre-ordered in configurational mesostates.
Graph manifold learning of folding mesostates
In order to assess how the thermal folding reaction can proceed by way of configurational mesostates, we examined the folding ensemble at the midpoint of its folding transition as comprised by the 310 K replica, by using graph manifold learning. At the folding midpoint, the unfolded and native state ensembles are equi-populated, and their inter-conversion defines all of the possible folding pathways . Projections of individual configurations of the folding ensemble onto its LLE space map a star-shaped manifold, with multiple mesostates radiating from the origin of the projection (Fig. 7). Displacement along the M1 coordinate of the manifold coincides with the transformation between the native and unfolded structures, with configurations near the origin of the LLE map being partially native-like (Fig. 7). Displacements along the M2 and M3 coordinates coincide in part with the transformations of the α-helix and the β-turn, respectively, either in the context of native-like or unfolded topologies, depending on the particular location along the M1 coordinate (Fig. 7). The LLE mapping identifies a wide variety of folding mesostates, including those that possess a near native topology and α-helix but lack a native β-turn, those that lack the tertiary hydrophobic core and the native β-turn but retain the α-helix, as well as those that possess a near native β-turn and hydrophobic cores but lack the α-helix (Fig. 7). The existence of such mesostates explains the observed stabilities of their constituent conformational motifs (Fig. 5), as well as the apparent cooperativities of their configurations (Table 1). Combined with the star-shaped organization of the manifold of TC5b's folding ensemble, the variety of these folding mesostates suggest that the thermal folding reaction of TC5b is structurally heterogeneous. Though the folding of TC5b is pre-organized extensively by the unfolded state ensemble (Table 1&Fig. 6), this heterogeneity implies a relative diversity of available folding pathways, in agreement with experimental studies . Determination of the exact subset(s) of folding mesostates that contribute to the kinetic transition state ensemble and the overall folding mechanism is an important direction of future work.
Mapping of TC5b's folding ensemble at the midpoint of its thermal transition, as calculated using the 310 K replica, onto the top three coordinates of its LLE manifold. Displacement along the M1 coordinate of the manifold coincides with the transformation of the 5) nearly native and 6) partially unfolded mesostates that lack the tertiary hydrophobic core and the native β-turn, but retain a frayed α-helix and the tertiary salt bridge. Displacement along the M2 coordinate coincides in part with the transformation of the α-helix from mesostate 7) that possesses a near native β-turn and hydrophobic cores and a non-α-helical but compact N-terminus, and mesostate 8) that lacks the native hydrophobic cores and has a non-native β-turn centered at K8 that is part of the N-terminal α-helix in the NMR structure. Displacement along the M3 coordinate coincides with the transformation of the β-turn, including mesostates 9) that have a near native β-turn and tertiary salt bridge but have an unfolded α-helix and hydrophobic cores, and 10) possess a near native topology and α-helix but lack a native β-turn.
Insofar as the free energy of flexible polymers can be described by a configurational partition function, our study shows that molecularly adapted variants of replica exchange, including REMS introduced here, can be used for the calculation of the free energy and cooperativity of protein folding ab initio. In addition, structural configurations and mesostates unknown a priori but adopted by the folding ensemble can be discovered and characterized by using graph manifold learning methods such as LLE. Our findings indicate that the thermal folding of a model globular protein, Trp cage TC5b, involves a structurally heterogeneous set of configurations and mesostates (Fig. 7). Some of these configurations persist in the molecular ensemble at high temperature (Fig. 6), concomitant with the pre-organization of TC5b's folding by such ordered unfolded state ensemble (Table 1). Combined with observations of thermodynamic pre-organization of polypeptide secondary structures , , these findings suggest that macromolecular modularity, as described by ensemble mesostates, likely plays an essential role in determining the structures and stabilities of biological macromolecules.
Furthermore, the successes and failures of current de novo protein design approaches likely reflect the significance of configurational organization of protein ensembles and the latter's contribution to protein stability, respectively . Since TC5b's thermal stability and apparent folding cooperativity, two hallmark features of equilibrium folding of all natural proteins, are related to the residual structure of TC5b's unfolded state ensemble (Figs. 5&6), this suggests that the design of naturally stable proteins may be based on the structural preferences of unfolded polypeptides , as obtained computationally for example . Indeed, TC5b has been re-designed recently by using just such an approach . Application of advanced methods such as replica exchange Monte Carlo to sample the rugged energy spaces of proteins, and graph manifold learning to analyze the vast structural spaces of the molecular ensembles that constitute them, should prove useful for a variety of ab initio approaches to structure prediction, genome annotation, and drug design.
To understand the origin of protein stability and cooperativity, we chose to examine a protein the folding of which is well characterized structurally, thermodynamically, and kinetically. The smallest such protein is the 20-residue Trp cage , TC5b (NLYIQWLKDGGPSSGRPPPS; Fig. 1), a derivative of the Gila monster extendin-4 that has been truncated and redesigned to include an N-terminal α-helix cap (N1), α-helical/secondary salt bridge (Q5:K8), β-turn/tertiary salt bridge (D9:R16), and optimized hydrophobic stack (Y3:W6). In addition, TC5b contains a naturally occurring type I β-turn S13-S14-G15, type II polyproline helix P17-P18-P19, and a hydrophobic core containing both local secondary L2-Y3-I4 and non-local tertiary W6:P18 and Y3:P19 interactions.
NMR structure of TC5b (PDB code 1L2Y; model 1) was used as the starting configuration for our studies. The structure was solvated under periodic boundary conditions using a 60×60×60 Å3 cubic box of equilibrated TIP3 water, and energy minimized using the CHARMM27 potential energy function in the presence of one randomly placed chloride ion to yield electroneutrality , . The resulting system was heated using molecular dynamics with a linear gradient of 20 K/ps and equilibrated in the isothermal-isobaric (NPT) ensemble at 273 K and 1 atm pressure for 100 ps, using the Leapfrog Verlet integrator with velocity rescaling, 2 fs integration time step, energy-conserving Nose-Hoover thermostat, SHAKE to constrain hydrogen atoms, center of mass updates to remove rotational and translational solute motion, and particle mesh Ewald (PME) summation to calculate electrostatic interactions, as implemented in CHARMM. Because these calculations were already in progress, we did not use the subsequently introduced CHARMM backbone dihedral parameter correction . Upon equilibration, systems were 60.7×60.7×60.7 Å3 in volume, containing a total of 21,640 atoms and 7,112 water molecules. Such size and equilibration was necessary to thermalize and unfold this protein (see below). This system was used as the initial state for molecular dynamics equilibrations in the canonical (NVT) ensemble for 100 ps at mean temperatures of 273+3n K, where n = (0, 31).
For REM, we utilized the MMTSB Tool Set, a recently developed collection of Perl scripts that interface with CHARMM . Thirty two replicas were prepared as described above, thermalized at temperatures that were spaced between 273 and 363 K, a range chosen based on the experimentally observed thermostability of TC5b . Each replica was simulated independently in the canonical ensemble under periodic boundary conditions using Leapfrog Verlet molecular dynamics with velocity rescaling, 2 fs integration time step, Nose-Hoover thermostat, SHAKE constraint, and PME electrostatics. Every 2 ps, an exchange between replicas n and m neighboring in temperature was attempted using the energy smoothed Metropolis criterion: P (xn | xm) = 1 if ΔE ≤ 0 and P (xn | xm) = exp(–ΔE) if ΔE>0, where P is the probability of exchange, ΔE = βn 〈Un〉ts–βm 〈Um〉ts, β = 1/kBT, U is potential energy, and ts is the MD smoothing time preceding the exchange over which the energies of the instantaneous configurations xn and xm are box averaged. Value of ts was tuned interactively to produce mean exchange acceptance rates of about 30%, while preserving approximately Bolzmann sampling, with ts of 200 fs used to generate the results described below. In the limit where the smoothing time is very long and the distribution of energy approaches the fluctuations in that time domain, e.g., ts>600 fs (Fig. 2C), REMS is expected to produce ensembles with significantly reduced energy differences among states, allowing transitions between states that would otherwise by very different in their energies.
Upon each exchange of replicas neighboring in temperature, another exchange using the new pairs of neighboring replicas was attempted in order to maximize the tempering effect and the movement of replicas across the sampled temperature range. Upon a completed exchange, velocities of the exchanged configurations were rescaled to the new temperatures, another exchange was attempted 2 ps later, and the entire REMS simulation was produced for a total of 4,710 exchanges, while discarding 100 initial exchanges, corresponding to more than 0.3 µs of aggregate MD time, and sampling more than 150 million configurations.
Energy smoothing of REMS is equivalent to introducing an error into the calculation of the Metropolis criterion, and consequently produces non-stationary distributions of Markov chains of configurations. Though different in origin, this feature of REMS is analogous to the lack of stationary distributions produced by other tempering methods such as variants of Jump-walking (J-walking), where the conventional MC walker is allowed large transitions sampled from a different temperature ensemble, yielding generally non-stationary distributions of states , . Nevertheless, it can be shown that approximately canonical distributions of states can be generated by using tempering MC methods such as J-walking when the jumping frequency is low compared to the total length of the MC walker, e.g., when the deformation of the free energy of the system is small relative to the differences in energy of major ensemble states , .
In order to evaluate the suitability of REMS to actually recover canonical energy distributions, we calculated the constant volume heat capacity of pure water: Cv = (〈U2〉–〈U〉2)/kBT2. Because heat capacity reports squares of energy fluctuations, it is an extremely sensitive measure of the equipartition of energy that characterizes canonical ensembles. For this purpose, we used a 20×20×20 Å3 box of equilibrated TIP3 water under periodic boundary conditions, simulated using MD in the canonical ensemble for 1 ns, using MD protocol as described above, at four different temperatures: 273, 285, 299, and 313 K. We carried out a REMS simulation of the same system, using replicas at 273, 285, 299, and 313 K, simulated for 1,000 exchanges attempted every 1 ps with ts of 200 fs, corresponding to aggregate MD time of 1 ns, equal to that of simulations using canonical MD without REMS. As can be seen from Fig. 3, usage of the energy smoothed Metropolis criterion does not lead to any significant distortions of the mean energy of water under near physiologic conditions of temperature and pressure, as seen from the comparison of the results of MD NVT and REMS simulations. More importantly, no statistically significant differences exist between the constant volume heat capacities of water calculated using exactly canonical MD NVT and approximately canonical REMS, both of which are in good agreement with the experimentally measured values (Fig. 3) .
To evaluate the computational efficiency of REMS, we calculated mean transition probabilities of exchanging pairs of replicas adjoining in temperature during the course of the simulation of the thermal folding of TC5b. As can be seen from Fig. 4, usage of REMS improves the otherwise system size-limited parallel tempering MC, yielding mean exchange acceptance ratios of about 30%, similar to traditional MC transition probabilities. To evaluate sampling efficiency, we calculated the evolution of the apparent self-diffusion coefficient Δ0−N = (f(0) − f(N))/f(final), as a function of simulation length with respect to the number of replica exchanges N, where f is a phase space variable, such as the fraction of the native hydrophobic core of TC5b. If the sampling of phase space is ergodic, Δ0−N decays to one at long N. This is a necessary but insufficient condition of ergodicity, since it depends on the choice of initial and final conditions. Due to the requirement of carrying out multiple independent simulations, we are unable to evaluate ergodicity directly .
Microscopic analysis and clustering
In the analysis of structures of calculated ensembles, we use the term conformation to refer to geometries of individual interactions, and configuration to refer to molecular geometries of groups of interactions. Although canonical structures, such as α-helices and β-turns, have defined regular geometries, conformations in solution at ambient temperature exhibit considerable plasticity. Thus, we utilized a self-consistent method for defining conformational basins using a stepwise optimal clustering algorithm based on a self-organizing neural net, as implemented in ART-2 by Brooks and coworkers . Briefly, the cluster assignments of structural variables extracted from simulation ensembles were minimized subject to a constraint on a cluster radius, such that no member of a cluster was farther than a specified distance from the cluster center. Because the convergence of such minimizations is sensitive to initial conditions, we tested the robustness of assignments to conformational basins by recalculating cluster assignments using reshuffled trajectories (data not shown). Cluster occurrences and probabilities of sampling of conformational basins as defined in this manner were calculated using a set of home-built programs, available upon request.
In this manner, we examined the formation of the N-terminal α-helix by clustering (Φ,ψ) dihedral angles of the L2YIQWLK9 polypeptide backbone and intrahelical hydrogen bond distances between backbone amide hydrogens and carbonyl oxygens, formation of the α-helical/secondary Q5:K8 salt bridge by clustering the distance between side chain Q carboxamide oxygen and K amine nitrogen, formation of the β-turn by clustering (Φ,ψ) dihedral angles of S14 and the hydrogen bond distance between backbone D9 carbonyl oxygen and side chain S14 hydroxyl hydrogen, formation of the β-turn/tertiary salt bridge D9:R16 by clustering the distance between side chain D carboxylate carbon and R guanidino nitrogen, formation of the polyproline helix by clustering (Φ,ψ,ω) dihedral angles of P18, and lastly, formation of the hydrophobic core by clustering contact distances among side chain Y3 phenol carbon ζ, W6 indole carbon δ, and P19 imido carbon δ. For all conformational variables, probabilities of forming native conformations were calculated by using clusters with near native centroids, as referenced to the NMR structure of TC5b.
Folding manifold learning
Because probabilities of forming structural configurations, such as folding intermediates, cannot be derived from conformational probabilities a priori, we examined their occurrence by direct enumeration of conditional probabilities of forming pairs of conformations. Apparent cooperativities of forming pairs of native interactions were calculated by using Ppair = P (i+j|i ; j), the probability of forming both interactions i and j under the condition that either i or j is formed.
In order to discover configurations that involve more than four-body interactions described above, we applied non-linear graph manifold learning techniques. Conventionally, study of high dimensional data such as atomic protein folding trajectories has been done using linear methods such as principal component analysis (PCA). PCA works by computing linear projections of greatest variance from the top eigenvectors of the data covariance matrix, thereby preserving the covariance structure of the data. However, because the global structure of high dimensional data is not necessarily linear, low dimensional linear principal components fail to capture this structure adequately (Fig. 6) . Recently, graph based methods, including locally linear embedding (LLE), have been developed to preserve data neighbor relationships without enforcing global linearity . Simply put, such methods provide compact representations of complex data without imposing artificial constraints.
Our LLE input data set was dimensioned using the Cartesian coordinates of heavy atoms of TC5b (154 atoms × 3 (x,y,z) = 462 dimensions), and included 2,355 configurations sampled from the 363 K replica to model the unfolded state ensemble, or from the 310 K replica to model the folding ensemble. All coordinates were centered and oriented with respect to the NMR structure of TC5b (PDB model 1, see Methods) in order to simplify the calculated manifolds, though this procedure is not required, in contrast to PCA , . LLE was carried out by calculating Euclidean distances between individual configurations, as defined by the Cartesian coordinates of their heavy atoms, and constructing nearest neighbor graphs using k-means clustering to define nodes of k-nearest neighbors. For the results shown below, we used k of 18. Varying k between 12 and 20 produced no qualitative differences in resulting manifolds (data not shown). The constructed graphs contained edges that specified nearest neighbor relations, as based on geometric similarity of Cartesian coordinates of heavy atoms, with edge weights computed by reconstructing each input configuration xi from its k-nearest neighbors and minimizing the reconstruction error εW = Σi (xi−Σj Wijxj)2. The low dimensional manifold that preserved these locally linear neighbor relations was constructed by minimizing εψ = Σi (ψi−Σj Wijψj)2, where ψi is the low dimensional embedding of the high dimensional configuration xi. Such a manifold preserves distance relationships of the data, subject to the constraints of the nearest-neighbor graph and the locally (but not globally) linear embeddings that describe it.
Our approach is related to other graph-based studies of molecular ensembles –, but instead of analyzing kinetic or energetic relations among states with respect to each other, we examine their geometric (dis)similarities with respect to the overall organization of the ensemble. In this way, projections of the high dimensional configurations xi, as sampled from their molecular ensembles, onto the low dimensional manifold ψi reveal groups of geometric mesostates and their ensemble coordinates.
We thank Leslie Greengard for helpful discussions, Alex Proekt for comments on the manuscript, and Michael Feig for help with the MMTSB Tool Set. This study utilized the high-performance computational capabilities of the Biowulf PC/Linux cluster at the National Institutes of Health, Bethesda, MD (http://biowulf.nih.gov).
Conceived and designed the experiments: AK RO. Performed the experiments: AK. Analyzed the data: AK TG MM. Contributed reagents/materials/analysis tools: AK. Wrote the paper: AK RO.
- 1. Levinthal C (1968) Are there pathways for protein folding? Extrait du Journal de Chimie Physique 65: 44–45.
- 2. Sosnick TR, Mayne L, Englander SW (1996) Molecular collapse: the rate-limiting step in two-state cytochrome c folding. Proteins 24: 413–426.
- 3. Baldwin RL, Rose GD (1999) Is protein folding hierarchic? II. Folding intermediates and transition states. Trends Biochem Sci 24: 77–83.
- 4. Baldwin RL, Rose GD (1999) Is protein folding hierarchic? I. Local structure and peptide folding. Trends Biochem Sci 24: 26–33.
- 5. Daggett V, Fersht AR (2003) Is there a unifying mechanism for protein folding? Trends Biochem Sci 28: 18–25.
- 6. Neri D, Billeter M, Wider G, Wuthrich K (1992) NMR determination of residual structure in a urea-denatured protein, the 434-repressor. Science 257: 1559–1563.
- 7. Logan TM, Theriault Y, Fesik SW (1994) Structural characterization of the FK506 binding protein unfolded in urea and guanidine hydrochloride. J Mol Biol 236: 637–648.
- 8. Bai Y, Chung J, Dyson HJ, Wright PE (2001) Structural and dynamic characterization of an unfolded state of poplar apo-plastocyanin formed under nondenaturing conditions. Protein Sci 10: 1056–1066.
- 9. Schwalbe H, Fiebig KM, Buck M, Jones JA, Grimshaw SB, et al. (1997) Structural and dynamical properties of a denatured protein. Heteronuclear 3D NMR experiments and theoretical simulations of lysozyme in 8 M urea. Biochemistry 36: 8977–8991.
- 10. Klein-Seetharaman J, Oikawa M, Grimshaw SB, Wirmer J, Duchardt E, et al. (2002) Long-range interactions within a nonnative protein. Science 295: 1719–1722.
- 11. Kortemme T, Kelly MJ, Kay LE, Forman-Kay J, Serrano L (2000) Similarities between the spectrin SH3 domain denatured state and its folding transition state. J Mol Biol 297: 1217–1229.
- 12. Dyson HJ, Wright PE (2005) Elucidation of the protein folding landscape by NMR. Methods Enzymol 394: 299–321.
- 13. Still WC, Tempczyk A, Hawley RC, Hendrickson T (1990) Semianalytical treatment of solvation for molecular mechanics and dynamics. J Am Chem Soc 112: 6127–6129.
- 14. Zhou R, Berne BJ (2002) Can a continuum solvent model reproduce the free energy landscape of a beta-hairpin folding in water? Proc Natl Acad Sci U S A 99: 12777–12782.
- 15. Lwin TZ, Zhou R, Luo R (2006) Is Poisson-Boltzmann theory insufficient for protein folding simulations? J Chem Phys 124: 034902.
- 16. Chen J, Im W, Brooks CL Iii (2006) Balancing solvation and intramolecular interactions: toward a consistent generalized born force field. J Am Chem Soc 128: 3728–3736.
- 17. Geney R, Layten M, Gomperts R, Hornak V, Simmerling C (2006) Investigation of Salt Bridge Stability in a Generalized Born Solvent Model. J Chem Theory Comput 2: 115–127.
- 18. Hukushima K, Nemoto K (1996) Exchange Monte Carlo method and application to spin glass simulations. J Phys Soc Japan 65: 1604–1608.
- 19. Hansmann UH (1997) Parallel-tempering algorithm for conformational studies of biological molecules. Chem Phys Lett 281: 140–150.
- 20. Sugita Y, Okamoto Y (1999) Replica-exchange molecular dynamics method for protein folding. Chem Phys Lett 314: 141–151.
- 21. Kentsis A, Mezei M, Gindin T, Osman R (2004) Unfolded state of polyalanine is a segmented polyproline II helix. Proteins 55: 493–501.
- 22. Ulmschneider JP, Jorgensen WL (2004) Polypeptide Folding Using Monte Carlo Sampling, Concerted Rotation, and Continuum Solvation. J Am Chem Soc 126: 1849–1857.
- 23. Mezei M (2003) Efficient Monte Carlo sampling for long molecular chains using local moves, tested on a solvated lipid bilayer. J Chem Phys 118: 3874–3880.
- 24. Mitsutake A, Okamoto Y (2004) Replica-exchange extensions of simulated tempering method. J Chem Phys 121: 2491–2504.
- 25. Nymeyer H, Gnanakaran S, Garcia AE (2004) Atomic simulations of protein folding, using the replica exchange algorithm. Methods Enzymol 383: 119–149.
- 26. Cheng X, Cui G, Hornak V, Simmerling C (2005) Modified Replica Exchange Simulation Methods for Local Structure Refinement. J Phys Chem B 109: 8220–8230.
- 27. Liu P, Kim B, Friesner RA, Berne BJ (2005) Replica exchange with solute tempering: a method for sampling biological systems in explicit water. Proc Natl Acad Sci U S A 102: 13749–13754.
- 28. Neidigh JW, Fesinmeyer RM, Andersen NH (2002) Designing a 20-residue protein. Nat Struct Biol 9: 425–430.
- 29. Zhou R (2003) Trp-cage: folding free energy landscape in explicit water. Proc Natl Acad Sci U S A 100: 13280–13285.
- 30. Pitera JW, Swope W (2003) Understanding folding and design: replica-exchange simulations of “Trp-cage” miniproteins. Proc Natl Acad Sci U S A 100: 7587–7592.
- 31. Schug A, Wenzel W (2004) All-atom folding of the trp-cage protein with an adaptive parallel tempering method. Europhys Lett 67: 307–313.
- 32. Neuweiler H, Doose S, Sauer M (2005) A microscopic view of miniprotein folding: enhanced folding efficiency through formation of an intermediate. Proc Natl Acad Sci U S A 102: 16650–16655.
- 33. Ahmed Z, Beta IA, Mikhonin AV, Asher SA (2005) UV-resonance raman thermal unfolding study of Trp-cage shows that it is not a simple two-state miniprotein. J Am Chem Soc 127: 10943–10950.
- 34. Qiu L, Pabit SA, Roitberg AE, Hagen SJ (2002) Smaller and faster: the 20-residue Trp-cage protein folds in 4 micros. J Am Chem Soc 124: 12952–12953.
- 35. Nikiforovich GV, Andersen NH, Fesinmeyer RM, Frieden C (2003) Possible locally driven folding pathways of TC5b, a 20-residue protein. Proteins 52: 292–302.
- 36. Go N, Taketomi H (1978) Respective roles of short-and long-range interactions in protein folding. Proc Natl Acad Sci U S A 75: 559–563.
- 37. Abkevich VI, Gutin AM, Shakhnovich EI (1995) Impact of local and non-local interactions on thermodynamics and kinetics of protein folding. J Mol Biol 252: 460–471.
- 38. Faisca PF, Telo da Gama MM, Nunes A (2005) The Go model revisited: Native structure and the geometric coupling between local and long-range contacts. Proteins 60: 712–722.
- 39. Cheung MS, Finke JM, Callahan B, Onuchic JN (2003) Exploring the Interplay between Topology and Secondary Structural Formation in the Protein Folding Problem. J Phys Chem B 107: 11193–11200.
- 40. Shi Z, Olson CA, Rose GD, Baldwin RL, Kallenbach NR (2002) Polyproline II structure in a sequence of seven alanine residues. Proc Natl Acad Sci U S A 99: 9190–9195.
- 41. Mezei M, Fleming PJ, Srinivasan R, Rose GD (2004) The solvation free energy of the peptide backbone is strongly conformation-dependent. Proteins 55: 502–507.
- 42. Shoemaker BA, Wang J, Wolynes PG (1997) Structural correlations in protein folding funnels. Proc Natl Acad Sci U S A 94: 777–782.
- 43. Krantz BA, Dothager RS, Sosnick TR (2004) Discerning the structure and energy of multiple transition states in protein folding using psi-analysis. J Mol Biol 337: 463–475.
- 44. Schueler-Furman O, Wang C, Bradley P, Misura K, Baker D (2005) Progress in modeling of protein structures and interactions. Science 310: 638–642.
- 45. Biswas P, Zou J, Saven JG (2005) Statistical theory for protein ensembles with designed energy landscapes. J Chem Phys 123: 154908.
- 46. Kentsis A, Mezei M, Osman R (2005) Origin of the sequence-dependent polyproline II structure in unfolded peptides. Proteins 61: 769–776.
- 47. Bunagan MR, Yang X, Saven JG, Gai F (2006) Ultrafast folding of a computationally designed trp-cage mutant: trp(2)-cage. J Phys Chem B Condens Matter Mater Surf Interfaces Biophys 110: 3759–3763.
- 48. Jorgensen W, Chandrasekhar J, Madura JD, Impey RW, Klein ML (1983) Comparison of simple potential functions for simulating liquid water. J Chem Phys 79: 926–935.
- 49. MacKerell AD, Bashford D, Bellott M, Dunbrack RL, Evanseck JD, et al. (1998) All-atom empirical potential for molecular modeling and dynamics studies of proteins. J Phys Chem B 102: 3586–3616.
- 50. Mackerell AD Jr, Feig M, Brooks CL 3rd (2004) Extending the treatment of backbone energetics in protein force fields: limitations of gas-phase quantum mechanics in reproducing protein conformational distributions in molecular dynamics simulations. J Comput Chem 25: 1400–1415.
- 51. Feig M, Karanicolas J, Brooks CL 3rd (2004) MMTSB Tool Set: enhanced sampling and multiscale modeling methods for applications in structural biology. J Mol Graph Model 22: 377–395.
- 52. Geyer CJ, Thompson EA (1995) Annealing Markov Chain Monte Carlo With Applications to Ancestral Inference. J Am Stat Assoc 90: 909.
- 53. Opps SB, Schofield J (2001) Extended state-space Monte Carlo methods. Phys Rev E 63: 056701.
- 54. Neirotti JP, Calvo F, Freeman DL, Doll JD (2000) Phase changes in 38-atom Lennard-Jones clusters. I. A parallel tempering study in the canonical ensemble. J Chem Phys 112: 10340–10349.
- 55. Brown S, Head-Gordon T (2003) Cool walking: A new Markov chain Monte Carlo sampling method. J Comp Chem 24: 68–76.
- 56. Karpen ME, Tobias DJ, Brooks CL 3rd (1993) Statistical clustering techniques for the analysis of long molecular dynamics trajectories: analysis of 2.2-ns trajectories of YPGDV. Biochemistry 32: 412–420.
- 57. Saul LK, Weinberger KQ, Ham JH, Sha F, Lee DD (2005) Spectral methods for dimensionality reduction. In: Schoelkopf B, Chapelle O, Zien A, editors. Semisupervised Learning. Cambridge, MA: MIT Press.
- 58. Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290: 2323–2326.
- 59. Hunenberger PH, Mark AE, van Gunsteren WF (1995) Fluctuation and cross-correlation analysis of protein motions observed in nanosecond molecular dynamics simulations. J Mol Biol 252: 492–503.
- 60. Prompers JJ, Bruschweiler R (2002) Dynamic and structural analysis of isotropically distributed molecular ensembles. Proteins 46: 177–189.
- 61. Singhal N, Snow CD, Pande VS (2004) Using path sampling to build better Markovian state models: predicting the folding rate and mechanism of a tryptophan zipper beta hairpin. J Chem Phys 121: 415–425.
- 62. Rao F, Caflisch A (2004) The protein folding network. J Mol Biol 342: 299–306.
- 63. Andrec M, Felts AK, Gallicchio E, Levy RM (2005) Protein folding pathways from replica exchange simulations and a kinetic network model. Proc Natl Acad Sci U S A 102: 6801–6806.