Figures
Abstract
In scientific experiments where measurement sensitivity is a major limiting factor, the optimization of experimental conditions, such as measurement parameters, is essential to maximize the information obtained per unit time and the number of experiments performed. When optimization in advance is not possible because of limited prior knowledge of the system, autonomous, adaptive optimization must be implemented during the experiment. One approach to this involves sequential Bayesian optimal experimental design, which adopts mutual information as the utility function to be maximized. In this study, we applied this optimization method to the chemical exchange saturation transfer (CEST) experiment in nuclear magnetic resonance (NMR) spectroscopy, which is used to study minor but functionally important invisible states of certain molecules, such as proteins. Adaptive optimization was utilized because prior knowledge of minor states is limited. To this end, we developed an adaptive optimization system of 15N-CEST experimental conditions for proteins using Markov chain Monte Carlo (MCMC) to calculate the posterior distribution and utility function. To ensure the completion of MCMC computations within a reasonable period with sufficient precision, we developed a second-order approximation of the CEST forward model. Both simulations and actual measurements using the FF domain of the HYPA/FBP11 protein with the A39G mutation demonstrated that the adaptive method outperformed the conventional one in terms of estimation precision of minor-state parameters based on equal numbers of measurements. Because the algorithm used for the evaluation of the utility function is independent of the type of experiment, the proposed method can be applied to various spectroscopic measurements in addition to NMR, if the forward model or its approximation can be calculated sufficiently quickly.
Citation: Kasai T, Kigawa T (2025) Autonomous adaptive optimization of NMR experimental conditions for precise inference of minor conformational states of proteins based on chemical exchange saturation transfer. PLoS One 20(5): e0321692. https://doi.org/10.1371/journal.pone.0321692
Editor: Yong Wang, Zhejiang University College of Life Sciences, CHINA
Received: October 17, 2024; Accepted: March 10, 2025; Published: May 16, 2025
Copyright: © 2025 Kasai, Kigawa. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All NMR data and in-house programs used in this study are available on Open Science Framework at https://osf.io/3xwrp/ and RIKEN Research Data Management System (R2DMS) at https://dmsgrdm.riken.jp/9w25r/.
Funding: For T. Kasai: JSPS KAKENHI Grant-in-Aid for Scientific Research (C), Grant Number JP20K06533, from Japan Society for the Promotion of Science, https://www.jsps.go.jp/ For T. Kigawa: JST Core Research for Evolutional Science and Technology (CREST), Grant Number JPMJCR13M3, from Japan Science and Technology Agency, https://www.jst.go.jp/ JSPS KAKENHI Grant-in-Aid for Scientific Research on Innovative Areas, "Sparse Modeling", Grant Number JP25120003, from Japan Society for the Promotion of Science, https://www.jsps.go.jp/ "NMR Platform" supported by the Ministry of Education, Culture, Sports, Science and Technology (MEXT), Grant Number JPMXS0450100021, from Ministry of Education, Culture, Sports, Science and Technology, https://www.mext.go.jp/ the RIKEN Pioneering Project, "Dynamic Structural Biology", from RIKEN (Institute of Physical and Chemical Research), https://www.riken.jp/ the RIKEN Pioneering Project, "Biology of Intracellular Environments", from RIKEN (Institute of Physical and Chemical Research), https://www.riken.jp/ The funders played no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
One of the primary purposes of scientific experiments is to estimate parameters of mathematical models (henceforth referred to as model parameters) that represent or approximate systems of interest. Experimental design is optimized to satisfy specific statistical criteria, e.g., small variance in the estimated model parameters [1]. Bayesian design usually aims to maximize the amount of information gathered regarding the model and/or model parameters per unit cost. Thus, it adopts the expected gain in Shannon information in terms of the model parameters as the utility function to be optimized [2,3], which is equivalent to the expected Kullback–Leibler (KL) divergence as well as the mutual information [4–6]. Sequential or iterative design, which involves optimization based on recursive pairs of experimental and design phases, is expected to outperform pre-determined experimental designs in the case of nonlinear models as it leverages information obtained from previous observations [6–8]. On this basis, combined sequential and Bayesian design has also been suggested—however, this was difficult to be realized at the time of its proposal because of computational intractability [6]. Owing to methodological and hardware developments in recent years, the scope of this approach has expanded from simplified hypothetical problems to complicated real-world problems in various research fields [9–16].
To date, only a limited number of applications of sequential design have been reported in nuclear magnetic resonance (NMR) spectroscopy. High-Resolution Iterative Frequency Identification (HIFI) NMR was developed to estimate signal positions on original 3D spectra based on 2D projections via iterative selection of optimal projection angles [17]. Based on this method, an Assignment-directed Data collection Algorithm utilizing a Probabilistic Toolkit in NMR (ADAPT-NMR) was established to select informative angles for the stochastic assignment of protein NMR signals using a Bayesian network and belief propagation approach [18]. This approach calculated the utility function analytically to determine the optimal solution for networks containing loop structures [18]. However, it depended on ingenious model-specific treatments, thereby sacrificing generalizability. For simpler models with only two model parameters, Song et al. reported sequential optimization of experimental parameters for longitudinal or transverse relaxation measurements via exhaustive evaluation of the entire model parameter space [19]. Recently, an iterative selection method for evolution times and phases has been proposed in the context of non-uniform sampling for line-shape fittings. It utilizes linear approximation of a non-linear model [20]. Thus, the next step to expand the scope of NMR applications requires the development of sequential design methodologies capable of addressing relatively complicated nonlinear models in their intact forms, even at the cost of slightly higher computation loads.
Chemical shift exchange saturation transfer (CEST) is an NMR experiment that reveals minor and, therefore, directly invisible conformations of molecules, including proteins, slowly exchanging with a major visible state (Vallurupalli et al. [21] and references therein). Conventional CEST involving numerous sampling points corresponding to evenly spaced frequency offsets of saturation pulses is significantly time consuming [22,23]. To mitigate this problem, optimization of the offset step [23], interpolation of the sampling points in the frequency domain using linear prediction in the time domain [24], and multifrequency or cosine-modulated saturation pulses [25–27] have been proposed. In general, 15N-CEST experiments exhibit high signal-to-noise ratios (SNRs), because the typical protein concentration in 15N-CEST experiments is approximately 1 mM [21], with a few exceptions in the case of small peptides or relatively large (~10%) minor populations [28,29]. Therefore existing design approaches in the case of CEST assume sufficient sensitivity, thereby excluding repetition of the same experimental condition, analogous to the so-called “sampling-limited regime” in the context of non-uniform sampling or reduced dimensionality [30]. However, in the “sensitivity-limited regime,” repetitive sampling of important experimental conditions is essential to improve sensitivity via accumulation, leading to more precise model-parameter estimation. In the context of the preceding discussion, sequential Bayesian optimal design is a promising method because it samples informative experimental conditions preferentially.
In this study, a sequential Bayesian design method applicable to 15N-CEST experiments on proteins is proposed, assuming low SNR. To achieve this, we employed Markov chain Monte Carlo (MCMC) and Riemann sum approximations to calculate the utility function. As MCMC-based Bayesian analysis involves significantly more forward model evaluation times than point estimation analysis using a gradient-descent algorithm, we introduced a second-order approximation of the relaxation coefficient to accelerate the evaluation of the forward model. We compared the precision and accuracy of the proposed and conventional methods based on model parameters estimated via simulation as well as real observation of the FF domain of the HYPA/FBP11 protein with the A39G mutation.
Results and discussion
Theoretical background of the proposed method
A detailed theoretical background of adaptive CEST is provided in Supporting Information. In this section, we present a brief summary. The pseudocode for adaptive CEST is as follows:
- set the next experimental condition
to the reference (
,
,
)
- for iteration
,
- perform CEST measurements with the condition
- process NMR data to obtain intensities
- sample model parameter
from the posterior distribution
via MCMC, where
- calculate the utility function
using the MCMC samples
- set the next experimental condition
, which maximizes
- perform CEST measurements with the condition
- repeat iteration
times
- if necessary, resample from the posterior distribution
for detailed analysis
For more details of the algorithm and the theoretical background, see S1 Text. The actual code used in this study is available on Open Science Framework at https://osf.io/3xwrp/ and RIKEN Research Data Management System (R2DMS) at https://dmsgrdm.riken.jp/9w25r/ as described in the Data Availability Statement.
The experimental condition comprised the offset,
, the strength,
, and the duration,
. of the irradiation pulse. In general, a constant
is adopted in conventional CEST experiments [22]. However, based on the similarity between CEST and
experiments [31], the adaptive adjustment of
were considered in this study to improve the performance.
The model parameter, , is a set of parameters corresponding to different residues,
, where
denotes the population ratio of the invisible (B) state,
denotes the exchange rate,
denotes the chemical shift of the B state,
denotes the longitudinal relaxation rate constant,
denotes the transverse relaxation rate constant for the observable major (A) state,
denotes that of the B state, and
denotes the basal intensity at
. We followed the assumption of Vallurupalli et al. [22] that the longitudinal relaxation rate of both states have the same
value considering their finding that the CEST data does not contain information about that of the B state,
. The chemical shift of the A state,
, is known from the spectrum.
and
are likely to be constant or correlated among residues in single-domain globular proteins. However, this is usually confirmed by performing local (individual) fitting before global fitting, which fixes
and
for all residues. In adaptive CEST,
and
are also conservatively assumed to be independent of residues at the experimental design stage, whereas, in the detailed analysis after the experiment, the global model may be used.
As the utility function, we selected mutual information, defined by , which is commonly used in Bayesian design [5,6]. Here,
denotes the stochastic variable of the future observation,
. Mutual information is the expected value of the Kullback-Leibler (KL) divergence,
, over
[4–6]. As we assumed independence of
among residues, mutual information,
, was calculated as the sum of residues,
. The dimensions (i.e., the number of parameters) of
and
are
and
, respectively, as the evaluation of
requires
times of MCMC exploration of the seven-dimensional parameter space. However, this evaluation requires less computations than the evaluation of
, which requires a single MCMC exploration of the
-dimensional parameter space. Note that the same
can be repetitively selected corresponding to different iterations, which may be effective in low-SNR cases, analogous to the increase in the number of scans in conventional NMR.
Approximation of the CEST forward model with low computational cost
While performing autonomous measurements with a sequential Bayesian design, the posterior distribution and the utility function between the iterative measurements need to be evaluated within a short period to maximize the effectiveness of the NMR machine per unit time. Owing to the intrinsic similarities between CEST and experiments, the CEST forward function has been approximated using
values in multiple papers, with reduced computational cost compared to that incurred in calculating the Bloch-McConnell equation completely [31,32]. While
can be calculated as one of the eigenvalues of the propagation matrix of the Bloch-McConnell equation, first-order approximations with some perturbations have been proposed to further reduce computational time [33,34]. However, as these approximations were not sufficiently accurate for our purpose, we approximated
to the second order (S2 Text, S4 Fig). When combined with the Palmer’s CEST approximation [31], the proposed
approximation method exhibited a typical computation time that exceeded those of first-order methods by only 25%, and was lower than that required for numerical eigenvalue calculation by an approximate factor of 30 (S3 Table).
A simple 1-residue simulation
As a proof-of-concept for adaptive CEST, we first simulated a 200-iteration experiment, henceforth referred to as simulation A1, using a virtual 1-residue protein (Fig 1a). The experimental configurations and true model parameters are listed in Supporting Information (S6 Table and S7 Table). The SNR, defined to be , was taken to be 20, where
denotes the standard deviation of the spectral background noise. The apparent SNR of the CEST curve was reduced to 12.2 when
because the off-resonance signal intensity was
. There were 803 experimental condition candidates (
), including the reference (
) for the simulation A1. The offset
spanned from -1000–1000 Hz, and the strength
was either 10 or 50 Hz.
(a) Observed signal intensities in all 200 iterations are indicated by crosses. The theoretical noiseless responses are indicated using lines. The colors represent different values of the irradiation strength, : 0 Hz = red, 10 Hz = blue, and 50 Hz = magenta. Vertical solid and dotted gray lines represent the chemical shifts of A (
) and B (
) states, respectively. (b) Red areas represent 68.3% credible intervals (CIs) for the estimated model parameters. Horizontal black lines represent the actual parameter values. (c) The selected irradiation offsets,
, are plotted indicating different values of
using different markers: 0 Hz = red triangle, 10 Hz = blue circle, and 50 Hz = magenta diamond. (d) The mutual information evaluated following observations recorded at the designated representative iterations. The experimental condition with the highest mutual information is indicated—it is selected for the next iteration. The same markers as those used in (c) were used.
and
are indicated by vertical lines, as in (a). (e) The mutual information (black circle) and KL divergence calculated based on the realized observation (blue triangle).
Fig 1b illustrates the 68% CIs of the model parameters plotted with respect to varying numbers of iterations. Unsurprisingly, the estimation of model parameters became more precise as the number of iterations was increased. During the first 20 iterations, there was almost no information regarding the chemical shift of the B state. After that, it was confirmed that was ~300 Hz, and prompting us to gather information about other exchange parameters (
,
,
,
, and
). This change also appeared during the selection of the experimental conditions. In the former iterations, the selected offset values were varied to search for a B-state dip, whereas in the later iterations, the offset values were more stable (Fig 1c). The selection of the experimental conditions during the later iterations was qualitatively explained using the simulated CEST curves. Slight changes in
and
values affected the dip size of the B state (S8 Fig). This indicated that the B-state on-resonance experiments (
) were selected because they were informative for
and
. Similarly, the slight off-resonance corresponding to the B-state (
) experiments was for
; the slight off-resonance corresponding to the A-state (
) experiments was for
; the off-resonances corresponding to
or
was for
, and the reference experiments were for
. However, because some of the model parameters were correlated, information on one parameter aided the estimation of others (S9 Fig).
Fig 1d depicts the mutual information as the utility function for representative iterations. For the first four iterations, the shape of the function varied drastically, suggesting that the posterior distributions, especially of , were considerably updated by informative observations (Fig 1d: left panel). Consequently, various offset values were selected to search for the B state dip during these iterations (Fig 1c). In contrast, after reaching confidence for
, the shape of the function was stable with
being restricted to the aforementioned typical conditions (~300 Hz, ~400 Hz, ~−450 Hz, off resonances, or the reference) at these iterations (Fig 1d right). As discussed in the Theory section, mutual information is expected to exhibit KL divergence over the observation distribution,
. Fig 1d depicts the mutual information evaluated prior to observation and the KL divergence evaluated using the realized
after observation. The mutual information decreased as the number of iterations increased (Fig 1e). This was attributed to a general lack of new information obtained from a single future observation compared to the knowledge pieced together based on numerous past observations as the number of iterations increased. In the first few iterations, the probability density of
was widespread, indicating the difficulty of prediction (Fig 2a-c). In such cases, the system confirmed unpredictable observations, as explained in the literature, where the observations were considered to be virtually free from noise [35]. However, this explanation no longer held true after the prediction of uncertainty was reduced to the noise level. In this case, the smaller KL divergence compared to that of mutual information reduced the difference between the posterior distributions before and after the observation. For example, during Iteration 32, 68% CI of the intensity of the subsequent observation was predicted to be 2.06–3.37 (Fig 2d). Because the observation at the Iteration 33 fell within the predicted range (2.73), the KL divergence was as small as 0.0167 nat, which was lower than the mutual information of 0.134 nat (Fig 2d). Such well-predicted measurements increased confidence in current knowledge. In contrast, KL divergences larger than the mutual information indicated an outlying observation derived from significant noise and/or inaccurate prediction. The former case was instantiated in Iteration 83, which featured large KL divergence owing to accidental large noise, even though the prediction of the observation was close to the true distribution (Fig 2f). The latter case was instantiated in Iteration 35. The 68% CI of the subsequent observation was 4.95–6.32, whereas the true value was 4.46. The disparity between the predicted range and the observation led to a larger KL divergence of 0.293 nat compared to the mutual information of 0.101 nat, as the observed divergence was significantly smaller than the predicted divergence (Fig 2e). Such informative observations increase the agreement between the knowledge gathered and the true values of the model parameters. As mutual information is defined as the expected value of KL divergence,
, the possibility of large knowledge multiplied with its probability updates contributes the mutual information. In other words, the system autonomously designs experiments to decrease the risk of misevaluating the model parameters.
In each panel, the mutual information at the designated iteration and the KL divergence calculated after the observation at the following iteration are depicted. The red line at the top represents the KL divergence, , plotted with respect to the future observation,
. The red line in the middle indicates the estimated
calculated based on the current knowledge plotted against
. The gray vertical line indicates the ideal noiseless response calculated using the true parameters. The gray dotted line represents the true distribution with a random observation noise. The red and gray horizontal thick lines represent the 68.3% CI of the estimated and the true
, respectively. The product of the above two functions of
,
, is represented by the red line at the bottom. As KL divergence estimates the degree of knowledge update after each subsequent observation, it tends to increase significantly when the subsequent observation is unexpected. Over the first iterations (i.e., at Iteration 1, 2, and 3), the knowledge about the model parameters is limited; thus, the estimated range of
is wide. In contrast, at later iterations (e.g., at Iteration 32, 35, and 83), the range of the estimated
reaches a width equal to the observation noise. As a result, the product,
, exhibits trapezoidal or bimodal shapes in the former and latter cases, respectively. Mutual information, represented here by a black horizontal line, is the integration of the product,
. Blue vertical lines in all plots indicate the realized observation at each successive iteration. The blue triangles in the top and the bottom panels represent the corresponding realized
and
, respectively.
Simulation with different irradiation durations
In conventional CEST, irradiation pulses are usually applied with various offsets, , a single or several strengths,
, and a fixed duration,
[22]. This simple experimental configuration is beneficial to both experimental design as well as analysis of the results. However, we varied
to improve parameter estimations, motivated by the close resemblance between CEST and
experiments, where
is varied while investigating
via curve fitting [31]. Because the design and analysis steps of the adaptive experiment are free from human instruction, increasing the dimensionality of the design space from two to three is acceptable.
To exemplify incorporating as an experimental parameter, we tested a single-residue simulation named A2 with the same configuration as the simulation A1, except for fixed
and variable values of
over 0.50, 0.75, and 1.00 s (S6 Table). The model-parameter estimation was less precise than that for A1 (S10 Fig), possibly due to the lack of variance of
[21,24]. For precise estimation of relaxation constants such as
,
was observed to be the most informative sampling point when
was known. The selected value of
was close to the inverse of the estimated
, with some exceptions possibly derived from the uncertainty of
and
estimations (Fig 3a). When the
estimate was large, smaller values of
increased reliability. However, the approximation of the CEST forward model used in this study assumed sufficiently long
to eliminate transverse magnetization in the tilted reference frame [31]. This was also true in case of the Bloch-McConnell equation because the complete measurement of
inhomogeneity is difficult [36]. For these reasons, we set the lower limit of
as 0.5 s to ensure the accuracy of forward calculation. The curves of the utility function corresponding to different
were similar even in the first iterations (Fig 3b), in contrast to those corresponding to different
in the simulation A1 (Fig 1e). Therefore, we decided to use only
= 0.5 or 1.0 s as candidates for the following simulations and measurements, conserving computational resources for the more important
variation.
. (a) Selected
values with respect to maximum-a-posteriori
. The gray line represents
. An outlier is observed at iteration 2, indicated by the letter “2”. (b) Mutual information at several representative iterations. The red, blue, magenta, and green lines correspond to
(reference),
,
, and
, respectively. The different markers represent selected experimental conditions with the highest mutual information.
Simulation involving a virtual 70-signal protein
In practical 15N-CEST experiments on proteins, we observed multiple signals corresponding to all residues, except prolines and an N-terminal residue. We defined the utility function to be the mutual information in the -dimensional model parameter space, i.e., the sum of the mutual information of individual
signals (see S1 Text for details). In this situation, because the same experimental conditions were applied to signals with potentially different model parameters at different iterations, the conditions may not have been optimal for each signal. To evaluate the performance of multiple signals, we simulated adaptive (A3 and A4) and conventional (C4) CEST using a virtual 70-signal protein (S6 Table). The number of 2D measurements was set to 192 for all simulations to ensure a fair comparison of their performances based on equal instrumental resources. For adaptive CEST,
candidates were either 6.3, 13.0, 26.2, and 50 Hz (for A3) or 6.3, 13.0, and 26.2 Hz (for A4). For conventional CEST,
values comprised 63 evenly spaced points between -1000 and 1000 Hz (32.3-Hz step);
values were the same as in A4; and
was fixed to 0.5 s. Including the three references (
),
2D measurements were performed in aggregate. We also performed conventional CEST simulations C5–C9 with double or single
values (S6 Table). All simulations were repeated ten times with different random seeds. Both conventional and adaptive CEST data were subjected to Bayesian analysis to compare the uncertainties of model parameters. Both the precision and accuracy of model parameter estimation for adaptive CEST were better than or comparable to those for conventional CEST corresponding to most signals (Fig 4a, S12 Fig). Notably, the lower bound of the CIs of
was higher in adaptive CEST. i.e., more information was obtained about
. One of the key features of adaptive CEST is that it does not require prior knowledge of the
distribution, which is generally unknown in CEST experiments. Based on a set of candidate experimental conditions with broad offsets, adaptive CEST automatically focuses on the most informative ones based on the acquired data. In contrast, conventional CEST requires a predetermined offset range, often requiring broader selection than necessary. To evaluate hypothetical scenarios where prior knowledge is available, e.g., that most
values fall within the [0, 500] Hz range, we conducted additional simulations using conventional CEST with
limited to [0, 500] Hz, as illustrated in C10 and C11 of S12 Fig. As expected, parameter estimation was less presice corresponding to residues with
or
values lying outside the aforementioned range. However, for other residues, adaptive CEST continued to provide more precise or comparable parameter estimates compared to conventional CEST.
(a) Model parameter estimation after 192 iterations or 192 2D measurements. The left, middle, and right panels correspond to adaptive CEST with ,
,
, and 50.0 Hz; adaptive CEST with
,
, and
Hz; and a conventional CEST with
,
, and
Hz; respectively. The red lines represent the 68.3% CIs of the model parameter estimates. For each residue, 10 individual simulations with different random seeds are performed and plotted. The horizontal black lines represent the true values of the parameters. The horizontal blue lines in the
plots represent
. Terminal residues and residues with
are omitted. Plots with all residues are included in Supporting Information. (b) The selected experimental condition for adaptive CEST simulation with
,
,
, and 50.0 Hz. Blue circles and red triangles correspond to non-reference and reference experiments, respectively. The first 20 iterations are highlighted in yellow. (c) Mutual information of adaptive CEST simulation with
,
,
, and 50.0 Hz plotted against
and
. Only Iterations 21–192 are illustrated, colored by a spectrum ranging from red (at Iteration 21) to blue (at Iteration 192).
Owing to variations in ,
, and the other model parameters among the signals, the optimum experimental condition depended on the signal. However, adaptive CEST optimized the experimental design notwithstanding the variety of optima. As in the case of the 1-signal simulation A1, the selected experimental condition for A3 over the first ~20 iterations was varied to investigate B-state chemical shifts (Fig 4b). During this stage, strong irradiation (
) was preferred for effective exploration with a wide irradiation range. Over the rest of the iterations, both strong (
) and weak (
or
) strengths were selected. The mutual information of the individual residues plotted against
or
indicated that stronger irradiation facilitated the collection of information from a wide range of signals while weaker irradiation facilitated the collection of more detailed information corresponding to fewer signals (Fig 4c). Adaptive CEST was autonomously balanced using these two types of irradiation by following the definition of the utility function. It should be noted that the use of both strong and weak irradiation is important for adaptive CEST for this reason, together with the reported importance of exchange parameter estimation in conventional CEST [21,24]. To investigate whether more iterations are required to reach certain model-parameter precision when multiple residues are targeted, the precision of representative residues were plotted against the iteration number (S13 Fig). Although this simulation should not be directly compared to the one-signal simulation A1 (Fig 1b) due to differences in the model parameters and experimental conditions, the precision of the model parameters apprears to largely differ between signals, some of which reached comparable precision to the one-signal case at early iterations. This difference likely results from the variance in the SNRs, chemical shifts, and/or exchange parameters. In contrast to the remaining residues, A3 and A4 underperformed corresponding to residue X28 (Fig 4a), possibly owing to its outlying
value. The proposed adaptive CEST autonomously prioritized estimation for the majority of signals, rather than for a single outlying signal based on the definition of the utility function. To focus on a specific signal, a different definition of the utility function should be used, e.g., residue-specifically weighted mutual information. Moreover, additional iterations with different utility functions would be useful for gathering more information about a specific residue after the experiment. Simulation A3, followed by an additional 48 iterations using the new utility function, i.e., the mutual information of residue X28, outperformed the simulation with the same number of iterations using the same utility function in terms of parameter estimation for residue X28 (S14 Fig).
Evaluation using real measurements
Finally, we performed a real CEST experiment with the 71-aa FF domain of the HYPA/FBP11 protein with A39G mutation [22] (Fig 5a) using the same experimental configurations as those used in simulations A3 and C4. For adaptive CEST, MCMC and mutual information calculations were performed on a remote computer, which transmitted messages of selected experimental conditions to an NMR-control computer to run iterations (Fig 6, see experimental section for details). We employed this configuration because the NMR-control computer provided by the NMR vendor had insufficient computational performance to calculate the experimental conditions involving many MCMC iterations. If the NMR-control computer has adequate computational capabilities, the program can be executed on this computer. The measurement time for a single experimental condition, i.e., a single 2D spectrum, was 19 and 24 min for and
, respectively. The typical computation times for MCMC and mutual information were 50–60 s and 18 s, respectively, using dual Intel Xeon E5-2690v4 CPUs (a total of 28 physical cores). In combination with the communication time, the typical turnaround time between NMR measurements was less than 90 s, which slightly increased the total occupation time of the machine.
(a) Observed intensities of the two representative residues in the adaptive experiment (red circle) and the conventional experiment (blue cross). and
values are indicated in each plot. Red curves represent the responses calculated using the MAP estimator after 192 iterations of the adaptive experiment. (b) Estimated model parameters of adaptive CEST with 192 iterations (left), conventional CEST with 192 2D measurements (middle), and conventional CEST with 768 2D measurements (right). The red circles and error bars represent the MAP estimator and 68.3% CIs, respectively. The black horizontal lines represent the reported parameters from conventional CEST with 2.0 mM protein [22]. The gray bars indicate 68.3% CIs from the separately recorded 15N relaxation experiments with the same 0.1 mM sample.
Fig 5b illustrates the model parameter estimates after 192 iterations of 2D measurements. The accuracy was evaluated with respect to the values of ,
, and
reported in the literature, separate inversion recovery or CPMG experiments for
,
, and conventional CEST with 4-fold more scans for all parameters (Fig 5b). Adaptive CEST estimates agreed with these values. It outperformed, or at least performed comparable to, conventional CEST in terms of precision, except in the case of G39, which exhibited an outlying
value.
General discussion
In the preceding discussion, we assumed that the forward model and the noise were known. However, the proposed Bayesian experimental design method can also be implemented in general NMR experiments or even other applications by simply substituting the forward and noise models, while retaining calculation of mutual information using MCMC. As described in the Introduction, experimental designs pursuing the best inference of model parameters have been proposed in various research fields [9–16]. The method proposed in this paper serves as another example of a Bayesian optimal sequential experimental design, in which the computation algorithm does not depend on the type of measurement. Its applicability to NMR CEST measurements was validated by introducing an approximation for the forward model compatible with relatively heavy MCMC computations. One possible drawback of this method is its dependence on forward models. The proposed system considers a two-state forward model; thus, the system does not attempt to search for a third state after finding the second one. This is problematic in certain 15N-CEST applications involving models with more than two states; e.g., the observation of intermediate states in fold-unfold equilibria [37,38]. In principle, adaptive CEST could be extended to accommodate three-state exchange explicitly, but this would require developing a new approximation method tailored for the three-state exchange model. It should be noted that, in addition to general human-instructed research, it is possible to switch the model used for analysis after data acquisition. In this case, following adaptive measurement, all data are analyzed using a three-state model, expecting some information on the third state, despite the autonomous system not actively gathering such information. If the SNR is low, as assumed in this study, it is practical to prioritize identifying only one minor state over identifying all.
In most practical applications of conventional CEST, manual recognition of minor state dips is easy when measurements are equally spaced and the SNR is high. However, under low SNR conditions, distinguishing minor dips from noise becomes challenging. One key advantage of Bayesian analysis is its objectibity—unlike manual interpretation, it outputs probability distributions based on computational analysis, enabling more reliable identification of minor states.
The optimal number of iterations depends on the trade-off between available machine time and the required precision, complicating the establishment of a universal guideline. However, as demonstrated in our example (Fig 5b), adaptive CEST performed comparably to conventional CEST based on only a quarter of the number of 2D measurements. This efficiency stems from its ability to allocate measurement resources to the most informative experimental conditions. As a rough reference, this four-fold reduction can be used to estimate the number of required iterations, even though the actual number may vary depending on factors such as protein size, the distribution of and
, and/or SNR. Notably, when the protein concentration is low adaptive CEST achieved acceptable precision values, but required more iterations than practical CEST experiments under high-SNR conditions.
Theoretically, adaptive CEST could be impremented using a global model by assuming and
to be identical for all residues and optimizing the experimental design on this basis. In this scenario, precise estimation of
and
based on a subset of residues could enable adaptive CEST to deprioritize measurements in determining
and
for other residues. However, as mentioned in the main text, implementing adaptive CEST under a global model presents significant challenges due to the infeasibility of calculating the posterior distribution and mutual information within the short time intervals between successive NMR measurements. Even if feasible, this approach risks missing data that could reveal residue-specific variations in
and
, which is generally undesirable in most protein CEST applications. Therefore, in this study, we designed experimental conditions assuming variation in
and
across residues and collected the data accordingly. Subsequently, we performed a comprehensive analysis of the complete dataset. If the results suggest that
and
are identical for all residues or over a subset of residues, the dataset can be re-analyzed under these global constraints. However, this re-analysis currently relies on fitting-based methods rather than Bayesian-based ones, owing to the unavailability of the Bayesian CEST program that supports global models.
The utility function for adaptive CEST is defined to be the sum of the mutual information across all residues. Consequently, when multiple residues favor a particular condition, their preference is more likely to be selected, leading to more precise parameter estimation for residues with dominant and
values, although at the cost of reduced precision for outliers. However, in proteins, residues within the same domain or in close proximity often exhibit cooperative motions. As a result, prioritizing the majority still allows for robust extraction of key parameters, such as
,
, and cooperative dynamics. In general, glycine residues are more likely to be outliers due to their up-field 15N random coil shifts.
To acquire responses corresponding to various frequency offsets efficiently, multifrequency or cosine-modulated saturation pulses have been used in some studies, instead of conventional single-frequency pulses [25–27]. The proposed method is capable of integrating these conventional and advanced pulses by considering them as different experimental condition candidates, provided that the forward model computation for advanced pulses is compatible with the MCMC calculations. The performance of the integrated method is expected to be better than or at least comparable to that of adaptive CEST with a conventional pulse.
The parameter range to be explored should be defined to cover the possible parameter range of the system. If it is found that the range is too narrow after the experiment, the data can be re-analyzed using a wider parameter range, although the data acquisition may be based on nonoptimal experimental design. In this study, we retrospectively confirmed the appropriateness of the parameter range based on the posterior distributions (Figs 1b, 4a, 5b, S9, S10, and S14). Although a wider parameter range can more reliably cover the possible parameter space, a narrower range of parameters is preferable for two reasons. The first is to allow the MCMC system to find the global minimum within a limited number of MCMC iterations to reduce the NMR idle time. Narrowing the range is unnecessary since its broader inclusion does not impact MCMC convergence negatively, given the monotonic response of measured intensity with respect to
variation (S8 Fig). The second is to ensure fast computation while maintaining the accuracy of the approximation. In general, an approximation that is applicable to a wider range of parameters requires a longer computation time. Among the model parameters of CEST, adequate coverage of the estimated
range by the
range, as well as the offsets of experimental condition candidates and MCMC exploration ranges for
, and
is essential. This should be determined based on prior knowledge of the
distribution and the magnetic field strength. Although we used the range
in this study, our results indicate that the approximation remains sufficiently accurate even when extended to the range
. Besides
, we believe that the proposed approximation and the parameter range used in this study constitute a balanced configuration that may be applicable to various practical systems.
In this study, the 2D measurement time varied with . As we did not consider this variation over a single iteration, the objective of the experimental design was the amount of information gathered per iteration, not per unit time. If the measurement time is considered, the mutual information per unit measurement time may be a more suitable utility function. In this study, the NMR spectrometer was idle between measurements. It is worth considering to acquire data during this period as well, e.g., using 1D 15N-HSQC to monitor the state of the sample.
As discussed previously, in some situations, extending the iterations with different utility functions is useful. If, upon completion, an experiment yields insufficient general precision for model parameter estimates, more iterations can be added after the adaptive experiment using the same utility function. In this study, we performed the experiments with a fixed number of iterations; in this context, autonomous halting or extension of the experiment based on the required precision is an interesting topic.
Furthermore, we considered adaptive CEST with four different values and two different
values. We did not attempt to wield more precise control over these parameters because the computation time for mutual information in the current algorithm was proportional to the number of discrete experimental conditions. In future works, a suitable experimental configuration should be identified for adaptive CEST.
The choice between adaptive CEST and conventional CEST depends on the desired balance between measurement resources and precision. For example, if the minimum number of scans required for phase cycling is 8, which needs to be increased to 16 due to low SNR, adaptive CEST functions advantageously by maintaining 8 scans per experiment while doubling the number of 2D measurements (i.e., iterations). This approach enables the allocation of limited measurement resources to the most informative experimental conditions. However, if the and
distributions are broad and spread uniformly over the offset range, the advantage of adaptive CEST over the conventional alternative diminishes. When applied to larger proteins, more signals are expected to occupy more diverse chemical-shift spaces. This may reduce the possibility of optimizing the experimental conditions, and this issue will be investigated a future study. Adaptive CEST may also reduce the number of measurements in a sampling-limited regime with high SNR, although this scenario has not been tested explicitly. In such high-SNR conditions, simpler experimental design algorithms that do not require Bayesian estimation might be more suitable.
Conclusions
The primary advantage of the adaptive optimization methods proposed in this paper is that it can select effective experimental conditions for model parameter estimation without human intervention, provided that a reliable forward model is available. In CEST, one of the model parameters () is almost unknown before starting the experiment, even though the design of the other parameters depends on it. In such cases, autonomous experimental design is helpful because of the independence of external instruction that it provides while switching the target model parameters. Moreover, for complicated nonlinear model functions, manual estimation of the current knowledge based on in-hand data, accurate prediction of the behavior of the observation with respect to varying model parameters, and appropriate experimental design to maximize information gathered about model parameters are difficult.
Materials and methods
Sample preparation
The gene encoding the FF domain of HYPA/FBP11 containing the A39G mutation was synthesized by Eurofins Genomics K.K. (Tokyo, Japan). A template DNA encoding FF A39G with a histidine affinity tag and a Tobacco Etch Virus (TEV) protease cleavage site at its N-terminus was constructed using a polymerase chain reaction (PCR)-based method, as described previously [39]. U-13C/15N-labeled FF A39G was produced using the dialysis mode of a cell-free protein synthesis system, with a 9-mL inner reaction solution [40–43]. Affinity purification was performed by loading the reaction solution diluted with buffer A (20 mM Tris-Cl pH 8.0, 500 mM NaCl, and 20 mM imidazole) onto a HisTrap 1-mL affinity column (Global Life Sciences Solutions, Marlborough, MA, USA) and eluting with buffer B (identical to A, except containing 500 mM imidazole). The eluate was exchanged with buffer A via ultrafiltration with Amicon Ultra 15 MWCO = 3K (Merck, Darmstadt, Germany) and subsequently cleaved with 100 ug of TEV for 16 hours at 25 °C. The cleaved product was further purified using a HiTrap SP 1-mL cation exchange column (Global Life Sciences Solutions, Marlborough, MA, USA) with a gradient of C (50 mM 2-(N-morpholino)ethanesulfonic acid (MES)-sodium, pH 6.0) and D (same as C, except containing 1 M sodium chloride) buffers. Fractions containing FF A39G were concentrated and exchanged in the NMR buffer (100 mM sodium acetate, 200 mM sodium chloride, pH = 5.7) with Amicon Ultra 15 MWCO = 3 K (Merck, Darmstadt, Germany). The cleaved protein product was 71-residues long with no cloning artifacts at either end (GSQPAKKTYT WNTKEEAKQA FKELLKEKRV PSNASWEQGM KMIINDPRYS ALAKLSEKKQ AFNAYKVQTE K).
NMR measurements
All NMR measurements were performed at 274.2 K using an AVANCE III HD 700 MHz spectrometer equipped with a TCI CryoProbe (Bruker BioSpin, Rheinstetten, Germany). Prior to recording the NMR measurements, the sample temperature was calibrated with methanol following the manufacturer’s instructions. The B1 field strength was calibrated with a 15N-labeled Tryptophan and Glutamine solution using a pulse program “hsqc_cest_f3gpphtc_b1cal” provided by the manufacturer. For the CEST measurements, 500 uL of 0.1 mM U-13C/15N FF A39G in the NMR buffer was loaded into a 5 mm NMR sample tube. Main-chain amide signals were sequentially assigned to standard triple resonance experiments [44–46]. To verify the accuracy of CEST-derived relaxation rate constants, 15N R1 and R2 were separately measured with the same sample using pulse programs “hsqct1etf3gpsi3d” and “hsqct2etf3gpsi,” respectively. The spectra were processed and analyzed using MATLAB 2020a (MathWorks, MA, USA). The detailed information for the NMR measurement is summarized in S15 Table.
Adaptive CEST experiments
All CEST measurements were performed using a modified pulse program based on “hsqc_cest_etf3gpsitc3d”, which was originally designed for pseudo-3D measurement for 1H, 15N, and the irradiation-condition dimensions. We modified it to acquire a 1H-15N 2D plane under single irradiation conditions. Each 2D plane was acquired with 64 real points, 25-Hz spectral width, and 118.5-ppm carrier frequency in the 15N dimension, with eight cumulative transients corresponding to each time point. The adaptive NMR measurements were performed with the cooperation of two computers (Fig 6)—a control computer of the NMR system and a calculation computer (HP Z840 Workstation (HP Japan Inc., Tokyo, Japan) with dual Intel Xeon E5-2690v4 CPUs and 128 GiB main memory). On the control computer, an in-house C program running on TopSpin 3.5 software (Bruker BioSpin, Rheinstetten, Germany) was used to read the offset frequency, duration, and strength of each irradiation pulse from a local text file, start a measurement, and store raw time-domain data in local storage. On the calculation computer, another in-house program running on MATLAB 2020a (MathWorks, MA, USA) was used to write the irradiation conditions to the text file on the control computer, download the time-domain raw data, process them into spectra, analyze their peak intensities, perform MCMC for Bayesian inference of model parameters, and finally select each subsequent experimental condition based on mutual information. The in-house program utilized JSch 0.1.55 (JCraft, Sendai, Japan) for the SSH connection between the control and calculation computers, NMRglue 0.7 for NMR data processing [47], and mcmcstat for the MCMC analysis [48,49]. By the MCMC analysis, the following seven model parameters were inferred with either linear or logarithmic uniform prior distributions in the designated range: (linear),
(logarithmic),
(linear),
(logarithmic),
(logarithmic),
(logarithmic),
(logarithmic). The numbers of burn-in steps, sampling steps, and thinning intervals were 20,000, 30,000, and 50, respectively, in the mutual information calculation to reduce the computation time between NMR measurements. After all the iterations were completed, another iteration of MCMC with an increased number of steps (100,000 burn-in steps and 1,000,000 sampling steps) was performed for a more detailed analysis.
Supporting information
S1 Text. The theoretical background of the proposed method.
https://doi.org/10.1371/journal.pone.0321692.s001
(PDF)
S2 Text. Second-order approximation of
for calculation of the CEST forward model.
https://doi.org/10.1371/journal.pone.0321692.s002
(PDF)
S3 Table. Computational time of various approximation methods.
https://doi.org/10.1371/journal.pone.0321692.s003
(PDF)
S4 Fig. Approximation of the CEST forward model.
https://doi.org/10.1371/journal.pone.0321692.s004
(PDF)
S5 Fig. Approximation of the
relaxation constant.
https://doi.org/10.1371/journal.pone.0321692.s005
(PDF)
S6 Table. The settings of CEST simulations in this study.
https://doi.org/10.1371/journal.pone.0321692.s006
(PDF)
S7 Table. The true model parameters of the 1-signal virtual protein for simulations A1 and A2.
https://doi.org/10.1371/journal.pone.0321692.s007
(PDF)
S8 Fig. The response to model-parameter changes in the simulation A1.
https://doi.org/10.1371/journal.pone.0321692.s008
(PDF)
S9 Fig. Two-parameter joint and one-parameter marginal posterior distribution of the simulation A1.
https://doi.org/10.1371/journal.pone.0321692.s009
(PDF)
S10 Fig. Model-parameter estimation of the simulation A2.
https://doi.org/10.1371/journal.pone.0321692.s010
(PDF)
S11 Table. The true model parameters of the 70-signal virtual protein for simulations A3, A4, and C4.
https://doi.org/10.1371/journal.pone.0321692.s011
(PDF)
S12 Fig. The model-parameter estimation of the adaptive and conventional CEST simulations.
https://doi.org/10.1371/journal.pone.0321692.s012
(PDF)
S13 Fig. The model-parameter estimation for the representative residues of the adaptive CEST simulation A3.
https://doi.org/10.1371/journal.pone.0321692.s013
(PDF)
S14 Fig. The estimated model parameters with or without additional iterations for the simulation A3.
https://doi.org/10.1371/journal.pone.0321692.s014
(PDF)
S15 Table. Detailed information of the NMR measurements.
https://doi.org/10.1371/journal.pone.0321692.s015
(PDF)
Acknowledgments
The authors would like to express their earnest gratitude to the members of the Laboratory for Cellular Structural Biology for valuable discussions. We are grateful to S. Onami, principal investigator of the Research DX Foundation Team, for his understanding and support in publishing this work. We would also like to thank S. Yasuda, A. Yokooku, and A. Sekiguchi for their secretarial assistance.
References
- 1.
Box GEP, editor. Choice of response surface design and alphabetic. Optimality; 1982.
- 2. Shannon CE. A mathematical theory of communication. Bell System Technical Journal. 1948;27(3):379–423.
- 3. Lindley DV. On a measure of the information provided by an experiment. Ann Math Statist. 1956;27(4):986–1005.
- 4. Kullback S, Leibler RA. On information and sufficiency. Ann Math Statist. 1951;22(1):79–86.
- 5.
Cover TM, Thomas JA. Elements of information theory. Hoboken, New Jersey: John Wiley & Sons, Inc.; 1991.
- 6. Chaloner K, Verdinelli I. Bayesian experimental design: a review. Statist Sci. 1995;10(3).
- 7. Dror HA, Steinberg DM. Sequential experimental designs for generalized linear models. J Am Stat Assoc. 2008;103(481):288–98.
- 8. Golovin D, Krause A. Adaptive submodularity: Theory and applications in active learning and stochastic optimization. J Artif Int Res. 2011;42:427–86.
- 9. Cavagnaro DR, Myung JI, Pitt MA, Kujala JV. Adaptive design optimization: a mutual information-based approach to model discrimination in cognitive science. Neural Comput. 2010;22(4):887–905. pmid:20028226
- 10. Vanlier J, Tiemann CA, Hilbers PAJ, van Riel NAW. A Bayesian approach to targeted experiment design. Bioinformatics. 2012;28(8):1136–42. pmid:22368245
- 11. Drovandi CC, McGree JM, Pettitt AN. Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data. Computational Statistics & Data Analysis. 2013;57(1):320–35.
- 12.
Aggarwal R, Demkowicz MJ, Marzouk YM. Information-driven experimental design in materials science. In: Lookman T, Alexander FJ, Rajan K, editors. Information science for materials discovery and design. Cham: Springer International Publishing; 2016, 13–44. https://doi.org/10.1007/978-3-319-23871-5_2
- 13. Ryan EG, Drovandi CC, McGree JM, Pettitt AN. A review of modern computational algorithms for bayesian optimal design. Int Statistical Rev. 2016;84(1):128–54.
- 14.
Jiang H, Zhao Y. A review of Bayesian optimal experimental design on different models. In: Zhao Y, Chen D-G, editors. Modern statistical methods for health research. Cham: Springer International Publishing; 2021, 205–220. https://doi.org/10.1007/978-3-030-72437-5_10
- 15. Kalinin SV, Ziatdinov M, Hinkle J, Jesse S, Ghosh A, Kelley KP, et al. Automated and autonomous experiments in electron and scanning probe microscopy. ACS Nano. 2021;15(8):12604–27.
- 16. Lee SY. Bayesian nonlinear models for repeated measurement data: an overview, implementation, and applications. Mathematics. 2022;10(6):898.
- 17. Eghbalnia HR, Bahrami A, Tonelli M, Hallenga K, Markley JL. High-resolution iterative frequency identification for NMR as a general strategy for multidimensional data collection. J Am Chem Soc. 2005;127(36):12528–36. pmid:16144400
- 18. Bahrami A, Tonelli M, Sahu SC, Singarapu KK, Eghbalnia HR, Markley JL. Robust, integrated computational control of NMR experiments to achieve optimal assignment by ADAPT-NMR. PLoS One. 2012;7(3):e33173. pmid:22427982
- 19. Song Y-Q, Tang Y, Hürlimann MD, Cory DG. Real-time optimization of nuclear magnetic resonance experiments. J Magn Reson. 2018;289:72–8. pmid:29476928
- 20. Waudby CA, Burridge C, Christodoulou J. Optimal design of adaptively sampled NMR experiments for measurement of methyl group dynamics with application to a ribosome-nascent chain complex. J Magn Reson. 2021;326:106937. pmid:33706222
- 21. Vallurupalli P, Sekhar A, Yuwen T, Kay LE. Probing conformational dynamics in biomolecules via chemical exchange saturation transfer: a primer. J Biomol NMR. 2017;67(4):243–71. pmid:28317074
- 22. Vallurupalli P, Bouvignies G, Kay LE. Studying “invisible” excited protein states in slow exchange with a major state conformation. J Am Chem Soc. 2012;134(19):8148–61. pmid:22554188
- 23. Bolik-Coulon N, Hansen DF, Kay LE. Optimizing frequency sampling in CEST experiments. J Biomol NMR. 2022;76(5–6):167–83. pmid:36192571
- 24. Carneiro MG, Reddy JG, Griesinger C, Lee D. Speeding-up exchange-mediated saturation transfer experiments by Fourier transform. J Biomol NMR. 2015;63(3):237–44. pmid:26350257
- 25. Leninger M, Marsiglia WM, Jerschow A, Traaseth NJ. Multiple frequency saturation pulses reduce CEST acquisition time for quantifying conformational exchange in biomolecules. J Biomol NMR. 2018;71(1):19–30. pmid:29796789
- 26. Yuwen T, Bouvignies G, Kay LE. Exploring methods to expedite the recording of CEST datasets using selective pulse excitation. J Magn Reson. 2018;292:1–7. pmid:29753980
- 27. Yuwen T, Kay LE, Bouvignies G. Dramatic decrease in CEST measurement times using multi-site excitation. Chemphyschem. 2018;19(14):1707–10. pmid:29663694
- 28. Ceccon A, Schmidt T, Tugarinov V, Kotler SA, Schwieters CD, Clore GM. Interaction of huntingtin exon-1 peptides with lipid-based micellar nanoparticles probed by solution NMR and Q-band pulsed EPR. J Am Chem Soc. 2018;140(20):6199–202. pmid:29727175
- 29. Kragelj J, Orand T, Delaforge E, Tengo L, Blackledge M, Palencia A, et al. Enthalpy-entropy compensation in the promiscuous interaction of an intrinsically disordered protein with homologous protein partners. Biomolecules. 2021;11(8):1204. pmid:34439869
- 30.
Maciejewski MW, Mobli M, Schuyler AD, Stern AS, Hoch JC. Data sampling in multidimensional NMR: Fundamentals and strategies. In: Billeter M, Orekhov V, editors. Novel sampling approaches in higher dimensional NMR. Berlin, Heidelberg: Springer Berlin Heidelberg; 2012, 49–77. https://doi.org/10.1007/128_2011_185
- 31. Palmer AG 3rd. Chemical exchange in biomacromolecules: past, present, and future. J Magn Reson. 2014;241:3–17. pmid:24656076
- 32. McConnell HM. Reaction rates by nuclear magnetic resonance. J Chem Phys. 1958;28(3):430–1.
- 33. Trott O, Palmer AG 3rd. R1rho relaxation outside of the fast-exchange limit. J Magn Reson. 2002;154(1):157–60. pmid:11820837
- 34. Baldwin AJ, Kay LE. An R1ρ expression for a spin in chemical exchange between two sites with unequal transverse relaxation rates. J Biomol NMR. 2013;55(2):211–8. pmid:23340732
- 35.
Houlsby N, Huszár F, Ghahramani Z, Lengyel M. Bayesian active learning for classification and preference learnng. arXiv:1112.5745 p. 2011.
- 36. Nagashima K. B1 mapping of liquid NMR transversal RF coils: Analysis of heterogeneity and nonlinearity. Concepts Magn Reson. 2012;41B(1):1–12.
- 37. Lim J, Xiao T, Fan J, Yang D. An off-pathway folding intermediate of an acyl carrier protein domain coexists with the folded and unfolded states under native conditions. Angew Chem Int Ed Engl. 2014;53(9):2358–61. pmid:24470381
- 38. Tiwari VP, Toyama Y, De D, Kay LE, Vallurupalli P. The A39G FF domain folds on a volcano-shaped free energy surface via separate pathways. Proc Natl Acad Sci U S A. 2021;118(46):e2115113118. pmid:34764225
- 39. Yabuki T, Motoda Y, Hanada K, Nunokawa E, Saito M, Seki E, et al. A robust two-step PCR method of template DNA production for high-throughput cell-free protein synthesis. J Struct Funct Genomics. 2007;8(4):173–91. pmid:18167031
- 40.
Kigawa T. Cell-free protein production system with the E. coli crude extract for determination of protein folds. In: Endo Y, Takai K, Ueda T, editors. Cell-free protein production. Methods and protocols. Totowa, New Jersey: Humana Press; 2010, 101–111. https://doi.org/10.1007/978-1-60327-331-2_10
- 41. Kigawa T, Muto Y, Yokoyama S. Cell-free synthesis and amino acid-selective stable isotope labeling of proteins for NMR analysis. J Biomol NMR. 1995;6(2):129–34. pmid:8589601
- 42. Kigawa T, Yabuki T, Matsuda N, Matsuda T, Nakajima R, Tanaka A, et al. Preparation of Escherichia coli cell extract for highly productive cell-free protein expression. J Struct Funct Genomics. 2004;5(1–2):63–8. pmid:15263844
- 43. Matsuda T, Koshiba S, Tochio N, Seki E, Iwasaki N, Yabuki T, et al. Improving cell-free protein synthesis for stable-isotope labeling. J Biomol NMR. 2007;37(3):225–9. pmid:17237976
- 44. Bax A, Grzesiek S. Methodological advances in protein NMR. Acc Chem Res. 1993;26(4):131–8.
- 45. Clubb RT, Thanabal V, Wagner G. A constant-time three-dimensional triple-resonance pulse scheme to correlate intraresidue 1HN, 15N, and 13C′ chemical shifts in 15N·13C-labelled proteins. Journal of Magnetic Resonance (1969). 1992;97(1):213–7.
- 46. Ikura M, Kay LE, Bax A. A novel approach for sequential assignment of 1H, 13C, and 15N spectra of proteins: heteronuclear triple-resonance three-dimensional NMR spectroscopy. Application to calmodulin. Biochemistry. 1990;29(19):4659–67. pmid:2372549
- 47. Helmus JJ, Jaroniec CP. Nmrglue: an open source Python package for the analysis of multidimensional NMR data. J Biomol NMR. 2013;55(4):355–67. pmid:23456039
- 48. Haario H, Laine M, Mira A, Saksman E. DRAM: Efficient adaptive MCMC. Stat Comput. 2006;16(4):339–54.
- 49. Haario H, Saksman E, Tamminen J. An adaptive metropolis algorithm. Bernoulli. 2001;7(2):223.