## Figures

## Abstract

In this manuscript we apply stochastic modeling to investigate the risk of reactivation of latent mycobacterial infections in patients undergoing treatment with tumor necrosis factor inhibitors. First, we review the perspective proposed by one of the authors in a previous work and which consists in predicting the occurrence of reactivation of latent tuberculosis infection or newly acquired tuberculosis during treatment; this is based on variational procedures on a simple set of parameters (e.g. rate of reactivation of a latent infection). Then, we develop a full analytical study of this approach through a Markov chain analysis and we find an exact solution for the temporal evolution of the number of cases of tuberculosis infection (re)activation. The analytical solution is compared with Monte Carlo simulations and with experimental data, showing overall excellent agreement. The generality of this theoretical framework allows to investigate also the case of non-tuberculous mycobacteria infections; in particular, we show that reactivation in that context plays a minor role. This may suggest that, while the screening for tuberculous is necessary prior to initiating biologics, when considering non-tuberculous mycobacteria only a watchful monitoring during the treatment is recommended. The framework outlined in this paper is quite general and could be extremely promising in further researches on drug-related adverse events.

**Citation: **Agliari E, Asti L, Barra A, Scrivo R, Valesini G, Wallis RS (2013) Application of a Stochastic Modeling to Assess the Evolution of Tuberculous and Non-Tuberculous Mycobacterial Infection in Patients Treated with Tumor Necrosis Factor Inhibitors. PLoS ONE 8(1):
e55017.
https://doi.org/10.1371/journal.pone.0055017

**Editor: **Pere-Joan Cardona,
Fundació Institut d’Investigació en Ciències de la Salut Germans Trias i Pujol, Universitat Autònoma de Barcelona, CIBERES, Spain

**Received: **August 26, 2012; **Accepted: **December 18, 2012; **Published: ** January 28, 2013

**Copyright: ** © 2013 Agliari et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Funding: **This research was sponsored by the FIRB grant RBFR08EKEV from Ministero dell’ Instruzione Università Ricerca and by Sapienza Università di Roma. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing interests: ** The authors have read the journal’s policy and have the following conflict: one of the authors (R.S. Wallis) is Senior Director at Pfizer, which is the manufacturer of Enbrel (etanercept). This does not alter the authors’ adherence to all the PLOS ONE policies on sharing data and materials.

## Introduction

Over the last decades the improved understanding of the pathogenesis of chronic inflammatory diseases, together with a major advance in biotechnology, have accelerated the development of biological therapies, designed to neutralize specific targets that mediate and sustain the clinical manifestations of diseases. These compounds, mainly monoclonal antibodies (mAb) and fusion proteins, introduced a breakthrough in the management of different conditions including inflammatory rheumatologic disorders [1]. In this context, the first setting of application of the biological agents was rheumatoid arthritis (RA), a chronic autoimmune disease affecting approximately of the adult population [2]. If the disease is not treated adequately, progressive deformity can lead to loss of quality of life and reduce average life expectancy by about a decade [2]. Studies on the pathogenic mechanisms of RA have revealed that tumor necrosis factor (TNF) is a cytokine playing a critical role in the inflammatory cascade that results in the irreversible joint damage typical of the disease [3]. Following these discoveries, a series of clinical trials in patients with RA showed the therapeutic benefit of TNF blockade [4]. As a consequence, five biological agents engineered to block TNF actions are currently available: infliximab, adalimumab, golimumab, certolizumab pegol (all of them mAb), and etanercept (a receptor fusion protein) [5]. While being highly effective, TNF blockers have raised concerns about the potential for an increased susceptibility to infections, in particular the reactivation of latent tuberculosis (TB) infection [6]–[10]. Mycobacterium tuberculosis, the cause of human TB, can result in a metastable clinical latency lasting for decades. Much has been speculated about the structure of granuloma which should contain Mycobacteria, since murine models indicated that TNF was necessary for both formation and maintenance of granulomas [11]. However, subsequent studies on zebrafish model [12], monkeys [13], and humans [14]–[17] challenged these data, demonstrating that the crucial role of TNF in the granuloma was indeed macrophage activation and stimulation of chemokine production. The reactivation of latent TB infection has been associated with all TNF inhibitors, hence pre-initiation screening procedures have been recommended, which have successfully reduced the number of reported cases [18], although current screening tools lack sensitivity and specificity [19], [20].

TNF blockers seem to increase also the risk of other granulomatous diseases, but little is known about the emergence of illness due to non-tuberculous Mycobacteria (NTM). These are a huge ensemble of pathogens (e.g. M. avium, M. abscessus, and so on [21]) and up to date, approximately different mycobacterial species are considered to be etiological agents of human diseases and this number seems still growing [21]. Most cases these days occur in hosts with relatively intact immune responses. However, RA and other chronic diseases with pulmonary manifestations can predispose a person to NTM pulmonary disease [22] expressing as a possible serious complication, especially in immunosuppressed subjects. Thus, it is of utmost importance to study also the risk related to NTM, in the perspective to understand if a proper screening may be helpful in conferring a wider protection to the patients. This is particularly true, in that the TNF blockers appear to predispose both to disseminated and localized disease [21], [23], but also because these infections are increasing in prevalence, especially among women, which are more frequently affected by RA than men. In the present state of the art, the scenario for NTM diseases, with respect to TNF-blocking drugs, seems different from the TB counterpart: in particular, through extensive experimental screening, both Wallis and coworkers [10], and Winthrop and coworkers [23], [24] evidenced that latency and reactivation do not seem to play a crucial role in this context, yet a clear-cut picture is still missing.

Now, as far as TB is concerned, data collected through the Adverse Event Reporting System of the US Food and Drug Administration (FDA) in the time-window , related to the two test-case drugs with a different mechanism of action, i.e. infliximab and etanercept, highlight that TB infections involve over patients treated with infliximab and over patients receiving etanercept [10]. Therefore, the question is: As the latency in TB can last decades, are these infections (in patients under therapy) new ones or are they reactivation of previously encountered pathogens due to a suppressed immune system? This kind of question underlies the awareness of a real need and disposal for extensive pre-screening procedures. Unfortunately, the answer is by far not trivial as, for TB, there are no secure pathways to discriminate between a new infection or the raise of a previous one. Moreover, a clear methodology for finding latencies is still lacking. Furthermore, the rarity and different sizes of this infection in different countries (ranging from over in Sweden up to over in Romania [8]) implies that data analysis and its subsequent interpretation must be carefully performed.

As for NTM, still from FDA, through the post-marketing surveillance system (MedWatch) and through a further survey within the Emerging Infections Network of the Infectious Diseases Society of America (IDSA), Winthrop and coworkers reported a detailed study of possible correlations between the usage of TNF blockers and the emergence of NTM diseases: over a time-window of years, they highlighted a higher prevalence of NTM diseases in patients treated with infliximab rather than etanercept [24].

In order to investigate possible correlations between the incidence of infections by such Mycobacteria and biological therapy, one could rely directly on the molecular details of TNF processing signal (which has been, at least partially, elucidated, see e.g. [25]), coupled to the underlying infliximab and etanercept mechanism of action, which could be achievable directly through molecular immunology approach. Beyond these “standard” strands, a completely different route can also be performed: Given the relative large amount of collected data, the problem can be considered from a purely inferential viewpoint, by-passing the underlying molecular immunology know-how (see also [26], [27]). According to this perspective, in Ref. [9], [10], an abstract (logical) environment for TB case has been defined, where patients can occupy one of the (following) five different states: No infection, New infection, Latency, Reactivation of a previous TB infection, Post first TB encounter. Clearly, the patients starting the therapy (and hence belonging to the survey) can correspond to either state or , because all the other states imply quantifiable sickness and the patient would then be treated for TB rather than RA. Then, at the end of the survey, a fraction of these patients will be in an illness state, i.e. either state or . The transition rates between different states are assumed as free-parameters, whose values are estimated through numerical simulations: the best estimate is the one able to reproduce, with the smallest error, the experimental data. Remarkably, the probability of latent TB reactivation in patients treated with infliximab turned out to be an order of magnitude per unit of time higher than the same probability for patients trated with etanercept [9].

Here, we first formalize this approach in terms of Markov chains and we write the related Master equation in continuous-time limit, then we solve the model analytically and study its properties in full details. In this way we get the explicit expression for the number of patients exhibiting a TB (re)activation, as a function of time . One step forward, we check the robustness of our results through extensive Monte Carlo simulations and over the clinical data of the TB scenario, finding overall excellent agreement among all our results (and previous literature). Moreover, we find that different magnitudes for the probability of reactivation correspond to qualitative different behaviors for (on the proper timescale), that is, the number of patients displaying active infection increases exponentially in time when using infliximab and linearly in time when using etanercept.

The analytical expression for the whole evolution of the system implies a great feasibility of the technique itself (e.g. we have the whole set of first integrals and a clear picture of all the hidden symmetries) and also allows to address, in complete generality, several instances. In particular, we can finally consider generic NTM infections, where, interestingly, the scenario appears quite different from the TB counterpart: clinical data suggest that (on the proper timescale) grows quadratically with time and this is recovered by our analytical picture only under the assumption of a negligible role played by latency reactivation. We check these findings also through extensive Monte Carlo runs, which are in full agreement too. Remarkably, this is very consistent with the present state of the art in the medical literature dealing with NTM.

As a final result, there are two types of conclusions which stem from our work: The former belongs to the world of modelers, while the latter to the world of clinicians.

From a mathematical perspective, the encouraging results of this approach may pave the way for the development of handily and fruitful instruments for physicians.

Much more carefully, in the clinician’s counterpart, as this approach bypasses the whole underlying biological complexity, it may contribute to confirm, from a theoretical perspective, the current understanding of adverse events coupled to TNF-inhibitors and the consequent real need for screening procedures before undergoing biological therapies.

## Materials and Methods

In this section we formalize the scheme introduced in [9] and aimed to reproduce data of TB onset in patients treated with TNF inhibitors, with particular attention on infliximab (an anti-TNF mAb) and etanercept (a soluble TNF receptor). Seeking for clarity, in this section we mention only applications to the TB case, although, as we will see in the second part of the paper, the approach is rather robust and can be successfully applied to the NTM case, too.

The model, whose structure is depicted in Figure 1, consists in identifying a set of possible states for the patient subjected to biological treatments, and in fixing the likelihood for the patient to change his/her state within a proper unit time. Of course, on large samples, some patients may experience sudden incidents (e.g. death for other causes) or some others may assume both the drugs: the analysis has been previously purified from these cases [9], [10].

States are represented as circles and numbered from to according to the scheme outlined in the Materials and Methods section. The arrows represent the transition probabilities connecting two different states, while and represent the initial conditions on the states .

The clinical states available to a test-patient are taken as follows (see Figure ):

0 : Absence of infection;

1 : New infection (that after a time can give rise either to active TB or latent infection);

2 : Latent infection;

3 : Reactivated TB after latency;

4 : Active TB (that progresses from new infection within a time , without an intervening period of latency).

Moreover, each patient is assumed to change his/her state, following the corresponding transition probabilities, which constitute the model parameter set, and are meant over a proper unit time . Using to label the time, these probabilities are:

*L* : Probability of having a latent infection at the beginning of the observation (), while, obviously, is the probability of not having any infection at that moment;

*N* : Probability of TB infection during the observational time;

*P* : Probability of a new TB infection to become active TB after a time ; as a consequence, is the probability of this new infection to give rise to a latent infection;

*R* : Probability of reactivation of a latent TB infection.

We stress that such probabilistic framework is based on purely clinical variables.

On the experimental side, the available data consist in a collection of times (one for each patient) corresponding to the onset of TB (in its active phase, namely a detectable scenario), after the beginning of the treatment with TNF blockers. As a consequence, the only states which are possible to observe are the states and . Unfortunately, as discussed in the introduction, these states (that account for ill patients) are not distinguishable one respect to the other by simply looking at the data (hence motivating both earlier studies [9], [10] and our machinery), however, some progress can be made using stochastic extremization. The idea resembles the standard maximum likelihood and consists in finding the best values for free parameters such that the theoretical curves collapse over the experimental data [28].

As already outlined, following this procedure, the main result in [9] is that the principal difference between infliximab and etanercept treatments resides in different management of latent TB, i.e. on . The former seems to enhance reactivation one order of magnitude more than the latter.

### Markov Chains and Master Equations

The model described in the previous section can be translated into a set of differential equations coding for the temporal evolution of the probability of patient’s states (which can be compared to the corresponding fractions over a sample of patients given the large collection of data).

Being the states discrete, this can be accomplished in complete generality using Markov chains, namely a (discrete-time) probabilistic framework where the probability of being in a given state at a given time depends only on the probability distribution over all the states at the previous time step , and on the transition rates linking these states.

It is instructive to consider the illustrative Markov chain with only three states (, and ), non-null transition rates and and time step , shown in Figure 2.

From the state there is a potential flux of probability at rate toward the state , hence we expect that, after a proper amount of time, a fraction of the probability will be drained from to . The same holds for the situation linking to . After an infinite time the probability of having the patient in the state is one, while it is zero for the states .

Note that, in the model, the probabilities of going from to and from to exist but not the opposite () hence, if the initial state is all concentrated in , there will be no evolution, while if the starting point is spread among and , after enough time, the probability distribution will be peaked on only (but in its *finite* temporal evolution resides our interest).

Now, the probability of remaining-at/moving-into the state in the time interval is given by the probability of already being in (hence ) plus the probability of arriving in from times the probability of being in at the previous step (hence ) minus the probability of leaving to times the probability of being in at the previous step (hence ); this concept can be written as follows:(1)

Now, the mathematics for continuous variable differential equations is much more handily and does not change significantly the perspective if the time step is small with respect to the global time window; indeed, both experimental data sets considered here (for TB cases [10] and for NTM cases [23]) fulfill this requirement and thus we are allowed to consider the time as a continuous variable. This can be achieved straightforwardly starting from the previous equation using a limit procedure:

The evolution for the probability is then ruled by the following differential equation, namely a “Master equation”, which acts as a continuous counterpart of the Markov chain in the discrete-time case:(2)

In general, for a system which can be in one of arbitrary states, we need a transition-rate matrix (where is the rate for the transition from state to state ) and the Master equation takes the form(3)

Note that we use the symbol above the functions meaning their temporal derivative. Finally, we switch to a form where the explicit timescale of the process appears directly in the equation, that is(4)where stands for the probability of transition from state to along the time interval .

### Master Equations for the Model

Keeping in mind Figure 1, we can write down the system of differential equations describing the evolution of the five states earlier introduced as follows:(5)with initial conditions

(6)The numbers indexing the probabilities mirror the enumeration of the previous section, that is, stands for the probability that a patient has never been affected by the infection, and so on. The parameter represents the typical time for a patient experiencing a new infection to either develop the disease or to fall into a latent state and it should be chosen according to the natural time-scale of the process described. For instance, for the TB case, the data collected suggest that is order of a few months [10], [29], and we set for the sake of simplicity and in agreement with previous works [9], [10].

Note that, as patients affected by active TB do not start RA therapy, we set . Furthermore, the parameter tunes the initial amount of latent-TB patients with respect to free-TB patients, such that for all patients are healthy, while for all patients display a latent TB infection; as we have no ways to discriminate between healthy and latent-infected patients, is taken as a free parameter which can be estimated a posteriori comparing the solution of (5) with available data.

The solution of the system (5) can be easily obtained using first order ordinary differential equations theory and reads off as(7)

Of course, since the total amount of patients is conserved, is an integral of motion, that is(8)

Beyond , the system ( ) admits another integral of motion , namely(9)

This means that the rate of growth for patients in the latency branch (i.e. in states ) equals the rate of growth for the rest of infected patients (i.e. in state ) weighted by a factor , so that the smaller and the larger the difference between the related rates. The knowledge of integrals of motion can be very useful as they allow to obtain information in a very simple way; for instance, should drop, then would also decrease (or, analogously, would increase) in order to maintain constant. Given and , other integrals of motion, which are combination of and , can be trivially built. For example, fulfills.(10)

We underline that this kind of investigation can be accomplished only through an analytical study of the system.

As discussed above, the fraction of active TB cases is given by the sum of the fraction of cases of direct TB after infection and of the fraction of cases with reactivated TB; namely, calling the total fraction of cases, we have:(11)

In the above quantity, the time dependence appears only through three different exponential decay terms , which vanish at infinite time, so that the solution becomes a constant term equal to 1, meaning that, if we wait for a sufficient long (possibly infinite) time, all patients become sick (although, obviously, they can possibly die earlier due to reasons not related to RA/TB). In order to deepen the temporal evolution of these probabilities at relatively short times, it is useful to use a little bit of algebraic manipulation to distinguish constant terms from decaying terms, in such a way that we get(12)where the three constants , and are related to the physiological parameters by

(13)Of course, from one can derive the effective number of cases multiplying by the overall number of treated patients.

Before turning attention to the fitting procedure, we stress that the analytical solution in Eq. (7) was successfully checked through numerical methods, i.e. fourth-order Runge-Kutta algorithm and Monte Carlo simulations (notice that here, with Monte Carlo simulation we mean a simulation in which a set of virtual patients evolves in time following the Markov chain of Figure 1, giving a sample of the evolution of the fraction of cases during time. In our simulations we set virtual patients).

## Results

### The TB-infection Case

Having obtained the complete solution of the model and exploiting the available information on parameters, we now look for proper approximations able to highlight the effective behavior of in cases of practical interest, starting with the TB scenario.

In particular, Eq. (12) can be reduced to a simpler form if we note that the probability of TB infection is much smaller than all the other parameters, in agreement with studies on TB and with results found in [9] and, a posteriori, in the current paper (see Table 1).

Hence, as a first approximation step, we assume and such that we can expand the solution, at the first order in and , as follows:notice that here and in the following we use the “big-O” Landau notation to characterize the growth rate of functions; more precisely, being and two arbitrary functions, we say as if there exists a positive real number such that .

By plugging the previous expressions into Eq. 12, with some algebra and retaining only up-to-linear terms in or , we get(14)

Let us now move further and focus on the exponential terms. First, we notice that and, consequently, we can neglect the term , as it decays much faster that both and . Moreover, since the time range considered is months and is expected to be , we can expand as , and considering only the leading dependence on , we get(15)

As for , a similar approximation () can be adopted as long as so to obtain the following linear approximation.(16)

Notice that a smaller (larger) estimate for would simply require a stricter (softer) condition on and on for the related linear expansions to hold (on the same time range); the model would not be affected and the parameters coupled with time, i.e. , would be accordingly rescaled. As shown in Figure 3, the approximation (16) is rather good only for etanercept-treated patients, for which the best fit yields . On the other hand, if we consider infliximab-treated patients, the approximation (16) does not fit data, while using (15) we get a good overlap with data and the best fit yields , confirming that now is no longer small over the time window. All best-fit coefficients are reported in Table , and the related errors are shown in Figure 4.

Cumulative number of patients undergoing active TB-infection. Experimental data from [9] ( for infliximab-treated patients and for etanercept-treated patients) are compared with the approximated analytical solution (see Eq. 15 and Eq. 16, respectively, solid curves) and with data from numerical simulation (dashed curves). The parameters used to draw the analytical curves correspond to the best-fit coefficients and are reported in Table 1. Notice that here we consider the extensive number of patients affected by TB over a population of treated patients, according to experimental results.

Absolute difference between experimental data and theoretical data reported in Fig. 3; the same legend holds.

We can estimate how sensitive is with respect to the system parameters by deriving its analytic expression (see Eq. 12) with respect to , respectively; in this way we get that, in the regime , the most relevant parameter affecting the behavior of is . Another argument in favor of this claim is that, in the zero approximation of the solution (i.e. neglecting even terms ), does not appear at all.

In order to get further insight on the effect of infliximab and of etanercept on TB incidence, in Fig. 5 we plotted the model predictions for the percentage of patients having TB because of new infections () or reactivations ().

The probability of being in state (TB reactivation) and of being in state (Post TB) are calculated from Eq. 7, using the parameters of Table . In the main plot we compare the ratio obtained from infliximab () and etanercept () parameters. In the inset, we depict each single probability, namely for infliximab (dark ) and for etanercept (dark ), for infliximab (bright ) and for etanercept (bright ); notice that the two sets of data for are partially overlapped. Lines are guide for the eye.

To summarize, our results confirm that, in the present context, the most important difference between therapies based on infliximab or etanercept is that the former enhances TB reactivation more than the latter, in fact, we found , in agreement with [9]. Such a discrepancy implies even a qualitatively different behavior of over the time-window considered: the number of infliximab-treated patients experiencing a TB infections grows exponentially in time, while for etanercept-treated patient the growth is linear.

### The NTM-infection Case

The analytical expression for , (see Eqs. 7 and 11) holds for a general environment schematizable as in Fig. 1; in the last paragraph we used the details of TB infections to implement convenient approximations. We now turn to NTM-infections in patients treated with infliximab and etanercept and look for proper approximations able to highlight the characteristic features of such case. The experimental data we refer to are those reported in [23] and collected over the period . Overall, there were reports of NTM infections in patients who were receiving anti-TNF therapy. Most reports were for patients receiving infliximab () or etanercept () and here we shall focus just on these drugs.

Some remarks are in order here to merge mathematically the TB and NTM scenarios.

First, it is important to notice that patients affected by NTM lung infections typically suffer through long periods of illness before a clinical diagnosis is made. To comply with the actual state of the art on the involved time-scales we follow M. Iseman and T. Marras [29] that we quote: “Preliminary prevalence estimates have been made, assuming that the disease duration for TB is months and for pulmonary NTM is within the range of to years” ( to months), hence for NTM the timescale is at least one order of magnitude larger than in the TB counterpart.

Another important point is that available data on NTM-diseases related to drug therapies lack the size of the survey, namely the number of patients participating to the screening, consequently, we can quantify the (cumulative) amount of sick patients, but we do not know their percentage. This is not a serious deficiency since, while we do not have access to the very reactivation probabilities or , their ratio (which cancels out both time-scales and survey-size) still retains a quantitative information content.

As a result of the first remark, the (average) exit time from state , i.e. , is comparable to the experimental time window, and one can expand the solution reported Eq. 7 at second order in as(17)(18)

We notice that, at this stage of expansion, grows quadratically with time, while presents two contributes growing, respectively, linearly and quadratically with time, the former being the leading one.

Such expressions must now be compared with experimental data, which display a purely quadratic growth in time, i.e. compatible with (see Fig. 6). In order for the comparison to hold, one must therefore drop the linear coefficient, and this implies (or which is conceptually pretty similar). With this choice of parameters we get.(19)and this form successfully fits experimental data, as shown in Figure 6; the best-fit coefficients are reported in Table 2, and the related errors are shown in Figure 7.

Cumulative number of patients undergoing active NTM-infection. Experimental data from [23] ( for infliximab-treated patients and for etanercept-treated patients) are compared with the approximated analytical solution (see Eq. , solid curves) and with data from numerical simulation (dashed curves). The parameters used to draw the analytical curves correspond to the best-fit coefficient and are reported in Table . Notice that here we consider the extensive number of patients affected by NTM over the whole population of treated patients, according to experimental results.

Absolute difference between experimental data and theoretical data reported in Fig. 5; the same legend holds.

The functional form of highlights why finding an estimate of the parameters is extremely difficult through blind numerical extremization, without any explicit analytical hint: The latency-branch turns out to be negligible in NTM-context and this results in a coupling of the parameters and as only a single probability streaming toward survives. Therefore the two parameters alone are undetectable.

Using the coefficients of Table 2 in numerical simulations we obtain results in excellent agreement with real data and analytical ones. Notice that, impressively, the fit is very good although here the optimization relies only on one parameter.

We stress that the qualitative difference between the behaviors of in the case of TB and NTM infection (see Eqs. 15 and 19) mainly stems from a significant gap in the related disease duration (few months versus several years). In the latter case is relatively large to allow the expansion of the exponential functions into a polynomial form, while for TB this can be accomplished only under the condition of small enough *R*. Such expansions do not significantly alter the predicted values of the fit parameters, as long as the underlying assumptions are consistent with facts.

To summarize, the theoretical framework developed evidences that the rate of reactivation is vanishing: This issue makes the fraction of reactivation cases negligible, while the number of activation cases grows quadratically with time through the contribution of only , consistently with the actual understanding of NTM-pathology achieved through standard pathways. Moreover, differently from the TB case, in the NTM scenario no qualitative difference can be detected between infliximab and etanercept: The parabolic behavior for seems robust.

## Discussion

In the last decades, several tools and concepts stemmed from the fields of stochastic mathematics and theoretical physics have been proposed to help the investigation of the immunological world, ranging from kinetic theories [30], to associative neural networks [31], [32], to cellular automata and more [33], [34].

Along the same line, in these notes we formalized and extended a stochastic approach to data analysis (originally introduced in [7]–[10]) for evidencing underlying correlations between adverse events and therapies based on immunosuppressants. In particular, the focus of our investigation concerns the risk of reactivation of latent mycobacterial infection in patients undergoing treatment with TNF-inhibitors.

We gave a clear and complete mathematical backbone to this approach, building it on explicit Markov processes, whose continuous-time limit yields the Master equation governing the evolution of the expected fraction of patients exhibiting an active infection. We also solved the Master equation in all details finding an analytical expression for Such mathematical developments make the original approach much more versatile and general: For instance, handling the complete (mathematical) solution allows to better account for reasonable approximations, tackling their control quantitatively (e.g. finding the proper timescales involved in the process or the integrals of motion constraining the evolution of the system). Furthermore, we can finally consider, within the same framework, different problems. In particular, we focused on TB and NTM infections emerging during anti-TNF therapies (infliximab and etanercept) according to data reported in [9], [23].

In the former case, we recovered previous findings showing that the rate of reactivation of TB from a latent state to an active state plays a crucial role: being we get qualitatively different behaviors for . More precisely, once fixed the observational time-window, for infliximab grows exponentially with time, while for etanercept it grows linearly with time. Hence, these results sustain the need, for patients candidate to TNF blockers, to perform an accurate TB screening at baseline, irrespective of the type of antiTNF. Indeed, screening may decrease the risk of TB reactivation in such patients, while it is less clear what should be done to prevent NTM disease occurrence or progression in patients taking biologic agents. Importantly, for this purpose, we found that the comparison with experimental data allows to infer that reactivation plays a very minor role for both the therapies and that grows quadratically with time.

We checked our results also against Monte Carlo simulation with excellent agreement.

Furthermore, our results are all consistent with recent experimental data and seem to indicate that TB and NTM infections are sustained by different pathogenetic mechanisms.

Non-tuberculous Mycobacteria are present in large numbers in the environment, including fresh water, aerosols, biofilms, and soils [35]. There are thus many opportunities for acquisition of NTM infection during ordinary daily activities, although the true incidence is not known. In contrast, nearly all transmission of Mycobacterium tuberculosis infection results from inhalation cough-generated aerosols from persons with active pulmonary TB. The annual risk of TB infection (ARTI) can be calculated from age-specific rates of tuberculin skin test reactivity; in most instances it is directly related to TB prevalence. Thus, although the ARTI may reach in highly TB-endemic regions such as South Africa, it is as low as in much of Northern Europe and North America [36]–[38]. These epidemiologic findings are consistent with the results of our mathematical model, and underscore the interplay of microbial and host biology in determining the relative contributions of reinfection and reactivation to mycobacterial pathogenesis.

Hence, while the screening for TB is necessary prior to initiating biologics, when considering NTM only a watchful monitoring during the treatment is recommended. This finding is particularly relevant, since it allows to avoid screening for NTM infection, which is complicated by the poor sensitivity of chest radiograph and more expensive and invasive techniques, such as chest computed tomography scan and/or bronchoscopy, should be used.

It is worth stressing that this methodology, being based on very standard stochastic procedures, has the advantage to hold beyond the test case of Mycobacteria. We hope that this test-case may shed light to future developments of this sideline approach in figuring out adverse events of biological therapies.

## Author Contributions

Conceived and designed the experiments: EA AB RS. Performed the experiments: EA AB LA. Analyzed the data: EA LA RS. Contributed reagents/materials/analysis tools: EA LA RS GV RSW. Wrote the paper: EA RS GV RSW.

## References

- 1. Tracey D, Klareskog L, Sasso E, Salfeld J, Tak P (2008) Tumor necrosis factor antagonist mechanisms of action: a comprehensive review. Pharmacol Ther 117: 244–279.
- 2. Lee D, Weinblatt M (2001) Rheumatoid arthritis. The Lancet 358: 903–911.
- 3. Choy E, Panayi G (2001) Cytokine pathways and joint inflammation in rheumatoid arthritis. N Engl J Med 344: 907–916.
- 4. Elliott M, Maini R, Feldmann M (1995) TNF alpha blockade in rheumatoid arthritis: rationale, clinical out-comes and mechanisms of action. Int J Immunopharmacol 17: 141–145.
- 5. Tak P, Kalden J (2011) Advances in rheumatology: new targeted therapeutics. Arthritis Res Ther 13: 1–14.
- 6. Gardam M, Keystone E, Menzies R, Manners S, Skamene E, et al. (2003) Anti-tumour necrosis factor agents and tuberculosis risk: Mechanisms of action and clinical management. Lancet Infect Dis 3: 148–155.
- 7. Wallis R, Ehlers S (2005) Tumor necrosis factor and granuloma biology: Explaining the differential infection risk of etanercept and infliximab. Semin Arthritis Rheum 34: 34–38.
- 8. Wallis R (2008) Tumour necrosis factor antagonists: structure, function, and tuberculosis risks. Lancet Infect Dis 8: 601–611.
- 9. Wallis R (2008) Mathematical modeling of the cause of tuberculosis during tumor necrosis factor blockade. Arthritis Rheum 58: 947–952.
- 10. Wallis R, Broder M, Wong Y, Hanson M, Beenhouwer D (2004) Granulomatous infectious diseases associated with tumor necrosis factor antagonists. Clin Infect Dis 38: 1261–1265.
- 11. Plessner H, Lin PL, Kohno T, Louie JS, Kirschner D, et al. (2007) Neutralization of tumor necrosis factor (TNF) by antibody but not tnf receptor fusion molecule exacerbates chronic murine tuberculosis. J Infect Dis 195: 1643–50.
- 12. Clay H, Volkman H, Ramakrishnan L (2008) Tumor necrosis factor signaling mediates resistance to mycobacteria by inhibiting bacterial growth and macrophage death. Immunity 29: 283–94.
- 13. Lin P, Myers A, Smith L, Bigbee C, Bigbee M, et al. (2010) TNF neutralization results in disseminated disease during acute and latent M. tuberculosis infection with normal granuloma structure. Arthritis Rheum 62: 340–350.
- 14. Keane J, Gershon S, Wise R, Mirabile-Levens E, Kasznica J, et al. (2001) Tuberculosis associated with infliximab, a tumor necrosis factor alpha-neutralizing agent. N Engl J Med 345: 1098–104.
- 15. Iliopoulos A, Kedikoglou S, Laxanis S, Kourouklis S, Katsaros E (2006) A case of tuberculous meningoencephalitis in a patient with Behcet’s disease. Clin Rheumatol 25: 121–2.
- 16. Liberopoulos E, Drosos A, Elisaf M (2002) Exacerbation of tuberculosis enteritis after treatment with infliximab. Am J Med 113: 615.
- 17. Verhave JC, van Altena R, Wijnands M, Roerdink H (2008) Tuberculous peritonitis during infliximab therapy. Neth J Med 66: 77–80.
- 18. Schiff M, Burmester G, Kent J, Pangan A, Kupper H, et al. (2006) Safety analysis of adalimumab (humiraæ) in global clinical trials and US postmarketing surveillance of patients with rheumatoid arthritis. Ann Rheum Dis 65: 889–894.
- 19. Scrivo R, Sauzullo I, Mengoni F, Iaiani G, Vestri A, et al. (2012) Serial interferon- release assays for screening and monitoring of tuberculosis infection during treatment with biologic agents. Clin Rheumatol 31: 1567–1575.
- 20.
Scrivo R, Sauzullo I, Mengoni F, Priori R, Coppola M, et al. (2012) Mycobacterial IFN-gamma release variations during long-term treatment with TNF blockers: lack of correlation with clinical outcome. J Rheumatol (in press).
- 21.
Wagner D, Young L (2003) Nontuberculous mycobacteria infections: a clinical review. Infection 31.
- 22. Griffith D, Aksamit T, Brown-Elliott B, Catanzaro A, Daley C, et al. (2007) An official ats/idsa statement: diagnosis, treatment, and prevention of nontuberculous mycobacterial diseases. Am J Respir Crit Care Med 175: 367–416.
- 23. Winthrop K, Chang E, Yamashita S, Iademarco M, LoBue P (2009) Nontuberculous mycobacteria infections and anti-tumor necrosis factor-α therapy. Emerg Infect Dis 15: 1556–1561.
- 24. Winthrop K, Yamashita S, Beekman S, Polgreen P (2008) Mycobacterial and other serious infections in patients receiving anti-TNF and other newly approved biological therapies; case-finding via the emerging infectious network. Clin Infect Dis 46: 1738–1740.
- 25. Peschon J, Torrance D, Stocking K, Glaccum M, Otten C, et al. (1998) TNF receptor-deficient mice reveal divergent roles for p55 and p75 in several models of inflammation. J Immunol 160: 943–948.
- 26. Marino S, Sud D, Plessner H, Lin P, Chan J, et al. (2007) Differences in reactivation of tuberculosis induced from anti-tnf treatments are based on bioavailability in granulomatous tissue. PLoS Computational Biology 3: 1909–1924.
- 27. Fallahi-Sichani M, Flynn J, Linderman J, Kirschner D (2012) Differential Risk of Tuberculosis Reactivation among Anti-TNF Therapies Is Due to Drug Binding Kinetics and Permeability. The J Immun 188: 3169–78.
- 28.
Pearson RK (1952) Exploring Data in Engineering, the Sciences, and Medicine. Oxford University Press.
- 29. Iseman M, Marras T (2008) The importance of nontubercolous mycobacterial lung disease. Am J Respir Crit Care Med 178: 999–1001.
- 30. Bellomo N, Delitala M (2008) From the mathematical kinetic, and stochastic game theory, to modelling mutations, onset, progression and immune competition of cancer cells. Phys Life Rev 5: 18–206.
- 31. Agliari E, Barra A, Gervasi Vidal K, Guerra F (2012) Can persistent Epstein-Barr virus infection induce chronic fatigue syndrome as a Pavlov reflex of the immune response? J Biol Dyn 6: 740–762.
- 32. Agliari E, Barra A, Guerra F, Moauro F (2011) A thermodynamic perspective of immune capabilities. J Theor Biol 287: 48–63.
- 33. Paulsson J (2005) Models of stochastic gene expression. Phys Life Rev 2: 157–175.
- 34. Cooper E (2010) Evolution of immune system from self not-self to danger to artificial immune system. Phys Life Rev 7: 55–78.
- 35. Falkinham JI (2002) Nontuberculous mycobacteria in the environment. Clin Chest Med 23: 529–551.
- 36. Sutherland I, Bleiker M, Meijer J, Styblo K (1983) The risk of tuberculous infection in the Netherlands from 1967 to 1979. Tubercle 64: 241–253.
- 37. Shanaube K, Sismanidis C, Ayles H, Beyers N, Schaap A, et al. (2009) Annual risk of tuberculous infection using different methods in communities with a high prevalence of TB and HIV in Zambia and South Africa. PLoS One 4: e7749.
- 38. Daniel T, Debanne S (1997) Estimation of the annual risk of tuberculosis infection for white men in the United States. J Infect Dis 175: 1535–1537.