Figures
Abstract
Mathematical models can be very useful in determining efficient and successful antibiotic dosing regimens. In this study, we consider the problem of determining optimal antibiotic dosing when bacteria resistant to antibiotics are present in addition to susceptible bacteria. We consider two different models of resistance acquisition, both involve the horizontal transfer (HGT) of resistant genes from a resistant to a susceptible strain. Modeling studies on HGT and study of optimal antibiotic dosing protocols in the literature, have been mostly focused on transfer of resistant genes via conjugation, with few studies on HGT via transformation. We propose a deterministic ODE based model of resistance acquisition via transformation, followed by a model that takes into account resistance acquisition through conjugation. Using a numerical optimization algorithm to determine the ‘best’ antibiotic dosing strategy. To illustrate our optimization method, we first consider optimal dosing when all the bacteria are susceptible to the antibiotic. We then consider the case where resistant strains are present. We note that constant periodic dosing may not always succeed in eradicating the bacteria while an optimal dosing protocol is successful. We determine the optimal dosing strategy in two different scenarios: one where the total bacterial population is to be minimized, and the next where we want to minimize the bacterial population at the end of the dosing period. We observe that the optimal strategy in the first case involves high initial dosing with dose tapering as time goes on, while in the second case, the optimal dosing strategy is to increase the dosing at the beginning of the dose cycles followed by a possible dose tapering. As a follow up study we intend to look at models where ‘persistent’ bacteria may be present in additional to resistant and susceptible strain and determine the optimal dosing protocols in this case.
Citation: Ali A, Imran M, Sial S, Khan A (2022) Effective antibiotic dosing in the presence of resistant strains. PLoS ONE 17(10): e0275762. https://doi.org/10.1371/journal.pone.0275762
Editor: Ashwani Kumar, Sant Longowal Institute of Engineering and Technology, INDIA
Received: June 11, 2022; Accepted: September 22, 2022; Published: October 10, 2022
Copyright: © 2022 Ali et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
1 Introduction
Misuse and overuse of antibiotics has led to bacteria developing resistance to antibiotics, and this has resulted in complications in treatment and even treatment failures. Antibiotic resistance is rising to very high levels throughout the world and is now a major public health challenge, with new resistance mechanisms emerging and spreading globally. According to the CDC, more than 2.8 million antibiotic-resistant infections occur every year in the US and account for more than 35,000 deaths. In the EU, antibiotic resistance causes more than 25,000 deaths every year, and there have been estimates attributing more than 700,000 deaths globally to antibiotic resistance [1–3].
Antibiotic resistance occurs when bacteria stop responding to antibiotic agents at specific concentration levels and are able to proliferate in the presence of the drug at these concentrations. While antibiotic resistance was reported very soon after the large scale use of antibiotics, this was ameliorated by the discovery of newer and more effective antibiotic agents; however, the development of new antibiotics has been outpaced by the acquisition of resistance to existing drugs by bacteria [4–6].
Bacteria can become resistant to antibiotics either by spontaneous mutations in their DNA (De-Novo resistance) or through the transfer of genetic material from drug-resistant bacteria, horizontal gene transfer (HGT). There are several mechanisms that give rise to resistance, and these include the production of enzymes that cause drug inactivation, alteration of the target sites of the drug, activation of efflux pumps that remove the drug from the bacterium, and the alteration of cell wall proteins preventing the uptake of the drug. The overuse and misuse of antibiotics provide selection pressure favoring the resistant strains causing these to proliferate. The well-known mechanisms for horizontal gene transfer include conjugation, transduction, and transformation. Conjugation or Bacterial conjugation involves the transfer of DNA via a plasmid during cell to cell contact. In the process of transduction, DNA is moved from one bacterium to another by a phage (virus), and in transformation, foreign genetic material is taken up and expressed by a bacterium. It has been well established in the literature [7] that HGT is the predominant mechanism for resistance acquisition; specifically, conjugation and transformation have been identified as primary pathways by which resistance may be transferred from a resistant strain to a susceptible one [8–12].
Several mechanistic models have been proposed in the literature to investigate the acquisition of antimicrobial resistance through HGT. These include models of HGT via conjugation, as well as via transformation. D’agata et al. presented an ODE based single and multidrug-resistant strain model with resistance acquired through conjugation which was modeled using a mass action law [13]. They included the innate immune response in their model, the effects of which were modeled using a Monod function. They studied that the the relationship between antimicrobial therapies immune response in preventing the proliferation of the resistant strains. Stekel et al. present a model of resistance via conjugation in a natural environment [14]. The model is based on a system of two ODEs and with conjugation modeled via a mass action term. They show that the spread of resistance is very sensitive to the rates of gene transfer and the antibiotic inflow. Imran et al. study the effects of different dosing regimens on a population of susceptible and resistant bacteria in a chemostat setting using a series of ODE based models [15]. Resistance may be acquired via bacterial conjugation which is modelled by a mass action term, effects of the antibiotic treatment are modeled by a pharmacodynamic function. The derive conditions for treatment success based on the model parameters. Svara et al. present a model to study selection pressure which favors the plasmid carried resistant genes in the presence of an antibiotic [16]. Using a system of ODEs to model the dynamics they show that the dosage and the inter-dose time of the antibiotic are critical in determining the selection for plasmid carried resistance. Torella et al. study the synergistic effects of multiple antibiotic agents and their efficacy, considering drug interaction [17]. They consider a susceptible bacterial strain, strains resistant to one particular antibiotic and strains that are resistant to both. The dynamics are modeled by a system of ODEs with the resistance to either strain acquired de novo. They include effects of drug interaction via a function representing the effective doses of the antibiotic felt by the susceptible strain. They show that greater synergy between the antibiotic may not always be beneficial and under certain conditions drug antagonism may be more advantageous in preventing multi drug resistance. Johnson et al. look into dynamics that maintain natural competence (i.e. the ability to transform by uptake of DNA) and transformation in a bacterial population [17]. Their ODE based model incorporates compartments for bacteria that do and do not express competence and transformed bacteria, the process of transformation is modeled by a mass action law [18]. They show that selection pressure can help maintain competence in the population, this is further augmented if there is in addition selection pressure favoring transformants. Lu et al. explain the experimentally observed rates of natural transformation in the presence of motile and non-motile strains of Azotobacter vinelandii using a simple model of interaction between the competent cells and the transforming DNA based on Levin’s mass action term [11].
The use of mathematical models to study antibiotic resistance and successful treatment protocols is an area of active research. The conventional treatment protocols involved periodic dosing with doses of constant strength, this, however, may not be the optimal strategy. Mathematical models have been used to identify successful strategies for antibiotic dosing. However, there does not seem to be a consensus on the issue. Several studies have recommended a hit-hard and fast strategy. This involves high early doses of the antibiotic [13, 19, 20], however other studies have shown that this may not always be optimal [21]. Some studies recommend a pulsed and tapered strategy, but other studies show that resistant strains may persist under such a regimen. Merideth et al. recommend dosing strategies be adopted in light of a pathogen-antibiotic interaction metric, based on the time a bacterial population takes to return to its initial density after a single dose of the antibiotic [21]. Bonhoeffer et al. investigated the use of single and multiple antibiotics. In the case of a single antibiotic, they find that high initial dosing is a better strategy [22]. Hoyle et al. study single and multiple fixed-dose regimens as well as tapered dosing [23]. They conclude that a single large dose is never optimal, while the optimal dosing when we also want to minimize the total antibiotic quantity follows a tapering pattern; in a follow-up work [24] they find similar results and also validate their findings using biological experiments. Penna-Miller et al. use optimal control to study dosing strategies in the case where commensal and pathogenic bacteria are present; they find that an ‘intermittent’ or pulsed dosing is optimal [25].
In this study, we consider the problem of determining the optimal antibiotic dosing when both susceptible and resistant bacteria are present. The goal is to find the dosing regimen that is successful in eradicating the bacterial population while keeping the total administered antibiotic at a minimum. Resistant strains are assumed to have a higher minimum inhibitory concentration (MIC). This is included in our models in the pharmacodynamic term as described in detail in the sections below. We now briefly describe the structure of the paper.
In section (2), we describe a numerical optimal control scheme, the direct gradient descent method (DGDM); we will use this to determine the optimal antibiotic dosing. We then consider a bacterial growth model in a chemostat setting proposed in [26] and use the DGDM to obtain a discrete optimal dosing schedule. We compare our results to those obtained using a quasi-optimal strategy in the literature.
In the next section (3), we propose a model for resistance acquisition via transformation. This is an HGT mechanism, where DNA fragments containing the resistant genes are taken up and incorporated in the chromosome of susceptible bacteria. We incorporate the uptake of antibiotic by the bacteria in our model. We first consider discrete doses of antibiotics applied periodically, using the killing rates of the susceptible and resistant strains as bifurcation parameters. We show that the system exhibits bistability, i.e., a periodic dosing regimen may not be successful. We then formulate the dosing problem as an optimal control problem, and we want to minimize the bacterial population while keeping the total antibiotic quantity low. Using the DGDM, we determine a discrete optimal dosing regimen. We show that the optimal treatment is successful in eradicating the bacteria for a wide range of scenarios, including different antibiotic killing rates and different relative costs of the antibiotic dosing. Finally, we consider a slightly different functional in our optimal control setup; here, we are interested in minimizing the bacterial population at the end of our simulated time while keeping the total antibiotic quantity low. We note that the initial dosing schedule is somewhat different in this case, followed by tapered dosing.
In section (4), we determine the optimal dosing for the case where HGT occurs via conjugation; we use a model presented in [15]. We set up the optimal control problem and use the DGDM to determine the best antibiotic dosing strategy. We again consider two different functionals, and note that we obtain the qualitatively similar result as in the case where resistance acquisition is via transformation. We also compare our results to those obtained in [26], who determined a quasi-optimal strategy for this case, and note that while our method also suggests a tapered dosing strategy, the total antibiotic needed is much lower.
In the last section (5), we summarize the study and present the main findings of this work.
2 Optimal antibiotic dosing using the direct gradient descent method
We give a brief overview of our numerical optimization scheme, the direct gradient descent method (DGDM). We then apply it to a simple antibiotic dosing problem to benchmark the method. Using the method, we determine a discrete optimal strategy and compare the results with those obtained using a quasi-optimal strategy proposed in the literature [26]. In subsequent sections, we will use the DGDM to find the best dosing strategy when resistant bacteria are also present.
2.1 Direct gradient descent algorithm
We consider the problem of minimizing a cost functional, subject to differential equation constraints. Mathematically, the functional to be minimized is of the form
subject to differential equation conditions
with initial conditions
We now give a description of our numerical optimization scheme, the DGDM. The gradient (functional derivative) ∇F(u) of a functional F can be found from the Taylor series
where h is a permissible variation about u and <, > is the inner product in the space being used. Different inner products for the same set of vectors will result in different gradients with different numerical properties. The gradient ∇F(u) points in the direction of greatest increase of F in the inner product space in which ∇F(u) was calculated.
Zizza [27] and Gigena [28] discussed the minimization of a functional subject to constraints by taking the exterior derivative of the functional and of the constraints. The wedge product of the exterior derivative gives a gradient in the independent variable that is set equal to zero and then solved. In our case, we use automatic differentiation to find the gradient with respect to the control variable and construct all other state variables from the control, as described below. This avoids the Lagrange multiplier as well as the explicit construction of the gradient in the space of only the control.
We consider the state variables as functions of the control variable u. That allows us to consider the system of the control and state variables as defining a manifold with local coordinates u. The numerical problem is then done on a grid with equally space nodes on the interval [a, b]. The algorithm is given below.
For each optimization step;
- values of the state variables si are found numerically at each node
- these values are used in the numerical analogue of the functional F
- the gradient ∇F(u) is calculated the value of the functional is reduced by replacing u by u−λ∇F(u).
- process continues until a convergence criterion is met.
2.2 A discrete optimal dosing strategy for susceptible bacteria
We consider a chemostat-based model of bacterial growth, introducing antibiotic dosing through a pharmacodynamic term; this was proposed by [15]. The model consists of three different compartments, representing the nutrient, antibiotic, and bacteria concentrations.
Let S denote the nutrient concentration, A the antibiotic concentration, u the susceptible bacterial population with no drug resistance. The model equations are
(1)
Here the first equation shows the change in nutrient concentration. The first term dS S0 represents the flux of nutrients into the chemostat, −dS S and G(S)u are the washout and removal of nutrients by the bacteria, respectively. Similarly, the only way for antibiotics to deplete is through consumption by susceptible bacteria and via washout. The time-dependent function A0(t) shows the antibiotic dosing strategy that is being employed. The susceptible bacterial population is changing due to the nutrient-dependent growth term
, constant dilution with rate du and killing of the susceptible bacteria due to the antibiotic, represented by the term
which is assumed to be dependent on nutrient as well as and antibiotic concentration.
The problem we consider is designing a dosing strategy that minimizes the bacterial population while keeping the total cost of antibiotic dosing low at the same time. Mathematically, the optimization problem is to minimize the objective functional
(2)
subject to ODE system constraints (1).
We use Pontryagin’s Maximum Principle from the theory of optimal control to determine continuous and quasi-continuous optimal dosing strategies. In the case of quasi-continuous optimal control problem, we consider the A0(t) = Am δ(t) where Am is the maximum concentration of the antibiotic and δ(t) is a function which determines the antibiotic influx. For a detailed description of the numerical algorithm, we would refer to [26]. Next, we look at determining a discrete optimal dosing protocol using the DGDM. The underlying optimization problem is to minimize (2) subject to constraints (1). The dosing applied in this case is consists of discrete periodic doses given by A0(t) = ∑i Ai δ(t−iP). This means that the antibiotic concentration Ai is applied periodically with a period P. For simulation purposes, we considered the case when P = 5 hours and the total number of cycles are 6. We compare the results obtained by continuous, quasi-continuous and discrete techniques in Fig 1.
The total antibiotic used at the optimal dosing is given in the Table 1.
We note that while all these methods lead to bacterial eradication, the discrete strategy does so at a much lower total antibiotic usage.
3 Modeling antibiotic resistance via transformation
Transformation is a horizontal gene transfer mechanism, where foreign DNA is taken up and incorporated by bacteria from the environment [12]. Within the body, cell-free DNA (cf-DNA) can be introduced into the blood due to cell death, active secretions, phagocytosis, autophagocytosis, etc. cf-DNA is distributed throughout the organism, and all cells release cf-DNA during cell division.
In this section, we propose a model of bacterial growth in a chemostat setting, where both resistant and susceptible bacteria are present; we also include the introduction of antibiotics in the system. The mechanism of resistance acquisition is horizontal gene transfer through transformation. Cell-free DNA can persist after disinfection and promote gene transfer in the absence of physical and temporal contact between a donor and recipient bacteria. Natural transformation is the process of physiological uptake of foreign DNA by ‘competent bacteria,’ and its genomic integration [29]. Competence is the ability of bacteria to take up extracellular DNA from the environment. Approximately 80 bacterial species, including human and animal pathogens, and soil bacteria, in their lifetime, are able to acquire the competence in a natural environment [30] and it has been posited that around 10 to 20% of a bacterial population may be competent [31].
We now define the state variables in the model. S represents the nutrient concentration present in the chemostat, A is the antibiotic concentration, x the amount of cf-DNA present in the chemostat, and u, v are the susceptible and resistant bacterial populations, respectively.
We hypothesize that the natural transformation happens through the uptake of cf-DNA from resistant strains by the competent bacterial population. In previous work on HGT via transformation, Johnson et al. [30] used the mass action dynamics to illustrate the transformation mechanism where the competent bacteria takes up the DNA interacting with the transformant bacterial population. Lu [11] proposed a mathematical model to explain the natural transformation dynamics in azotobacter vinelandii. The transformation mechanism used is based on Levin’s mass action dynamics [18] and transformation rates for the tetracycline-resistant gene were estimated by taking into account the motile/non-motile nature of the bacterial population. Our work extends these models by including more of the process pathways in the model, in particular we incorporate a compartment for the cell free DNA density along with the resistant and susceptible bacterial populations which we hope better captures the dynamics, moreover we have set our model in a chemostat setting, as a proxy for a more complex organism, a detailed description of the model is given below
(3)
where
,
,
,
, and
.
Here, G1(S) and G2(S) are the nutrient-dependent growth rates of the susceptible and resistant bacteria, and K1(S, A) and K2(S, A) are the antibiotic killing rates, which we have assumed to depend on the limiting nutrient and antibiotic levels, as has been done in the literature [32, 33].
The primary mechanism for nutrient concentration change includes a constant nutrient flux into the reservoir with a constant dilution of the nutrient and nutrient-dependent bacterial population growth.
The antibiotic concentration changes with the input of time dependent dosing given by A0(t) = ∑i Am δ(t−iP) with a period P over the time interval [t0, tf]. The antibiotic is consumed by the susceptible and resistant bacteria and its removal is represented by the term −f(A)(u+ v).
The third additional state variable x changes with the influx of cf-DNA from dead resistant bacteria. This depends on the killing rate K2(S, A) which results in the release of free circulating DNA. The term −dx x shows the constant dilution of the cf-DNA from the chemostat with dilution rate dx. The term αxu represents the phenomena of transformation where the cell-free DNA is taken up and incorporated by the susceptible bacteria resulting in resistance acquisition.
The fourth equation shows the change in susceptible bacterial population density. This includes the nutrient-dependent influx, constant dilution with rate dS, and nutrient and antibiotic-dependent killing of the susceptible bacterial population. The last term −k3 xu represents the removal of susceptible bacteria due to interaction with and incorporation of the cf-DNA leading to resistance.
The last equation represents the change in resistant bacterial density where G2(S)v is the growth of resistant bacteria at a nutrient-dependent rate. The terms −d+ v, −K2(S, A)v show the removal of resistant bacteria due to washout and the effect of the antibiotic, respectively.
3.1 Periodic dosing treatment
We now consider antibiotic being given at fixed dosage periodically. We analyze the system and determine the steady states. We show that both sterile i.e. bacteria free steady state and infection states, those with the bacterial population surviving exist. We then find conditions for stability and the long term behavior of the system.
The parameters for the models are attached in Table 2.
Theorem 3.1. The non-negative cone
is positively invariant for the model (3) and all solution for the model equations are ultimately uniformly bounded in forward time.
proof. The proof is attached in the appendix A.1 in S1 Appendix.
The periodic solution to (3) includes the sterile steady state
(4)
where A* is the solution of A′(t) = dA(A0−A(t)). There are also other infection states where bacterial populations are not identically zero. The local stability of the sterile state can be found by the computing the Floquet exponents associated with the u and v states.
Theorem 3.2. The sterile state E0(t) corresponding to (3) is locally asymptotically stable if λ4 = G1(S0)−du−[K1(S0, A*)]m < 0 and λ5 = G2(S0)−d+−[K2(S0, A*)]m < 0 and unstable if either λ4 > 0 or λ5 > 0. Moreover in the constant case when A0(t) = A0 and both λ4 < 0, λ5 < 0 then E0 is globally asymptotically stable.
Proof. The proof is attached in the appendix A.2 in S1 Appendix.
To determine the stability of the sterile and infection states we use Floquet theory [34]. We calculate Floquet exponents and consider those related to the state variables u and v, and if both of them are negative then the sterile state is stable and the system converges to the sterile state (Fig 2). If either one of these is positive the sterile state is unstable and the bacterial population grows (Fig 3). Our simulation results verify the theoretical findings.
The right figure shows the success of the treatment for 0 < t < 30h when λ4 = −0.1057 < 0 and λ5 = −0.0861 < 0.
The right figure shows the failure of the antibiotic treatment for 0 < t < 30h when λ4 = 0.3868, λ5 = 0.4224 > 0.
Biologically this means that a periodic dose may or may not be successful in eradicating the bacteria, depending on the effect (killing rates) of the antibiotic on the susceptible and resistant bacteria and the amount of nutrient and antibiotic influx.
3.2 Optimal dosing strategy
3.2.1 Minimizing the total bacterial population.
In this section, we look at the problem of determining the optimal dosing strategy, where the bacterial population in minimized while keeping the total antibiotic does low using the Direct Gradient Descent Method (DGDM). The functional we consider involves minimizing the total bacterial population along with the total antibiotic dosage. In the following section, we will look at the case where we consider minimizing the bacterial population at the end of the dosing period.
The mathematical problem is to find out the optimal antibiotic dosing strategy by minimizing the objective functional
(5)
subject to constraints (3).
The dosing applied in this case is consists of discrete doses given by A0(t) = ∑i Ai δ(t−iP). This means that the antibiotic Ai is applied periodically with a period P. For simulation purposes, we considered the case when P = 5 hours and total number of cycles are 6.
Using the DGDM, we determine the optimal dosing scheme and note that in this case a high initial dose with subsequent tapering is optimal (Fig 4). This is in line with several studies in the literature.
We now consider several scenarios and determine optimal dosing in each case. First, we vary the values of k+, biologically as the value of k+ becomes smaller the resistant strain is less ‘susceptible’ to the antibiotic. Using the DGDM, we obtain the dosing schemes under a range of values of k+, the results are shown in the Fig 5.
Fig 5 shows that as the value of k+ is reduced, a higher total dose of antibiotic is needed. This is consistent over a wide range of values of k+, moreover, a tapered dosing regimen is still optimal in each case.
Next, we look at how optimal dosing changes as the relative cost of the treatment is varied. In our model, this is captured by the parameter Wa (Cost sensitivity parameter associated with the implementation of the dosing protocol). As expected, we observe that the total antibiotic in the optimal dosing is reduced as it becomes more costly. However, this also means that the bacterial population decreases at a lower rate as seen in the Fig 6. The dosing strategy remains qualitatively the same in this case, with higher initial doses that are tapered with time.
3.2.2 Minimizing the bacterial population at the end of dosing period.
We now consider the problem of determining a dosing strategy where we want to minimize the bacterial population at the end of the dosing period, keeping the total antibiotic at a minimum. The mathematical problem is formulated by now evaluating u and v at the final time tf in the optimization functional as given below
(6)
subject to ODE system constraints (3).
We use the DGDM to determine the optimal dosing strategy in this case, which is given in the Fig 7.
We now look into how the dosing schedule varies across different values of the antibiotic killing rate for resistant bacteria k+, and for different relative antibiotic costs. Our results show that the optimal strategy remains qualitatively similar and involves an initial dose build up followed by tapering. This is observed across a wide range of values of k+ and du and demonstrated in Fig 8.
The right figure shows the dosing strategies for various values of washout parameter du.
4 Modeling antibiotic resistance via conjugation
We consider a model for resistance acquisition through conjugation proposed by Imran et al. [15]. In follow-up work, Khan et al. used optimal control theory to determine a quasi-optimal dosing strategy for the problem [26]. Using the DGDM, we will find the optimal strategy and compare our results to those in [26]. We now give a brief description of the model.
Let S denote the nutrient concentration, A the antibiotic concentration, u the susceptible bacterial population with no drug resistance, and v is the resistant bacterial population. The model equations are
(7)
The model represents bacterial growth in a chemostat setting. The first and second equations represent the change in the nutrient and antibiotic concentrations. The change in the susceptible bacterial population density is represented by the third equation. Susceptible bacteria increase at a nutrient dependent growth rate G1(S), moreover it was posited that mis-segregation of resistant strains also give rise to susceptible bacteria. The last equation shows population density change in the resistant bacteria. The term G2(S)(1−q)v represents the increase the population, where the loss due to mis-segregation is accounted for, the process of conjugation is modelled by the mass action term μuv. For a more detailed discussion on the model we would refer to Imran et al. [15].
4.1 Optimal discrete dosing
4.1.1 Minimizing the total bacterial population.
We would like to determine the best dosing strategy which minimizes the overall cost of antibiotic and the susceptible and resistant bacterial population density.
The optimization problem takes the following mathematical form where we want to minimize the objective functional
(8)
subject to ODE system constraints (7). We want to determine the optimal discrete dosing given by A0(t) = ∑i Ai δ(t−iP). The antibiotic concentration Ai applied periodically with a period P will be determined using the DGDM. For simulation purposes, we considered the case when P = 5 hours and total number of cycles are 6. The optimal dosing schedule, antibiotic concentration and the bacterial population are given in the Fig 9.
We note that the optimal strategy is to give a high initial dose which is then tapered off with each subsequent dose. We also compare the discrete optimal dose to the quasi optimal regimen obtained by the method used in [26]. We observe that the discrete optimal strategy is successful in eradicating the bacteria at a lower total antibiotic dose. As antibiotic is mostly administered in discrete doses (or doses given over short intervals) the discrete regimen may also help quantitatively determine the optimal strategy.
4.1.2 Minimizing the bacterial population at the end of dosing period.
We also look at the problem which is to minimize the susceptible and resistant bacterial at the end of the antibiotic dosing along with cost associated with administering the antibiotic. The optimization problem takes the following mathematical form
(9)
subject to ODE system constraints (7). The optimal dosing strategies, antibiotic concentration and bacterial population are shown in Fig 10.
The optimal strategy in this case is an initial increase in the dose which is then tapered off. This is in contrast to the case where we want to minimize the total bacterial population. In that case, a higher initial antibiotic concentration is used but each subsequent does is smaller than the previous one. Qualitatively, both the results are similar for both HGT mechanisms we have studied.
5 Conclusion
In this work, we consider the problem of determining the optimal antibiotic dosing regimen when both susceptible and resistant bacterial strains are present. We consider mechanistic models for resistance acquisition and set up an optimal control problem, the goal being to minimize the bacterial population while keeping the total antibiotic dose low. We use a numerical optimal control method, the direct gradient descent (DGDM) algorithm, to determine these dosing regimens. Resistance acquisition is assumed to be via horizontal gene transfer. In particular, we propose a model of acquired resistance via transformation and determine the optimal dosing regimen for a variety of scenarios. We also consider a model from the literature for resistance acquisition via conjugation and find the best dosing strategies in this case.
We first describe our numerical optimal control algorithm, the DGDM, and then use it for the simple case of determining optimal dosing for susceptible bacteria. Using a chemostat-based model from the literature [15], we determine the dosing regimen and compare our results to some quasi-optimal ones in the literature [26].
We then propose and analyze a model of resistance acquisition via transformation (3), where resistant genes are acquired by susceptible bacteria from the surrounding environment. We incorporate antibiotic dosing in the model and show that discrete antibiotic doses administered periodically may lead to treatment failure, i.e., the system exhibits bi-stability. This means that the success or failure of treatment under such dosing protocols would depend on the sensitivity of the resistant strain to the antibiotic.
We then set up the optimal control problem (3.2), where the dynamics of bacterial growth and antibiotic administration are governed by a mechanistic model. We want to determine a successful strategy to eliminate the bacteria while keeping treatment costs low by cutting down on antibiotic usage. We want to minimize the total bacterial population along with the administered antibiotic quantity. We look at different scenarios, varying the killing rates of the antibiotic for the resistant strain and varying the relative cost of administering the antibiotic. Our findings show that the optimal strategy in all cases is high initial loading followed by dose tapering.
We also look at the problem where we would like to minimize the bacterial population at the end of our treatment, rather than the total bacterial population over the dosing cycles. In this case, the optimal strategy is to build up the initial doses and then taper off. We again study the dosing under a variety of scenarios, varying the sensitivity of the resistant strains and the relative cost of antibiotic dosing. We note that qualitatively similar dosing is recommended in the different scenarios. A higher quantity of antibiotics is needed when the resistant strains are less sensitive. We also observe that as the relative cost of dosing becomes higher, the optimal dose is quantitatively smaller, the cost being that the bacterial population is reduced at a slower rate.
Finally, we consider treatment strategies when resistance is acquired through conjugation. We consider a model from the literature and set up the optimal control problem. Using the DGDM, we determine the optimal dosing once again for different scenarios. We find that the results are qualitatively similar to those in the transformation acquired resistance case.
We have determined discrete optimal antibiotic dosing when both resistant and susceptible bacteria are present. Our results can help determine both qualitative and quantitative dosing regimens for antibiotic treatment.
As a follow-up study, we would like to model horizontal gene transfer via transduction as a resistance acquisition mechanism. In this case, we would further determine efficient dosing protocols by setting up the optimal control problem and optimizing using our numerical optimization scheme. Another direction for future work is to extend our basic model and include a persister cell population, and this has been identified in the literature to be important in susceptible cell survival; the natural setting for this study would be a bio-film. We would again like to study efficient and effective antibiotic dosing based on the model.
References
- 1.
WHO. Antibiotic resistance; 2022. https://www.who.int/news-room/fact-sheets/detail/antibiotic-resistance.
- 2.
CDC. Antibiotic Resistance Threatens Everyone; 2022. https://www.cdc.gov/drugresistance/index.html.
- 3. O’neill J. Antimicrobial resistance. Tackling a crisis for the health and wealth of nations. 2014;.
- 4. Rodloff A, Bauer T, Ewig S, Kujath P, Müller E. Susceptible, Intermediate, and Resistant—The Intensity of Antibiotic Action. Deutsches Ärzteblatt international. 2008. pmid:19626213
- 5. Kowalska-Krochmal B, Dudek-Wicher R. The Minimum Inhibitory Concentration of Antibiotics: Methods, Interpretation, Clinical Relevance. Pathogens. 2021;10(2):165. pmid:33557078
- 6. Zaman SB, Hussain MA, Nye R, Mehta V, Mamun KT, Hossain N. A Review on Antibiotic Resistance: Alarm Bells are Ringing. Cureus. 2017. pmid:28852600
- 7. Tenover FC. Mechanisms of Antimicrobial Resistance in Bacteria. The American Journal of Medicine. 2006;119(6, Supplement 1):S3–S10. pmid:16735149
- 8. Leclerc QJ, Lindsay JA, Knight GM. Mathematical modelling to study the horizontal transfer of antimicrobial resistance genes in bacteria: current state of the field and recommendations. J R Soc Interface. 2019;16(157):20190260. pmid:31409239
- 9. Peterson E, Kaur P. Antibiotic Resistance Mechanisms in Bacteria: Relationships Between Resistance Determinants of Antibiotic Producers, Environmental Bacteria, and Clinical Pathogens. Frontiers in Microbiology. 2018;9. pmid:30555448
- 10. Yalew ST. Review on Antibiotic Resistance: Resistance Mechanisms, Methods of Detection and Its Controlling Strategies. Biomedical Journal of Scientific & Technical Research. 2020;24(5).
- 11. Lu N, Massoudieh A, Liang X, Kamai T, Zilles JL, Nguyen TH, et al. A kinetic model of gene transfer via natural transformation of Azotobacter vinelandii. Environmental Science: Water Research & Technology. 2015;1(3):363–374.
- 12. Winter M, Buckling A, Harms K, Johnsen PJ, Vos M. Antimicrobial resistance acquisition via natural transformation: context is everything. Current Opinion in Microbiology. 2021;64:133–138. pmid:34710742
- 13. D’Agata EMC, Dupont-Rouzeyrol M, Magal P, Olivier D, Ruan S. The Impact of Different Antibiotic Regimens on the Emergence of Antimicrobial-Resistant Bacteria. PLoS ONE. 2008;3(12):e4036. pmid:19112501
- 14. Baker M, Hobman JL, Dodd CER, Ramsden SJ, Stekel DJ. Mathematical modelling of antimicrobial resistance in agricultural waste highlights importance of gene transfer rate. FEMS Microbiology Ecology. 2016;92(4). pmid:26906100
- 15. Mudassar I, Smith H. The Pharmacodynamics of Antibiotic Treatment. Computational and Mathematical Methods in Medicine. 2006;7(4):229–263.
- 16. Svara F, Rankin DJ. The evolution of plasmid-carried antibiotic resistance. BMC Evolutionary Biology. 2011;11(1):130. pmid:21595903
- 17. Torella JP, Chait R, Kishony R. Optimal Drug Synergy in Antimicrobial Treatments. PLoS Computational Biology. 2010;6(6):e1000796. pmid:20532210
- 18. Levin BR, Stewart FM, Rice VA. The kinetics of conjugative plasmid transmission: Fit of a simple mass action model. Plasmid. 1979;2(2):247–260. pmid:377323
- 19. Geli P, Laxminarayan R, Dunne M, Smith DL. “One-Size-Fits-All”? Optimizing Treatment Duration for Bacterial Infections. PLoS ONE. 2012;7(1):e29838. pmid:22253798
- 20. Slama TG. Gram-negative antibiotic resistance: there is a price to pay. Critical Care. 2008;12(Suppl 4):S4. pmid:18495061
- 21. Meredith HR, Lopatkin AJ, Anderson DJ, You L. Bacterial Temporal Dynamics Enable Optimal Design of Antibiotic Treatment. PLOS Computational Biology. 2015;11(4):1–22. pmid:25905796
- 22. Uecker H, Bonhoeffer S. Antibiotic treatment protocols revisited: the challenges of a conclusive assessment by mathematical modelling. Journal of The Royal Society Interface. 2021;18(181):20210308. pmid:34428945
- 23. Paterson IK, Hoyle A, Ochoa G, Baker-Austin C, Taylor NGH. Optimising Antibiotic Usage to Treat Bacterial Infections. Scientific Reports. 2016;6(1):37853. pmid:27892497
- 24. Hoyle A, Cairns D, Paterson I, McMillan S, Ochoa G, Desbois AP. Optimising efficacy of antibiotics against systemic infection by varying dosage quantities and times. PLOS Computational Biology. 2020;16(8):1–20. pmid:32745111
- 25. Peña-Miller R, Lähnemann D, Schulenburg H, Ackermann M, Beardmore R. Selecting Against Antibiotic-Resistant Pathogens: Optimal Treatments in the Presence of Commensal Bacteria. Bulletin of Mathematical Biology. 2012;74(4):908–934. pmid:22057950
- 26. Khan A, Imran M. Optimal Dosing Strategies against Susceptible and Resistant Bacteria. Journal of Biological Systems. 2018;26(01):41–58.
- 27. Zizza F. Differential Forms for Constrained Max-Min Problems: Eliminating Lagrange Multipliers. The College Mathematics Journal. 1998;29(5):387–396.
- 28. Gigena S. Constrained local extrema without Lagrange multipliers and the higher derivative test; 2013. pmid:24267701
- 29. Woegerbauer M, Bellanger X, Merlin C. Cell-Free DNA: An Underestimated Source of Antibiotic Resistance Gene Dissemination at the Interface Between Human Activities and Downstream Environments in the Context of Wastewater Reuse. Frontiers in Microbiology. 2020;11. pmid:32390973
- 30. Johnsen PJ, Dubnau D, Levin BR. Episodic selection and the maintenance of competence and natural transformation in Bacillus subtilis. Genetics. 2009;181(4):1521–1533. pmid:19189946
- 31. Blokesch M. Natural competence for transformation. Current Biology. 2016;26(21):R1126–R1130. pmid:27825443
- 32. Imran M, Smith HL. The dynamics of bacterial infection, innate immune response, and antibiotic treatment. Discrete and Continuous Dynamical Systems—B. 2007;8(1):127–143.
- 33. Cogan NG. Effects of persister formation on bacterial response to dosing. Journal of Theoretical Biology. 2006;238(3):694–703. pmid:16125727
- 34. Klausmeier CA. Floquet theory: a useful tool for understanding nonequilibrium dynamics. Theoretical Ecology. 2008;1(3):153–161.