Skip to main content
Advertisement
  • Loading metrics

Phage-inducible chromosomal islands promote genetic variability by blocking phage reproduction and protecting transductants from phage lysis

  • Rodrigo Ibarra-Chávez,

    Roles Formal analysis, Investigation, Writing – original draft, Writing – review & editing

    Affiliations Institute of Infection, Immunity and Inflammation, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, United Kingdom, Department of Biology, Section of Microbiology, University of Copenhagen, Copenhagen, Denmark

  • Aisling Brady,

    Roles Formal analysis, Investigation

    Affiliations Institute of Infection, Immunity and Inflammation, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, United Kingdom, MRC Centre for Molecular Bacteriology and Infection, Imperial College London, United Kingdom

  • John Chen,

    Roles Formal analysis, Writing – review & editing

    Affiliation Department of Microbiology and Immunology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore

  • José R. Penadés ,

    Roles Conceptualization, Formal analysis, Funding acquisition, Writing – original draft, Writing – review & editing

    j.penades@imperial.ac.uk (JRP); afh22@st-andrews.ac.uk (AFH)

    Affiliations Institute of Infection, Immunity and Inflammation, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, United Kingdom, MRC Centre for Molecular Bacteriology and Infection, Imperial College London, United Kingdom, Universidad CEU Cardenal Herrera, Moncada, Spain

  • Andreas F. Haag

    Roles Conceptualization, Formal analysis, Investigation, Writing – original draft, Writing – review & editing

    j.penades@imperial.ac.uk (JRP); afh22@st-andrews.ac.uk (AFH)

    Affiliations Institute of Infection, Immunity and Inflammation, College of Medical, Veterinary and Life Sciences, University of Glasgow, Glasgow, United Kingdom, School of Medicine, University of St Andrews, North Haugh, St Andrews, United Kingdom

Abstract

Phage-inducible chromosomal islands (PICIs) are a widespread family of highly mobile genetic elements that disseminate virulence and toxin genes among bacterial populations. Since their life cycle involves induction by helper phages, they are important players in phage evolution and ecology. PICIs can interfere with the lifecycle of their helper phages at different stages resulting frequently in reduced phage production after infection of a PICI-containing strain. Since phage defense systems have been recently shown to be beneficial for the acquisition of exogenous DNA via horizontal gene transfer, we hypothesized that PICIs could provide a similar benefit to their hosts and tested the impact of PICIs in recipient strains on host cell viability, phage propagation and transfer of genetic material. Here we report an important role for PICIs in bacterial evolution by promoting the survival of phage-mediated transductants of chromosomal or plasmid DNA. The presence of PICIs generates favorable conditions for population diversification and the inheritance of genetic material being transferred, such as antibiotic resistance and virulence genes. Our results show that by interfering with phage reproduction, PICIs can protect the bacterial population from phage attack, increasing the overall survival of the bacterial population as well as the transduced cells. Moreover, our results also demonstrate that PICIs reduce the frequency of lysogenization after temperate phage infection, creating a more genetically diverse bacterial population with increased bet-hedging opportunities to adapt to new niches. In summary, our results identify a new role for the PICIs and highlight them as important drivers of bacterial evolution.

Author summary

Bacteria need to protect themselves from infection and killing by phages to survive in the environment. For this purpose, bacteria have developed a sophisticated arsenal of defense mechanisms that can protect individual cells or the overall bacterial population. Individualized protection is achieved via systems such as CRISPR-Cas or lysogenization that allow the infected cell to survive. By contrast, population-based protection such as abortive infection systems lead to the cell’s death before phage progeny is released. Here we describe a new role for phage-inducible chromosomal islands (PICIs) in protecting bacterial populations from phage predation. The resulting increased survival has consequences for the acquisition of foreign DNA such as antimicrobial resistance and fitness genes by the prey population as it also allows for the increased survival of bacteria that have acquired new genetic material. As a direct consequence of this increased survival, PICIs expand genetic diversity in bacterial populations. Such increased genetic diversity is advantageous to the complete bacterial population as the best adapted clones will outcompete others in any given environment. PICIs therefore also act as key mediators of population diversification.

Introduction

Bacteriophages (phages) are viruses that infect bacteria and are estimated to be the most abundant biological entities on the planet [1]. Phages play an important role in the ecology of biological ecosystems and affect not only bacterial population structures, but also global carbon and nitrogen turnover [2,3]. They are likewise key mediators of horizontal gene transfer (HGT) via transduction, one of the most important processes driving bacterial evolution as well as the spread of antimicrobial resistance (AMR) genes. Transducing particles that contain bacterial DNA are generated during phage infection or prophage induction by a variety of mechanisms that lead to three main types of transduction: generalized, specialized, and lateral transduction (recently reviewed in [4]). Generalized transduction is the process by which phages package any bacterial DNA (chromosomal or plasmid) and transfer it to another cell. Here, the phage terminase “mistakenly” recognizes pseudo-pac sites located on the host chromosomal or on episomal DNA and package it into the phage particles [5,6]. Conversely, specialized transduction can package and transfer a limited segment of host bacterial DNA adjacent to the phage [7]. This type of transduction is the result of the erroneous excision of a prophage from the host chromosome. Consequently, in addition to the phage DNA, a small segment of prophage-adjacent chromosomal DNA is also packaged into the phage capsid resulting in transducing particles containing, in most cases, a defective phage. Specialized transduction has been described in both cos-type and pac-type phages [8]. During lateral transduction, replication and packaging of the prophage genome begins before its excision [911]. Thus, the phage packaging machinery can continue into the host chromosome leading to the generation of transducing particle that contain larger segments of chromosomal DNA adjacent to the prophage integration site. Since packaging is directional, high frequency transducing particles are only generated for chromosomal DNA to one side of the prophage. This mechanism has only been observed in pac-type phages because of the additional packaging constraints imposed on cos-type phages render it far less likely to occur.

In the final stage of the lytic cycle, lysis of the host cells releases a mixture of phages and transducing particles, where phages significantly outnumber transducing particles. Once bacterial DNA is injected into a host cell, the transductants with the best chance of survival are either those with lysogenic protection or those that rapidly acquire immunity against the surrounding phages. The last few years have seen a vast expansion of known phage defense mechanisms and studies have revealed that some of these are clustered in what is called defense islands [12]. These mechanisms frequently act at the nucleic acid level (i.e. restriction modification systems or CRISPR-Cas) or trigger host cell suicide after infection (abortive infection (Abi) systems) (see [13] for a recent review). Defense systems that can allow the host cell to survive phage infection are of particular interest as they can promote the survival and expansion of transduced bacterial clones. For example, lysogenization (by transducing phages) and CRISPR-Cas systems have been shown to increase the frequency of host cells transduced with bacterial DNA by protecting the transductants from phage lysis [14,15].

Phage-inducible chromosomal islands (PICIs) are a widespread family of phage satellites that parasitize helper phages for their own benefit [4,16]. After helper phage infection or prophage induction of a PICI-containing strain, PICIs are activated by a phage-encoded inducer and excise from the bacterial chromosome, replicate extensively, and are then packaged into capsids comprised of phage-encoded proteins [17,18]. The Staphylococcus aureus pathogenicity islands (SaPIs) were the first PICIs to be described [19], and are the prototypical members of this family of mobile genetic elements (MGEs). Importantly, PICIs can interfere with phage reproduction by hijacking the phage packaging machinery to promote packaging of their own genomes at the expense of phage transfer or interfering with phage late gene transcriptional regulation [2023]. For example, the interference mechanisms of SaPI1 lead to a reduction in phage titer and an increased survival of bacteria relative to a SaPI1-free strain infected with a phage [19]. Preliminary observations in this study also indicated that infected SaPI-containing cells were less likely to result in phage lysogens and that this could be either due to abortive or failed phage infection [19]. All PICIs to date carry at least some of these interference mechanisms although the extent of interference caused by individual PICIs on their inducing phage varies considerably. These interference mechanisms not only ensure high frequency SaPI transfer, but also enable the formation of transducing particles that use the PICIs strategy for packaging [24]. While many PICIs carry genes with obvious selective advantages such as virulence factors and antibiotic resistance [2527], some PICIs do not, suggesting that these islands could provide unexpected advantages to their host cells to persist in nature.

Based on the known ability of SaPIs to interfere with phage replication, we hypothesized that SaPIs, like other phage defense mechanisms [15,28,29], might benefit the bacterial population by allowing for the survival of an increased number of transductants after horizontal acquisition of bacterial DNA. Here we report that SaPIs promote the survival of bacterial cells after phage-mediated gene transfer by interfering with phage reproduction and reducing the population of infective phage particles. Our results indicate that this protection occurs at the population level and that this is enough to protect most of the bacterial cells from subsequent rounds of phage attack, allowing both cells that have and have not received foreign bacterial DNA to survive and persist in the population. Our work identifies a hitherto unexplored function for SaPIs in generating genetic diversity and shaping bacterial populations and highlights the role of this family of MGEs in bacterial evolution.

Results

SaPIs increase transduction

SaPIs are the prototypical members of the PICI family [17], and were used here as a model to investigate the impact of PICIs on phage-mediated transduction. Specifically, three different SaPIs were selected: (i) SaPIbov1 (GenBank accession number AF217235.1) and SaPI1 (GenBank accession number U93688.2) are clinically important since they encode menstrual toxic shock syndrome toxin (TSST-1) and both have been extensively used for studying the mechanisms of PICI-phage induction, replication and phage interference; and (ii) SaPINY940, previously described as the incomplete phage pT1028, (GenBank accession number NC_007045.1) [30], which does not encode any identifiable toxins or virulence factors whose acquisition could be advantageous for its host. We further selected two temperate prophages (Φ11 and 80α) able to engage in generalized and lateral transduction to study the impact of each SaPI within a recipient strain on phage-mediated gene transfer.

To obtain transducing lysates, Φ11 or 80α lysogens carrying plasmid pJP2511 (CmR) or a chromosomal cadmium resistance cassette (CadR) next to the Φ11 or 80α attB sites were treated with mitomycin C (MC) for prophage induction [9]. Note that in these experiments the transfer of the plasmid (CmR) and the chromosomal (CadR) marker reflect generalized and lateral transduction, respectively [9,31]. Next, Φ11 lysates were used to infect (MOI 1:10) either the non-lysogenic, susceptible host strain, RN4220, or an RN4220 derivative carrying SaPIbov1, while 80α lysates were used to infect either RN4220 or RN4220 carrying either SaPINY940 or SaPI1 (see S1 Fig for an overview of the experimental setup). These combinations were chosen to generalize our results, and because Φ11 can induce SaPIbov1 [32], while 80α induces SaPINY940 and SaPI1. Note that SaPINY940 encodes a repressor identical to SaPI1, which is also induced by 80α [33]. Eighteen hours after infection, the different recipient cells were plated on selective media and the number of transductants were quantified. In support of our hypothesis that the presence of a SaPI in a recipient strain would be beneficial for the acquisition of foreign DNA by a bacterial population, the presence of either SaPIbov1, SaPI1 or SaPINY940 in the recipient host cells significantly increased the number of clones harboring the transduced CadR or CmR markers (Fig 1).

thumbnail
Fig 1. SaPIs promote the survival of transductants.

S. aureus RN4220 derivative strains either devoid of (red) or harboring either SaPIbov1 (blue), SaPINY940 (green) or SaPI1 (purple) were infected with an MOI of 1:10 (phage:bacteria) of the indicated phages and acquisition of a chromosomal cadmium resistance marker (lateral transduction) (top row panels) or a plasmid-borne chloramphenicol resistance cassette (generalized transduction) (bottom row panels) was determined 18 h post-infection. Bold horizontal lines in each boxplot represent the median and lower and upper hinges the first and third quartiles, respectively (n = 7 biological replicates for strains infected with either Φ11 or Φ11 Δdut or n = 3 biological replicates for strains infected with either 80α or 80α Δsri). Assessment of statistically significant differences between groups was performed using a two-sided Student’s t-test on log10 transformed data. p-values are indicated above the respective comparison, ns not significant. Limit of detection (LOD) for this assay is 10 transductants per ml.

https://doi.org/10.1371/journal.pgen.1010146.g001

Induction of the SaPI cycle is required to significantly increase transduction

In view of the previous results, we next analyzed whether the activation of the SaPI cycle in the recipient strain by the transducing phages was required to increase transduction. Interestingly, when we repeating the same experiments using Φ11 Δdut or 80α Δsri mutants, which do not encode the SaPIbov1 or SaPINY940/SaPI1 inducers, respectively [33], and therefore do not induce these SaPIs, the presence of either SaPIbov1 or SaPI1 did not increase transduction of the different markers (Fig 1). Unexpectedly, although the transduction frequencies observed for the 80α Δsri mutant-mediated transfer of the different markers into the SaPINY940-positive strain were significantly lower than those observed when the wt phage (able to induce SaPINY940) was used, we still observed a minor increase in the transfer of the markers into the SaPINY940-positive strain, compared to the transfer into the SaPINY940-negative strain (Fig 1). This result suggested that contrary to what is seen with SaPI1 or SaPIbov1, the presence of SaPINY940 can provide a residual increase in the transfer of the markers independently of the activation of the SaPI cycle. Nevertheless and in concordance with what was seen with the other islands, the transfer of the marker was much more efficient when the SaPINY940 cycle was induced. The molecular basis of the different behavior among different SaPIs is currently under investigation.

Next, since SaPI induction severely interferes with phage reproduction [17], we hypothesized that a reduction in the phage titer after the first few rounds of infection led to an increase in the number of cells that survived later rounds of phage attack (including the cells transduced with bacterial DNA). In support of this hypothesis, the titers of the wt Φ11 and 80α phages, but not of the Φ11 Δdut and 80α Δsri mutants, were severely reduced after infection of the strains carrying SaPIbov1 or SaPI1 (Fig 2A). This reduction in phage titers was linked to a significant increase in the number of survivors present in the bacterial population (Fig 2B). In accordance with the increased transduction observed when the SaPINY940-positive strain was infected with the 80α Δsri mutant, a reduction in phage titer (Fig 2A) and an increase in cell viability (Fig 2B) were observed after infection of the SaPINY940-containing strain by phage 80α Δsri.

thumbnail
Fig 2. SaPIs reduce phage reproduction and lysogenization but increase cell viability.

S. aureus RN4220 derivative strains either devoid of (red) or harboring either SaPIbov1 (blue), SaPINY940 (green) or SaPI1 (purple) were infected with an MOI of 1:10 (phage:bacteria) of the indicated phages. Phage titers (A), viable cells (B) and the relative number of lysogens per viable cell (C) for each recipient were determined. Note that the number of lysogens could not be determined for SaPINY940 due to an incompatibility of selection markers. Bold horizontal lines in each boxplot represent the median and lower and upper hinges the first and third quartiles, respectively (n = 7 biological replicates for strains infected with either Φ11 or Φ11 Δdut or n = 3 biological replicates for strains infected with either 80α or 80α Δsri). Assessment of statistically significant differences between groups was performed using a two-sided Student’s t-test on log10 transformed data. p-values are indicated above the respective comparison, ns not significant. Limits of detection (LOD) for this assay are 100 plaques per ml (A), 100 colonies per ml (B).

https://doi.org/10.1371/journal.pgen.1010146.g002

SaPIs do not increase HGT but protect transductants from phage attack

To address whether SaPIs promoted increased levels of HGT or promoted the survival of transduced bacterial populations, we followed cell viability, phage titers and transduction titers of marker genes after 1, 4 or 18 h post infection (Fig 3). Note that the one-hour time point post infection allows for the completion of the initial transduction event but does not provide enough time for the release of phage progeny from this first infection event. We observed no significant differences in either viable cell counts, phage or transduction titers at this time. This suggested that there was no inherent difference between the ability to acquire exogenous DNA via HGT in either SaPI-positive or SaPI-negative strains. However, differences began to be evident 4 h after the phage lysates were added to the recipients: SaPI-containing cells showed an increased number of viable cells and transductants as well as reduced phage titers relative to the SaPI-free recipient strains or strains infected with the phage inducer mutants (Fig 3). To estimate whether bacterial population underwent additional transduction events after the initial infection cycle, we calculated the ratio of transduced to viable cells at 1 h and 18 h post infection. In cases where subsequent transduction events occurred, this number should increase at the later timepoint, reflecting a larger portion of the bacterial population to have acquired the relevant resistance markers. We did not observe any increase in this ratio, further suggesting that transduction of the marker genes occurred during the first infection cycle and did not play a major role during later timepoints.

thumbnail
Fig 3. Assessment of strain viability, phage titers and transduced markers at different time points following infection.

The indicated strains either devoid of (red) or harboring either SaPIbov1 (blue) or SaPINY940 (green) were infected with an MOI of 1:10 (phage:bacteria) with the indicated phage donor lysates. Samples for viable cell count, phage titer and number of cells transduced with either antibiotic resistance marker were taken at the indicated timepoints. Note that at 0 h, viable cells correspond to the number of infected cells used, phage titers correspond to the number phages from the donor lysate added for the infection and resistance marker titers are 0 as the recipient cells are sensitive at this stage. Error bars are s.d. from the mean. Assessment of statistically significant differences between groups was performed using a two-sided Student’s t-test on log10 transformed data. p-values are as follows: * p<0.05, ** p<0.01, *** p<0.001, **** p<0.0001, ns not significant. Limits of detection (LOD) are 100 colonies per ml for viable cells counts, 100 plaques per ml for phage titers and 10 colonies per ml for transductions.

https://doi.org/10.1371/journal.pgen.1010146.g003

SaPIs protect bacterial populations through a range of MOIs

To test whether SaPIs could mediate population protection when exposed to higher initial phage burdens, we repeated the infection experiment using an MOI of 1:1 rather than the MOI of 1:10 that was used in the previous experiments (Fig 4). This high MOI was selected to ensure that most bacterial cells would undergo a phage infection (~63% at an MOI of 1:1 compared to ~9.5% at an MOI of 1:10 assuming Poisson distribution of infection) as well as to balance the drive of temperate bacteriophages to lysogenize at higher MOIs [34,35]. Even when cells were infected with 10-fold the number of phages, SaPI-positive cells retained an increased number of transductants, a reduced phage titer and increased viability compared to their SaPI-negative relative (Fig 4). These differences were more robustly maintained in experimental systems involving phage 80α compared to the system with Φ11, indicating that the afforded protection was likely dependent on the phage-SaPI pair as well as the infectious dose.

thumbnail
Fig 4. Impact of MOI on horizontal gene transfer, phage titers and viability.

S. aureus RN4220 derivative strains either devoid of (red) or harboring either SaPIbov1 (blue), SaPINY940 (green) or SaPI1 (purple) were infected with an MOI of either 1:1 or 1:10 (phage:bacteria) of the indicated phages and acquisition of a chromosomal cadmium resistance marker (lateral transduction) (A), a plasmid-borne chloramphenicol resistance cassette (generalized transduction) (B), phage titers (C) and cell viability (D) was determined 18 h post-infection. Bold horizontal lines in each boxplot represent the median and lower and upper hinges the first and third quartiles, respectively (n = 3–4 biological replicates as indicated). Assessment of statistically significant differences between groups was performed using a two-sided Student’s t-test on log10 transformed data. p-values are indicated above the respective comparison, ns not significant. Limit of detection (LOD) of transductants (A&B) is 10 transductants per ml, 100 plaques per ml for phage titers (C), and 100 colonies per ml for viable cells (D).

https://doi.org/10.1371/journal.pgen.1010146.g004

SaPIs increase genetic diversity in the recipient cells by reducing lysogenization

Prophages are known to promote transduction by protecting recipient cells from phage attack, preventing further superinfection by the same phage type (superinfection immunity) [36]. Consequently, most of the surviving transductants become lysogenic for the transducing phage in the absence of a PICI within the recipient population [14]. The fact that SaPIs modify phage dynamics prompted us to study the effect that SaPIs may have on the frequency of lysogeny after phage infection. To do that, we took advantage of the fact that the wt and mutant Φ11 and 80α prophages carried an erythromycin resistance marker ermC integrated into their phage genomes [37]. The lysates obtained in Fig 2A were used to infect either RN4220 (susceptible strain, Φ11 and 80α lysates) or RN4220 carrying either SaPIbov1 (Φ11 lysates) or SaPI1 (80α lysates), (MOI 1:10). Note that SaPINY940 was not used in these experiments because it carries the same ermC marker present in the phages. Eighteen hours after infection, the bacterial cells that survived the phage attack were grown on TSA plates lacking or containing erythromycin, and the proportion of the lysogens (compared to the viable cells) quantified. The SaPIbov1- and SaPI1-containing strains showed a significantly reduced proportion of cells becoming lysogenic compared to the susceptible RN4220 strain when infected with either wt Φ11 or wt 80α, respectively. By contrast, no differences between the SaPI-containing strains and RN4220 were observed when infecting them with either their respective inducer mutant lysates (Φ11 Δdut for SaPIbov1 and 80α Δdut for SaPI1) (Fig 2C).

The previous results suggested that the presence of the island will not only increase the survival of transductants but also the genetic diversity of the bacterial population by preserving part of the original non-lysogenic population and promoting the existence of additional different cell types, carrying different genetic information. To test this idea, we introduced into the lysogenic strains for Φ11 (wt or Δdut) both the chromosomally encoded Cd marker, and the plasmid pJP2511, which encodes CmR. These strains were MC induced, and the lysates were used to infect strain RN4220 or its SaPIbov1-containing derivative. From this experiment we determined the number of viable cells, lysogens, transductants as well as number of transductants becoming lysogenic by replica-plating them onto TSA supplemented with erythromycin. These data were then used to further assess the impact of SaPIs in a host cell on population diversity, by calculating the relative frequencies of different cell populations as a proportion of viable cells within each replicate. In support of the hypothesis, and as is shown in Fig 5, in absence of SaPIbov1, all the cells became lysogenic for Φ11 (Fig 5C, orange population, ErmR), which implied that the original non-lysogenic RN4220 strain (Fig 5C, grey population) was no longer present in the population. Moreover, in absence of SaPIbov1, two additional cell types appeared in the population, which corresponded to derivative lysogenic cells for Φ11 carrying either the chromosomally encoded CmR marker or the pJP2511 plasmid (Fig 5C, depicted in yellow). By contrast, the presence of SaPIbov1 notably increased diversity in the population, not only by modifying the frequency distribution of the aforementioned clones generated in absence of the island, but also by promoting the existence of three additional cell types (Fig 5). The first one corresponded to the original non-lysogenic RN4220 (grey population), which is absent when the island is not present but remained as the most prevalent clone in the population when the island is present. The other two clones were derivative RN4220 strains carrying the antibiotic resistance markers, but not the prophage (Fig 5, depicted in green). Of note is that the proportion of cells that had both become lysogenic for Φ11 and acquired one of the transduced resistance markers showed no differences between either the SaPI-positive or the susceptible RN4220 strain, suggesting that in the generation of this subpopulation (i) transduction and lysogenization were coupled, (ii) had to occur during early infection and (iii) were independent of the presence of a SaPI and other cell populations. Taken together, these results confirmed an unexpected role of the SaPIs in bacterial evolution by promoting genetic variability.

thumbnail
Fig 5. SaPIs increase population heterogeneity.

S. aureus RN4220 derivative strains either devoid of (RN4220) or harboring SaPIbov1 were infected with an MOI of 1:10 (phage:bacteria) of a Φ11 or Φ11 Δdut mutant lysate derived from a donor strains containing a chromosomal cadmium and plasmid-borne chloramphenicol resistance marker. Number of viable cells, transductants and lysogenization frequencies of the defined populations and their relative frequencies to the total number of viable cells were determined. Population frequencies of (A) cells acquiring the chromosomal cadmium resistance marker or (B) the plasmid-encoded chloramphenicol resistance marker in the defined recipient strains. Bold horizontal lines in each boxplot represent the median and lower and upper hinges the first and third quartiles, respectively (n = 4 biological replicates for all samples). Assessment of statistically significant differences between groups was performed using a two-sided Student’s t-test on log10 transformed data. p-values are indicated above the respective comparison, ns not significant. Note that 10−9 as relative population frequency in these data indicates populations that were completely absent. (C) Schematic representation of the presence of different cell populations in either a recipient lacking a SaPI (left) or containing a SaPI (right).

https://doi.org/10.1371/journal.pgen.1010146.g005

Discussion

Transduction is a fundamental process of bacterial evolution that hinges on the survival of the transduced cells (from further phage attack) in order to persist. By protecting their host cells from phage killing, phage defense mechanisms such as lysogenic protection or CRISPR-Cas, increase the chances of any given cell’s survival within the population while Abi-systems act on the whole bacterial population by preventing the release of phage progeny. Here we show that PICIs are not merely selfish MGEs but provide additional benefits to their host cells by blocking phage reproduction and thus promoting the survival of the entire bacterial population, including those that have acquired foreign genetic material (Fig 6). While prophages and CRISPR-Cas systems provide defense at the single cell level, PICIs are likely operating at population level through a general reduction in phage titers. While PICI-containing cells show no differences in phage infection, phage burst sizes are known to be reduced in PICI-containing cells that are unsuccessful in fully blocking the infecting phage [19]. Whether PICIs can also contribute to protecting individual cells from phage predation remains to be determined but is likely to be dependent on the individual phage-PICI combination. Untangling the protective effects that are eventually attributable to PICIs or simply the result of lysogenic protection (particularly at high MOIs), could provide further insights into the evolutionary impacts of these versatile molecular parasites. In this study, protection of host populations is dependent on the induction of the PICIs following host cell infection in all three PICIs tested. However, we cannot discard the possibility that some PICIs may confer protection even in the absence of phage induction. Indeed, some evidence for this can be gleaned from our results when infecting a strain containing SaPINY940 with a phage unable to induce this island. Even though a substantial amount of protection is lost in absence of island replication, there was still evidence of an increased level of protection in this strain background compared to its PICI-free relative. While this observation will require further confirmation, we anticipate PICI mediated protection might also act against non-inducing phages. This is currently under investigation.

thumbnail
Fig 6. Model of the impact of SaPI protection from phage predation on horizontal gene transfer and population heterogeneity.

In SaPI-free recipients (grey cells), infecting phages can reproduce without restrictions and lyse their host cell (indicated dashed lines and skull and crossbones symbol). Only lysogenization (cells shaded blue) can protect the host cell from future phage infection and killing. Any cells with horizontally acquired genes (red and green shaded cells) that do not undergo lysogenization are also subject to subsequent rounds of phage infection increasing the likelihood of their loss. In the presence of SaPIs, recipient strains can successfully block phage replication and can survive without the need for lysogenization. Consequently, transductants are also more likely to survive leading to an overall increase in population heterogeneity. We propose that this occurs mainly via a general reduction of phage reproduction and burst size protects at population level. However, SaPIs could also act at the individual cell level and protect the infected cell from lysis. The mechanistic details of protection are likely to be diverse and different SaPIs could employ replication-dependent and -independent mechanisms to achieve this.

https://doi.org/10.1371/journal.pgen.1010146.g006

Another interesting observation of our study is that SaPIs can substantially reduce the proportion of phage lysogens in the bacterial population which results in a more heterogenous population overall. Since lysogenization is a stochastic process that occurs randomly [3840] and is promoted by high MOIs [34,35], we initially hypothesized that this reduction in the number of lysogens might simply reflect the reduction in phage titers caused by the SaPI interference. However, the consistent protection of the bacterial population and the resulting reduction in phage titers even at higher MOIs suggest that SaPIs might be more apt at blocking infecting phages than previously appreciated. In any case, such genetic heterogeneity can afford the bacteria with bet-hedging opportunities that enable them to better adapt and survive in changing and stressful environments.

While it is true that the horizontal transfer of specific genes can be beneficial to a cell if the acquired genes provide an advantage to the recipient cells compared to the rest of the population, it can also be detrimental if the mobilized genes have no function or are incompatible with existing genes [41]. The same applies to lysogenization, which can provide positive or negative effects, depending on the environmental context [42]. Importantly, our results demonstrate that SaPIbov1 increases the genetic variability of the recipient cells, not just by preserving the original lineage but also by creating new lineages that do not appear when the island is not present, highlighting how these events can further influence the evolution and clonal expansion of bacteria. Since the output of the transfer can be positive or negative for the recipient cells, PICIs can therefore increase the chance of the bacterial population to survive by minimizing the negative effects that the horizontal transfer of undesirable genes may have in the recipient cells by promoting genetic diversity. In essence, genetic variability is facilitated by the presence of PICIs in a host strain and natural selection will determine the fittest clone.

In nature, bacteria live in polymicrobial communities that contain abundant phage loads [43]. These phages are not only immensely important in shaping the bacterial community but are a major hub for the inter- and intrageneric exchange of genetic information [44]. Among the genetic material on offer are virulence and fitness factors as well as antimicrobial resistance genes. By increasing the frequency of genetic material exchange via increased survival of transduced clones, SaPIs can no longer be considered as self-serving MGEs but rather as major contributors to bacterial evolution. SaPIs benefit the host population by effectively acting as a host defense strategy, undermining phage reproduction, and increasing the chances of acquiring new sets of genes by transduction [45]. The fact that PICIs are found across distantly related taxa suggests that their lifestyle has a strong selective value representing a novel strategy for conferring fitness and promoting genomic variability among bacteria and adds another defense element to the mobile bacterial immune systems [29]. Following this rationale, the protective role of SaPIs, and other PICIs could potentially affect the application of phages as a means to reshaping microbiomes and eliminate specific pathogenic strains. This aspect should be evaluated in phage therapy and gene delivery to avoid the unintended fitness enhancement by transduction which could cause potential risks associated with public health and antimicrobial resistance.

Materials and methods

Bacterial strain and culture conditions

The bacterial strains and plasmids used in this study are detailed in Table 1. S. aureus strains were grown in Tryptic soy broth (TSB) or on Tryptic soy agar (TSA) plates. Antibiotic selection was used where appropriate (erythromycin 10 μg ml-1, chloramphenicol 20 μg ml-1, cadmium chloride 100 μM).

Phage induction and titration

S. aureus strains lysogenic for the defined phages and containing the defined chromosomal markers or plasmids were grown to early exponential phase (OD540~0.15) at 37°C and 120 rpm. Cultures were then induced by the addition of mitomycin C (2 μg ml-1) and incubated for 4–5 h at 30°C followed by overnight incubation at room temperature before filtering with a 0.2 μm syringe filter (Sartorius). To determine the phage titers, RN4220 cultures were grown to OD540~0.35 and 100 μl of this culture was mixed with 3 ml of phage top agar (PTA, 20 g l-1 Nutrient Broth No. 2, Oxoid, plus 3.5 g l-1 agar, Formedium supplemented with 10 mM CaCl2) and overlaid onto phage base agar plates (20 g l-1 Nutrient Broth No. 2, Oxoid, plus 7 g l-1 agar, Formedium supplemented with 10 mM CaCl2). Phage lysates and dilutions in phage buffer (PHB) (1 mM MgSO4, 4 mM CaCl2, 50 mM Tris-Cl, 100 mM NaCl, pH = 8) were spotted in triplicates of 10 μl each onto lawns of the specified strains, dried and incubated overnight prior to plaque forming unit (PFU ml-1) determination.

Phage time-course infection experiment

Cultures of the indicated strains were grown to exponential phase and normalized to an OD540 of 0.25 corresponding to ~1 x 108 CFU ml1. Five to ten ml of this suspension were then supplemented with 5 μM CaCl2 and infected with the defined phage lysates at an MOI of either 1:10 (phage:bacteria) and incubated at 30°C and 80 rpm. At the indicated timepoints, samples were taken to assess the number of viable cells, transductants and phage titers.

Viable cell count determination

Cultures were serially diluted in PBS and spotted in triplicates of 10 μl per dilution onto a TSA plate. The plates were incubated for 18 h and the colony forming units determined.

Transductions of resistance markers

At the defined timepoints, 100 μl of culture was plated directly onto TSA supplemented with the appropriate antibiotics. Plates were then incubated for 24–48 h (depending on the resistance marker assessed) and colonies were counted for transduction titer enumeration (TFU ml1).

Phage lysogenization

Lysogenization of Φ11 was assessed either directly from culture or by replica plating surviving colonies or transductants onto TSA plates supplemented with 10 μg ml-1 erythromycin, as this phage contained an erythromycin resistance cassette within its genome.

Statistical analysis

Statistical analysis and plotting was performed using RStudio version 1.4.1717 and R version 4.1.0 [55] with the following packages installed: ggplot2 [56], tidyverse [57], stringi [58], plyr [59], dplyr [60], rstatix [61] and datarium [62]. Details are annotated in the relevant figure legends.

Supporting information

S1 Fig. Experimental set up.

Recipient cultures were grown to exponential phase (OD540 of 0.25, corresponding to ~1 x 108 CFU ml1) in TSB. 5 ml of each recipient culture supplemented with 5 μM CaCl2 were infected with indicated phage lysates at an MOI of 1:10 (phage:bacteria). Cultures were incubated at 30°C and 80 rpm and samplings were performed at the indicated timepoints (1, 4 and 18 h). For transduction assessment, 100 μl of each culture at the defined timepoints were plated directly onto TSA plates supplemented with the appropriate antibiotics. For viability assessment, cultures were serially diluted in PBS and spotted in triplicates of 10 μl per dilution onto TSA plates. For phage titer assessment, 1 ml of each culture was filtered and used for serial dilutions in phage buffer (PHB). Dilutions were spotted in triplicates of 10 μl each onto PBA plates overlaid with a lawn of RN4220. Created with BioRender.com.

https://doi.org/10.1371/journal.pgen.1010146.s001

(TIF)

References

  1. 1. Comeau AM, Hatfull GF, Krisch HM, Lindell D, Mann NH, Prangishvili D. Exploring the prokaryotic virosphere. Research in microbiology. 2008;159(5):306–13. Epub 2008/07/22. pmid:18639443.
  2. 2. Zimmerman AE, Howard-Varona C, Needham DM, John SG, Worden AZ, Sullivan MB, et al. Metabolic and biogeochemical consequences of viral infection in aquatic ecosystems. Nat Rev Microbiol. 2020;18(1):21–34. Epub 2019/11/07. pmid:31690825.
  3. 3. Breitbart M, Bonnain C, Malki K, Sawaya NA. Phage puppet masters of the marine microbial realm. Nat Microbiol. 2018;3(7):754–66. Epub 2018/06/06. pmid:29867096.
  4. 4. Chiang YN, Penades JR, Chen J. Genetic transduction by phages and chromosomal islands: The new and noncanonical. PLoS Pathog. 2019;15(8):e1007878. Epub 2019/08/09. pmid:31393945; PubMed Central PMCID: PMC6687093.
  5. 5. Susskind MM, Botstein D. Molecular genetics of bacteriophage P22. Microbiol Rev. 1978;42(2):385–413. Epub 1978/06/01. PubMed Central PMCID: PMC281435. pmid:353481
  6. 6. Thierauf A, Perez G, Maloy AS. Generalized transduction. Methods Mol Biol. 2009;501:267–86. Epub 2008/12/11. pmid:19066827.
  7. 7. Kwoh DY, Kemper J. Bacteriophage P22-mediated specialized transduction in Salmonella typhimurium: identification of different types of specialized transducing particles. J Virol. 1978;27(3):535–50. Epub 1978/09/01. PubMed Central PMCID: PMC525840. pmid:359828
  8. 8. Morse ML, Lederberg EM, Lederberg J. Transduction in Escherichia coli K-12. Genetics. 1956;41(1):142–56. Epub 1956/01/01. pmid:17247607; PubMed Central PMCID: PMC1209761.
  9. 9. Chen J, Quiles-Puchalt N, Chiang YN, Bacigalupe R, Fillol-Salom A, Chee MSJ, et al. Genome hypermobility by lateral transduction. Science. 2018;362(6411):207–12. Epub 2018/10/13. pmid:30309949.
  10. 10. Humphrey S, Fillol-Salom A, Quiles-Puchalt N, Ibarra-Chávez R, Haag AF, Chen J, et al. Bacterial chromosomal mobility via lateral transduction exceeds that of classical mobile genetic elements. Nature communications. 2021;12(1):6509. pmid:34750368
  11. 11. Fillol-Salom A, Bacigalupe R, Humphrey S, Chiang YN, Chen J, Penadés JR. Lateral transduction is inherent to the life cycle of the archetypical Salmonella phage P22. Nature communications. 2021;12(1):6510. pmid:34751192
  12. 12. Makarova KS, Wolf YI, Snir S, Koonin EV. Defense Islands in Bacterial and Archaeal Genomes and Prediction of Novel Defense Systems. J Bacteriol. 2011;193(21):6039–56. pmid:21908672
  13. 13. Bernheim A, Sorek R. The pan-immune system of bacteria: antiviral defence as a community resource. Nat Rev Microbiol. 2020;18(2):113–9. Epub 2019/11/07. pmid:31695182.
  14. 14. Fillol-Salom A, Alsaadi A, Sousa JAM, Zhong L, Foster KR, Rocha EPC, et al. Bacteriophages benefit from generalized transduction. PLoS Pathog. 2019;15(7):e1007888. Epub 2019/07/06. pmid:31276485; PubMed Central PMCID: PMC6636781.
  15. 15. Watson BNJ, Staals RHJ, Fineran PC. CRISPR-Cas-Mediated Phage Resistance Enhances Horizontal Gene Transfer by Transduction. mBio. 2018;9(1). Epub 2018/02/15. pmid:29440578; PubMed Central PMCID: PMC5821089.
  16. 16. Ibarra-Chavez R, Hansen MF, Pinilla-Redondo R, Seed KD, Trivedi U. Phage satellites and their emerging applications in biotechnology. FEMS Microbiol Rev. 2021;45(6). pmid:34104956.
  17. 17. Penades JR, Christie GE. The Phage-Inducible Chromosomal Islands: A Family of Highly Evolved Molecular Parasites. Annu Rev Virol. 2015;2(1):181–201. Epub 2016/03/10. pmid:26958912.
  18. 18. Novick RP. Pathogenicity Islands and Their Role in Staphylococcal Biology. Microbiol Spectr. 2019;7(3). Epub 2019/06/08. pmid:31172913.
  19. 19. Lindsay JA, Ruzin A, Ross HF, Kurepina N, Novick RP. The gene for toxic shock toxin is carried by a family of mobile pathogenicity islands in Staphylococcus aureus. Mol Microbiol. 1998;29(2):527–43. Epub 1998/08/28. pmid:9720870
  20. 20. Fillol-Salom A, Bacarizo J, Alqasmi M, Ciges-Tomas JR, Martinez-Rubio R, Roszak AW, et al. Hijacking the Hijackers: Escherichia coli Pathogenicity Islands Redirect Helper Phage Packaging for Their Own Benefit. Mol Cell. 2019;75(5):1020–30 e4. Epub 2019/07/28. pmid:31350119; PubMed Central PMCID: PMC6739421.
  21. 21. Martinez-Rubio R, Quiles-Puchalt N, Marti M, Humphrey S, Ram G, Smyth D, et al. Phage-inducible islands in the Gram-positive cocci. ISME J. 2017;11(4):1029–42. Epub 2016/12/14. pmid:27959343; PubMed Central PMCID: PMC5363835.
  22. 22. Ram G, Chen J, Kumar K, Ross HF, Ubeda C, Damle PK, et al. Staphylococcal pathogenicity island interference with helper phage reproduction is a paradigm of molecular parasitism. Proc Natl Acad Sci U S A. 2012;109(40):16300–5. Epub 2012/09/20. pmid:22991467; PubMed Central PMCID: PMC3479557.
  23. 23. Ram G, Chen J, Ross HF, Novick RP. Precisely modulated pathogenicity island interference with late phage gene transcription. Proc Natl Acad Sci U S A. 2014;111(40):14536–41. Epub 2014/09/24. pmid:25246539; PubMed Central PMCID: PMC4209980.
  24. 24. Chen J, Ram G, Penades JR, Brown S, Novick RP. Pathogenicity island-directed transfer of unlinked chromosomal virulence genes. Mol Cell. 2015;57(1):138–49. Epub 2014/12/17. pmid:25498143; PubMed Central PMCID: PMC4289434.
  25. 25. Viana D, Blanco J, Tormo-Mas MA, Selva L, Guinane CM, Baselga R, et al. Adaptation of Staphylococcus aureus to ruminant and equine hosts involves SaPI-carried variants of von Willebrand factor-binding protein. Mol Microbiol. 2010;77(6):1583–94. Epub 2010/09/24. pmid:20860091.
  26. 26. Ubeda C, Tormo MA, Cucarella C, Trotonda P, Foster TJ, Lasa I, et al. Sip, an integrase protein with excision, circularization and integration activities, defines a new family of mobile Staphylococcus aureus pathogenicity islands. Mol Microbiol. 2003;49(1):193–210. Epub 2003/06/26. pmid:12823821.
  27. 27. O’Neill AJ, Larsen AR, Skov R, Henriksen AS, Chopra I. Characterization of the epidemic European fusidic acid-resistant impetigo clone of Staphylococcus aureus. J Clin Microbiol. 2007;45(5):1505–10. Epub 2007/03/09. pmid:17344365; PubMed Central PMCID: PMC1865894.
  28. 28. Rocha EPC, Bikard D. Microbial defenses against mobile genetic elements and viruses: Who defends whom from what? PLoS Biol. 2022;20(1):e3001514. Epub 20220113. pmid:35025885.
  29. 29. Rousset F, Depardieu F, Miele S, Dowding J, Laval A-L, Lieberman E, et al. Phages and their satellites encode hotspots of antiviral systems. Cell host & microbe. 2022.
  30. 30. Kwan T, Liu J, DuBow M, Gros P, Pelletier J. The complete genomes and proteomes of 27 Staphylococcus aureus bacteriophages. Proc Natl Acad Sci U S A. 2005;102(14):5174–9. Epub 2005/03/25. pmid:15788529; PubMed Central PMCID: PMC556006.
  31. 31. Zinder ND, Lederberg J. Genetic exchange in Salmonella. J Bacteriol. 1952;64(5):679–99. Epub 1952/11/01. pmid:12999698; PubMed Central PMCID: PMC169409.
  32. 32. Ubeda C, Maiques E, Knecht E, Lasa I, Novick RP, Penades JR. Antibiotic-induced SOS response promotes horizontal dissemination of pathogenicity island-encoded virulence factors in staphylococci. Mol Microbiol. 2005;56(3):836–44. Epub 2005/04/12. pmid:15819636.
  33. 33. Tormo-Mas MA, Mir I, Shrestha A, Tallent SM, Campoy S, Lasa I, et al. Moonlighting bacteriophage proteins derepress staphylococcal pathogenicity islands. Nature. 2010;465(7299):779–82. Epub 2010/05/18. pmid:20473284; PubMed Central PMCID: PMC3518041.
  34. 34. Steinberg BM, Gough M. Bacteriophage P22 lysogenises efficiently at high multiplicities of infection because Salmonella typhimurium DNA synthetic capacity is limited. Nature. 1976;263(5572):54–6. pmid:785285
  35. 35. Kourilsky P. Lysogenization by bacteriophage lambda. I. Multiple infection and the lysogenic response. Mol Gen Genet. 1973;122(2):183–95. pmid:4573866
  36. 36. Rostol JT, Marraffini L. (Ph)ighting Phages: How Bacteria Resist Their Parasites. Cell Host Microbe. 2019;25(2):184–94. Epub 2019/02/15. pmid:30763533; PubMed Central PMCID: PMC6383810.
  37. 37. Haaber J, Leisner JJ, Cohn MT, Catalan-Moreno A, Nielsen JB, Westh H, et al. Bacterial viruses enable their host to acquire antibiotic resistance genes from neighbouring cells. Nature communications. 2016;7(1):13333. pmid:27819286
  38. 38. Joh RI, Weitz JS. To lyse or not to lyse: transient-mediated stochastic fate determination in cells infected by bacteriophages. PLoS computational biology. 2011;7(3):e1002006. Epub 2011/03/23. pmid:21423715; PubMed Central PMCID: PMC3053317.
  39. 39. Robb ML, Shahrezaei V. Stochastic cellular fate decision making by multiple infecting lambda phage. PloS one. 2014;9(8):e103636. Epub 2014/08/12. pmid:25105971; PubMed Central PMCID: PMC4126663.
  40. 40. Arkin A, Ross J, McAdams HH. Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. Genetics. 1998;149(4):1633–48. Epub 1998/08/05. pmid:9691025; PubMed Central PMCID: PMC1460268.
  41. 41. Vogan AA, Higgs PG. The advantages and disadvantages of horizontal gene transfer and the emergence of the first species. Biology direct. 2011;6(1):1. pmid:21199581
  42. 42. De Paepe M, Tournier L, Moncaut E, Son O, Langella P, Petit M-A. Carriage of λ Latent Virus Is Costly for Its Bacterial Host due to Frequent Reactivation in Monoxenic Mouse Intestine. PLoS genetics. 2016;12(2):e1005861. pmid:26871586
  43. 43. Fortier LC, Sekulovic O. Importance of prophages to evolution and virulence of bacterial pathogens. Virulence. 2013;4(5):354–65. Epub 2013/04/25. pmid:23611873; PubMed Central PMCID: PMC3714127.
  44. 44. Camarillo-Guerrero LF, Almeida A, Rangel-Pineros G, Finn RD, Lawley TD. Massive expansion of human gut bacteriophage diversity. Cell. 2021;184(4):1098–109 e9. pmid:33606979; PubMed Central PMCID: PMC7895897.
  45. 45. Koonin EV, Makarova KS, Wolf YI, Krupovic M. Evolutionary entanglement of mobile genetic elements and host defence systems: guns for hire. Nat Rev Genet. 2020;21(2):119–31. Epub 2019/10/16. pmid:31611667.
  46. 46. Mir-Sanchis I, Martinez-Rubio R, Marti M, Chen J, Lasa I, Novick RP, et al. Control of Staphylococcus aureus pathogenicity island excision. Mol Microbiol. 2012;85(5):833–45. Epub 2012/06/30. pmid:22742067.
  47. 47. Quiles-Puchalt N, Tormo-Mas MA, Campoy S, Toledo-Arana A, Monedero V, Lasa I, et al. A super-family of transcriptional activators regulates bacteriophage packaging and lysis in Gram-positive bacteria. Nucleic Acids Res. 2013;41(15):7260–75. Epub 2013/06/19. pmid:23771138; PubMed Central PMCID: PMC3753634.
  48. 48. Quiles-Puchalt N, Martinez-Rubio R, Ram G, Lasa I, Penades JR. Unravelling bacteriophage Φ11 requirements for packaging and transfer of mobile genetic elements in Staphylococcus aureus. Mol Microbiol. 2014;91(3):423–37. Epub 2013/11/29. pmid:24283262.
  49. 49. Ibarra-Chavez R, Haag AF, Dorado-Morales P, Lasa I, Penades JR. Rebooting Synthetic Phage-Inducible Chromosomal Islands: One Method to Forge Them All. BioDesign Research. 2020;2020:14.
  50. 50. Ubeda C, Barry P, Penades JR, Novick RP. A pathogenicity island replicon in Staphylococcus aureus replicates as an unstable plasmid. Proc Natl Acad Sci U S A. 2007;104(36):14182–8. Epub 2007/08/19. pmid:17693549; PubMed Central PMCID: PMC1964853.
  51. 51. Christie GE, Matthews AM, King DG, Lane KD, Olivarez NP, Tallent SM, et al. The complete genomes of Staphylococcus aureus bacteriophages 80 and 80α–implications for the specificity of SaPI mobilization. Virology. 2010;407(2):381–90. Epub 20100925. pmid:20869739; PubMed Central PMCID: PMC2952651.
  52. 52. Novick R. Properties of a cryptic high-frequency transducing phage in Staphylococcus aureus. Virology. 1967;33(1):155–66. Epub 1967/09/01. pmid:4227577.
  53. 53. Kreiswirth BN, Lofdahl S, Betley MJ, O’Reilly M, Schlievert PM, Bergdoll MS, et al. The toxic shock syndrome exotoxin structural gene is not detectably transmitted by a prophage. Nature. 1983;305(5936):709–12. Epub 1983/10/20. pmid:6226876.
  54. 54. Haag AF, Podkowik M, Ibarra-Chavez R, Gallego Del Sol F, Ram G, Chen J, et al. A regulatory cascade controls Staphylococcus aureus pathogenicity island activation. Nat Microbiol. 2021;6(10):1300–8. Epub 20210913. pmid:34518655; PubMed Central PMCID: PMC7611864.
  55. 55. R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2021.
  56. 56. Wickham H. ggplot2: Elegant Graphics for Data Analysis. New York: Springer-Verlag; 2016 2016.
  57. 57. Wickham H, Averick M, Bryan J, Chang W, McGowan LDA, François R, et al. Welcome to the {tidyverse}. Journal of Open Source Software. 2019;4(43):1686.
  58. 58. Gagolewski M. stringi: Fast and portable character string processing in R. Journal of Statistical Software. 2021.
  59. 59. Wickham H. The Split-Apply-Combine Strategy for Data Analysis. Journal of Statistical Software. 2011;40(1):1–29.
  60. 60. Wickham H, François R, Henry L, Müller K. dplyr: A Grammar of Data Manipulation. 2021.
  61. 61. Kassambara A. rstatix: Pipe-Friendly Framework for Basic Statistical Tests. 2021.
  62. 62. Kassambara A. datarium: Data Bank for Statistical Analysis and Visualization. 2019.