Upon cell invasion, retroviruses generate a DNA copy of their RNA genome and integrate retroviral cDNA within host chromosomal DNA. Integration occurs throughout the host cell genome, but target site selection is not random. Each subgroup of retrovirus is distinguished from the others by attraction to particular features on chromosomes. Despite extensive efforts to identify host factors that interact with retrovirion components or chromosome features predictive of integration, little is known about how integration sites are selected. We attempted to identify markers predictive of retroviral integration by exploiting Precision-Recall methods for extracting information from highly skewed datasets to derive robust and discriminating measures of association. ChIPSeq datasets for more than 60 factors were compared with 14 retroviral integration datasets. When compared with MLV, PERV or XMRV integration sites, strong association was observed with STAT1, acetylation of H3 and H4 at several positions, and methylation of H2AZ, H3K4, and K9. By combining peaks from ChIPSeq datasets, a supermarker was identified that localized within 2 kB of 75% of MLV proviruses and detected differences in integration preferences among different cell types. The supermarker predicted the likelihood of integration within specific chromosomal regions in a cell-type specific manner, yielding probabilities for integration into proto-oncogene LMO2 identical to experimentally determined values. The supermarker thus identifies chromosomal features highly favored for retroviral integration, provides clues to the mechanism by which retrovirus integration sites are selected, and offers a tool for predicting cell-type specific proto-oncogene activation by retroviruses.
When HIV-1, murine leukemia virus (MLV), or other retroviruses infect a cell, the virus generates a DNA copy of the viral RNA genome and ligates the cDNA within host chromosomal DNA. This integration reaction occurs at sites throughout the host cell genome, but little is known about how integration sites are selected. We attempted to identify markers predictive of retroviral integration by comparing the genome-wide binding sites for more than 60 factors with 14 retroviral integration datasets. We borrowed Precision-Recall methods from the Information Retrieval field for extracting information from highly skewed datasets such as these. For MLV and other gammaretroviruses, strong association was observed with STAT1, acetylation of H3 and H4 at several positions, and methylation of H2AZ, H3K4, and K9. We generated a supermarker by combining high scoring markers. The supermarker localized within 2 kB of 75% of MLV proviruses and predicted the likelihood of integration within specific chromosomal regions in a cell-type specific manner. This study identified chromosomal features highly favored for retroviral integration. It also provides clues to the mechanism by which retrovirus integration sites are selected, and offers a tool for predicting cell-type specific proto-oncogene activation by retroviruses.
Citation: Santoni FA, Hartley O, Luban J (2010) Deciphering the Code for Retroviral Integration Target Site Selection. PLoS Comput Biol 6(11): e1001008. https://doi.org/10.1371/journal.pcbi.1001008
Editor: Sergei L. Kosakovsky Pond, University of California San Diego, United States of America
Received: May 20, 2010; Accepted: October 25, 2010; Published: November 24, 2010
Copyright: © 2010 Santoni et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by the Swiss National Science Foundation (SNF 3100A0-128655), the FP7 framework of the European Union (THINC, HEALTH-2007- 2.3.2-1), the National Institute of Health USA (RO1AI59159), and the Master & Back Program of Sardinia. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Retroviruses and retrotransposons are of profound importance to eukaryotic biology, evolution, and medicine. These retroelements constitute at least 40% of the mass of mammalian genomes  and 75% of the maize genome . When retroelements are transcribed they remodel eukaryotic genomes by generating a cDNA and integrating it into locations scattered throughout the host cell genome , . By doing so, retroelements have the potential to influence local gene expression or to promote recombination and generate deletion mutations –. In some cases they act in trans to catalyze retrotransposition of cellular RNAs, generating pseudogenes or new exons within existing genes , . Since retrotransposon enhancer elements influence local gene expression, and retrotransposon silencing can vary from cell to cell, it has been proposed that retrotransposons contribute to the phenotypic variation that distinguishes genetically identical individuals . Additionally, it has been suggested that programmed release from retroelement silencing accompanies metazoan development and leads to hypermutation in complex somatic tissues like the brain , .
Among retroelements, retroviruses have received much attention, in part due to their association with human disease. Basic studies concerning retroviral replication have greatly advanced understanding of the biochemistry of retrotransposition , . A tetramer of the viral integrase protein (IN)  cleaves the ends of the viral cDNA to produce recessed 3′OH and free CA dinucleotides at the terminus of each long terminal repeat (LTR) . IN catalyzes nucleophilic attack of host chromosomal DNA by the two free 3′-OH viral DNA ends, resulting in covalent attachment of the retroviral DNA strands to the host DNA –. The remaining free ends of the viral DNA are then repaired by host enzymes –.
Study of HIV-1, the retrovirus that causes AIDS, has led to the development of drugs that block retrotransposition and alter progression to AIDS , . Attempts to develop better therapies for HIV-1 would benefit from a deeper understanding of the integration mechanism. Gene therapy vectors based on another retrovirus, MLV, dramatically rescued children from a life-threatening illness, but a large percentage of the patients suffered from insertional activation of proto-oncogenes –. This lethal complication further emphasizes the need to better understand retroviral integration site selection in host chromosomal DNA.
Retroviruses establish proviruses at sites throughout the host cell genome, but integration is not random. Some regions are favored hundreds of times over others , . For some retroviruses, transcribed regions are preferred , , though high-level, concurrent transcription at a given target gene inhibits integration . Nucleosome-bearing DNA is targeted more efficiently than free DNA in vitro – perhaps because the integration machinery preferentially targets bent DNA . Indeed, high-throughput sequencing experiments analyzing over 40,000 HIV-1 integration sites in cells show periodic distribution on predicted nucleosome positions, consistent with favored integration into outward-facing DNA major grooves in chromatin .
The retrotransposition mechanism, and integration site selection on a genomic scale, differs considerably from one class of retrovirus to another. HIV-1 infects non-dividing cells ,  and integrates preferentially into transcriptionally active genes, all along the length of the gene , , . In contrast, MLV integration requires mitosis ,  and has a tendency to localize near promoters, 20% of the time within 2 kB of transcriptional start sites , . Retroviral capsid (CA) is sufficient to determine whether a given virus infects non-dividing cells ,  but both CA and IN contribute to integration site selection: an HIV-1 vector in which IN-coding sequences and a fragment of gag encompassing CA were replaced by the homologous MLV sequences exhibits the retrotransposition behavior of MLV .
Of the many host factors reported to interact with retroviral CA or IN –, the lentiviral IN-interacting protein PSIP1/LEDGF/p75 – is the most informative regarding integration site selection. LEDGF promotes the infectivity of HIV-1 and related lentiviruses and influences integration site selection – perhaps by acting as a physical tether directing integration to the chromosomal sites this protein naturally occupies. In support of this model, fusion of heterogeneous chromatin binding domains to the part of LEDGF that binds IN redirected the site of HIV-1 integration –. The mechanism by which gammaretroviruses such as MLV preferentially target promoter regions is unknown.
We attempted to identify chromatin features predictive of retroviral integration site selection by exploiting ChIPSeq datasets. Compared to previous methods, this technology has brought profiles of human DNA binding factors and histone epigenetic modifications closer to genome-wide saturation –. Over 60 ChIPSeq datasets were compared with 14 retroviral integration data sets in order to develop tools for predicting viral integration sites throughout the genome with maximal predictive power.
Development of methods for detection and display of associations between retroviral integration sites and chromatin features
To identify markers predictive of retroviral integration site selection, stringent associations were sought between ChIPSeq profiles for more than 60 chromatin-associated factors (Table 1) – and 14 retroviral integration site datasets (Table 2) , , –. Following a common convention in the retrovirus integration literature , association with a given marker was defined as integration within 2 kB (wi2kB) of the nearest marker on the linear sequence of the chromosome.
The proviruses in the datasets used here (Table 2) were cloned from host genomic DNA using restriction enzymes, each of which has the potential to introduce a bias . Therefore, as described in the literature , , , , each integration site was matched to ten control sites designed to exhibit the same bias as the experimental set: control sites were placed the equivalent distance from randomly chosen recognition sites of the restriction enzyme that was used to clone the provirus (see Methods). No distortion of the results by the control datasets was evident, in that identical values for provirus association with a given chromatin feature were obtained using 10 different randomly-generated control datasets.
Integration datasets are generally compared with control datasets using Fisher's exact test and reported as the p-value , , , . Since significance determination is dependent upon dataset size, these measures can be easily conflated, generating extraordinarily low p-values and making it difficult to compare the importance of two factors . Receiver operating characteristic area methods (ROC) have also been used to identify associations , , , but these methods also have drawbacks when it comes to discriminating between markers for retroviral integration. With the datasets used in these studies, the number of true negatives (control sites not associated with the marker) is considerably higher than the number of false positives (control sites associated with the marker). Given that the false positive rate = false positives / [false positives+true negatives], two markers which differ by as much as 10-fold in terms of the number of false positives will fail to be differentiated from one another using ROC .
To address the problems associated with the analysis of these highly skewed data sets, we borrowed the concepts of Precision and Recall from the field of Information Retrieval –. In the context of this discussion, Precision is defined as the number of experimentally-determined integration sites associated with a marker divided by the sum of all associated experimental and all associated control sites (see Methods). Recall is the number of marker-associated experimental integration sites divided by all experimental integration sites. The Fβ score, a convenient way to aggregate Precision and Recall, is the weighted harmonic mean of the two measures . Usual values for β are 0.5, 1 or 2 . To limit the influence of true negatives in the analysis of these skewed datasets, we emphasized Precision over Recall by setting β = 0.5. The F score tracks better with statistical significance when β = 0.5, than 1 or 2 (see the comparison of results using different values for β, as well as with other metrics, described below, as well as Text S1). Moreover we normalized the number of false positives with respect to the number of experimental integration sites so as to make the F score independent of control sample size. For the analysis here, markers with F scores between 0.5 and 1 were considered to be associated with integration sites.
To visualize genome-wide association of proviruses with potential markers, chromosome projection mandalas were developed (Figure 1A, see Methods). Each dot on the mandala represents a retroviral integration site with the following polar coordinates: angular distance corresponds to genomic location on the indicated chromosome; radial distance from the contour of the circle is the distance in nucleotides from the nearest site of the marker in question, log-scaled from 0 to 1 megabase.
(A) Construction of chromosome projection mandalas to visualize the proximity of individual proviruses to the nearest marker on the chromosome. The linear sequence of each human chromosome was linked and circularized. Proviral integration sites were located on the circle according to their position on each chromosome (empty circles) and then a marker (filled circles) was placed towards the center of the circle, at a distance from the perimeter that was equal, in log scale from 0 to 1 megabase, to the distance from the closest marker (empty boxes). Blue filled circles represent proviruses that were within 2kB from the nearest marker; red circles represent proviruses that are >2kB from the nearest marker. Examples of chromosome projection mandala for (B) MLV (Lewinski et al. 2006) versus H3K4me3, the arrow indicates the chromosomal mapping direction (C) Control versus H3K4me3 (D) MLV versus STAT1 and (E) MLV versus CpG+TSS. The number of MLV proviruses analyzed in this dataset (Lewinski et al. 2006) was 588. The F score and the percentage of proviruses within 2 kB are presented under each mandala.
Association of retroviral integration sites with ChIPSeq datasets
Currently, the best chromosomal marker for retroviral integration site selection is the association of CpG islands and transcription start sites (CpG+TSS) with gammaretroviruses , , . By examining published datasets for MLV, 21 to 27% of integration sites fall within 2 kB (wi2kB) of CpG+TSS, with probabilities <3×10−22 to <4×10−42 (Table 3). Despite these extremely low p-values, F scores calculated for these datasets fall between 0.36 to 0.51 (Table 3 and Figure 1E), indicating that CpG+TSS is not a powerful predictor of MLV integration sites. Stronger association with CpG+TSS was observed with porcine endogenous retrovirus, PERV (50% wi2kB; p<10−250; F score 0.72), and xenotropic MuLV-related virus, XMRV (33% wi2kB; p<10−46; F score 0.58), two viruses from the same gammaretrovirus family as MLV (Table 3 and Figure 2). No significant association with CpG/TSS was observed for proviruses generated by non-gammaretroviruses, including HIV-1, for which the F score was 0.11 (Table 3, Figure 3), or with ASLV, HTLV, or Foamy virus (Table 3, Figure S1).
The source of the provirus datasets is listed (see Table 2 and the text) and N indicates the number of proviruses considered for each analysis. MLV  proviruses were cloned from HeLa cells, XMRV proviruses from DU145, and PERV proviruses from HEK 293. H3K4me3 and STAT1 ChIPSeq datasets were from HeLa (see Table 1 and text). The F score and the percentage of proviruses within 2 kB are presented under each mandala.
All proviruses were cloned from HeLa cells (Table 2 and text). H3K4me3 and STAT1 ChIPSeq datasets were from HeLa cells (Table 1). N indicates the number of specific proviral integrations considered for each analysis. The F score and the percentage of proviruses within 2 kB are presented under each mandala.
ChIPSeq datasets for 60 chromatin-associated factors (Table 1) were compared with 14 provirus datasets for MLV, PERV, XMRV, HIV-1, HTLV-1, ASLV, Foamy virus, and HIV/MLV chimeras (Table 2). Acetylation of H3 and H4 at several positions, and methylation of H2AZ, H3K4, and K9, were strongly associated with gammaretroviral integration sites, all with F scores >0.80 (Figures 1 and 2, Table 3 and Tables S1 and S2). H3K4me3 in particular was strongly associated with MLV integration sites (68% wi2kB; p<10−324; F score 0.83) and with the integration sites of PERV (60% wi2kB; p<10−350; F score 0.82) and XMRV (64% wi2kB; p<10−170; F score 0.81) (Figures 1 and 2, Table 3). The effect of window size on the F score was examined for factors strongly associated with MLV and the other gammaretroviruses. Interestingly, the F score was maximal when it was calculated using a window of +/−2 kB for proviruses flanking the sites of these chromatin features (Figure 4).
Association (F score) between MLV proviruses  and either H3K4me3 (green dashed line with stars) or the supermarker in HeLa cells (solid blue line with solid circles) as a function of window size in kilobases. The true positive fraction versus the false positive fraction is shown for each point.
In contrast to the gammaretroviruses, HIV-1 integration sites were not associated with H3K4me3 (9% wi2kB; p>0.05; F score 0.21)(Figure 3 and Table 3). Among the markers for which ChIPSeq datasets were available from HeLa cells, H3K4me1 had the strongest association with HIV-1 proviruses (48% wi2kB; p<10−31; F score 0.6), though H3K4me1 was the sole chromatin marker that yielded F score values greater than 0.5 across all queried viruses (Table 3, Table S3). H3K4me3, and other chromatin modifications linked to transcriptionally active promoters , –, were reported to be associated with HIV proviruses when a window of 50 kB flanking the proviruses was considered , . This could be explained by the fact that HIV-1 proviruses localize to active transcription units with equal distribution along the length of the genes , , , and that the size of the average transcription unit is on the order of tens of kilobases.
To examine this further, the F score for HIV-1 versus H3K4me3 in HeLa cells was plotted as a function of window size (Figure 5). For comparison, a similar plot was generated for a hypothetical marker at the TSS of transcribed genes in HeLa cells, taking into account the length of these genes, and considering a uniform distribution of proviruses on each gene. For both H3K4me3 and the hypothetical TSS marker, the F score plateaued at a window size of 20 kB, the median gene length. Thus if the window size is large enough to encompass the TSS and half of the gene length, the F score becomes significant. This could explain the window-size dependence of HIV-1 association with H3K4me3.
The first marker is H3K4me3 sites in HeLa (green solid line). The second is a virtual marker placed in the promoter region of transcribed genes in HeLa cells (blue dashed line), assuming a uniform distribution of integration sites in transcribed regions. The median length of transcribed genes in HeLa is ∼20kB.
We also analyzed an integration site map for an HIV-1 vector in which IN-encoding pol sequences and part of gag were replaced by homologous sequences from MLV . It was shown previously that substitution of these two viral components from MLV is sufficient to change the integration site preference of HIV-1, such that it targets TSS with a frequency like MLV . Replacement with these MLV genes was sufficient for HIV-1 proviruses to associate with methylated histones (65% wi2kB, p<10−182, F score 0.82) in a manner that was indistinguishable from MLV (Figure 3).
STAT1 association with gammaretroviruses
A remarkable association was found between MLV integration sites and STAT1 binding sites in IFN-γ stimulated HeLa cells (68% wi2kB; p<10−324; F score 0.83) (Figure 1 and 2, Table 3). Strong association with STAT1 binding sites was also observed for porcine endogenous retrovirus (60% wi2kB; p<10−350; F score 0.82) and XMRV (64% wi2kB; p<10−170; F score 0.81). Interestingly, if MLV was compared with STAT1 bindings sites in HeLa cells that had not been treated with IFN-γ the association was greatly decreased (34% wi2kb; p<10−120, F score: 0.69). HIV-1 proviruses showed no association with STAT1 (8% wi2kB; p>0.4; F score 0.27). Substitution of HIV-1 IN and parts of gag with the corresponding genes from MLV was sufficient for HIV-1 proviruses to associate with STAT1 binding sites (64% wi2kB, p<10−182, F score 0.81) (Figure 3, Table 3).
Attempts to detect a protein-protein interaction between STAT1 and MLV IN were unsuccessful. STAT1-deficient cell lines, either Stat1−/− mouse embryonic fibroblasts , HeLa cells with stable STAT1 knockdown using lentiviral vectors , or well-characterized, STAT1 mutant, HT1080 cells , were challenged with MLV and, as a control, HIV-1. No clear defect associated with STAT1-deficiency was detected when MLV infectivity was compared with HIV-1 (data not shown). These results suggest that STAT1 itself is not directly responsible for MLV integration site preference but that its chromatin preferences resemble those of MLV.
The F score is robust and highly discriminating
The stability of the F score for H3K4me3, an excellent marker, and for TSS/CpG, a poor marker, was examined as the size of a dataset containing 588 MLV proviruses  was decreased. The ratio of the size of the provirus dataset with respect to the control dataset was fixed at ten. While the p-value varied enormously as the size of the provirus dataset decreased, the F score was constant for both H3K4me3 and TSS/CpG over the full range from 50 to 500 proviruses (Figure 6A). The size of the provirus dataset was then fixed at 588  and the F score was plotted versus the ratio (from 0.1 to 10) of the experimental and control datasets. Under these conditions the F score for either factor was constant except for a small increase when the ratio of the experimental to control datasets decreased below 0.3 (Figure 6B). The p-value for H3K4me3 changed markedly with the change in ratio of the datasets. Thus, while the p-value is strongly biased by the size of the provirus dataset or by the ratio of experimental to control sites, the F score is a remarkably stable measure. Similar stability was observed for the F score of all markers as compared to all proviral integration datasets (data not shown).
(A) Plot of the absolute value of the p-value exponent (right Y scale) or the F score (left Y scale) for H3K4me3 or CpG+TSS, as a function of MLV provirus dataset size. The experimental MLV dataset size (x-axis) was reduced by random sampling and the ratio of control dataset points was fixed at 10. (B) Examination of the same parameters as a function of the ratio between experimental and control dataset size (x-axis). The experimental dataset size was reduced by random sampling from 1∶1 down to 0.1∶1. From 1∶1 up to 1∶10 the control dataset size was proportionally increased by matched random generation.
As demonstrated for the F score (Figure 6), the area under the curve (AUC) ROC method used previously to evaluate markers associated with retroviral integration sites , ,  is a robust measure that is insensitive to dataset size. Like the F score, AUC(ROC) also works well to assess markers that are weakly or moderately associated with integration sites (Text S1). But, as demonstrated for the highly associated marker H3K4me3, AUC(ROC) does not respond to the increase in false positives that is expected with increasing window size (Figure 7A). Moreover, this insensitivity to false positives leads AUC(ROC) to overestimate the association of markers that are more common in the genome. Consequently, AUC ranks markers differently from statistical significance, as shown in Figure 8 and discussed in more detail in Text S1. In contrast, the p-value and the F0.5 score incorporate an adjustment for the increase in false positives as window size increases, and both measures achieve a maximal value at a window size of 2 kB (Figure 7A). A standard regression plot shows that the F0.5 score tracks with the p-value almost perfectly (R2 = 0.97), whereas the AUC(ROC) diverges considerably (R2 = 0.37) (Figure 7B). The F0.5 score and the p-value adjust similarly for the increasing number of false positives.
(A) Plot of Area Under Curve (AUC) or F score (both on left Y scale) or the absolute value of the p-value exponent (right Y scale) for MLV with respect to H3K4me3 as a function of window size in basepairs. (B) Pearson correlation for AUC or F score (both on X axis) versus the absolute value of the p-value exponent (Y axis).
Markers for MLV integration in HeLa cells (A) or in CD4+ T cells (B) were ranked by Area Under Curve (AUC), Area Under Precision and Recall Curve (AUPR), or using the F0.5 score. The rankings obtained by these methods were compared with the ranking obtained by the Fisher's exact test: each crosslink between markers in the grid represents a comparison. Red squares indicate when the ranking calculated by the specified metric disagrees with the ranking calculated by significance. Markers were arranged in order of decreasing significance (from left to right).
Indeed among a set of measures that included F0.5, F1, F2, Area Under Curve (AUC), Area Under Precision/Recall (AUPR), Odds Ratio (OR), Shannon Mutual Information (SMI), and Difference of Proportions (DOP), the F0.5 score showed the strongest link with statistical significance (see Methods). We analyzed one of the MLV integration dataset in HeLa cells  (the same results were obtained using the other HeLa dataset ) and the MLV integration dataset in CD4+ T cells . The strength of association of 9 significant markers (in terms of p-value) from HeLa cells, and 31 significant markers from CD4+ T cell, was assessed. Markers were ranked according to each of the above methods and the results of each were compared with the ranking obtained using significance −log(p value). This was done by fixing the matched control data set size at 10-times the experimental dataset size and using window sizes of 2, 5, 10, and 20 kilobases. Results for the analysis are reported in Table 4 and in Text S1.
Several conclusions can be drawn from this analysis. Concerning markers that were highly associated with proviruses, the ranking yielded by the F0.5 score closely tracked with significance (Table 4). By increasing the weight of recall over precision by increasing the beta value (F1 or F2) the F score tracked less well with significance (it was the F0.5 score that was used throughout this manuscript). The SMI also tracked well, but, unlike the F score, the results with this method vary with dataset size (see Text S1). The AUC, OR, AUPR, and DOP were clearly not as good as the F0.5 score.
Concerning markers that are moderately or weakly associated with proviruses (Text S1), the ranking based on the F0.5 score was similar to that obtained by significance, AUC, AUPR, OR, or DOP (Table 4). SMI scored less well for these markers.
Figure 8 visualizes the deviation of AUC, AUPR or F0.5 from significance. Red squares indicate cases in which the ranking calculated by the specified metric differs from the rank obtained by significance. All results indicate that, for the datasets evaluated here, the F0.5 score is a superior measure at discriminating among factors for differences in magnitude of association with genomic sites of integration.
Generation of a supermarker for retrovirus integration
Given the effectiveness of the F score for identifying and ranking individual factors associated with retrovirus integration site selection, markers with the best F scores were combined in an attempt to generate a supermarker (see Methods for more details). An estimate of the probability of proviral integration into the host genome (P(V)) was derived based on the genomic distribution of combinations of ChIPSeq peaks for the best scoring markers with respect to particular experimental provirus datasets. The resulting probability mass function (at base- pair resolution) is(A)where V is the set of proviral integration sites, Fj is the F score associated with each marker Mj, for the set of peaks Γj. x is the physical position on chromosomal DNA and K is a normalization constant. From this composite distribution, the peaks with the largest amplitude were identified, and the subset of peaks yielding the maximal F score in the test dataset was defined as the supermarker peak set.
Two strategies were used to validate the supermarker procedure. First we calculated the supermarker and the relative peak set on each single proviral dataset and then we evaluated the association with the remaining datasets. The second strategy was a standard 10-fold cross-validation applied to each single dataset. The two evaluations yielded the same results (Table 5 and Table S5). Further, we compared the strength of association of the supermarker peak set for gammaretroviral datasets to the performance of the Random Forest machine learning algorithm . The two methods obtained superimposable results (Table S6, see Methods for details).
With respect to MLV integration in HeLa cells, H3K4me1, H3K4me3, H3K9ac and STAT1 were the markers with the best F scores (>0.80)(Table S1 and S2). Examination of the ChIPSeq peaks derived from all combinations of these five candidates revealed that the best supermarker was generated by combining H3K4me3, H3K4me1, and H3K9ac (75% wi2kb; p<10−284; F score 0.87) (Figure 9 and Table 5). Figure 9A shows the distribution of supermarker density and MLV integration sites across the human genome, with an expansion of chromosome 1 to help visualize detail in Figure 9B. The Pearson correlation for the supermarker density and MLV integration site density across the whole genome was 0.75 (p = 0, with both functions averaged over a non-overlapping 10 kB window). Figure 9C shows the correlation for chromosome 1 in isolation. As with the single marker H3K4me3, the supermarker yields a maximal F score using a window size of 2 kB (Figure 4).
(A) Chromosome projection mandala showing MLV proviruses from HeLa cells plotted as in Figure 1 and 2 with supermarker density (gray shading) from the 2 kB circle to the contour of the circle. (B) Chromosome projection mandala for chromosome 1 in isolation. (C) Plot showing density of supermarker (red dashed line) vs MLV proviruses (solid blue line) in HeLa cells, calculated over a 10 kB sliding window on chromosome 1. Pearson correlation is 0.81 for chromosome 1 and 0.75 for the whole genome.
Inclusion of STAT1 in the HeLa supermarker increased the number of false positives over the number of true positives and thus decreased the composite F score. This suggests that any information carried by STAT1 is contained within the other markers.
Among the ChIPSeq data in CD4+ T cells, the best individual markers associated with MLV were H3K4m1, H3K4m2, H3K4m3, H3K9ac, H2BK120ac, H2BK5ac, H3K18ac, H3K27ac, and H2AZ (all >0.80, Table S1 and S2). The best supermarker for MLV on CD4+ T cells was composed of H3K4m1, H3K4m2, H3K4m3, and H3K9ac (71% wi2kb; p<10−122; F score 0.84).
The F score detects differences between cell types
The F scores reported here (Tables 3 and 4) were calculated using ChIPSeq and provirus datasets that were matched for cell type. In a previous report, when AUC(ROC) was used to evaluate epigenetic marks mapped in T cells, the correlation with proviruses cloned from T cells was no greater than the correlation with proviruses cloned from other target cell types such as the human embryonic kidney cell line HEK 293 or the fibrosarcoma cell line HT1080 . Differences due to experimental error were in fact greater than differences due to cell type .
To determine if the F score has the ability to discriminate between cell types, MLV provirus data sets from HeLa and CD4+ T cells were compared with the supermarker for each of these cell types, in all combinations. As mentioned above, when an MLV provirus dataset obtained from infection of HeLa cells  was compared with the supermarker from HeLa cell ChIPSeq data, very strong association was observed (75% wi2kB; p<10−284; F score 0.87) (Table 5 and Figure 10). When the same provirus dataset was compared with the supermarker derived from CD4+ T cell ChIPSeq data the strength of the association was much decreased (32% wi2kB; p<10−57; F score 0.61) (Table 5 and Figure 10). The same pattern was seen for the chimera HIVmINmGag, for which association with the supermarker in HeLa cells (70% wi2kB; p<10−263; F score 0.86)(Table 5 and Figure 10) was much greater than association with the supermarker in CD4+ T cells (27% wi2kB; p<10−24; F score 0.56) (Table 5 and Figure 10). The opposite pattern was also seen in that MLV proviruses cloned from CD4+ T cells  were strongly associated with the supermarker derived in these cells (71% wi2kB; p<10−112; F score 0.84) (Table 5 and Figure 10), and less well associated with the supermarker from HeLa cells (39% wi2kB; p<10−42; F score 0.67) (Table 5 and Figure 10).
Histograms of the F score (upper panel) and the percentage of associated proviruses wi2kb of the supermarkers (lower panel) with respect to MLV proviruses, either from Lewinski et al (MLV HeLa I) or Wu et al (MLV HeLa II), and the HIVmINmGAG chimera, as indicated. Supermarkers were generated with ChiPSeq data from HeLa cells or from CD4+ T cells and compared with MLV proviruses from either HeLa cells or CD4+T cells. “Matched” means that the provirus and the supermarker are from the same cell type.
A similar analysis was attempted with provirus datasets for the gammaretroviruses XMRV and PERV (Table 5). The XMRV provirus data was obtained in the human prostate cancer cell line DU145  and ChiPSeq datasets are not available for these cells. Despite the mismatched cell lines, when the XMRV dataset from DU145 cells was compared with the epigenetic markers mapped in HeLa cells strong correlation was observed with the supermarker (66% wi2kB; p<10−190; F score 0.83). When the supermarker was derived from CD4+ T cell data, the association with XMRV was much less significant (41% wi2kB; p<10−85; F score 0.70). Similarly, the PERV provirus dataset cloned from HEK 293 cells was better associated with the supermarker from HeLa cells (66% wi2kB; p<10−350; F score 0.83) than from CD4+ T cells (51% wi2kB; p<10−350; F score 0.75).
To understand why some mismatched cell comparisons gave higher F scores than others, CD4+ T cells, HeLa, DU145, Jurkat, HEK 293, and CD34+ hematopoietic stem cells were clustered based on global gene expression profiles (http://www.ncbi.nlm.nih.gov/geo). The resulting dendrogram (Figure S2) demonstrated that the cells clustered into two groups, one consisting of HeLa, DU146, and HEK 293 cells, and the other CD4+ T cells, Jurkat cells, and CD34+ cells. Based on expression profiles DU145 cells are more similar to HeLa cells than to CD4+ T cells, offering an explanation for the higher F score when XMRV was compared with HeLa.
Use of the supermarker to predict the likelihood of integration at specific loci within specific cell types
As a first step towards examining the utility of the supermarker in the context of published clinical or experimental data, supermarker density was examined in proto-oncogenes that have been activated by retroviral insertion. 20 SCID-X1 patients were successfully treated with autologous bone marrow CD34+ hematopoietic stem cells transduced ex-vivo with an MLV vector expressing the therapeutic gene IL2RG. 5 of these patients developed T cell leukemia and 4 possessed insertional mutations from the MLV vector at LMO2 –, a T cell oncogene . The fifth patient had a provirus near CCND2, another lymphoid oncogene  that encodes cyclin D2.
When ChIPSeq datasets from HeLa cells were used to generate the supermarker, no high probability sites were identified near the promoters of LMO2 or CCND2 (Figure 11). For LMO2 the nearest sites in HeLa cells were >150 kbp upstream and >200 kbp downstream of the TSS. For CCND2 the nearest sites in HeLa were >800 kbp upstream and >50 kbp downstream of the TSS.
(A) Schematic diagram of the region on human chromosome 11 flanking the promoter of the protooncogene LMO2. In CD4+ T cells, a very prominent supermarker peak is found wi2kB of the TSS. According to supermarker density, the probability of MLV integration in this region is 1 in 105. In HeLa cells, the nearest supermarker is found more >150 kB upstream and the probability of MLV integration is 1 in 107. (B) Schematic diagram of the region on human chromosome 12 flanking the promoter of the protooncogene CCND2. In CD4+ T cells, a dense cluster of supermarker peaks is found wi2kB of the TSS, and the probability of MLV integration is 1 in 104. In HeLa cells, the nearest supermarker is found >50 kB downstream and the probability of MLV integration is 1 in 107.
Sufficient ChIPSeq datasets to generate a supermarker were not available for CD34+ hematopoietic stem cells. Given the relative similarity of the transcription profile (Figure S2) we used the supermarker data generated from CD4+ T cells. The F score when crossing from CD34+ cells to CD4+ cells decreases from 0.85 to 0.78 (57% wi2kb, p<10−102), but is much better than when using HeLa cell data (38% wi2kB; p<10−48 ; F score 0.66).
With respect to the LMO2 TSS a very prominent supermarker peak was observed at −1730 bp (Figure 11A). Based on the probability of the supermarker we estimate that 1 out of 105 MLV proviruses would target this gene in CD34+ cells or CD4+ T cells, as compared to a much less frequent 1 out of 107 MLV proviruses in HeLa cells. Nearly identical probabilities were calculated based on experiments in which MLV proviruses were cloned from T cell lines and HeLa cells . These authors observed a hotspot for MLV integration located between −1740 to −3000 of the LMO2 promoter within CD4+ T cells but not within HeLa. Though experimental data for calculating the probability of integration into CCND2 is not available, it is interesting that multiple, high-probability supermarkers are located wi2kB of the promoter (Figure 11B).
Here we attempted to identify epigenetic markers predictive of retroviral integration site selection. To this end, the growing body of ChIP-Seq and retroviral integration datasets was exploited. Borrowing from the field of information retrieval, we derived a measure, the F score, that allowed us to identify and rank candidate markers for association with proviruses. Covalent modification of histone H3, most prominently H3K4me1, H3K4me3, and H3K9ac, as well as binding sites for the transcription factor STAT1, were tightly linked to proviruses from MLV, XMRV, and PERV. The F score also permitted us to combine factors to generate a supermarker that predicted 75% of integration sites with precision and with specificity for integration site preference within a given cell type. The ChIPSeq datamining approach used here identified markers for gammaretroviral integration site selection that are superior to any markers previously reported.
Advantages of the F score
Prior to this study, the best predictor for retroviral integration site selection was the association of TSS/CpG with gammaretroviruses such as MLV , , . Given a window of 2 kB, TSS/CpG predicts 21 to 27% of MLV integration sites. But even this modest prediction comes with the cost of a high background rate (low precision) and consequently a borderline F score (0.51 under the best conditions). In contrast, H3K4me3 predicts 63 to 68% of MLV integration sites with high precision (F score 0.84). H3K4me1 predicts 90% of MLV integration sites but, in isolation, this marker has a higher background rate (F score 0.78) due to the larger size of the H3K4me1 ChIPSeq dataset (300,000 binding sites for H3K4me1 versus 70,000 for H3K4me3).
Previous studies have reported the same histone modifications as markers associated with integration sites , . The Precision-Recall methods used here have been shown to be better suited than ROC when negative results far exceed positive ones . Precision-Recall methods have been shown to perform better than ROC in a number of other areas in biology, including the prediction of functional residues within proteins  or predicting the function of genes . In our case, the resolution offered by the Precision-Recall-based F score allowed us to rank markers according to statistical significance (Text S1). Then, by ranking markers with respect to their F score, we were able to combine them to generate a supermarker which predicts 75% of MLV integration sites wi2kB with very high precision (F score 0.87). It will certainly be important to find an explanation for the remaining 25% of integration sites not accounted for by the markers identified here.
Significance of the supermarker
The supermarker was used here to predict the probability of gammaretroviral integration into a specific locus, in a cell-type specific manner (Figure 11). Our in silico probability estimates for integration near a particular proto-oncogene, LMO2, were nearly identical to the probabilities calculated from experimental data , and even concurred with respect to the cell-type specificity of the experimentally determined probability. Additional experimental confirmation of supermarker predictions is called for but the case of LMO2 suggests that the supermarker is indeed the first powerfully predictive tool for retroviral integration site selection. A supermarker generated from cell-type-specific ChIPSeq data for a handful of markers has the potential to transform how decisions are made concerning clinical gene-therapy trials.
The calculations here were based on distinct datasets from multiple sources (Tables 1 and 2). It is possible that by generating matched datasets, i.e., integration datasets and ChiPSeq datasets from identical cells and by the same laboratory, or by combining ChIPSeq data for new factors in new combinations, the ability of the supermarker to predict integration sites will be improved even further. On the other hand, STAT1, a powerful marker in isolation, increased the false positive rate and decreased the F score. In addition to the ChIPSeq datasets in Table 1, we checked if the F score was improved by examining other previously reported features, including GC content, AT content, putative consensus sequences for integration or transcription factors , . When a window of 2kB was considered, these features failed to yield a significant F score (all were ≤0.5) for all of the retroviral provirus datasets, and these factors considerably lessened the F score when combined with the highly associated markers (Table S7).
The strength of the associations with H3K4me3, H3K4me1, and H3K9ac indicates that gammaretroviral integration is not a quasi-random process, but rather, a deterministic process that follows the epigenetic histone code. Though some of these histone modifications are linked to transcriptionally active promoters , –, the link to transcription per se seems not to be relevant since 60 to 70% of supermarker loci are not associated with TSS/CpG. Consistent with this point, our supermarker is highly associated with the LMO2 promoter in CD4+ T cells, but not in HeLa cells, and these cell-type-specific differences in marker binding do not correlate with differential LMO2 expression in these cells . The 2 kB window maxima for the F score of the supermarker is intriguing and suggests that it is a physical property of chromatin that is favored for integration by gammaretroviruses, perhaps linked to the position of the supermarker relative to nucleosomes or bent DNA , –.
The factors constituting the supermarker, along with the other histone modifications listed in Tables S1 and S2 that are also associated with MLV integration, suggest a mechanistic link between gammaretroviral integration and chromatin-associated complexes with H3K4 methyltransferase and histone acetyltransferase activity. H3K4 methylation is clearly linked with histone acetylation, in that promoters which are methylated are much more likely to become acetylated  and knockdown of WDR5, a factor required for H3K4 methylation  leads to altered histone acetylation , . Methylation may recruit chromatin remodeling complexes , , the methylated histone may be bound by the acetylases , or acetylases may be components of the methylase complex itself . CBP/p300 is associated with H3K4 methyltranferase activity in vivo , . ChIPSeq data on acetyltransferases shows a weak but significant association between CBP and MLV integrations in CD4+ T cells (F score 0.68, Table S4). Interestingly, combination of CBP and p300 leads to an aggregated F score of 0.75. Thus, any of these chromatin associated factors, methylated histones, methylases, chromatin remodeling complexes or acetylases are candidates for gammaretroviral IN-binding factors. Interestingly, HIV-1 IN associates with, and is acetylated by, p300  but the p300 ChIPSeq binding profile was not associated with the HIV-1 proviral datasets (F score 0.34).
Gammaretrovirus association with STAT1
Though very strong association was observed when any of the gammaretroviruses were compared with STAT1 binding sites, adding this transcription factor to the supermarker did not improve the F score. This is perhaps because any retroviral targeting information derived from STAT1 binding sites is already present in the modified histone H3. 90 to 95% of the STAT1 binding sites are in fact within 2 kB of the nearest H3K4me1 site. Our attempts to detect STAT1 binding to MLV IN, or to see effects of STAT1 disruption on MLV infectivity were unsuccessful. Taken together it seems likely that STAT1 itself is not mechanistically involved in gammaretrovirus integration. More likely, STAT1 homes to chromosomal regions that are also preferred targets for integration by these viruses. STAT1 has a complex relationship with the histone acetylase CBP/p300. Acetylation of histones is required for STAT1-mediated transcription ,  but STAT1 itself binds CBP/p300  and is also acetylated and this contributes to its inactivation .
HIV integration site selection
The best single marker for HIV-1 in HeLa cells, H3K4me1, predicted 48% of proviruses wi2kB but with only moderate precision (F score 0.60). Using the F score we were able to detect a stronger association of HIV-1 with H3K4me1 in CD4+ T cells (57% wi2kB, p<10−71, F score 0.73) but combining markers in an attempt to generate a supermarker failed to improve the F score. The associations that were observed may be related to HIV-1's propensity to integrate along the length of transcriptionally active genes , . Association with histone modifications at active promoters may be detected given short enough gene-length, or a wide-enough window around the provirus (Figure 5). Either way, we were unable to identify a marker capable of predicting HIV-1 integration site selection wi2kB. Perhaps the HIV-1 IN-interacting protein PSIP1/LEDGF/p75 – would be such a factor. Though binding sites have been reported for LEDGF , this dataset is limited to 1% of the human genome and cannot be used for a genome-wide association study. LEDGF influences HIV-1 integration site selection in that its disruption causes a shift away from transcriptional units and towards CpG-rich sequences , , . Nonetheless, these are relatively general effects and LEDGF binding sites may fail to give resolution down to a window of 2 kB. It appears that integration site selection by HIV-1 is mechanistically quite different than for the gammaretroviruses.
Retrovirus integration site datasets and generation of controls
The analysis of integration sites was based on the published integration datasets in Table 2. In the analysis performed here, to control for possible bias introduced during the cloning of the integration sites, 10 control sites in the human genome were generated for each integration site, as previously described , , , . These control, in silico-generated sites were used to calculate the significance and the F score (see below).
CpG island and transcription start sites
These genomic features were obtained from Annotated Genome version hg18 for human (http://genome.ucsc.edu/). CpG island and transcription start sites were combined into single datasets for determining association with retrovirus integration sites.
ChIPSeq peaks were derived from published ChIPSeq datasets (Table 1) with a robust and fast algorithm, F-Seq  running with default parameters and standard Poisson statistics. We recalculated the peaks even when the peak set was already available to confirm the reproducibility of published procedures.
Two-sided Fisher exact test (or χ2 approximation when appropriate) was used to evaluate statistical significance. All p-values were Bonferroni corrected for multiple testing. p-values<0.01 were considered significant.
To measure marker performance with respect to a given retroviral integration dataset, we used the -score (van Rijsbergen 1979). It is defined as the β-weighted harmonic mean of Precision and Recall(1)where tp is the number of actual integration sites within 2 kB from a specified factor; tn is the number of control datapoints (generated in silico as described above) >2 kB from a specified factor; fp is the number of control datapoints within 2 kB from a specified factor and fn is the number of actual integration sites >2 kB from a specified factor. We set β = 0.5 to give more weight to Precision than to Recall. This balances type I and type II errors by adjusting for the high rate of False Positives (fp) inherent in the examination of large datasets for genome-wide binding sites according to statistical significance (Text S1). Moreover, to overcome the limitation of standard statistical methods we normalized fp with respect to the number of actual integration sites.
The normalized -score is finallywith V and C being, respectively, the number of effective and control integration sites. The resulting F score is almost constant with respect to the size and ratio of experimental and control datasets (Figure 7).
It is worth noting that a null-predictor yielding (i.e. a marker composed of all bases in the genome) gives P = 0.5 and R = 1, resulting in an F score0.5. A marker is considered significant if the F score lies between 0.5 and 1.0.
Marker ranking and metric comparison
Different metrics can be used to measure the association between proviruses and given markers. We opted to identify the metric among F0.5, F1, F2, Area Under Curve (AUC), Area Under Precision/Recall (AUPR), Odds Ratio (OR), Shannon Mutual Information (SMI), and Difference of Proportions (DOP) that best agrees with statistical significance. The association between markers and proviruses was measured according to each of the above-mentioned metrics. Then the markers were ranked by comparing the measure associated to the i-esim marker with that associated with the j-esim marker and filling in an NXN matrix M for each measure. Formallywhere X is one of the considered metrics. As a reference, a similar matrix was built using the p-value (significance) obtained by Fisher's exact test, defined for the i-esim marker as . ThusA simple measure of similarity between metric X and reference S was calculated by (sum spans over all matrices elements). Observe that .
Generation of a supermarker
The mass probability functions p(V = i) or p(M = i) are defined as the probability of a provirus V or a marker M to be localized at a given genomic location defined as i≡(chromosome, position). p(V = i) is estimated from the linear combination of mass probability functions for candidate markers, that isCoefficient measures the goodness of fit of the marker and it seems reasonable to write as a function of the related F score.
Adding these equations we get the mixture model(2)Now, from (1) and we havethenA first order approximation of (2) is thenwhere K is a normalization constant. Eventually we set and the resulting new probability mass function is(3)The marker mass density was modeled as the sum of Gaussian functions centered on ChIPSeq peaks, with the variance set as the average size of the peak regions, as determined by the F-seq algorithm . In this way we minimized the potential bias that can arise by summing ChIPSeq densities obtained over different experimental conditions. Briefly, each marker probability density function was written aswhere Γ is the peak set of the marker M.
This function (3) summarizes the properties of all the markers and can be interpreted as a new ChIPSeq density. Indeed it contains all markers associated and not associated peaks. To reduce the number of false positives we applied a thresholding procedure similar to that used to filter raw ChIPSeq data in a training set of experimental and control integration sites. The peaks of function (3) were ranked with respect to their amplitude and the F score is recalculated on the training set as a function of the number of peaks. We define the supermarker M* as the marker set that yields a maximal F score.
To validate the model, we adopted two strategies. First we calculated the supermarker and the relative reduced peak set on each single proviral dataset and then we evaluated the association with the remaining datasets. The second strategy was a standard 10-fold cross-validation applied to each single dataset.
To validate the effectiveness of the supermarker peak set, we trained RandomForest , a machine learning algorithm, with the same set of markers composing the supermarker. Our datasets are extremely imbalanced and this results in a classifier with an high misclassification error for predicting the minority class (i.e. the experimental dataset) as shown in Table S6. In order to correct for that, RandomForest can be tuned by an additional parameter, classwt, that can be used to assign priors to the classes (experimental and control) to minimize the misclassification error and improve the performance. We adopted a 10-fold cross-validation procedure by correcting the priors in the training set. Interestingly, the maximum achievable F score and the number of associated integration sites wi2kb match almost exactly with the F score and wi2kb that we obtained with our supermarker procedure. We consider this as further evidence of the effectiveness of the supermarker.
Position specific scoring matrix (PWM)
PWM for retroviruses and human transcription factors was borrowed from  and from the JASPAR database (jaspar.cgb.ki.se).
All computation and graphics were done with ad-hoc Python scripts with the support of the motility library for PWM calculations (cartwheel.caltech.edu/ motility), Matplotlib library for graphical and scientific computing (matplotlib.sourceforge.net) and the Random Forest implementation on R environment (http://cran.r-project.org/web/packages/randomForest/).
Graphic representation of data
Chromosome projection mandalas (Figure 1) represent the distribution across of the genome of binding sites for a specific factor or histone modification on the circumference of a circle. Each dot represents a retroviral integration site with the following polar coordinates: angular distance corresponds to genomic location on the indicated chromosome; radial distance from the contour of the circle is the log-scaled distance in nucleotides from the closest marker site. Diagrams have been set to visualize proviruses located between 0 and 1 megabase. Proviruses located more than 1 megabase from the nearest marker accumulate at the center of the mandala.
Chromosome projection mandala and F0.5 score calculated within 2 kB for the indicated markers (columns) versus the indicated proviruses (rows). ASLV and HTLV1 proviruses were cloned from HeLa cells, the Foamy virus from CD34+ hematopoietic stem cells (Table 2 and text). H3K4me3 and STAT1 ChIPSeq datasets were from HeLa cells (Table 1). N indicates the number of specific proviral integrations considered for each analysis. The F0.5 score and the percentage of proviruses within 2 kB are presented under each mandala.
(0.35 MB TIF)
Hierarchical clustering applied to the expression profiles of the cell types cited in this study as a measure of similarity. Branch length correlates inversely with similarity, according to the scale bar.
(0.06 MB TIF)
Histone acetylation markers and MLV.
(0.04 MB DOC)
Histone methylation markers and MLV.
(0.05 MB DOC)
HIV-1 versus histone methylation and acetylation.
(0.04 MB DOC)
Acetyltransferases, deacetyltransferases, and MLV.
(0.03 MB DOC)
Crossvalidation of supermarker association with gammaretroviral proviruses.
(0.03 MB DOC)
Comparison of supermarker with random forest algorithm.
(0.03 MB DOC)
Association of various genomic features with proviruses, H3K4me3, and H3K4me1.
(0.04 MB DOC)
The authors thank Peter Cherepanov, Madeleine Zufferey, and Stephane Hausmann for stimulating discussions and experiments.
Conceived and designed the experiments: FAS JL. Performed the experiments: FAS. Analyzed the data: FAS OH JL. Contributed reagents/materials/analysis tools: FAS. Wrote the paper: FAS JL.
- 1. Lander ES, Linton LM, Birren B, Nusbaum C, Zody MC, et al. (2001) Initial sequencing and analysis of the human genome. Nature 409: 860–921.
- 2. SanMiguel P, Gaut BS, Tikhonov A, Nakajima Y, Bennetzen JL (1998) The paleontology of intergene retrotransposons of maize. Nat Genet 20: 43–45.
- 3. Coffin J, Hughes S, Varmus H (1997) Retroviruses. New York: Cold Spring Harbor Laboratory Press.
- 4. Bushman F (2002) Lateral DNA transfer: mechanisms and consequences. Cold Spring Harbor: Cold Spring Harbor Laboratory Press.
- 5. Uren AG, Kool J, Berns A, van Lohuizen M (2005) Retroviral insertional mutagenesis: past, present and future. Oncogene 24: 7656–7672.
- 6. Jern P, Coffin JM (2008) Effects of retroviruses on host genome function. Annu Rev Genet 42: 709–732.
- 7. Goodier JL, Kazazian HH Jr (2008) Retrotransposons revisited: the restraint and rehabilitation of parasites. Cell 135: 23–35.
- 8. Moran JV, DeBerardinis RJ, Kazazian HH Jr (1999) Exon shuffling by L1 retrotransposition. Science 283: 1530–1534.
- 9. Sayah DM, Sokolskaja E, Berthoux L, Luban J (2004) Cyclophilin A retrotransposition into TRIM5 explains owl monkey resistance to HIV-1. Nature 430: 569–573.
- 10. Whitelaw E, Martin DI (2001) Retrotransposons as epigenetic mediators of phenotypic variation in mammals. Nat Genet 27: 361–365.
- 11. Muotri AR, Chu VT, Marchetto MC, Deng W, Moran JV, et al. (2005) Somatic mosaicism in neuronal precursor cells mediated by L1 retrotransposition. Nature 435: 903–910.
- 12. Coufal NG, Garcia-Perez JL, Peng GE, Yeo GW, Mu Y, et al. (2009) L1 retrotransposition in human neural progenitor cells. Nature 460: 1127–1131.
- 13. Li M, Mizuuchi M, Burke TR Jr, Craigie R (2006) Retroviral DNA integration: reaction pathway and critical intermediates. EMBO J 25: 1295–1304.
- 14. Hare S, Gupta SS, Valkov E, Engelman A, Cherepanov P (2010) Retroviral intasome assembly and inhibition of DNA strand transfer. Nature 464: 232–U108.
- 15. Roth MJ, Schwartzberg PL, Goff SP (1989) Structure of the termini of DNA intermediates in the integration of retroviral DNA: dependence on IN function and terminal DNA sequence. Cell 58: 47–54.
- 16. Engelman A, Mizuuchi K, Craigie R (1991) HIV-1 DNA integration: mechanism of viral DNA cleavage and DNA strand transfer. Cell 67: 1211–1221.
- 17. Vink C, Yeheskiely E, van der Marel GA, van Boom JH, Plasterk RH (1991) Site-specific hydrolysis and alcoholysis of human immunodeficiency virus DNA termini mediated by the viral integrase protein. Nucleic Acids Res 19: 6691–6698.
- 18. Aiyar A, Hindmarsh P, Skalka AM, Leis J (1996) Concerted integration of linear retroviral DNA by the avian sarcoma virus integrase in vitro: dependence on both long terminal repeat termini. J Virol 70: 3571–3580.
- 19. Daniel R, Katz RA, Skalka AM (1999) A role for DNA-PK in retroviral DNA integration. Science 284: 644–647.
- 20. Yoder KE, Bushman FD (2000) Repair of gaps in retroviral DNA integration intermediates. J Virol 74: 11191–11200.
- 21. Skalka AM, Katz RA (2005) Retroviral DNA integration and the DNA damage response. Cell Death Differ 12: Suppl 1971–978.
- 22. Sarafianos SG, Marchand B, Das K, Himmel DM, Parniak MA, et al. (2009) Structure and function of HIV-1 reverse transcriptase: molecular mechanisms of polymerization and inhibition. J Mol Biol 385: 693–713.
- 23. Hazuda D, Iwamoto M, Wenning L (2009) Emerging pharmacology: inhibitors of human immunodeficiency virus integration. Annu Rev Pharmacol Toxicol 49: 377–394.
- 24. Hacein-Bey-Abina S, Garrigue A, Wang GP, Soulier J, Lim A, et al. (2008) Insertional oncogenesis in 4 patients after retrovirus-mediated gene therapy of SCID-X1. J Clin Invest 118: 3132–3142.
- 25. Hacein-Bey-Abina S, Von Kalle C, Schmidt M, McCormack MP, Wulffraat N, et al. (2003) LMO2-associated clonal T cell proliferation in two patients after gene therapy for SCID-X1. Science 302: 415–419.
- 26. Deichmann A, Hacein-Bey-Abina S, Schmidt M, Garrigue A, Brugman MH, et al. (2007) Vector integration is nonrandom and clustered and influences the fate of lymphopoiesis in SCID-X1 gene therapy. J Clin Invest 117: 2225–2232.
- 27. Howe SJ, Mansour MR, Schwarzwaelder K, Bartholomae C, Hubank M, et al. (2008) Insertional mutagenesis combined with acquired somatic mutations causes leukemogenesis following gene therapy of SCID-X1 patients. J Clin Invest 118: 3143–3150.
- 28. Davé UP, Akagi K, Tripathi R, Cleveland SM, Thompson MA, et al. (2009) Murine leukemias with retroviral insertions at Lmo2 are predictive of the leukemias induced in SCID-X1 patients following retroviral gene therapy. PLoS Genet 5: e1000491.
- 29. Kitamura Y, Lee YM, Coffin JM (1992) Nonrandom integration of retroviral DNA in vitro: effect of CpG methylation. Proc Natl Acad Sci U S A 89: 5532–5536.
- 30. Withers-Ward ES, Kitamura Y, Barnes JP, Coffin JM (1994) Distribution of targets for avian retrovirus DNA integration in vivo. Genes Dev 8: 1473–1487.
- 31. Wu X, Li Y, Crise B, Burgess SM (2003) Transcription start regions in the human genome are favored targets for MLV integration. Science 300: 1749–1751.
- 32. Schroder AR, Shinn P, Chen H, Berry C, Ecker JR, et al. (2002) HIV-1 integration in the human genome favors active genes and local hotspots. Cell 110: 521–529.
- 33. Maxfield LF, Fraize CD, Coffin JM (2005) Relationship between retroviral DNA-integration-site selection and host cell transcription. Proc Natl Acad Sci U S A 102: 1436–1441.
- 34. Pryciak PM, Sil A, Varmus HE (1992) Retroviral integration into minichromosomes in vitro. EMBO J 11: 291–303.
- 35. Pryciak PM, Varmus HE (1992) Nucleosomes, DNA-binding proteins, and DNA sequence modulate retroviral integration target site selection. Cell 69: 769–780.
- 36. Pruss D, Bushman FD, Wolffe AP (1994) Human immunodeficiency virus integrase directs integration to sites of severe DNA distortion within the nucleosome core. Proc Natl Acad Sci U S A 91: 5913–5917.
- 37. Pruss D, Reeves R, Bushman FD, Wolffe AP (1994) The influence of DNA and nucleosome structure on integration events directed by HIV integrase. J Biol Chem 269: 25031–25041.
- 38. Muller HP, Varmus HE (1994) DNA bending creates favored sites for retroviral integration: an explanation for preferred insertion sites in nucleosomes. EMBO J 13: 4704–4714.
- 39. Wang GP, Ciuffi A, Leipzig J, Berry CC, Bushman FD (2007) HIV integration site selection: analysis by massively parallel pyrosequencing reveals association with epigenetic modifications. Genome Res 17: 1186–1194.
- 40. Weinberg JB, Matthews TJ, Cullen BR, Malim MH (1991) Productive human immunodeficiency virus type 1 (HIV-1) infection of nonproliferating human monocytes. J Exp Med 174: 1477–1482.
- 41. Lewis P, Hensel M, Emerman M (1992) Human immunodeficiency virus infection of cells arrested in the cell cycle. EMBO J 11: 3053–3058.
- 42. Mitchell RS, Beitzel BF, Schroder AR, Shinn P, Chen H, et al. (2004) Retroviral DNA integration: ASLV, HIV, and MLV show distinct target site preferences. PLoS Biol 2: E234.
- 43. Lewinski MK, Yamashita M, Emerman M, Ciuffi A, Marshall H, et al. (2006) Retroviral DNA integration: viral and cellular determinants of target-site selection. PLoS Pathog 2: e60.
- 44. Roe T, Reynolds TC, Yu G, Brown PO (1993) Integration of murine leukemia virus DNA depends on mitosis. EMBO J 12: 2099–2108.
- 45. Yamashita M, Emerman M (2005) The cell cycle independence of HIV infections is not determined by known karyophilic viral elements. PLoS Pathog 1: e18.
- 46. Yamashita M, Perez O, Hope TJ, Emerman M (2007) Evidence for direct involvement of the capsid protein in HIV infection of nondividing cells. PLoS Pathog 3: 1502–1510.
- 47. Luban J, Bossolt KL, Franke EK, Kalpana GV, Goff SP (1993) Human immunodeficiency virus type 1 Gag protein binds to cyclophilins A and B. Cell 73: 1067–1078.
- 48. Kalpana GV, Marmon S, Wang W, Crabtree GR, Goff SP (1994) Binding and stimulation of HIV-1 integrase by a human homolog of yeast transcription factor SNF5. Science 266: 2002–2006.
- 49. Sebastian S, Luban J (2005) TRIM5alpha selectively binds a restriction-sensitive retroviral capsid. Retrovirology 2: 40.
- 50. Yueh A, Leung J, Bhattacharyya S, Perrone LA, de los Santos K, et al. (2006) Interaction of moloney murine leukemia virus capsid with Ubc9 and PIASy mediates SUMO-1 addition required early in infection. J Virol 80: 342–352.
- 51. Van Maele B, Busschots K, Vandekerckhove L, Christ F, Debyser Z (2006) Cellular co-factors of HIV-1 integration. Trends Biochem Sci 31: 98–105.
- 52. Studamire B, Goff SP (2008) Host proteins interacting with the Moloney murine leukemia virus integrase: multiple transcriptional regulators and chromatin binding factors. Retrovirology 5: 48.
- 53. Cherepanov P, Maertens G, Proost P, Devreese B, Van Beeumen J, et al. (2003) HIV-1 integrase forms stable tetramers and associates with LEDGF/p75 protein in human cells. J Biol Chem 278: 372–381.
- 54. Emiliani S, Mousnier A, Busschots K, Maroun M, Van Maele B, et al. (2005) Integrase mutants defective for interaction with LEDGF/p75 are impaired in chromosome tethering and HIV-1 replication. J Biol Chem 280: 25517–25523.
- 55. Turlure F, Devroe E, Silver PA, Engelman A (2004) Human cell proteins and human immunodeficiency virus DNA integration. Front Biosci 9: 3187–3208.
- 56. Ciuffi A, Llano M, Poeschla E, Hoffmann C, Leipzig J, et al. (2005) A role for LEDGF/p75 in targeting HIV DNA integration. Nat Med 11: 1287–1289.
- 57. Llano M, Saenz DT, Meehan A, Wongthida P, Peretz M, et al. (2006) An essential role for LEDGF/p75 in HIV integration. Science 314: 461–464.
- 58. Marshall HM, Ronen K, Berry C, Llano M, Sutherland H, et al. (2007) Role of PSIP1/LEDGF/p75 in lentiviral infectivity and integration targeting. PLoS One 2: e1340.
- 59. Shun M-C, Raghavendra NK, Vandegraaff N, Daigle JE, Hughes S, et al. (2007) LEDGF/p75 functions downstream from preintegration complex formation to effect gene-specific HIV-1 integration. Genes Dev 21: 1767–1778.
- 60. Ferris AL, Wu X, Hughes CM, Stewart C, Smith SJ, et al. (2010) Lens epithelium-derived growth factor fusion proteins redirect HIV-1 DNA integration. Proc Natl Acad Sci U S A 107: 3135–3140.
- 61. Gijsbers R, Ronen K, Vets S, Malani N, De Rijck J, et al. (2010) LEDGF hybrids efficiently retarget lentiviral integration into heterochromatin. Mol Ther 18: 552–560.
- 62. Silvers RM, Smith JA, Schowalter M, Litwin S, Liang Z, et al. (2010) Modification of integration site preferences of an HIV-1-based vector by expression of a novel synthetic protein. Hum Gene Ther 21: 337–349.
- 63. Robertson G, Hirst M, Bainbridge M, Bilenky M, Zhao Y, et al. (2007) Genome-wide profiles of STAT1 DNA association using chromatin immunoprecipitation and massively parallel sequencing. Nat Methods 4: 651–657.
- 64. Barski A, Cuddapah S, Cui K, Roh TY, Schones DE, et al. (2007) High-resolution profiling of histone methylations in the human genome. Cell 129: 823–837.
- 65. Wang Z, Zang C, Cui K, Schones DE, Barski A, et al. (2009) Genome-wide mapping of HATs and HDACs reveals distinct functions in active and inactive genes. Cell 138: 1019–1031.
- 66. Rozowsky J, Euskirchen G, Auerbach RK, Zhang ZD, Gibson T, et al. (2009) PeakSeq enables systematic scoring of ChIP-seq experiments relative to controls. Nat Biotechnol 27: 66–75.
- 67. Cuddapah S, Jothi R, Schones DE, Roh TY, Cui K, et al. (2009) Global analysis of the insulator binding protein CTCF in chromatin barrier regions reveals demarcation of active and repressive domains. Genome Res 19: 24–32.
- 68. Valouev A, Johnson DS, Sundquist A, Medina C, Anton E, et al. (2008) Genome-wide analysis of transcription factor binding sites based on ChIP-Seq data. Nat Methods 5: 829–834.
- 69. Wang Z, Zang C, Rosenfeld JA, Schones DE, Barski A, et al. (2008) Combinatorial patterns of histone acetylations and methylations in the human genome. Nat Genet 40: 897–903.
- 70. Narezkina A, Taganov KD, Litwin S, Stoyanova R, Hayashi J, et al. (2004) Genome-wide analyses of avian sarcoma virus integration sites. J Virol 78: 11656–11663.
- 71. Recchia A, Bonini C, Magnani Z, Urbinati F, Sartori D, et al. (2006) Retroviral vector integration deregulates gene expression but has no consequence on the biology and function of transplanted T cells. Proc Natl Acad Sci USA 103: 1457–1462.
- 72. Trobridge GD, Miller DG, Jacobs MA, Allen JM, Kiem HP, et al. (2006) Foamy virus vector integration sites in normal human cells. Proc Natl Acad Sci U S A 103: 1498–1503.
- 73. Derse D, Crise B, Li Y, Princler G, Lum N, et al. (2007) Human T-cell leukemia virus type 1 integration target sites in the human genome: comparison with those of other retroviruses. J Virol 81: 6731–6741.
- 74. Cattoglio C, Facchini G, Sartori D, Antonelli A, Miccio A, et al. (2007) Hot spots of retroviral integration in human CD34+ hematopoietic cells. Blood 110: 1770–1778.
- 75. Ikeda T, Shibata J, Yoshimura K, Koito A, Matsushita S (2007) Recurrent HIV-1 integration at the BACH2 locus in resting CD4+ T cell populations during effective highly active antiretroviral therapy. J Infect Dis 195: 716–725.
- 76. Kim S, Kim N, Dong B, Boren D, Lee SA, et al. (2008) Integration site preference of xenotropic murine leukemia virus-related virus, a new human retrovirus associated with prostate cancer. J Virol 82: 9964–9977.
- 77. Moalic Y, Felix H, Takeuchi Y, Jestin A, Blanchard Y (2009) Genome areas with high gene density and CpG island neighborhood strongly attract porcine endogenous retrovirus for integration and favor the formation of hot spots. J Virol 83: 1920–1929.
- 78. Ciuffi A, Ronen K, Brady T, Malani N, Wang G, et al. (2009) Methods for integration site distribution analyses in animal cell genomes. Methods 47: 261–268.
- 79. Wang GP, Garrigue A, Ciuffi A, Ronen K, Leipzig J, et al. (2008) DNA bar coding and pyrosequencing to analyze adverse events in therapeutic gene transfer. Nucleic Acids Res 36: e49.
- 80. Berry C, Hannenhalli S, Leipzig J, Bushman FD (2006) Selection of target sites for mobile DNA integration in the human genome. PLoS Comput Biol 2: e157.
- 81. Wang GP, Levine BL, Binder GK, Berry CC, Malani N, et al. (2009) Analysis of lentiviral vector integration in HIV+ study subjects receiving autologous infusions of gene modified CD4+ T cells. Mol Ther 17: 844–850.
- 82. Davis J, Goadrich M (2006) The relationship between Precision-Recall and ROC curves. Proc Int Conf Mach Learn 148: 233–240.
- 83. Bunescu R, Ge R, Kate R, Marcotte E, Mooney R, et al. (2004) Comparative experiments in learning information extractors for proteins and their interactions. Journal of Artificial Intelligence in Medicine 33: 139–155.
- 84. Bockhorst J, Craven M (2005) Markov networks for detecting overlapping elements in sequence data. MIT Press.
- 85. van Rijsbergen C (1979) Information retrieval. Oxford: Butterworth-Heinemann.
- 86. Martin Rainer, Heute Ulrich, Antweiler C, editors. (2008) (2008) Advances in digital speech transmission. UK: Wiley & Sons. 572 p.
- 87. Santos-Rosa H, Schneider R, Bannister AJ, Sherriff J, Bernstein BE, et al. (2002) Active genes are tri-methylated at K4 of histone H3. Nature 419: 407–411.
- 88. Guenther MG, Levine SS, Boyer LA, Jaenisch R, Young RA (2007) A chromatin landmark and transcription initiation at most promoters in human cells. Cell 130: 77–88.
- 89. Kouzarides T (2007) Chromatin modifications and their function. Cell 128: 693–705.
- 90. Brady T, Lee YN, Ronen K, Malani N, Berry CC, et al. (2009) Integration target site selection by a resurrected human endogenous retrovirus. Genes Dev 23: 633–642.
- 91. Park C, Li S, Cha E, Schindler C (2000) Immune response in Stat2 knockout mice. Immunity 13: 795–804.
- 92. Kaul A, Stauffer S, Berger C, Pertel T, Schmitt J, et al. (2009) Essential role of cyclophilin A for hepatitis C virus replication and virus production and possible link to polyprotein cleavage kinetics. PLoS Pathog 5: e1000546.
- 93. Pellegrini S, John J, Shearer M, Kerr IM, Stark GR (1989) Use of a selectable marker regulated by alpha interferon to obtain mutations in the signaling pathway. Mol Cell Biol 9: 4605–4612.
- 94. Breiman L (2001) Random forests. Mach Learn 45: 5–32.
- 95. Nam CH, Rabbitts TH (2006) The role of LMO2 in development and in T cell leukemia after chromosomal translocation or retroviral insertion. Mol Ther 13: 15–25.
- 96. Clappier E, Cuccuini W, Cayuela JM, Vecchione D, Baruchel A, et al. (2006) Cyclin D2 dysregulation by chromosomal translocations to TCR loci in T-cell acute lymphoblastic leukemias. Leukemia 20: 82–86.
- 97. Yamada K, Tsukahara T, Yoshino K, Kojima K, Agawa H, et al. (2009) Identification of a high incidence region for retroviral vector integration near exon 1 of the LMO2 locus. Retrovirology 6: 79.
- 98. Fischer JD, Mayer CE, Soding J (2008) Prediction of protein functional residues from sequence by probability density estimation. Bioinformatics 24: 613–620.
- 99. Pena-Castillo L, Tasan M, Myers CL, Lee H, Joshi T, et al. (2008) A critical assessment of Mus musculus gene function prediction using integrated genomic evidence. Genome Biol 9: Suppl 1S2.
- 100. Felice B, Cattoglio C, Cittaro D, Testa A, Miccio A, et al. (2009) Transcription factor binding sites are genetic determinants of retroviral integration in the human genome. PLoS One 4: e4571.
- 101. Wysocka J, Swigut T, Milne TA, Dou Y, Zhang X, et al. (2005) WDR5 associates with histone H3 methylated at K4 and is essential for H3 K4 methylation and vertebrate development. Cell 121: 859–872.
- 102. Dou Y, Milne TA, Ruthenburg AJ, Lee S, Lee JW, et al. (2006) Regulation of MLL1 H3K4 methyltransferase activity by its core components. Nat Struct Mol Biol 13: 713–719.
- 103. Pray-Grant MG, Daniel JA, Schieltz D, Yates JR 3rd, Grant PA (2005) Chd1 chromodomain links histone H3 methylation with SAGA- and SLIK-dependent acetylation. Nature 433: 434–438.
- 104. Wysocka J, Swigut T, Xiao H, Milne TA, Kwon SY, et al. (2006) A PHD finger of NURF couples histone H3 lysine 4 trimethylation with chromatin remodelling. Nature 442: 86–90.
- 105. Martin DG, Grimes DE, Baetz K, Howe L (2006) Methylation of histone H3 mediates the association of the NuA3 histone acetyltransferase with chromatin. Mol Cell Biol 26: 3018–3028.
- 106. Vandel L, Trouche D (2001) Physical association between the histone acetyl transferase CBP and a histone methyl transferase. EMBO Rep 2: 21–26.
- 107. Wang H, Cao R, Xia L, Erdjument-Bromage H, Borchers C, et al. (2001) Purification and functional characterization of a histone H3-lysine 4-specific methyltransferase. Mol Cell 8: 1207–1217.
- 108. Cereseto A, Manganaro L, Gutierrez MI, Terreni M, Fittipaldi A, et al. (2005) Acetylation of HIV-1 integrase by p300 regulates viral integration. EMBO J 24: 3070–3081.
- 109. Paulson M, Press C, Smith E, Tanese N, Levy DE (2002) IFN-Stimulated transcription through a TBP-free acetyltransferase complex escapes viral shutoff. Nat Cell Biol 4: 140–147.
- 110. Zhang JJ, Vinkemeier U, Gu W, Chakravarti D, Horvath CM, et al. (1996) Two contact regions between Stat1 and CBP/p300 in interferon gamma signaling. Proc Natl Acad Sci USA 93: 15092–15096.
- 111. Kramer OH, Knauer SK, Greiner G, Jandt E, Reichardt S, et al. (2009) A phosphorylation-acetylation switch regulates STAT1 signaling. Genes Dev 23: 223–235.
- 112. De Rijck J, Bartholomeeusen K, Ceulemans H, Debyser Z, Gijsbers R (2010) High-resolution profiling of the LEDGF/p75 chromatin interaction in the ENCODE region. Nucleic Acids Res Epub ahead of print.
- 113. Boyle AP, Guinney J, Crawford GE, Furey TS (2008) F-Seq: a feature density estimator for high-throughput sequence tags. Bioinformatics 24: 2537–2538.