PhyloScan: identification of transcription factor binding sites using cross-species evidence
© Carmack et al. 2007
Received: 10 July 2006
Accepted: 23 January 2007
Published: 23 January 2007
When transcription factor binding sites are known for a particular transcription factor, it is possible to construct a motif model that can be used to scan sequences for additional sites. However, few statistically significant sites are revealed when a transcription factor binding site motif model is used to scan a genome-scale database.
We have developed a scanning algorithm, PhyloScan, which combines evidence from matching sites found in orthologous data from several related species with evidence from multiple sites within an intergenic region, to better detect regulons. The orthologous sequence data may be multiply aligned, unaligned, or a combination of aligned and unaligned. In aligned data, PhyloScan statistically accounts for the phylogenetic dependence of the species contributing data to the alignment and, in unaligned data, the evidence for sites is combined assuming phylogenetic independence of the species. The statistical significance of the gene predictions is calculated directly, without employing training sets.
In a test of our methodology on synthetic data modeled on seven Enterobacteriales, four Vibrionales, and three Pasteurellales species, PhyloScan produces better sensitivity and specificity than MONKEY, an advanced scanning approach that also searches a genome for transcription factor binding sites using phylogenetic information. The application of the algorithm to real sequence data from seven Enterobacteriales species identifies novel Crp and PurR transcription factor binding sites, thus providing several new potential sites for these transcription factors. These sites enable targeted experimental validation and thus further delineation of the Crp and PurR regulons in E. coli.
Better sensitivity and specificity can be achieved through a combination of (1) using mixed alignable and non-alignable sequence data and (2) combining evidence from multiple sites within an intergenic region.
Alteration of the frequency of transcription from DNA to messenger RNA is the primary means by which an organism controls gene expression. Transcription initiation is controlled primarily through the binding of transcription factors (proteins) to cognate sites on a chromosome (transcription factor binding sites). For a given transcription factor and an experimentally identified set of transcription factor binding sites, or a set of co-regulated promoters, computational methods can be applied to identify the DNA sequence pattern that is recognized by the transcription factor. Such a sequence pattern is commonly referred to as a motif, which is a conceptual extension of a single sequence, in which each position is characterized not by a single nucleotide, but rather by a column vector representing the probability with which each of the four nucleotides contributes to the pattern at that position.
The prediction of additional transcription factor binding sites by comparison of a motif to the promoter regions of an entire genome is a vexing problem, due to the large database size (approximately one half million intergenic base pairs for a typical prokaryote, and several hundred million base pairs for a mammal) and the relatively small width of a typical transcription factor binding site (6–30 bp). In such a large search space, chance alone results in the identification of many sites that match the motif. The problem is further compounded by variability among the transcription factor binding sites that are recognized by a transcription factor; such variability permits differences in the level of regulation, due to the altered intrinsic affinities for the transcription factor .
Programs that use a motif to search (i.e., scan) a sequence database for matches (i.e., predicted transcription factor binding sites) fall into two general categories. One approach is to employ a training set of transcription factor binding sites and a scoring scheme to evaluate predictions [2–8]. The scoring scheme is often based on information theory , and the training set is used to empirically determine a score threshold for reporting of the predicted transcription factor binding sites. The second method relies on a rigorous statistical analysis of the predictions, based upon modeled assumptions. Briefly, the statistical significance of a sequence match to a motif can be assessed through the determination of type I error (p-value): the probability of observing a match with a score as good or better in a randomly generated search space of identical size and nucleotide composition. The smaller the p-value, the less likely that the match is due to chance alone. Staden  presented an efficient method that exactly calculates this probability, and Neuwald et al.  described an implementation of this method.
When either of the two types of method is used to scan an entire genome, or the promoter regions of a genome, there is a difficult trade-off between sensitivity and specificity. If the threshold for a prediction (sites above a chosen information measure cutoff, or below a chosen p-value level) is chosen so as to reflect a reasonably low false positive rate (i.e., high specificity), it is frequently difficult to recover many of the known transcription factor binding sites that were used in the construction of the motif. Conversely, the choice of a threshold for prediction that finds many of the known transcription factor binding sites (i.e., high sensitivity) invariably leads to an overwhelming number of additional predicted sites, most of which are likely false positives. (Generally, we do not know where a transcription factor might bind in a way that does not affect transcription and thus, in this latter case, the functional interpretation of these "false positives" is somewhat subtle.)
The goal of the present study has been to increase the statistical power, when scanning a genome sequence database with a regulatory motif, by taking advantage of additional sequence data from related species and from multiple sites within an intergenic region. We have extended Staden's method  to allow scanning of orthologous sequence data that are either multiply aligned, unaligned, or a combination of aligned and unaligned. Our new algorithm, PhyloScan, an extension of Staden's method, statistically accounts for the phylogenetic dependence of the species contributing data to the alignment and calculates a p-value for the sequence match in the aligned data set. This approach is similar to the MONKEY method ; however, there are several key differences between the two.
MONKEY requires that all sequences be multiply aligned. However, this requirement is too restrictive for many transcription factors of interest that are conserved across a broad phylogenetic range. That is, there are many cases in which distantly related species contain orthologous transcription factors and binding sites, even though general sequence alignments are not feasible (e.g., between eubacteria and archaea [13–15]). Thus, we have developed a scanning approach that will find sites in mixed data that can include one or more clades of sequences (each of which can be aligned reliably) as well as sequences which cannot be aligned reliably to any other sequences.
Furthermore, regulatory modules often include multiple sites, none of which alone would be statistically significant in a genome-scale scan. Our procedure addresses this important case. In addition, our procedure permits use of a wide range of nucleotide substitution models, and it reports q-values , the fraction of intergenic regions of a given strength or better that are expected to be false, whereas MONKEY reports p-values, the fraction of false sites expected to show a given strength or better.
We evaluated PhyloScan on both real and synthetic data. For the real data, we chose the Escherichia coli Crp and PurR motifs, and we gathered genome sequence data for several gamma-proteobacteria. We and others have previously demonstrated that a comparative genomic approach is effective in the prediction of transcription factor binding sites within this phylogenetic group [17–26]. Among the species chosen for this study (E. coli, Salmonella enterica serovar Typhi (S. typhi), Yersinia pestis, Haemophilus influenzae, Vibrio cholerae, Shewanella oneidensis, and Pseudomonas aeruginosa), only E. coli and S. typhi exhibit sufficient homology in the promoter regions . Thus, we aligned orthologous intergenic regions for these two species, and we combined the statistical evidence from the scanning of the aligned E. coli and S. typhi data with the statistical evidence from the scanning of unaligned orthologous intergenic regions from the remaining five, more distantly related, species. (Approaches in which the S. typhi sequence data is considered independent of the E. coli sequence data were considered in earlier work .)
Synthetic sequence data
While of interest for comparison with previous studies, this set of species is not representative of the problem of incorporating phylogeny into scanning methods. Furthermore, evaluation of scanning algorithms using real sequence data is difficult, because of the presence of transcription factor binding sites that are likely real, but unreported. That is, because they have not yet been experimentally verified, some predicted sites reported as false positives may, in fact, be true positives. Thus, we generated synthetic data in which we controlled the binding site content. Specifically, as a typical example, we generated four sets of sequence data modeled on the phylogenetic relationship of fourteen prokaryotic species: seven Enterobacteriales (E. coli, S. typhi, Klebsiella pneumoniae, Salmonella bongori, Citrobacter rodentium, Shigella flexneri, & Proteus mirabilis), four Vibrionales (Vibrio cholerae, Vibrio parahaemolyticus, Vibrio vulnificus, & Vibrio fischeri), and three Pasteurellales (Haemophilus influenzae, Haemophilus somnus, & Haemophilus ducreyi).
Based upon the distances in the phylogenetic tree we partitioned the fourteen species into four clades, the Vibrionales clade, the Pasteurellales clade, P. mirabilis (by itself), and the remaining Enterobacteriales (henceforth, the Enterobacteriales clade). To evaluate the trade-off between sensitivity and specificity, we ran PhyloScan using the full-strength Crp motif; we scanned the full-strength-Crp-sites sequence data (positive data) and the no-sites sequence data (negative data). Likewise, we ran PhyloScan using the 1/2-strength Crp motif, scanning the 1/2-strength sequence data (positive data) and the no-sites sequence data (negative data); we also ran PhyloScan using the 1/3-strength Crp motif, scanning the 1/3-strength sequence data (positive data) and the no-sites sequence data (negative data).
Additionally, we ran PhyloScan with some of its features disabled. In three pairs of runs, one for each motif strength, as above, we ran PhyloScan on the four clades of sequence data, but by disabling its Neuwald-Green calculation (see Methods) we did not permit PhyloScan to statistically incorporate any sites other than the best found binding site in each intergenic region. In another three pairs of runs we ran PhyloScan, permitting it to consider multiple sites within an intergenic region, but by disabling its Bailey-Gribskov calculation (see Methods) PhyloScan could not consider more than one clade, and we gave it only the sequence data from the Enterobacteriales clade. Finally, we ran MONKEY (which incorporates neither the Neuwald-Green nor the Bailey-Gribskov calculation) on the Enterobacteriales clade sequence data, in a final three pairs of runs.
Each of these twelve pairs of runs – four algorithms times three motif strengths – produced p-values for each of 10,000 synthetic orthologous intergenic regions with sites and for each of 10,000 synthetic orthologous intergenic regions without sites. When any of the algorithms is used, it is desirable to set a p-value cutoff so that, in the positive data, the number of intergenic regions that have values below this cutoff is large and, in the negative data, the number of the intergenic regions that have values below the cutoff is small. Because the relative importances of the former (sensitivity) and the latter (type I error) depend upon the particular experiment and the parameters of that experiment, it is common to plot a Receiver Operating Characteristic (ROC) curve of sensitivity vs. type I error, to show what is achievable from differing cutoff levels.
Real sequence data
To evaluate the statistical power provided by different facets of the PhyloScan approach in real sequence data, we measured the increase in sensitivity originating from three sources: a reduction in database size, the use of aligned sequence data only, and the use of non-alignable ortholog data.
As a stripped-down baseline, we applied PhyloScan in a scan of the full E. coli sequence database, ignoring all other sequence data; this baseline is equivalent to the original Staden method, and thus has the same statistical power.
We compared the baseline to the results achievable from a reduced database. When orthologous sequences are aligned between closely related species, gaps may be introduced, and there are often portions of the sequence that do not align; thus, the overall feasible search space for transcription factor binding sites is reduced. A search of such a reduced database in and of itself will allow the detection of more statistically significant transcription factor binding sites than will a search of a full set of intergenic regions from a single species. Therefore, the scanning results from a database reduced in size, yet containing data from only one species, will provide a measure of the increase in sensitivity to the baseline scan that is due simply to a reduction in search space.
We compared the baseline and reduced-database results to those obtained by scanning a database of aligned E. coli-S. typhi sequences, in order to measure the increase in sensitivity provided by the use of this aligned sequence data.
Summary of PhyloScan Predictions
E. coli Sequence Data
Red. & Aligned c
Red. & Aligned c
Crp Known d
Crp Novel d
PurR Known d
PurR Novel d
Furthermore, in each of the tests described above (using the baseline, the reduced-database, or the aligned sequence data) we can incorporate non-alignable orthologous sequence data to measure the impact of these additional data on sensitivity. Thus, to determine the extent to which additional, more distantly related, species could provide evidence to support a particular candidate transcription factor binding site upstream of a particular gene in the target species, we used PhyloScan to scan the orthologous intergenic regions for that candidate gene from the additional species (clades), assuming phylogenetic independence between clades. The p-value representing the combined evidence supporting a transcription factor binding site prediction was then calculated using the method of Bailey and Gribskov , as described in the Methods.
To demonstrate this approach with the E. coli Crp and PurR examples, we employed orthologous data from the five additional gamma-proteobacterial species listed above. We used PhyloScan to identify potential Crp and PurR transcription factor binding sites in the E. coli-only and E. coli-S. typhi aligned data sets, using a P intergenic ≤ 0.05 cutoff to select candidate intergenic regions for examination in the other five species. As summarized in Table 1, depicted in Figures 4 and 5, and described below, we observed a considerable increase in the number of predicted transcription factor binding sites at the q-value ≤ 0.001 level, when the evidence from the five additional gamma-proteobacterial species was included by combining p-values.
For example, PhyloScan identified a total of 10 Crp-significant intergenic regions in the E. coli-S. typhi aligned data, but after combination of the evidence from the remaining five species, a total of 29 Crp-significant intergenic regions were predicted, a near tripling. Compared to a simple search of the raw E. coli intergenic sequences (one Crp-significant intergenic region), this represents a tremendous increase in sensitivity. The results with the PurR model were also dramatic: the use of data from S. typhi, Y. pestis, H. influenzae, and V. cholerae provided a 50% increase in the number of PurR-significant intergenic regions (to 18 from 12), compared to the scanning of E. coli-S. typhi aligned intergenic sequences only. In the E. coli sequence alone there was only a single PurR-significant intergenic region. In the Supplementary Materials are tables listing the located sites for Crp [see Additional file 3] and PurR [see Additional file 4], as well as captions for these tables [see Additional file 1].
Top 20 Predictions by PhyloScan
E. coli Sequence
Reduced & Aligned c
Reduced & Aligned c
# Diffs from C6
It is worth noting here that the non-alignable species were selected for combination of p-values based upon the presence or absence of the transcription factor under study. All gamma-proteobacteria used in this study encode orthologs to Crp; hence, data for all species were included when p-values were combined from scans with the Crp motif. In contrast, because S. oneidensis and P. aeruginosa do not encode PurR orthologs, these species were not considered when we scanned for PurR binding sites.
Key features of PhyloScan
We are able to increase the flexibility and sensitivity of scanning, without increasing the false positive rate, by incorporating the following three key features into PhyloScan:
1. We allow a mixture of alignable and unalignable sequence data. Specifically, sequences that can be reliably multiply aligned should be grouped and aligned. These clades of multiply-aligned sequences, including each "degenerate clade" of one sequence that cannot be reliably aligned with any other sequence, are used by PhyloScan. A phylogenetic tree relating the sequences within a clade, a user-specified nucleotide substitution model, and an extension to Staden's precise p-value calculation that is phylogenetically aware are all employed by PhyloScan to increase the statistical power of Staden's original method. (See Methods.)
2. We combine evidence from multiple sites within an intergenic region to produce a better sensitivity than could be achieved by simply examining the strongest site within an intergenic region. Specifically, a group of weak sites, none of which is statistically significant in isolation, is detected by the fact that for some value i, the ith weakest of the sites is surprisingly strong given that it is the ith weakest. (See Methods.)
3. We report our findings in terms of q-values  instead of p-values. For each intergenic region we report the probability that a region of its significance or better will be a false prediction, instead of reporting the probability that a negative control will appear at this significance or better.
Applicability of PhyloScan
The test cases described here reflect our past and present research interests in proteobacterial gene regulation, while simultaneously emphasizing PhyloScan's ability to handle multiple weak binding sites as well as mixed aligned and unaligned sequence data. However, the features of our data set are not unique; there are many examples where multiple binding sites are common (e.g., flies  and humans ) or where transcription factors and their cognate binding sites are conserved across diverse species for which multiple sequence alignments are not feasible (e.g., between eubacteria and archaea [13–15]). PhyloScan will have clear advantages in such contexts. However, it is important to note that in situations where orthologous regions are usually alignable and for which the multiple-weak-sites scenario is unlikely, PhyloScan will not perform better than existing approaches such as MONKEY. In another direction, in cases where sequences cannot be aligned, PhyloScan will not perform better than existing approaches that handle "independent species."
Here we have demonstrated significant improvement of scan results through the use of sequences from evolutionary distant species that have orthologous transcription factors. This is not unexpected, given results of a more theoretical nature that quantify the extent of such improvement .
PhyloScan evaluates significance at the level of the intergenic region
A key focus of this work has been to combine evidence across transcription factor binding sites within an intergenic region and across orthologous regions in order to correctly identify intergenic regions that are likely to contain transcription factor binding sites, even when each of the identified transcription factor binding sites, considered in isolation, may not be sufficiently strong to be statistically significant. Accordingly, the individual sites included in our predictions are not necessarily statistically significant and individual site predictions may be false positives even within true-positive intergenic sequences.
For instance, in the collection of 10,000 synthetic data sets in which we planted two full-strength Crp transcription factor binding sites per intergenic region, we have 9,985 true positive intergenic regions at the 99.9% specificity level (see Figure 3). Of these true positives, in 6,287 of the E. coli intergenic regions two sites were predicted and the sites exactly coincided with the two planted sites. In 24 E. coli intergenic regions two sites were predicted and one of the two sites exactly coincided with a planted site. In 3,672 of these regions one site was predicted and it exactly coincided with one of the two planted sites, and in 2 of the E. coli intergenic regions, one site was predicted that did not exactly coincide with a planted site.
Key user-selectable parameters in PhyloScan
Focus on a target species or clade
In running PhyloScan, the user must specify two cutoff values, and can optionally specify additional parameters describing the expected multiplicity of binding sites upstream of a regulated gene. The first cutoff is a p-value cutoff, calculated on a per intergenic-sequence basis for the clade that includes the species of primary interest. We chose a default value of 0.05, so that weak intergenic regions in the target species' clade will not be considered, even when strong intergenic regions are located in orthologous regions in more-distantly related species. The choice of a larger value would reduce the focus on the target species, allowing strong sites in other species to rescue weak sites in the target species. The choice of a smaller value would increase the focus on the target species; the choice of a very small value would effectively cancel out the information available from the related species, since any intergenic region that looks extremely promising in the target species will almost surely continue to look promising when additional data are included.
Quality of reported sites
The second cutoff that our approach requires is the q-value cutoff that specifies which sites will be reported. We chose a default value of 0.001, meaning that according to our model, at most 0.1% of the intergenic sequences that we report as binding the transcription factor are chance false positives. While we have incorporated a fairly accurate phylogenetic model, we have not incorporated into this model such effects as the non-independence of the positions in a site (e.g., the effect of di- or tri-nucleotide energy terms, also known as stacking energies), nor effects from the cooperative binding of multiple transcription factors on the ability of a factor to bind to a DNA site. Because our model does not capture these and other features, the actual rate of false positives is likely to be higher than 0.1%.
On the other hand, in calculating the q-value, we have assumed that the vast majority of intergenic sequences in a genome will likely not contain a transcription factor binding site for the particular transcription factor under study, i.e., we are looking for rare events. Under this assumption, the proportion of all intergenic sequences that are truly null will approach 1.0 in Storey and Tibshirani's q-value calculation (the term of ), and so does not appear in our q-value equation (see Methods). In a case where this assumption does not hold, the q-values provided by our approach will be overly conservative.
Note that the scan technology, first described by Staden  and employed here, is a frequentist hypothesis testing approach. A Bayesian approach presents an alternative through the use of Bayesian posterior probabilities for each site. Such an approach would require the specification of a model from which alternative sequences are drawn as well as null sequences. When a large number of observations are available the approach of Efron et al.  provides a compromise that yields local false discovery rates through the use of empirical Bayesian methods.
The number of sites per intergenic region
The number of potential sites to consider in each intergenic region, and their respective weights, are additional parameters that can be set by the user to best capture the underlying biology in the system under study. Generally speaking, for i ≥ 1, the algorithm detects that an intergenic region with sites is significant when its ith best site is surprisingly strong given its rank as the ith best site. The weight w i should be chosen in proportion to the number of such intergenic regions that are expected to have i as the first/lowest rank that appears strong by this test. We have set the default to have weights (w 1, w 2) = (0.9, 0.1) under the assumption that approximately 90% of intergenic regions with sites will have a strong site; among the remaining intergenic regions with sites, nearly all will have a site that is surprisingly strong given its rank as second strongest. (See the Methods.)
Divergently transcribed genes
The presence of divergently transcribed genes, that is, the circumstance in which an intergenic region is upstream of, and contains the promoters for, both of a given pair of neighboring genes, is quite common in prokaryotes, and also occurs in eukaryotes, albeit much less frequently. Divergently transcribed genes occur frequently in the E. coli genome (644 pairs of divergently transcribed genes), and their presence has raised the question of which orthologous data should be used when we combine p-values. In the present implementation of PhyloScan, the choice was made randomly. Thus, in such cases, we were as likely to make a "correct" choice as to make an "incorrect" choice, if only one of the E. coli genes flanking an intergenic region containing candidate transcription factor binding sites is regulated by the transcription factor of interest. However, in cases where gene synteny is conserved across several species, this choice becomes irrelevant. That is, when synteny is conserved, the same intergenic regions from each species will be examined regardless of the gene chosen; inspection of the output and, ultimately, experimental validation become necessary in order to evaluate whether a predicted site is associated with the chosen gene, with the divergently transcribed gene, or with both. Implementation of a systematic or informed choice in these situations will be a topic for the future development of PhyloScan.
We have used PhyloScan to combine evidence from matching sites found in orthologous data from several related bacterial species. In simulated sequence data, we demonstrate good sensitivity at high specificity levels. In real sequence data we are able to rediscover many of the known Crp and PurR transcription factor binding sites in E. coli, and we predict several novel Crp-significant intergenic regions and several novel PurR-significant intergenic regions in E. coli; specifically, over half of the Crp sites and one-third of the PurR sites are not experimentally validated by DNase I or electrophoretic mobility shift assays. Accordingly, our results have provided several new potential binding sites for these transcription factors, that require validation, to enable further delineation of these regulons in E. coli.
Through its capability of using cross-species data, PhyloScan improves the sensitivity of motif scanning; because the approach permits the use of both aligned and unaligned data, from both evolutionarily near and somewhat more distant species, it is our hope that researchers will find it useful in a wide variety of settings.
PhyloScan is available on request from the authors via email@example.com, and a Web interface for the software is available .
Like the MONKEY method , PhyloScan uses the phylogenetic model of Neyman  and the efficient algorithm of Felsenstein  to evaluate the probability that a site in observed multiply-aligned sequence data is consistent with a transcription factor's motif model. With either MONKEY or PhyloScan, each position of the motif is evaluated, and the computed probabilities for the motif positions are then multiplied together to give the strength of the site. Via the approach of Staden , the probability that such strength would arise by chance is precisely computed.
PhyloScan goes beyond MONKEY in several key ways. First, PhyloScan combines the information from multiple sites within an intergenic region, so that evidence from weak sites that would not be significant in isolation is combined, to identify a statistically significant find. Second, information from more-distant sequences, both non-alignable isolated sequences and clades of alignable sequences, is incorporated so as to further increase sensitivity, without an accompanying increase in false predictions. Third, we signify strength of a find by reporting its q-value, the fraction of predictions of this probability or better that are expected to be false, rather than its p-value, the fraction of false sites that are expected to demonstrate this probability or better.
Descriptions of the three main differences between the two algorithms are provided below.
Combining evidence across sites within an intergenic region
PhyloScan combines information from multiple predictions via a weighted Bonferroni test in a manner similar to that of Neuwald and Green . Specifically, for a user-supplied value k, which defaults to 2, and user-supplied weights (w 1,..., w k ), which default to (0.9, 0.1), PhyloScan conservatively computes an intergenic region's p-value as
where the weights (w 1,..., w k ) are nonnegative and sum to one, and p i is the probability that a randomly generated, intergenic sequence alignment of the same size would have its ith best site as good as or better than the ith best site in the intergenic sequence data under consideration. The calculation is conservative because the underlying events whose probabilities are (p 1,..., p k ) are not statistically disjoint .
Thus, an intergenic region with a strong site will make its presence known via a strong (i.e., low) value for the p 1/w 1 term, and an intergenic region that does not have a strong site, but that does have an ith best site that is surprisingly strong (given its rank as ith best), will be detected through a strong value for the p i /w i term. This enables us to detect both transcription factors that tend to bind strongly but in isolation and transcription factors that tend to bind multiply but weakly.
An alternate approach for combining the contributions of multiple binding sites, that of seeking the p-value of the sum of their log-likelihoods , is not employed by PhyloScan.
Combining evidence from more-distant sequences
As described above, a P intergenic p-value is generated for each sequence alignment of an intergenic region, but a true site's value may still be too weak to distinguish that site from the false positives in a vast genome. To address this problem, we combine this p-value with the p-values for the same intergenic region that come from sequence alignments of more distantly-related species. That is, we partition the input sequences for orthologous promoters into clades such that each clade is either an isolated sequence or contains sequences that can be reliably, multiply aligned; we compute the P intergenic value for each clade as above; and we combine these p-values using the formula of Bailey and Gribskov . When there are n such clades whose P intergenic values are P 1, P 2,..., P n then we compute:
This formula precisely computes the p-value for the product of n values drawn randomly from the interval [0, 1]. An example of this calculation is available in the Supplementary Materials [see Additional file 1].
PhyloScan allows a p-value cutoff α, which defaults to 0.05, such that sites in a user-specified clade of interest that are worse than this cutoff are not permitted to be strengthened by data from the other species via the combination process. This feature allows the user to concentrate on a single clade or species rather than the entire tree of species. Because of this cutoff, it is appropriate to modify the above formula for sites that survive the cutoff:
Utility of q-value over p-value
The p-value, the probability that a negative control would appear positive, must be used with great care because genomes are vast relative to regulatory sequence elements. For instance, in many other situations a p-value of 10-6 is considered excellent, but when there are on the order of 109 places where a transcription factor binding site is not likely to bind, such a "strong" p-value can leave us with 1,000 false positives – or even more, in the usual case that some of the biology has not been incorporated into the statistical model. Thus, to properly interpret a p-value, the researcher must be on guard to quantify the number of negative cases.
The q-value (or False Discovery Rate ) explicitly incorporates the vastness of the genome in the calculation. The q-value of a transcription factor binding site tells us the proportion of sites of that strength or better that we expect to be false positives. Under ideal circumstances, the researcher who chooses a q-value threshold of 0.001 expects only one in 1,000 of the reported sites to be a false positive regardless of the genome size. (However, because we do not pretend to have statistically modeled all the relevant biology, the false discovery rate will generally be higher than the specified threshold.)
Real data inputs
It is our belief that PhyloScan (and, e.g., MONKEY) are fairly robust to typical levels of error in these inputs, though further exploration is required to substantiate this claim.
Locating orthologous sequences
Genome sequence data and annotations were downloaded from the NCBI RefSeq database : Escherichia coli K12 (NC_000913.1), Salmonella enterica serovar Typhi (S. typhi)(NC_003198), Yersinia pestis CO92 (NC_003143), Haemophilus influenzae Rd (NC_000907), Vibrio cholerae El Tor (NC_002505 and NC_002506), Shewanella oneidensis MR-1 (NC_004347 and NC_004349), and Pseudomonas aeruginosa PA01 (NC_002516). Orthologs for each of the annotated E. coli genes were identified in each of the remaining six species, using INPARANOID v.1.35 . This program uses BLAST  to compare the complete set of predicted protein sequences from one genome with that of another, and identifies the reciprocal best hits. We set the parameters to use the BLOSUM62 matrix and a minimum bit score of 30, and we required that the alignment cover at least 50% of both proteins.
In the examples presented in this study, E. coli was the primary species of interest; we therefore identified a set of E. coli promoter-containing sequences by identifying each E. coli protein-coding gene (excluding 111 genes encoded on transposons or prophage elements) that has at least 20 bp of upstream intergenic sequence. By these criteria, there are 2379 E. coli intergenic regions of interest. Orthologous upstream intergenic-sequence data files were then generated for this set of 2379 E. coli regions, using the results from INPARANOID to identify orthologs, and the seven genome annotations to define intergenic boundaries. In the Supplementary Materials are a table with these data [see Additional file 2] and a caption for the table [see Additional file 1].
Among the species included in this study, only E. coli and S. typhi exhibit extensive homology (70% identity on average) in the promoter regions . The phylogenetic distance of two sequences that share this level of homology is 0.384, assuming the nucleotide substitution model of Jukes & Cantor  (and the value would be similar under a variety of more current models); thus, we assumed this phylogenetic distance between E. coli and S. typhi, and data from these two species are taken to form one clade for PhyloScan. Each of the remaining species formed a separate clade of unaligned sequence data, since these species do not exhibit sequence identity with E. coli or with each other .
Generally, we would combine sequences into a single clade if their pairwise phylogenetic distances were comparable to that between E. coli and S. typhi, or nearer.
Constructing multiple alignments
With only two closely related species in our set, we chose the Smith-Waterman  pairwise, gapped local alignment algorithm (implemented as BestFit in the Wisconsin Package Version 10.3, Accelrys Inc., San Diego, CA) to align their orthologous intergenic regions, using default parameters (match = 10.000; mismatch = -9.000; gap creation penalty = 50; gap extension penalty = 3). The alignment of E. coli and S. typhi orthologous upstream intergenic sequences resulted in 1662 unique aligned sequence pairs. The upstream intergenic sequences for an additional 836 E. coli genes that did not have orthologs in S. typhi remained. The combination of these two datasets (1662 + 836 = 2498) does not equal the above number of E. coli intergenic regions of interest (2379 sequences), due to the complication of divergently transcribed genes. Specifically, we observed that for some divergently transcribed genes in E. coli, the orthologous genes in S. typhi are not syntenic, thus S. typhi provided two separate intergenic regions for alignment to a single intergenic region of E. coli.
To perform the real-data tests, three databases representing the reference species clade were generated for scanning: (1) a database containing the 2379 E. coli intergenic regions of interest, (2) a database containing only E. coli data ("E. coli reduced"), where 1662 E. coli intergenic regions have been reduced in sequence space by alignment with S. typhi orthologous data plus an additional 836 E. coli sequences for which there was no orthologous S. typhi data, and (3) a database containing 1662 E. coli-S. typhi aligned orthologous intergenic regions plus an additional 836 E. coli sequences for which there was no orthologous S. typhi data.
Producing a phylogenetic tree
We constructed the phylogenetic tree for the more complicated, synthetic sequence data set using 16S rRNA gene data via MUSCLE  and PHYLIP , scaling tree branch lengths up by a factor of 13.5, as described above – see Synthetic Sequence Data in the Results section. A tree constructed in this manner is not definitive but should be sufficient for use with PhyloScan.
Obtaining binding site motif models
Generation of the weak synthetic sequence data
To test the sensitivity and specificity of PhyloScan when seeking binding sites that are weaker than E. coli Crp binding sites, we generated "1/2-strength" and "1/3-strength" Crp sites. The 1/2-strength Crp motif was designed to have an average information content per column that is half the average information content of the full-strength Crp motif; we did this by raising each probability of a nucleotide to its 0.637th power, with subsequent scaling so that the probabilities of the four nucleotides for any motif column sum to 1.0. Likewise, the 1/3-strength Crp sites were generated from a 1/3-strength Crp motif to give one-third the average information content, using an exponent of 0.507. See Figure 1 and its legend for more information.
We thank the Computational Molecular Biology and Statistics Core Facility at the Wadsworth Center, and William Thompson and Sean Conlan for helpful comments on the manuscript as well as throughout this project. This research was supported by Department of Energy grants DE-FG02-01ER63204 and DE-FG02-04ER63942 to GEL and LAM and by NIH grant 5K25HG003291 to LAN.
- Stormo GD: DNA Binding Sites: Representation and Discovery. Bioinformatics 2000,16(1):16–23.View ArticlePubMed
- Quandt K, Frech K, Karas H, Wingender E, Werner T: MatInd and MatInspector: New Fast and Versatile Tools for Detection of Consensus Matches in Nucleotide Sequence Data. Nucleic Acids Res 1995,23(23):4878–4884.View ArticlePubMed
- Hertz GZ, Hartzell GW 3rd, Stormo GD: Identification of Consensus Patterns in Unaligned DNA Sequences Known to be Functionally Related. Comput Appl Biosci 1990,6(2):81–92.PubMed
- Chen QK, Hertz GZ, Stormo GD: MATRIX SEARCH 1.0: A Computer Program that Scans DNA Sequences for Transcriptional Elements using a Database of Weight Matrices. Comput Appl Biosci 1995,11(5):563–566.PubMed
- Prestridge DS: SIGNAL SCAN 4.0: Additional Databases and Sequence Formats. Comput Appl Biosci 1996,12(2):157–160.PubMed
- Kim JT, Gewehr JE, Martinetz T: Binding Matrix: A Novel Approach for Binding Site Recognition. J Bioinform Comput Biol 2004,2(2):289–307.View ArticlePubMed
- Yellaboina S, Seshadri J, Kumar MS, Ranjan A: PredictRegulon: A Web Server for the Prediction of the Regulatory Protein Binding Sites and Operons in Prokaryote Genomes. Nucleic Acids Res 2004, 32:W318–320.View ArticlePubMed
- Osada R, Zaslavsky E, Singh M: Comparative Analysis of Methods for Representing and Searching for Transcription Factor Binding Sites. Bioinformatics 2004,20(18):3516–3525.View ArticlePubMed
- Schneider TD, Stormo GD, Gold L, Ehrenfeucht A: Information Content of Binding Sites on Nucleotide Sequences. J Mol Biol 1986,188(3):415–431.View ArticlePubMed
- Staden R: Methods for Calculating the Probabilities of Finding Patterns in Sequences. Comput Appl Biosci 1989,5(2):89–96.PubMed
- Neuwald AF, Liu JS, Lawrence CE: Gibbs Motif Sampling: Detection of Bacterial Outer Membrane Protein Repeats. Protein Sci 1995,4(8):1618–1632.View ArticlePubMed
- Moses AM, Chiang DY, Pollard DA, Iyer VN, Eisen MB: MONKEY: Identifying Conserved Transcription-Factor Binding Sites in Multiple Alignments Using a Binding Site-Specific Evolutionary Model. Genome Biol 2004,5(12):R98. [PubMed 15575972].View ArticlePubMed
- Bell SD, Cairns SS, Robson RL, Jackson SP: Transcriptional Regulation of an Archaeal Operon In Vivo and In Vitro. Mol Cell 1999,4(6):971–982.View ArticlePubMed
- Rodionov DA, Mironov AA, Gelfand MS: Conservation of the Biotin Regulon and the BirA Regulatory Signal in Eubacteria and Archaea. Genome Res 2002,12(10):1507–1516.View ArticlePubMed
- Studholme DJ, Pau RN: A DNA Element Recognised by the Molybdenum-Responsive Transcription Factor ModE is Conserved in Proteobacteria, Green Sulphur Bacteria and Archaea. BMC Microbiol 2003, 3:24.View ArticlePubMed
- Storey JD, Tibshirani R: Statistical Significance for Genomewide Studies. Proc Natl Acad Sci USA 2003,100(16):9440–9445.View ArticlePubMed
- Mironov AA, Koonin EV, Roytberg MA, Gelfand MS: Computer Analysis of Transcription Regulatory Patterns in Completely Sequenced Bacterial Genomes. Nucleic Acids Res 1999,27(14):2981–2989.View ArticlePubMed
- Panina EM, Mironov AA, Gelfand MS: Comparative Analysis of FUR Regulons in Gamma-Proteobacteria. Nucleic Acids Res 2001,29(24):5195–5206.View ArticlePubMed
- Panina EM, Vitreschak AG, Mironov AA, Gelfand MS: Regulation of Aromatic Amino Acid Biosynthesis in Gamma-Proteobacteria. J Mol Microbiol Biotechnol 2001,3(4):529–543.PubMed
- Rodionov DA, Mironov AA, Rakhmaninova AB, Gelfand MS: Transcriptional Regulation of Transport and Utilization Systems for Hexuronides, Hexuronates and Hexonates in Gamma Purple Bacteria. Mol Microbiol 2000,38(4):673–683.View ArticlePubMed
- Rodionov DA, Gelfand MS, Mironov AA, Rakhmaninova AB: Comparative Approach to Analysis of Regulation in Complete Genomes: Multidrug Resistance Systems in Gamma-Proteobacteria. J Mol Microbiol Biotechnol 2001,3(2):319–324.PubMed
- Laikova ON, Mironov AA, Gelfand MS: Computational analysis of the transcriptional regulation of pentose utilization systems in the gamma subdivision of Proteobacteria. FEMS Microbiol Lett 2001,205(2):315–322.View ArticlePubMed
- Rajewsky N, Socci ND, Zapotocky M, Siggia ED: The Evolution of DNA Regulatory Regions for Proteo-Gamma Bacteria by Interspecies Comparisons. Genome Res 2002,12(2):298–308.View ArticlePubMed
- Tan K, Moreno-Hagelsieb G, Collado-Vides J, Stormo GD: A Comparative Genomics Approach to Prediction of New Members of Regulons. Genome Res 2001,11(4):566–584.View ArticlePubMed
- McCue LA, Thompson W, Carmack CS, Ryan MP, Liu JS, Derbyshire V, Lawrence CE: Phylogenetic Footprinting of Transcription Factor Binding Sites in Proteobacterial Genomes. Nucleic Acids Res 2001,29(3):774–782.View ArticlePubMed
- McCue LA, Thompson W, Carmack CS, Lawrence CE: Factors Influencing the Identification of Transcription Factor Binding Sites by Cross-Species Comparison. Genome Res 2002,12(10):1523–1532.View ArticlePubMed
- About WebLogo[http://weblogo.berkeley.edu/]
- Halpern AL, Bruno WJ: Evolutionary Distances for Protein-Coding Sequences: Modeling Site-Specific Residue Frequencies. Mol Biol Evol 1998,15(7):910–917.PubMed
- Kimura M: A Simple Method for Estimating Evolutionary Rates of Base Substitutions through Comparative Studies of Nucleotide Sequences. J Mol Evol 1980,16(2):111–120.View ArticlePubMed
- Edgar RC: MUSCLE: multiple sequence alignment with high accuracy and high throughput. Nucleic Acids Res 2004,32(5):1792–1797.View ArticlePubMed
- Felsenstein J: [http://evolution.genetics.washington.edu/phylip.html]PHYLIP (Phylogeny Interface Package) 3.5c Seattle, WA: Department of Genetics, University of Washington 1993.
- Bailey TL, Gribskov M: Methods and Statistics for Combining Motif Match Scores. J Comput Biol 1998,5(2):211–221.View ArticlePubMed
- Berman BP, Nibu Y, Pfeiffer BD, Tomancak P, Celniker SE, Levine M, Rubin GM, Eisen MB: Exploiting Transcription Factor Binding Site Clustering to Identify Cis-Regulatory Modules Involved in Pattern Formation in the Drosophila Genome. Proc Natl Acad Sci USA 2002,99(2):757–762.View ArticlePubMed
- Li SL, Valente AJ, Qiang M, Schlegel W, Gamez M, Clark RA: Multiple PU.l Sites Cooperate in the Regulation of p40(phox) Transcription During Granulocytic Differentiation of Myeloid Cells. Blood 2002,99(12):4578–4587.View ArticlePubMed
- Newberg LA, Lawrence CE: Mammalian genomes ease location of human DNA functional segments but not their description. Stat Appl Genet Mol Biol 2004, 3:Article23.PubMed
- Efron B, Tibshirani R, Storey JD, Tusher V: Empirical Bayes Analysis of a Microarray Experiment. J Am Stat Assoc 2001,96(456):1151–1160.View Article
- The PhyloScan Hompage[http://bayesweb.wadsworth.org/PhyloScan]
- Neyman J: Molecular Studies of Evolution: A Source of Novel Statistical Problems. Statistical Decision Theory and Related Topics (Edited by: Gupta SS, Yackel J). New York, NY: Academic Press 1971, 1–27.
- Felsenstein J: Evolutionary Trees from DNA Sequences: A Maximum Likelihood Approach. J Mol Evol 1981,17(6):368–376.View ArticlePubMed
- Neuwald AF, Green P: Detecting Patterns in Protein Sequences. J Mol Biol 1994,239(5):698–712.View ArticlePubMed
- Frith MC, Spouge JL, Hansen U, Weng Z: Statistical Significance of Clusters of Motifs Represented by Position Specific Scoring Matrices in Nucleotide Sequences. Nucleic Acids Res 2002,30(14):3214–3224.View ArticlePubMed
- Pruitt KD, Maglott DR: RefSeq and LocusLink: NCBI Gene-Centered Resources. Nucleic Acids Res 2001, 29:137–140.View ArticlePubMed
- Remm M, Storm CE, Sonnhammer EL: Automatic clustering of orthologs and in-paralogs from pairwise species comparisons. J Mol Biol 2001,314(5):1041–1052.View ArticlePubMed
- Altschul SF, Madden TL, Schaffer AA, Zhang J, Zhang Z, Miller W, Lipman DJ: Gapped BLAST and PSI-BLAST: A New Generation of Protein Database Search Programs. Nucleic Acids Res 1997,25(17):3389–3402.View ArticlePubMed
- Jukes TH, Cantor C: Evolution of Protein Molecules. Mammalian Protein Metabolism (Edited by: Munro HM). New York, NY: Academic Press 1969, 3:21–132.
- Smith TF, Waterman MS: Comparison of biosequences. Adv Appl Math 1981, 2:482–489.View Article
- Salgado H, Gama-Castro S, Martinez-Antonio A, Diaz-Peredo E, Sanchez-Solano F, Peralta-Gil M, Garcia-Alonso D, Jimenez-Jacinto V, Santos-Zavaleta A, Bonavides-Martinez C, Collado-Vides J: RegulonDB (Version 4.0): Transcriptional Regulation, Operon Organization and Growth Conditions in Escherichia coli K-12. Nucleic Acids Res 2004,32(Database Issue):D303-D306. [PubMed 14681419].View ArticlePubMed
- Robison K, McGuire AM, Church GM: A Comprehensive Library of DNA-Binding Site Matrices for 55 Proteins Applied to the Complete Escherichia coli K-12 Genome. J Mol Biol 1998,284(2):241–254.View ArticlePubMed
- Thompson W, Rouchka EC, Lawrence CE: Gibbs Recursive Sampler: Finding Transcription Factor Binding Sites. Nucleic Acids Res 2003,31(13):3580–3585.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.