- Research
- Open Access
- Published:
Finding the region of pseudo-periodic tandem repeats in biological sequences
Algorithms for Molecular Biology volume 1, Article number: 2 (2006)
Abstract
Summary
The genomes of many species are dominated by short sequences repeated consecutively. It is estimated that over 10% of the human genome consists of tandemly repeated sequences. Finding repeated regions in long sequences is important in sequence analysis.
We develop a software, LocRepeat, that finds regions of pseudo-periodic repeats in a long sequence. We use the definition of Li et al. [1] for the pseudo-periodic partition of a region and extend the algorithm that can select the repeated region from a given long sequence and give the pseudo-periodic partition of the region.
Availability
LocRepeat is available at http://www.cs.cityu.edu.hk/~lwang/software/LocRepeat
Background
Finding pseudo-periodic repeats (or tandem repeats) is an important task in biological sequence analysis [1–3]. The genomes of many species are dominated by short sequences repeated consecutively. It is estimated that over 10% of the human genome consists of tandemly repeated sequences. About 10–25% of all known proteins have some form of repeated structure ranging from simple homopolymers to multiple duplications of entire globular domains. An instance (originally from Jaitly et al. [2]) of a human tandem repeat appears below (Genbank:10120313):
CCTCCTCCTCCACCTCCTCCTCCTCCTCCTCCTCCTCCGCCTTCTCATCCTCCTCCACTT
CCTCCTCCTCCTCCTCCTCCCCTTCTCATCCTCCTCCTCTTCATCTACCC
This tandem repeat consists of 35 approximate copies of the repeated pattern CCT.
Variation in the pseudo-periodic repeats demonstrates biologically important information. Sensitive tools for finding those regions containing pseudo-periodic repeats are required in practice. Repeats occur frequently in biological sequences, but they may not be exact in many cases. If the repeats are exact, the problem can be easily solved from computation point of view. However, repeats are seldom exact in biological sequences. The errors in those repeats make it difficult to find regions of those repeats. Many measures and algorithms have been proposed.
Landau and Schmidt [4] studied the problem of finding the two consecutive copies in a sequence of length n such that the edit distance (a match costs 0 and a mismatch/indel costs 1) between the two copies is at most k. The running time of the algorithm is O(kn log k log(n/kL)). Schmidt [5] used weighted grid digraphs for finding all non-overlapping pairs of substrings (not necessarily consecutive) with the highest scores in a given string of length n. The algorithm can handle any score scheme. It requires O(n2 log n) time and Θ(n2) space. In both [4] and [5], only two copies of the pattern are considered.
Measures for finding repeats
Three measures can be used to give partitions of repeated regions.
Quasiperiodicty
Wan and Song proposed a measure in which all the repeated copies (except the last one) have the same length [6]. For this measure, a linear time and space algorithm was given [6].
Approximate periods
Sim et al. [7] introduced a notion of approximation periods (approximate period) using edit distance or relative edit distance. The problem in general is defined as follows: given a string x, find a repeated pattern p such that x can be partitioned as x = p1p2...p
k
and 
is minimized. Here d(p, p
l
) is the relative edit distance which is 
the edit distance, where L = (|p| + |p
l
|)/2 is the average length of the two strings p and p
l
. Note that, the normalization of the edit distance is important for finding repeated patterns since otherwise, one can give a partition in which each pattern has one letter and the edit distance is at most 1 (small). The problem in general is NP-hard [7]. When the repeated pattern p is assumed to be a substring of x, The problem can be solved in O(|x|4) time. Note that the second measure is more general than the first since it allows insertions and deletions. Both measures in [7] and [6] use the bottleneck function that finds the repeated pattern p and assumes that each copy p
i
in the long string is close to the repeated pattern p, i.e., d(p
i
, p) ≤ δ and δ is minimized. However, in biological sequences, copies of the repeated patterns may change gradually so that some repeats in the region may have very little in common. For example, it is well-known that the N-terminal non-globular region of Thermus thermophilus seryl-tRNA synthetase (PDB:1SRY) [1, 8] has weak 7-residue repeats. See Table 1. The similarity score between two consecutive patterns is calculated using Blosum62 matrix and the gap penalty is set to be -4. The repeated patterns gradually changes from the 4-th unit LDLEALLA to the 13-th unit KEARLE. The average similarity score for the nine pairs of consecutive patterns is 4.56. But the similarity score between the 4-th unit and the 8-th unit is -11. In this case, the algorithms based on the bottleneck function may fail to find the multiple repeats.
Pseudo-periodic repeats
Li et al. [1] gave the first measure that allows gradual changes of patterns and changes of pattern lengths in the region. The repeats they defined are called the pseudo-periodic repeats. Given a repeated region (a string) x and a partition X = s1s2...s k , the pseudo periodic score is
where d(·) is the edit distance, |s i | is the length of s i , and c is a factor that control the penalty of the two ends of the partition. Li et al. [1] gave a O(|x|2) algorithm to compute an optimal partition of a given repeated region x. It was shown that the pseudo-periodic score can accurately give partitions for tandem repeated regions, where the repeated patterns are weakly similar.
Example: The example is from [1]. The sequence of the LbH domain of members of the LpxA family consists of the imperfect tandem repetition of hexapeptide units [9–11]. These imperfect tandem repeats (partitions) have been accurately detected by the algorithm using the pseudo periodic score [1]. (See Table 2).
In sequence analysis, we may have a long sequence s and only a substring t (or a few substrings) of s contains the consecutive repeats. The problem here is to find out the substring t and give an optimal pseudo-periodic partition. We call this problem the local pseudo-periodic problem. In this paper, we define the maximization version of the pseudo-periodic partition and develop an algorithm that solves the local pseudo-periodic problem in O(n2) time, where n is the length of the input sequence s.
Definitions
In this section, we first give a definition of the pseudo-periodic partition of a string that is originally proposed in Li et al. [1]. We then give a definition of the local pseudo-periodic partition of a string.
Pseudo-periodic Partition
Let s = a1a2...a n be a string of length n. A partition π(s) = {s1, s2, ..., s k } of s is a set of substrings of s such that s = s1s2...s k (s i 's are also called repeats). When s is clear, we use π instead of π(s). Π(s) denotes the set of all partitions of s. Let s i and si+1be two strings. The similarity measure μ(s i , si+1) between s i and si+1is the maximum alignment value for s i and si+1. For any two letters (possibly spaces) x and y, μ(x, y) is the similarity score between the two letters. For example, one can use the following score scheme I: a match costs 1, a mismatch costs -1, and an insertion or deletion costs -1. Here we choose to use maximization version since for protein sequences, there are popular similarity matrices, e.g., PAM matrix.
Let c be a negative constant. We call 
the granularity factor. Let Δ denotes a space in an alignment. In this paper, we assume that > μ(x, Δ) for any letter x in the given sequence.
Let us consider the following example. s
A
= s1s2s3s4s5 and π(s
A
) = {s1, s2, s3, s4, s5}, where s1 = aaa, s2 = aat, s3 = att, s4 = ttt and s5 = tta. The self-alignment of this partition is show in Figure 1. The value of the self-alignment is 
, where |s1| and |s5| are the penalty scores for the two segments s1 and s5 aligned to spaces.
The alignment for π(s A ).
Note that the score for insertion and deletion would be different from the granularity factor
. If there is a gap at the right end of the alignment between s4 and s5, there is ambiguity in the calculation of the self-alignment value. Therefore, we need a more precise definition for the value of the self-alignment corresponding to a partition.
Let s = s1s2...s
k
be the string and π(s) = {s1, s2, ..., s
k
}. |s| denotes the length of the string. pre(s, i) is the length-i prefix of s and suf(s, i) is the length-i suffix of s. Note that the gap at the right end of the self-alignment of s only appears in the segments sk-1and s
k
. Denote by s
e
the suffix sk-1s
k
of s. We can designate that only the last i letters in s
e
are mapped to spaces with score each, for 1 ≤ i ≤ |s
e
|. Now let us consider the remain part pre(s
e
, |s
e
| - i) of s
e
. There are two cases: (1) If i ≥ |s
k
|, pre(s
e
, |s
e
| - i) is a prefix of sk-1and is optimally aligned with s
k
. (2) If i < |s
k
|, pre(s
e
, |s
e
| - i) contains sk-1and a prefix of s
k
. In this case, sk-1is optimally aligned with s
k
and the letters in the prefix of s
k
are scored as μ(x, Δ) each.
For a partition π of s and a fixed i, 1 ≤ i ≤ |s
e
|, let V(π, c, i) be the value of the self-alignment such that s1 is mapped to spaces with score each, s
j
is optimally aligned with sj+1for j = 1, 2, ..., k -2, pre(s
e
, |s
e
| - i) is scored according to the above two cases, and the last i letters in s
e
are mapped to spaces with score each. We have
In V(π, c, i), the alignment between s1s2...sk-2pre(s
e
, |s
e
| - i) and s2s3...s
k
is called the middle alignment. The value of the self-alignment of π is defined as 
.
For example, let s
B
= s1s2s3 and π(s
B
) = {s1, s2, s3}, where s1 = aaaa, s2 = aaat and s3 = aaa. We use score scheme I and c = -1. The valid value of i is 1, 2, ..., 7 since |s2s3| = 7. For i = 5 ≥ |s3|, pre(s2, 2) is optimally aligned with s3, s1 and suf(s2s3, 5) is scored as (Figure 2(a)). So V(π(s
B
), c, 5) = μ(s1, s2) + μ(pre(s2, 2), s3) + × (|s1| + 5) = 
. For i = 2 < |s3|, s2 is optimally aligned with s3, pre(s3, 1) is scored as μ(x, Δ) and suf(s3, 2) is scored as (Figure 2(b)). In this case, V(π(s
B
), c, 2) = μ(s1, s2) + μ(s2, s3) + μ(x, Δ) × 1 + × (|s1| + 2) = 0. For i = 4, at the right ends of the optimal self-alignment of π(s
B
) (Figure 2(c)), there are 4 letters that match spaces. The last letter t in s2 matches a space at the right end of the alignment. The assumption that > μ(x, Δ) forces this column to have score instead of μ(t, Δ) to maximize V(π, c). We have V(π(s
B
), c) = V(π(s
B
), c, 4) = 1. For i = 1, 3, 6, 7, the values are lower than V(π(s
B
), c) = V(π(s
B
), c, 4) = 1.
The alignment for π(s B ).
Let Π(s) be the set of all possible partitions of s. B c (s) = maxπ∈Π(s)V(π, c) is the optimal V(·) value of partitions. A partition π q = {s1, s2, ..., s k } of s is called the pseudo-periodic partition of s if B c (s) = V(π q , c). In Li et al. [1], it was demonstrated that the numerical measure B c (s) (in fact, the minimization version) is sensitive for partitioning s into repeats that allow the gradual changes of patterns and changes of pattern lengths.
In practice, we are given a long string s. We want to find a region (substring) t of s that contains pseudo-periodic repeats. Once the region t is found, we want to get the pseudo-periodic partition of t. The mathematical problem is defined as follows:
Local pseudo-periodic partition problem
Given a string s, find a substring t (the local optimal pseudo-periodic region) of s such that
where Sub(s) is the subset of all substrings of s.
The algorithm
Let s be the given string. We want to find a substring t of s with the maximum self-alignment value . Let s[1, j] be the substring of s that consists of the first j letters. Informally, we use w(i, j) to denote the maximum self-alignment value of a suffix t
j
of s[1, j] such that there are i letters at the right end of the self-alignment of t
j
that are aligned with spaces and scored as . Note that, the right end of the self-alignment of t
j
could contain more than i spaces. However, only the last i spaces are scores as each and the rest of them are scored as the score for μ(x, Δ).
Let T j be the set of all suffixes of s[1, j]. For a substring t of s and an integer i, Π(t, i) = {π(t)|π(t) ∈ Π(t) and |tk-1t k | ≥ i}, where tk-1, t k are the last two repeats in π(t). We define
to be the maximum V(·, c, i) value of all the partitions in Π(t, i), where t is a substring in T j . To compute w(i, j) using dynamic programming method, we first consider the boundary values of w(i, j). We set w(0, j) = -∞ since we do not allow suf(tk-1t k , i) to be empty. Note that, by definition, i ≤ j.
Lemma 1 For a sequence s of length n, w(j, j) = c·j for 1 ≤ j ≤ n.
Proof. For a partition π(t) = {t1, t2, ..., t
k
} satisfying t ∈ T
j
and π(t) ∈ Π(t, j), from the definition of Π(t, j), |tk-1t
k
| ≥ j. Since t is a suffix of s[1, j] and |t| ≥ |tk-1t
k
| ≥ j, we have t = s[1, j] and 1 ≤ k ≤ 2. Consider the self alignment of π(t) such that the last j letters in t are mapped to spaces with score . Two cases arise. Case 1: k = 1 and t = t1 = s[1, j]. In this case, the middle alignment is empty. Thus, V(π(t), c, j) = × (|t1| + j) = c·j. Case 2: k = 2 and t = t1t2 = s[1, j]. In this case, the middle alignment is the alignment between |t2| spaces and t2. By the assumption that > μ(Δ, x), V(π(t), c, j) = |t2| × μ(Δ, x) + × (|t1| + j) <c·j. □
From the above analysis, the initial and boundary values are
w(0, j) = -∞, w(j, j) = c·j (2)
Theorem 2 For a sequence s of length n and 2 ≤ j ≤ n, 1 ≤ i <j,
Proof. Consider the partition π(t) = {t1, t2, ..., t k } such that t ∈ T j , π(t) ∈ Π(t, i) and V(π(t), c, i) = w(i, j). We analyze the value of V(π(t), c, i) based on different cases.
case 1. π(t) has only one repeat. We have |t| = |t1| = i and the middle alignment is empty. Therefore V(π(t), c, i) = × (|t1| + i) = c·i.
case 2. π(t) has k ≥ 2 repeats. In this case, the middle alignment is not empty since it contains t
k
. The last column in the middle alignment has three configurations: (a) the last column contains two letters s[j - i] and s[j], (b) the last column contains a space and the letter s[j], (c) the last column contains the letter s[j - i] and a space. For sub-case (a), if we take away the last letter s[j] from the self alignment of π(t), we can get a self alignment of π'(t'), where t' ∈ Tj-1, π'(t') ∈ Π(t', i) and V(π'(t'), c, i) = w(i, j - 1). By comparing the two self alignment, we have V(π(t , c, i = V(π'(t'), c, i) + μ(s[j - i], s[j]) = w(i, j - 1) + μ(s[j - i], s[j]). For sub-case (b), if we take away the last letter s[j] and space aligned with s[j] from the self alignment of π(t), we can get a self alignment of π'(t'), where t' ∈ Tj-1, π'(t') ∈ Π(t', i - 1) and V(π'(t'), c, i) = w(i - 1, j - 1). Notice that in the end of the self alignment of π'(t'), there are only i - 1 letters mapped to spaces with score , and there is one more letter in the self alignment of π(t) mapped to spaces with score . Thus, V(π(t), c, i) = w(i - 1, j - 1) + μ(Δ, s[j]) + . For sub-case (c), π(t) ∈ Π(t, i + 1). We can impose that the alignment of the letter s[j - i] and the space is scored as , not μ(s[j - i], Δ). From V(π(t), c, i + 1) = w(i + 1, j), we have V(π(t), c, i) = w(i + 1, j) + μ(s[j - i], Δ) -
Based on Theorem 2, a dynamic programming algorithm is designed. Let n be the length of the input sequence s. We compute w(i, j) in the order shown below:
for j = 1 to n do
for i = j downto 1 docompute w(i, j) based on Theorem 2.
Obviously, the time complexity is O(n2), where n is the length of the whole string. A standard backtracking process allows us to find the local optimal pseudo-periodic region t.
The following example illustrates the algorithm. Let s = CAGAGT. We set c = -2 and use the following score scheme: a match costs 10, a mismatch costs -10, and an insertion or a deletion costs -10. The table constructed by using the dynamic programming algorithm is shown in Figure 3. The table is constructed in from the top to the bottom. For every row in the table, the w(i, j)'s are computed from left to right. From the table, it is easy to see that the maximum value of w(i, j) is w(2, 5) = 16. From the maximum value w(2, 5) = 16, we know that the local optimal pseudo-periodic region t is a suffix of s[1, 5] = CAGAG and there are 2 letters aligned with spaces and scored as at the right end of the self alignment of the local optimal pseudo-periodic region t. From w(2, 5), we can backtrack w(2, 5) → w(2, 4) → w(2, 3) and stop at w(2, 3) since w(2,3) gets its value from c·i indicating the first segment of the partition of t ends at 3-th letter in s and the length of the segment is 2. Thus, we get t = AGAG. From the self alignment, it is easy to get the partition of π(t) = {AG, AG}.
Dynamic programming algorithm and local alignment for s = CAGAGT.
The space complexity required is also O(n2) if we are not careful. However, we can release the space whenever they are no longer useful. Thus, only two columns, are required for the computation. For each of the two columns, we use two arrays: one array stores the value of w(i, j) and the other array stores the starting position of the subsequence t that maximizes w(i, j). Therefore, the space complexity is O(n) for computing all w(i, j)'s. After w(i, j)'s are computed, we know the substring t that leads to the optimal w value. Therefore, we can reconstruct the alignment for t in 
time and space, where n1 is the length of t, the repeated region. If n1 is still big, we can use the standard technique in [12] to reduce the space to O(n1) by doubling the computation time for reconstructing the alignment of t.
In practice, a sequence may contain more than one repeated region. To find all the repeated regions, we can select the best k values of w(i, j)'s for some pre-defined value k. Each backtracking gives a repeated region. Another way to set a threshold for the value of w(i, j) and select all w(i, j)'s with value greater than the threshold.
Implementation
We have implemented the algorithm using Visual C++ 6.0 and Windows XP. The software is called LocRepeat and has a user-friendly GUI (See Figure 4). Another version without GUI that works for Linux is also available.
LocRepeat interface.
LocRepeat accepts three kinds of sequence: DNA, RNA and Protein. The user can either click 'New Data' button to directly input the sequence at the input area, or click 'Input Data from File' button to input a sequence from a file. The user can click 'Set Parameters' button to set parameters, such as granularity factor, gap penalty and similarity score matrix. After the sequence is input and the parameters are set, click the 'Start' button to begin the computation.
Experiment results
We have done experiments to test the speed and sensitivity of the software.
Speed Testing
The time complexity of the algorithm is O(n2). To test the speed in practice, we use arbitrarily generated DNA and protein sequences. We ran our software on a PC with Pentium 4 3.4G CPU and 1GB memory, the result is shown in Table 3. We can see that for long DNA and protein sequences, our software can get the result in short time. For example, if the length of the sequence is 10000, it takes about 10.8 seconds and 26.9 seconds for DNA sequences and protein sequences, respectively. In some real applications, the length of sequences could be much longer than 10000. In this case, one can cut the long sequence into several short pieces and find out the repeated regions for each piece. If a region covers two pieces, then we can re-cut that segment to get that region.
Sensitivity testing using real data
We applied LocRepeat to the DNA sequence gene PRNP which contains tandem repeats (GenBank:M13667). The length of the sequence is 2420. We find the local optimal pseudo-periodic region [215,327], that contains 5 pseudo-periodic units (Table 4). The pseudo-periodic region misses the first several sites of the tandem repeats, but the region and the partitions show the tandem repeats correctly.
We also applied LocRepeat to the protein sequence LGR6 (Swiss-Prot: Q9HBX8). The length of the sequence is 828. We use PAM120 as the similarity score matrix and find the local units (Table 5).
In conclusion, the algorithm presented in this paper offers the possibility to find regions of pseudo-periodic repeats in a long sequence.
References
Li L, Jin R, Kok P, Wan H: Pseudo-periodic partitions of biological sequences. Bioinformatics. 2004, 20: 295-306.
Jaitly D, Kearney PE, Lin G, Ma B: Methods for reconstructing the history of tandem repeats and their application to the human genome. Journal of Computer and System Sciences. 2002, 65 (3): 494-507.
Tang M, Waterman M, Yooseph S: Zinc finger gene clusters and tandem gene duplication. Proceedings of the Fifth Annual International Conference on Computational Biology, April 22–25 2001. 2001, 297-304. Montreal, Canada, ACM
Landau GM, Schimidt JP: An algorithm for approximate tandem repeats. Proceedings of the Fourth Annual Symposium on Combinatorial Pattern Matching. 1993, 120-133. New York, LNCS 684, Springer-Verlag
Schmidt JP: All highest scoring paths in weighted grid graphs and their application to finding all repeats in strings. SIAM Journal on Computing. 1998, 27: 972-992.
Wan H, Song E: Quasiperiodic biosequences and modulo incidence matrices. Proceedings of the 16th International Parallel and Distributed Processing Symposium. 2002, 280-
Sim JS, Iliopoulos CS, Park K, Smyth WF: Approximate period of strings. Theoretical Computer Science. 2001, 262: 557-568.
Biou V, Yaremchuk A, Tykalo M, Cusack MS: The 2.9 Å crystal structure of T. thermophilus seryl-tRNA synthetase complexed with tRNA(Ser). Science. 1994, 263: 1404-1410.
Vaara M: Eight bacterial proteins, including UDP-N-acetylglucosamine acyltransferase (LpxA)and three other transferases of Escherichia coli, consist of a six-residue periodicity theme. FEMS Microbiology Letter. 1992, 76: 249-254.
Vuorio R, Harkonen T, Tolvanen M, Vaara M: The novel hexapeptide motif found in the acyltransferases LpxA and LpxD of lipid A biosynthesis is conserved in various bacteria. FEBS Letter. 1994, 337: 289-292.
Raetz CRH, Roderick SL: A left-handed parallel beta helix in the structure of UDP-N -acetylglucosamine acyltransferase. Science. 1995, 270: 997-1000.
Myers EW, Miller W: Optimal alignments in linear space. Computer Applications in the Biosciences. 1988, 4: 11-17.
Acknowledgements
We thank the referees for their helpful suggestions. This work is fully supported by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China [Project No. CityU 1070/02E].
Author information
Authors and Affiliations
Corresponding authors
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Liu, X., Wang, L. Finding the region of pseudo-periodic tandem repeats in biological sequences. Algorithms Mol Biol 1, 2 (2006). https://doi.org/10.1186/1748-7188-1-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1748-7188-1-2
Keywords
- Tandem Repeat
- Suffix
- Similarity Score
- Repeated Region
- Dynamic Programming Algorithm