# Efficient procedures for the numerical simulation of mid-size RNA kinetics

- Iddo Aviram
^{1}, - Ilia Veltman
^{1}, - Alexander Churkin
^{1}and - Danny Barash
^{1}Email author

**7**:24

https://doi.org/10.1186/1748-7188-7-24

© Aviram et al.; licensee BioMed Central Ltd. 2012

**Received: **26 October 2009

**Accepted: **22 August 2012

**Published: **7 September 2012

## Abstract

### Motivation

Methods for simulating the kinetic folding of RNAs by numerically solving the chemical master equation have been developed since the late 90's, notably the programs Kinfold and Treekin with Barriers that are available in the Vienna RNA package. Our goal is to formulate extensions to the algorithms used, starting from the Gillespie algorithm, that will allow numerical simulations of mid-size (~ 60–150 nt) RNA kinetics in some practical cases where numerous distributions of folding times are desired. These extensions can contribute to analyses and predictions of RNA folding in biologically significant problems.

### Results

By describing in a particular way the reduction of numerical simulations of RNA folding kinetics into the Gillespie stochastic simulation algorithm for chemical reactions, it is possible to formulate extensions to the basic algorithm that will exploit memoization and parallelism for efficient computations. These can be used to advance forward from the small examples demonstrated to larger examples of biological interest.

### Software

The implementation that is described and used for the Gillespie algorithm is freely available by contacting the authors, noting that the efficient procedures suggested may also be applicable along with Vienna's Kinfold.

## Background

The RNA molecule, once considered as an intermediate step between DNA and proteins, has drawn much attention in recent years. Discoveries relating to its unique capabilities to prominently participate in gene regulation have motivated even more the concerted efforts to understand its folding and structural arrangement at several levels, both at the level of tertiary structure and that of secondary structure. The functional form of single stranded RNA molecules frequently requires a specific tertiary structure, but the scaffold for this structure is provided by secondary structural elements which are hydrogen bonds within the molecule. The four building blocks of RNAs are A,C,G,U and the base pairings among them form the secondary structure. This leads to several recognizable "domains" of secondary structure like hairpin loops, bulges and internal loops. Although the functional role of the RNA molecule in more detail is related to its three-dimensional structure, the RNA secondary structure is experimentally accessible and in many interesting cases may contain substantial important information to shed light on the relationship between structure and function. In general, RNA folding is thought to be hierarchical in nature [1, 2], whereby a stable secondary structure forms first and subsequently there is a refinement to the tertiary fold. Thus, RNA conformational rearrangements that will be mentioned in the discussion can often be studied by examining their secondary structure, while keeping in mind the importance of tertiary structure.

When attempting to simulate the complete folding event, the time needed to reach equilibrium can become very long and it is computationally too expensive to consider the kinetics of the tertiary structure by using a molecular dynamics approach. Therefore, beyond the static view of RNA folding using energy minimization methods to predict the final state of the folding, a time-dependent view is desired in order to extract information on the folding kinetics. To do so practically, it is imperative to simulate the complete folding event at the level of RNA secondary structure. For that, the chemical master equation can be solved numerically by a stochastic simulation algorithm, as was first shown in that context in [3, 4]. Potentially, important information can be extracted from such a simulation that considers the suboptimal solutions, which were dealt with before in refs [5, 6] in an informative manner. The motivation and importance from the biochemical perspective for this type of computational simulations, also describing the experimental observables that can be extracted from the calculations, can be found in [7]. A recent comprehensive review of the field is available in [8]. Other computational simulation approaches for RNA kinetics besides Kinfold [4] that are beyond the regime of the mid-size RNA kinetics described herein include RNAkinetics [9], Kinefold [10], and Kinwalker [11] for large RNAs. To further motivate the time-dependent view, it was shown in [12] that RNA genes not only encode information about their functional structure, but also on their co-transcriptional folding pathway (and, e.g. transient structures). More recently, kinetically trapped RNA secondary structures were thermodynamically analysed in [13] and an efficient method for computing folding pathways between RNA secondary structures was developed in [14] that follows the work of [15] on determining an optimal folding pathway and barrier energies introduced in [4, 16]. For an overview on RNA folding kinetics and the importance of RNA folding intermediates, some recent review articles are available in [17–21].

## Methods

The complete folding event is governed by the chemical master equation [8]. In order to introduce the concept behind the reduction of the time-dependent RNA folding problem to that of stochastic chemical kinetics describing the time evolution of a well-stirred chemically reacting system, the Appendix follows closely references [22, 23] in summarizing the formulation leading to Gillespie's Stochastic Simulation Algorithm (SSA).

Our goal is to model the problem of RNA secondary structure folding in such a way that it can be reduced to the algorithm with the pseudocode given in the Appendix. Therefore, we will describe a reduction into the Stochastic Simulation Algorithm (SSA). The rationale behind this way of formulating the problem is that after the reduction it becomes easier to devise an efficient version of the SSA for RNA folding kinetics, with multiple runs performed in parallel (see SSA version II and discussion thereafter).

Using the Vienna's notations as can be found in [4, 24], the RNA sequence in time *t* will be represented as two strings. Both are of the size of the RNA sequence. One is over the character set {A,U,G,C} also providing what the order of the nucleotides is. It will be called from here on the 'sequence string'. The other is a string of balanced parentheses over the character set {., (,)}, known as "dot-bracket" notation, describing the secondary structure of the RNA sequence (dot means no base-pairing, and each open and close parentheses represent a base pairing). It will be named here the 'structure string'. We shall notice that while the former does not change over time, the latter does.

In attempting to simulate over time the secondary-structure changes of a certain RNA sequence, let us denote ${S}_{R}\left(t\right)$ as the random variable that contains what is the structure string of the RNA structure at time t, when the sequence string is known to be R. In the settings of this simulation, ${S}_{R}\left(0\right)$is set to be the string $"\dots ,\cdots ,\dots "$, which is the initial folding open state without any base pairings. Our goal is to predict what ${S}_{R}\left(t\right)$ is for some parameter *t*. In particular, we would like to predict how much time it will take for an RNA sequence to fold into its 'optimal' state, defined as the structure whose Gibbs free energy is minimal. To formalize that, we will denote the optimal structure for the sequence R as Op(R). Thus, our simulation goal is to find the smallest *t* for which${S}_{R}\left(t\right)=Op\left(R\right)$.

Having defined our goal, we will introduce some more notations to explain the reduction. ${F}_{R}=\left\{{s}_{R}^{1},{s}_{R}^{2},\dots ,{s}_{R}^{M\left(R\right)}\right\}$ will be the finite set (whose size is denoted by M(R)) of the feasible structure strings for the sequence string R, feasible meaning taking into account biological constraints. Now, for some 1 ≤ i ≤ M(R), a single step move of ${s}_{R}^{i}$ is a structure string ${s}_{R}^{j}\in {F}_{R}$ such that ${s}_{R}^{j}$ and ${s}_{R}^{i}$ differ only by omitting a pair of parentheses, adding a pair, or flipping a pair in the way that is well described in [4]. We will define the neighbourhood of ${s}_{R}^{i}$, denoted ${N}_{R}^{i}=\left\{{s}_{R}^{{i}_{1}},{s}_{R}^{{i}_{2}},\dots ,{s}_{R}^{{i}_{L}}\right\}$, as the subset of ${F}_{R}$ which can be reached from ${s}_{R}^{i}$within a single step, unless ${s}_{R}^{i}=OP\left(R\right)$, in which case we will define ${N}_{R}^{i}$ to be an empty set.

$\text{A}=\left[{a}_{\mathit{ij}}\right]$ is the transition probability matrix, with $\Delta G={G}_{j}^{0}-{G}_{i}^{0}$ when considering the rate of a transition to *j*, being at *i*. ${G}_{i}^{0}$is the Gibbs free energy of *i* for each secondary structure *i* for the SSA algorithm version 1 below; for the SSA algorithm version 2 that follows, it is the sum of the free energies over an n-tuple of secondary structures. We shall note that in our implementation, we used Vienna's own program called RNAeval to get the Gibbs free energy values for the RNA structures. In addition, similar to Vienna's Kinfold, a Kawasaki step can be used instead of the Metropolis step in the equation above. We can observe that we now have a proper input problem that fits Gillespie's SSA algorithm. Thus, we can use the following algorithm:

### SSA for RNA folding, version I – simulating one RNA-structure fold

- 1.
The current structure is ${s}_{R}^{i}$ for some 1 ≤ i ≤ M(R). While stopping condition ${s}_{R}^{i}$ equals to Op(R) is not met:

- 2.
Calculate ${N}_{R}^{i}$.

- 3.
Evaluate for each member of ${N}_{R}^{i}$ its probability factor, and the total sum of the factors. We define ${a}_{R}^{k}$ as the probability factor of ${s}_{R}^{i}\to {s}_{R}^{k}$ if ${s}_{R}^{k}\in {N}_{R}^{i}$ and 0 otherwise. We will also denote ${a}_{\mathit{sum}}$ as the total sum of all the factors.

- 4.
Draw two independent uniform (0,1) random numbers: ξ

_{1}and ξ_{2}. - 5.
Set j to be the smallest integer satisfying $\sum _{k=1}^{j}{a}_{R}^{k}}>{\xi}_{1}{a}_{\mathit{sum}}\text{.$

- 6.
Set $\tau =\frac{ln\left(1/{\xi}_{2}\right)}{{a}_{\mathit{sum}}}\text{.}$

- 7.
Set the current structure to be ${s}_{R}^{j}$, and the time to be (t + τ). Return to step 1.

At this point, a beneficial observation is that we can actually expand the model to run this way many simulations simultaneously. If we have different RNA sequences with the sequence strings of ${R}_{1},{R}_{2},{R}_{3},\dots ,{R}_{n}$ as in all possible single point mutations, we will have the possible moves of ${s}_{R1}^{1}\to {N}_{R1}^{1},{s}_{R1}^{2}\to {N}_{R1}^{2},\dots ,{s}_{R1}^{M\left(R1\right)}\to {N}_{R1}^{M\left(R1\right)}\text{,}$${s}_{R2}^{1}\to {N}_{R2}^{1},{s}_{R2}^{2}\to {N}_{R2}^{2},\dots ,{s}_{R2}^{M\left(R2\right)}\to {N}_{R2}^{M\left(R2\right)},\dots ,{s}_{\mathit{Rn}}^{1}\to {N}_{\mathit{Rn}}^{1},{s}_{\mathit{Rn}}^{2}\to {A}_{\mathit{Rn}}^{2},\dots \text{,}$. Let ${s}_{R1}^{i1},{s}_{R2}^{i2},\dots ,{s}_{\mathit{Rn}}^{\mathit{in}}$ be the current states of the n RNA sequences, then we are left with the feasible moves of ${s}_{R1}^{i1}\to {N}_{R1}^{i1},{s}_{R2}^{i2}\to {N}_{R2}^{i2},\dots ,{s}_{\mathit{Rn}}^{\mathit{in}}\to {N}_{\mathit{Rn}}^{\mathit{in}}$.

Using these formulations, we suggest a somewhat optimized and generalized variation of the aforementioned algorithm. In the following version, the indices *i* and *j* will not anymore correspond directly to an explicit $\left[{a}_{\mathit{ij}}\right]$ matrix instance of the Metropolis step's equation. Instead, although we still are doing a Metropolis step, it will correspond to a much larger matrix which is defined only implicitly.

### SSA for RNA folding, version II – simulating numerous RNA-structure folds

- 1.
The initial structure array is ${S}_{\mathit{arr}}=<{s}_{{R}_{1}}^{{i}_{1}},{s}_{{R}_{2}}^{{i}_{2}},{s}_{{R}_{3}}^{{i}_{3}},\dots ,{s}_{{R}_{n}}^{{i}_{n}}>$.

- 2.
Calculate${N}_{\mathit{arr}}=<{N}_{{R}_{1}}^{{i}_{1}},{N}_{{R}_{2}}^{{i}_{2}},{N}_{{R}_{3}}^{{i}_{3}},\dots ,{N}_{{R}_{n}}^{{i}_{n}}>$.

- 3.
Evaluate for each member of ${N}_{{R}_{j}}^{{i}_{j}}\in {N}_{\mathit{arr}}$ its probability factor, and the total sum of the factors. We denote by ${a}_{{R}_{i}}^{{k}_{i}}$ as the factor related to the k'th member of ${N}_{{R}_{j}}^{{i}_{j}}$, and ${a}_{\mathit{sum}}$ the total sum of all the factors related to ${N}_{{R}_{1}}^{{i}_{1}},{N}_{{R}_{2}}^{{i}_{2}},{N}_{{R}_{3}}^{{i}_{3}},\dots ,{N}_{{R}_{n}}^{{i}_{n}}\text{.}$ Having all the factors ordered by some total order, we will obtain a series $\left({a}_{k}\right)$. Each member of $\left({a}_{k}\right)$ corresponds to a specific member of ${N}_{\mathit{arr}}$, and we will denote this mapping to the corresponding ${N}_{\mathit{arr}}$ indices by $\left({m}_{k}\right)$.

- 4.
While ${S}_{\mathit{arr}}$ is not equal to$<Op\left({R}_{1}\right),Op\left({R}_{2}\right),Op\left({R}_{3}\right),\dots ,Op\left({R}_{n}\right)>$:

- 5.
Draw two independent uniform (0,1) random numbers: ξ

_{1}and ξ_{2}. - 6.
Set j to be the smallest integer satisfying $\sum _{k=1}^{j}{a}_{k}}>{\xi}_{1}{a}_{\mathit{sum}$. We shall denote j* and k* as the indices for which ${a}_{j}={a}_{k*}^{j*}\text{.}$

- 7.
Set $\tau =\frac{ln\left(1/{\xi}_{2}\right)}{{a}_{\mathit{sum}}}\text{.}$

- 8.
Set the ${m}_{j}$'th component of ${S}_{\mathit{arr}}$ to be ${s}_{R*}^{j*}$, the time to be (t + τ).

- 9.
Recalculate the ${m}_{j}$'th neighborhood (with its corresponding factors, ${a}_{{R}_{i}}$), and update ${N}_{\mathit{arr}}$ as well as $\left({a}_{k}\right)$ and ${a}_{\mathit{sum}}$. Return to step 4.

Repetitions of the same experiment, i.e. setting ${R}_{1}={R}_{2}={R}_{3}=\dots ={R}_{n}$, are useful to estimate the smallest *t* for which ${S}_{R}\left(t\right)=Op\left(R\right)$. This information is, as told at first, what we sought for, and what we actually implemented. In this special case, memoization might be useful in calculating the expensive step 9 above. Because folding patterns tend to be very repetitive, even a relatively small-sized memoization might save a significant amount of computation time. We implemented a simple memoization and were able to run it on short sequences (up to 40 nt). We measured running times with a memoization that memorizes the neighborhoods of 10,000 different structures. The allocated RAM space was large enough not to require swapping. We obtained a significant speedup: 43 seconds with memoization vs. 684 seconds without memoization for a sequence of size 35, with 100 simultaneous simulations, and approximately 6 seconds with memoization against 60 seconds without memoization for a sequence of size 20, with 1000 simultaneous simulations. When implementing memoization, keeping in memory all neighborhood sets possible is not feasible since their number grows too fast in respect to the size of the sequence. But because most of the transitions occur in the basins of the local minima, in terms of the energy values of the structures, keeping a fixed number of sets may suffice to decrease the computation time. We suggest the use of a cache-like LRU (least recently used) algorithm as mentioned above for deciding which information is likely to be re-usable among all neighboring sets and probabilities ever computed during a run. In addition, interesting ideas can be developed to make the memoization more efficient along the lines of calculating useful measures in order to assess the "folding progress" of all molecules. Since folding times may well be distributed over several orders of magnitude, one may want to let those molecules that have "fallen behind" given some time to catch up, such that all molecules fold at approximately the same speed without large time deviations that are problematic because of having to wait for the slowest molecules to terminate. A simple and practical candidate for such a measure is the base pair distance between the starting and stopping structures. In addition, we claim that the strategy outlined in the SSA for RNA folding, version II above is better tailored for biological problems in which it is not necessary to wait for all molecules to reach their target structure. For such type of problems, there are several advantages to our approach. First, when a particular molecule gets folded, it frees its memoization resources and also reduces the size of the probability space in the sense that it makes the transitions of the rest of the molecules more probable to be the next to occur.

Aside of memoization, an advantage of the approach of the SSA for RNA folding version II presented above over a repetition of single structure simulations is that we can stop the simulation after an elapsed simulation time τ, and extract the folding time of all the experiments that were already folded in time which is the most τ. Moreover, taking this approach, no single long-lasting simulation can delay the intermediate results of the overall run. It is well on our interest that the molecules that are last to be folded will not constitute a bottleneck for the whole computation. In our settings, if we could use an anytime computation approach in which the probability is revealed gradually, what we might give up by not waiting for the last molecules to terminate is just the extent of a long probability tail. If the whole computation is stopped before all molecules have terminated their folding, it may again be useful to calculate their base pair distances to the stopping structures in order to predict the amount of error by not letting all molecules terminate their folding. For some problems the error might be small enough or the computation can be resumed some more until the approximation is satisfactory for the particular problem's needs. It should also be noted that if the sequence strings ${R}_{1},{R}_{2},{R}_{3},\dots ,{R}_{n}$ are different mutants of the same wildtype then the ideas discussed above can still be used to considerably reduce the computation time.

## Results

Here below, we demonstrate our SSA implementation on two "toy problem" examples. Our program that we have been developing is similar in style to Vienna's Kinfold [4], but has been built in principle to have the ability of exploiting memoization and efficiency considerations as proposed above.

The sequences used for illustration in Figures 1, 2, 3, 4, 5, 6 are:

Example 1: SSA version I, R = ` GAGCAUCCGUGUAACCAUUCACACUGCUC '

Example 2: SSA version I, R = ` GGGGGGGGGGGGAAAUCCCCCCCCCCCC '

## Discussion

As a possible application of biological significance, the time-dependent approach discussed above is suggested for beneficial use in the problem of deleterious mutation prediction. To elaborate on this problem, a common way to detect deleterious mutations in the secondary structure of RNAs is to look for mutations that may cause a conformational rearrangement to occur. It was noted in [27] that there is some probability that even a single mutation can substantially alter the RNA secondary structure. Experimentally, this was observed in the spliced leader of *Leptomonas collosoma*[28], in RNA viruses [29, 30], and in some other biological systems. Another very recent finding of biological importance is the existence of disease-associated Single Nucleotide Polymorphisms (SNPs) called "RiboSNitches" that have an RNA secondary structural consequence that results in a disease phenotype [31]. Computationally, even before the added motivation as a consequence of the latter disease related finding, this gave rise to a procedure for detecting deleterious mutations using RNA folding predictions numerous times [32]. Each time, relevant programs from an energy minimization package such as RNAfold from the Vienna RNA package [24, 33] or Zuker's mfold [34, 35] can be used. In these packages, expanded energy rules [36] that were derived from an independent set of experiments are incorporated into the folding prediction algorithm. While the folding prediction problem described above is the most fundamental problem in RNA bioinformatics, the RNA mutation prediction problem is a sub-problem that uses the former multiple times, for various mutation combinations. Historically, initial works for the mutation prediction problem can be traced back to [37, 38] and have been substantially revived in [32, 39]. The first publicly available program for the RNA mutation prediction problem that takes into account only single-point mutation predictions was called RNAMute [40, 41]. It uses the Vienna RNA package in its core. Subsequently, a web server dealing with similar issues was put forth called RDMAS [42]. There are also some computationally challenging issues in the mutation prediction problem [43], mainly in the generalization to multiple-point mutations that can become computationally heavy if a 'brute-force' strategy of calculating all possible mutations is used without devising any unique approach. There have been various suggestions on how to reduce the number of mutations simulated or make the computations more efficient, for example [44–46]. In general, neither the original RNAMute [41] nor RDMAS [42] can handle multiple-point mutations. Consequently, RNAMute [41] was extended to MultiRNAMute [44] and based on the approach of [45], the web servers RNAmutants [47] and later corRna [48] were developed. A web server for MultiRNAMute was worked out in [49]. There is, however, one common feature that should be taken into account when considering all of the programs dealing with RNA deleterious mutation predictions. Because several single point mutations inserted to the wildtype sequence can bring about to the same secondary structure, oftentimes there is a degeneracy in the mutations that is needed to be addressed. Any mutation prediction method for the purpose of conformational rearrangement in the secondary structure should therefore aim to report in each step (i.e., one-mutation, two-mutations, etc.) several mutation possibilities, not only a single one. If the method only reports a single possible mutation in each step, it probably means that a computational efficiency consideration was taken that may neglect many good candidate mutations that are conformationally rearranging just as well and will lead to the same secondary structure. Therefore, in order to fundamentally solve the degeneracy of mutations leading to the same structure, we suggest to perform for each one a time-dependent calculation and check how smooth the folding occurs in time, to discriminate those mutation candidates that get stuck in a local optimum for a while during the folding in time. This is quite an intensive calculation for sequences that are beyond "toy problems", leading to a computational challenge from the numerical standpoint. It is also of considerable interest to check whether there is a correlation between the kinetic calculation and the static information obtained by performing energy minimization without taking into account what happens during the folding event. In order not to lose reliability, we suggest to consider all single point mutation combinations, and decide which one is the most likely to occur without getting trapped in a local minimum by using a time-dependent approach.

## Conclusions

The significance of the initial development of efficient procedures described here can be divided into several items. First, the time-dependent folding is what takes place within the RNA molecule, and the static view of RNA structure only at the beginning and end may not be sufficient or complete in many cases. Experimental approaches to measure folding kinetics in detail, such as temperature jump experiments or single molecular methods [7], can be employed to check the computational model and predictions, in turn, can be pivotal to RNA rational design. Developing efficient numerical methods for the time-dependent folding simulation is therefore, by itself, an important goal. Here, we embarked on the stochastic approach, noting that if at all possible to achieve with practical computation time then one should definitely consider deterministic approaches [50] for the simulations of biologically relevant examples. Another direction for reducing computational cost is by an efficient exploration of discrete energy landscapes, which was developed in a recent work [51] by introducing a sampling method that allows for a fast yet accurate estimation of the transition probabilities between macrostates when coarse graining of the state space is used [4, 16, 50, 52, 53]. Second, a time-dependent approach to contribute in deleterious mutation prediction is suggested, which is still an open problem of considerable biological interest in a variety of RNA systems. For example, point mutations performed on an RNA virus such as HCV can alter virus replication [30] or lead to a dramatic reduction in translation initiation [29]. Development of efficient time-dependent simulations can well assist from the predictive standpoint in such efforts.

## Appendix

The last equation is known as the chemical master equation. It is a set of linear ordinary differential equations (ODEs), one ODE for each possible state of the system. Solution of each of the equations at time t is a real number giving the probability of the system being in that particular state at time t. X(t) is the state vector, X(0) is the initial condition, and the quantity P(x,t) is the probability that X(t) = x. The inputs to the equation are the chemical reactions and their propensity function ${a}_{k}\left(X\left(t\right)\right)$. An illustrative example of how this equation is applied for studying the Michaelis-Menten model system is available in [23]. In order to solve the chemical master equation for practical cases, a stochastic simulation algorithm was devised, also known as the Gillespie algorithm [22], by simulating the changes in the system as they evolve in time. Because single steps are treated, the following quantities are introduced:

p(τ,j|x,t) is the probability that reaction j happens in the time interval [t,t + τ] given that X(t) = x.

p(τ,0|x,t) is the probability that no reaction happens in the time interval [t,t + τ] given that X(t) = x.

It is assumed that p(τ,0|x,t) and p(dτ,0|x,t + τ) are independent. It follows that: $\begin{array}{l}P(\tau +d\tau ,0|x,t)=P(\tau ,0|x,t)*P(d\tau ,0|x,t+\tau )=P(\tau ,0|x,t)\left(1-{\displaystyle \sum _{k=1}^{M}{a}_{k}\left(x\right)d\tau}\right)\\ \iff \frac{P\left(\tau +d\tau ,0|x,t\right)-P\left(\tau ,0|x,t\right)}{d\tau}=-{a}_{\mathit{sum}}(x)P(\tau ,0|x,t),where{a}_{\mathit{sum}}={\displaystyle \sum _{k=1}^{M}{a}_{k}\left(x\right)}\\ \stackrel{dt\to 0}{\Rightarrow}P(\tau ,0|x,t)={e}^{-{a}_{\mathit{sum}}\left(x\right)\tau}\end{array}$And, since: $P\left(\tau ,j|x,t\right)=P\left(\tau ,0|x,t\right){a}_{j}\left(x\right)d\tau $Then $\begin{array}{l}P(\tau ,j|x,t)={a}_{j}(x){e}^{-{a}_{\mathit{sum}}\left(x\right)\tau}\\ \iff P(\tau ,j|x,t)=\frac{{a}_{j}\left(x\right)}{{a}_{\mathit{sum}}\left(x\right)}{a}_{\mathit{sum}}(x){e}^{-{a}_{\mathit{sum}}\left(x\right)\tau}\end{array}$The last equation shows that $P\left(\tau ,j|x,t\right)$ can be written as the product of two individual density functions:

Next reaction index ${a}_{j}\left(x\right)/{a}_{\mathit{sum}}\left(x\right)$ corresponds to a discrete random variable: pick one of the reactions with the rule that the chance of picking the *j* th reaction is proportional to the propensity function ${a}_{j}\left(x\right)$.

Time until next reaction ${a}_{\mathit{sum}}\left(x\right){e}^{-{a}_{\mathit{sum}}\left(x\right)\tau}$ is the density function for a continuous random variable with an exponential distribution. These exponential random variables arise universally in descriptions of the time elapsing between unpredictable events.

The resulting algorithm for solving the master equation using the S tochastic S imulation A lgorithm (SSA, or the Gillespie algorithm) can now be described with the following pseudocode:

## SSA for chemical reactions

- 1.
Evaluate ${\left\{{a}_{k}\left(x\left(t\right)\right)\right\}}_{k=1}^{M}$ and ${a}_{\mathit{sum}}={\displaystyle \sum _{k=1}^{M}{a}_{k}\left(x\left(t\right)\right)}\text{.}$

- 2.
Draw two independent uniform (0,1) random numbers: ξ

_{1}and ξ_{2}. - 3.
Set j to be the smallest integer satisfying $\sum _{k=1}^{M}{a}_{k}\left(x\left(t\right)\right)}>{\xi}_{1}{a}_{\mathit{sum}}\left(x\left(t\right)\right)\text{.$

- 4.
Set $\tau =\frac{ln\left(1/{\xi}_{2}\right)}{{a}_{\mathit{sum}}\left(x\left(t\right)\right)}$

- 5.
Set x(t + τ) = x(t) + ν

_{j}and update t to t + τ - 6.
If no stopping condition is met, return to step 1.

This is the basic algorithm for simulating chemical reactions that is described in more detail in [22, 23], and has been used as well for simulating RNA folding kinetics [4].

## Declarations

### Acknowledgements

The research was partially supported by the Lynn and William Frankel Center for Computer Sciences at Ben-Gurion University.

## Authors’ Affiliations

## References

- Brion P, Westhof E: Hierarchy and dynamics of RNA folding. Annu Rev Biophys Biomol Struct. 1997, 26: 113-137. 10.1146/annurev.biophys.26.1.113PubMedView ArticleGoogle Scholar
- Tinoco I, Bustamante C: How RNA Folds. J Mol Biol. 1999, 293 (2): 271-281. 10.1006/jmbi.1999.3001PubMedView ArticleGoogle Scholar
- Flamm C, Hofacker IL, Stadler PF: RNA In Silico: The Computational Biology of RNA Secondary Structures. Adv Complex Syst. 1999, 2: 65-90. 10.1142/S0219525999000059View ArticleGoogle Scholar
- Flamm C, Fontana W, Hofacker IL, Schuster P: RNA Folding at Elementary Step Resolution. RNA. 2000, 6 (3): 325-338. 10.1017/S1355838200992161PubMedPubMed CentralView ArticleGoogle Scholar
- Wuchty S, Fontana W, Hofacker IL, Schuster P: Complete suboptimal folding of RNA and the stability of secondary structures. Biopolymers. 1999, 49 (2): 145-165. 10.1002/(SICI)1097-0282(199902)49:2<145::AID-BIP4>3.0.CO;2-GPubMedView ArticleGoogle Scholar
- Zuker M: On finding all suboptimal foldings of an RNA molecule. Science. 1989, 244: 48-52. 10.1126/science.2468181PubMedView ArticleGoogle Scholar
- Vieregg JR, Tinoco I: Modeling RNA Folding Under Mechanical Tension. Mol Phys. 2006, 104 (8): 1343-1352. 10.1080/00268970500525986PubMedPubMed CentralView ArticleGoogle Scholar
- Flamm C, Hofacker IL: Beyond Energy Minimization: Approaches to the Kinetic Folding of RNA. Monatsh Chem. 2008, 139 (4): 447-457. 10.1007/s00706-008-0895-3View ArticleGoogle Scholar
- Danilova LV, Pervouchine DD, Favorov AV, Mironov AA: RNAKinetcs: A Web Server that Models Secondary Structure Kinetics of an Elongating RNA. J Bioinform Comput Biol. 2006, 4 (2): 589-596. 10.1142/S0219720006001904PubMedView ArticleGoogle Scholar
- Xayaphoummine A, Bucher T, Isambert H: Kinefold Web Server for RNA/DNA Folding Path and Structure Prediction Including Pseudoknots and Knots. Nucleic Acids Res. 2005, 33: 605-610. 10.1093/nar/gki166View ArticleGoogle Scholar
- Geis M, Flamm C, Wolfinger MT, Hofacker IL, Middendorf M, Mandl C, Stadler PF, Thurner C: Folding Kinetics of Large RNAs. J Mol Biol. 2008, 379 (1): 160-173. 10.1016/j.jmb.2008.02.064PubMedView ArticleGoogle Scholar
- Meyer IM, Miklós I: Co-transcriptional Folding is Encoded within RNA Genes. BMC Mol Biol. 2004, 5: 10. 10.1186/1471-2199-5-10PubMedPubMed CentralView ArticleGoogle Scholar
- Lorenz WA, Clote P: Computing the Partition Function for Kinetically Trapped RNA Secondary Structures. PLoS One. 2011, 6 (1): e16178. 10.1371/journal.pone.0016178PubMedPubMed CentralView ArticleGoogle Scholar
- Dotu I, Lorenz WA, Van Hentenryck P, Clote P: Computing Folding Pathways Between RNA Secondary Structures. Nucleic Acids Res. 2010, 38 (5): 1711-1722. 10.1093/nar/gkp1054PubMedPubMed CentralView ArticleGoogle Scholar
- Morgan S, Higgs P: Barrier Heights Between Ground States in a Model of RNA Secondary Structure. J Phys A Math Gen. 1998, 31: 3153-3170. 10.1088/0305-4470/31/14/005View ArticleGoogle Scholar
- Flamm C, Hofacker IL, Stadler PF, Wolfinger MT: Barrier Trees of Degenerate Landscapes. Z Phys Chem. 2002, 216: 155-173. 10.1524/zpch.2002.216.2.155View ArticleGoogle Scholar
- Al-Hashimi H, Walter NG: RNA Dynamics: It is about Time. Curr Opin Struct Biol. 2008, 18: 321-329. 10.1016/j.sbi.2008.04.004PubMedPubMed CentralView ArticleGoogle Scholar
- Shcherbakova I, Mitra S, Laederach A, Brenowitz M: Energy Barriers, Pathways, and Dynamics During Folding of Large, Multidomain RNAs. Curr Opin Chem Biol. 2008, 12: 655-666. 10.1016/j.cbpa.2008.09.017PubMedPubMed CentralView ArticleGoogle Scholar
- Chen SJ: RNA Folding: Conformational Statistics, Folding Kinetics, and Ion Electrostatics. Ann Rev Biophys. 2008, 37: 197-214. 10.1146/annurev.biophys.37.032807.125957View ArticleGoogle Scholar
- Isambert H: The Jerky and Knotty Dynamics of RNA. Methods. 2009, 49: 189-196. 10.1016/j.ymeth.2009.06.005PubMedView ArticleGoogle Scholar
- Woodson SA: Compact Intermediates in RNA Folding. Ann Rev Biophys. 2010, 39: 61-77. 10.1146/annurev.biophys.093008.131334View ArticleGoogle Scholar
- Gillespie DT: Stochastic Simulation of Chemical Kinetics. Annu Rev Phys Chem. 2007, 58: 35-55. 10.1146/annurev.physchem.58.032806.104637PubMedView ArticleGoogle Scholar
- Higham DJ: Modeling and Simulating Chemical Reactions. SIAM Rev. 2008, 50 (2): 347-368. 10.1137/060666457View ArticleGoogle Scholar
- Hofacker IL, Fontana W, Stadler PF, Bonhoeffer LS, Tacker M, Schuster P: Fast Folding and Comparison of RNA Secondary Structures. Monatsh Chem. 1994, 125: 167-188. 10.1007/BF00818163View ArticleGoogle Scholar
- Kirkpatrick S, Gelatt CD, Vecchi MP: Optimization by simulated annealing. Science. 1983, 220: 671-680. 10.1126/science.220.4598.671PubMedView ArticleGoogle Scholar
- Metropolis N, Rosenbluth AW, Rosenbluth MN, Teller AH, Teller E: Equations of State Calculations by Fast Computing Machines. J Chem Phys. 1953, 21 (6): 1087-1092. 10.1063/1.1699114View ArticleGoogle Scholar
- Schuster P, Fontana W, Stadler PF, Hofacker IL: From Sequences to Shapes and Back: A Case Study in RNA Secondary Structures. Proc R Soc Lond B Biol. 1993, 255 (1344): 279-284.View ArticleGoogle Scholar
- LeCuyer KA, Crothers DM: Kinetics of an RNA Molecular Switch. Proc Natl Acad Sci. 1994, 91: 3373-3377. 10.1073/pnas.91.8.3373PubMedPubMed CentralView ArticleGoogle Scholar
- Tang S, Collier AJ, Elliott RM: Alterations to both the primary and predicted secondary structure of stem-loop IIIc of the Hepatitis C Virus 1b 5' untranslated region (5' UTR) lead to mutants severely defective in translation which cannot be complemented in trans by the wild-type 5' UTR sequence. J Virol. 1999, 73: 2359-2364.PubMedPubMed CentralGoogle Scholar
- You S, Stump DD, Branch AD, Rice CM: A cis-acting replication element in the sequence encoding the NS5B RNA-dependent RNA polymerase is required for Hepatitis C Virus RNA replication. J Virol. 2004, 78: 1352-1366. 10.1128/JVI.78.3.1352-1366.2004PubMedPubMed CentralView ArticleGoogle Scholar
- Halvorsen M, Martin JS, Broadaway S, Laederach A: Disease-Associated Mutations that Alter the RNA Structural Ensemble. PLoS Genet. 2010, 6 (8): e1001074. 10.1371/journal.pgen.1001074PubMedPubMed CentralView ArticleGoogle Scholar
- Barash D: Deleterious Mutation Prediction in the Secondary Structure of RNAs. Nucleic Acids Res. 2003, 31 (22): 6578-6584. 10.1093/nar/gkg872PubMedPubMed CentralView ArticleGoogle Scholar
- Hofacker IL: Vienna RNA Secondary Structure Server. Nucleic Acids Res. 2003, 31: 3429-3431. 10.1093/nar/gkg599PubMedPubMed CentralView ArticleGoogle Scholar
- Zuker M, Stiegler P: Optimal Computer Folding of Large RNA Sequences Using Thermodynamics and Auxiliary Information. Nucleic Acids Res. 1981, 9 (1): 133-148. 10.1093/nar/9.1.133PubMedPubMed CentralView ArticleGoogle Scholar
- Zuker M: Mfold Web Server for Nucleic Acid Folding and Hybridization Prediction. Nucleic Acids Res. 2003, 31: 3406-3415. 10.1093/nar/gkg595PubMedPubMed CentralView ArticleGoogle Scholar
- Mathews DH, Sabina J, Zuker M, Turner DH: Expanded sequence dependence of thermodynamic parameters improves prediction of RNA secondary structure. J Mol Biol. 1999, 288: 911-940. 10.1006/jmbi.1999.2700PubMedView ArticleGoogle Scholar
- Shapiro BA: An Algorithm for Comparing Multiple RNA Secondary Structures. Comput Appl Biosci. 1988, 4: 387-393.PubMedGoogle Scholar
- Margalit H, Shapiro BA, Oppenheim AB, Maizel JV: Detection of common motifs in RNA secondary structures. Nucleic Acids Res. 1989, 17 (12): 4829-4845. 10.1093/nar/17.12.4829PubMedPubMed CentralView ArticleGoogle Scholar
- Barash D: Second Eigenvalue of the Laplacian Matrix for Predicting RNA Conformational Switch by Mutation. Bioinformatics. 2004, 20 (12): 1861-1869. 10.1093/bioinformatics/bth157PubMedView ArticleGoogle Scholar
- Churkin A, Barash D: Structural Analysis of Single-Point Mutations Given an RNA Sequence: A Case Study with RNAMute. EURASIP J Appl Signal Process Spec Issue Bioinformatics. 2006, 56246: 1-7.View ArticleGoogle Scholar
- Churkin A, Barash D: RNAMute: RNA Secondary Structure Mutation Analysis Tool. BMC Bioinforma. 2006, 7: 221-10.1186/1471-2105-7-221. 10.1186/1471-2105-7-221View ArticleGoogle Scholar
- Shu W, Bo X, Liu R, Zhao D, Zheng Z, Wang S: RDMAS: a web server for RNA deleterious mutation analysis. BMC Bioinforma. 2006, 7: 404-10.1186/1471-2105-7-404. 10.1186/1471-2105-7-404View ArticleGoogle Scholar
- Barash D, Churkin A: Mutational Analysis in RNAs: Comparing Programs for RNA Deleterious Mutation Prediction. Brief Bioinformatics. 2010, 12: 104-114.PubMedView ArticleGoogle Scholar
- Churkin A, Barash D: An Efficient Method for the Prediction of Deleterious Multiple-Point Mutations in the Secondary Structure of RNAs Using Suboptimal Folding Solutions. BMC Bioinforma. 2008, 9: 222-10.1186/1471-2105-9-222. 10.1186/1471-2105-9-222View ArticleGoogle Scholar
- Waldispühl J, Devadas S, Berger B, Clote P: Efficient Algorithms for Probing the RNA Mutation Landscape. PLOS Computational Biology. 2008, 4 (8): e1000124. 10.1371/journal.pcbi.1000124PubMedPubMed CentralView ArticleGoogle Scholar
- Waldispühl J, Ponty Y: An Unbiased Adaptive Sampling Algorithm for the Exploration of RNA Mutational Landscapes Under Evolutionary Pressure. Proceedings of the 15th Annual International Conference on Research in Computational Molecular Biology (RECOMB 2011). 2011, 501-515.Google Scholar
- Waldispühl J, Devadas S, Berger B, Clote P: RNAmutants: A Web Server to Explore the Mutational Landscape of RNA Secondary Structures. Nucleic Acids Res. 2009, 1 (37): W281-W286.View ArticleGoogle Scholar
- Lam E, Kam A, Waldispühl J: CorRna: A Web Server for Predicting Multiple-Point Deleterious Mutations in Structural RNAs. Nucleic Acids Res. 2011, 39: W160-W166. 10.1093/nar/gkr358PubMedPubMed CentralView ArticleGoogle Scholar
- Churkin A, Gabdank I, Barash D: The RNAmute Web Server for the Mutational Analysis of RNA Secondary Structures. Nucleic Acids Res. 2011, 39: W92-W99. 10.1093/nar/gkr207PubMedPubMed CentralView ArticleGoogle Scholar
- Wolfinger MT, Svrcek-Seiler AW, Flamm C, Hofacker IL, Stadler PF: Efficient Computation of RNA Folding Dynamics. J Phys A Math Gen. 2004, 37: 4731-4741. 10.1088/0305-4470/37/17/005View ArticleGoogle Scholar
- Mann N, Klemm K: Efficient Exploration of Discrete Energy Landscapes. Phys Rev E. 2011, 83: 011113.View ArticleGoogle Scholar
- Tang X, Thomas S, Tapia L, Giedroc DP, Amato NM: Simulating RNA Folding Kinetics on Approximated Energy Landscapes. J Mol Biol. 2008, 381 (4): 1055-1067. 10.1016/j.jmb.2008.02.007PubMedView ArticleGoogle Scholar
- Hofacker IL, Flamm C, Heine C, Wolfinger MT, Scheuermann G, Stadler PF: BarMap: RNA Folding on Dynamic Energy Landscapes. RNA. 2010, 16 (7): 1308-1316. 10.1261/rna.2093310PubMedPubMed CentralView ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.