Markov process


Also found in: Thesaurus, Medical, Acronyms, Encyclopedia, Wikipedia.
ThesaurusAntonymsRelated WordsSynonymsLegend:
Noun1.Markov process - a simple stochastic process in which the distribution of future states depends only on the present state and not on how it arrived in the present state
Markoff chain, Markov chain - a Markov process for which the parameter is discrete time values
stochastic process - a statistical process involving a number of random variables depending on a variable parameter (which is usually time)
References in periodicals archive ?
Since the prognosis of each character depends only on the previous one, it is a Markov process and, hence, a Markov chain.
In this section we briefly introduce the basic concept of hidden Markov model, the process of Viterbi algorithm to solve the hidden states sequence, k-step Markov process.
t], t [greater than or equal to] 0} is a homogeneous Markov process taking values in a finite set S = {1, 2, 3, .
B)] of Markov process which models the buffer of the final length for one value of the parameter [u.
Sections 4 and 5 include the performance evaluation of the model under study, the modulated Markov process model, which takes into account real conditions such as non-saturated stations and heterogeneous traffic.
Instead, in our study we model the burst arrival process with an IDLE-ON process, which is the two-state Markov process shown in Fig.
We analyze the properties of the resulting piecewise deterministic Markov process, especially its trapping risk, and discuss for which groups of people insurance can reduce trapping probability.
With a similar distinction, Wurtzebach and Kim (1979) address costs prior to development completion using a Markov process, while Peiser (1984a), on land development, and MacFarlane (1995) opt for simulation.
2](t)) is a two-dimensional Markov process with state space
The standard definition of a Markov process is at odds with Deleuze's account of time in its most basic process (I would argue that this is also the case in terms of the third synthesis of time and Deleuze's concepts of caesura and eternal return, but that is beyond the scope of this essay--for a full account of these process see my Gilles Deleuze's Philosophy of Time: A Critical Introduction and Guide).