Similarly, Zhao discussed the Markovian
behavior of PU and a partially observable decision framework to maximize the throughput of CR system .
The name semi-Markov stems from the fact that the process is only assumed to be Markovian
from decision point to decision point, which conveniently allows for existing dynamic programming results to apply at the level of decisions (or action choices).
For instance, in , the authors studied the global stability of coupled nonlinear systems with Markovian
switching by graph theory; in , Zhang et al.
Spohn, "Kinetic equations from Hamiltonian dynamics: Markovian
limits," Reviews of Modern Physics, vol.
The performance analysis of such bursty and correlated type of the arrival (service) processes may be done through some analytically tractable processes, namely, Markovian
arrival process (C-MAP) and Markovian
service process (C-MSP); see Lucantoni et al.
To the best of our knowledge, there is no article that considers [H.sub.[infinity]] filtering problem for multiagent systems with Markovian
switching topologies and network-induced delay based on event-triggered strategy.
Cao, "Stability analysis of markovian
jump stochastic BAM neural networks with impulse control and mixed time delays," IEEE Transactions on Neural Networks and Learning Systems, vol.
Due to the random link failures, variation meeting the need and sudden environmental disturbances, some dynamical systems could be modeled as Markovian
switching systems, which are starting with a rapid development [21-23].
This type of process conforms to the Markovian
model of improvisation in the sense that the "actor's creative choice is determined by the probabilities of succession that accompany the semiotic act that immediately precedes it." Now, such a type of performance is not an easy task.
The researchers came to these conclusions by using an approach called pair-wise sequential Markovian
(ii) it extends from the analysis of the Markovian
queue with two heterogeneous servers studied by Yue et al.
Sakthivel, "Non-fragile synchronization control for Markovian
jumping complex dynamical networks with probabilistic time-varying coupling delays," Asian Journal of Control, vol.