> there is work from Florida University(?) about using Markov chains to reason while taking probabilities into about.

You're talking about the work that Prof. Daisy Zhe Wang and her students are doing over at the DSR lab. Go gators!

[1] http://dsr.cise.ufl.edu/?page_id=250