Extending Luo & Wolitzky (2024) to Persistent Markovian States: Belief-Robustness and the Cost of Persistence