Let ζ be a Markov chain on a finite state space D, f a function from D to ℝd , and S n = ∑k=1 n f(ζk ). We prove an invariance theorem for S and derive an explicit expression of the limit covariance matrix. We give its exact value for p-reinforced random walks on ℤ2 with p = 1, 2, 3.