We first characterize the automorphism groups of Hodge structures of cubic threefolds and cubic fourfolds. Then we determine for some complex projective manifolds of small dimension (cubic surfaces, cubic threefolds, and nonhyperelliptic curves of genus
), the action of their automorphism groups on Hodge structures of associated cyclic covers, and thus confirm conjectures made by Kudla and Rapoport in (Pacific J. Math. 260(2) (2012), 565–581).