This article proposes a genetic algorithm, the array histogram-based sampling algorithm (AHBSA), to assemble linear multidimensional forced-choice questionnaires (MFCQs), which are increasingly popular for measuring personality, with forced-choice items including any number of statements (block size). The algorithm also works for traditional multidimensional Likert and cognitive test forms, where items can be seen as having a block size of one. Real and simulated statement pools are used to evaluate AHBSA’s performance in terms of test reliability and running speed in assembling Likert forms and MFCQs with two (pair) and three (triplet) statements. Compared to mixed integer programming (MIP) and random assembly, AHBSA achieves as high or higher reliabilities under all conditions: in Likert forms, AHBSA reaches optimal solutions as MIP does, and in the MFCQs, AHBSA gains notable increases in reliabilities over MIP when the forms have no constraint on item direction (i.e., positively versus negatively keyed statements). AHBSA takes more time to converge than MIP. The findings and limitations are discussed, and suggestions for future work are provided.

Multidimensional forced-choice (MFC) tests are increasing in popularity but their construction is complex. The Thurstonian item response model (Thurstonian IRT model) is most often used to score MFC tests that contain dominance items. Currently, in a frequentist framework, information about the latent traits in the Thurstonian IRT model is computed for binary outcomes of pairwise comparisons, but this approach neglects stochastic dependencies. In this manuscript, it is shown how to estimate Fisher information on the block level. A simulation study showed that the observed and expected standard errors based on the block information were similarly accurate. When local dependencies for block sizes $>2$\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$>\,2$$\end{document} were neglected, the standard errors were underestimated, except with the maximum a posteriori estimator. It is shown how the multidimensional block information can be summarized for test construction. A simulation study and an empirical application showed small differences between the block information summaries depending on the outcome considered. Thus, block information can aid the construction of reliable MFC tests.