![]() In psychological assessment, Ferguson designed a sequential mastery test using the SPRT methodology as early as 1969. In some disciplines of psychology, the SPRT has already enjoyed great popularity for many years. We provide guidance for navigating these design decisions based on individual preferences and simulation-based design analyses. Our simulations indicate that when deciding on a sequential design within a unified sequential testing framework, researchers need to balance the needs of test efficiency, robustness against model misspecification, and appropriate uncertainty quantification. ![]() We demonstrate that the two methods use the same mechanisms for evidence monitoring and error control, and that differences in efficiency between the methods depend on the exact specification of the statistical models involved, as well as on the population truth. ![]() We show that although the two methods have different philosophical roots, they share many similarities and can even be mathematically regarded as two instances of an overarching hypothesis testing framework. Here, we compare two sequential hypothesis testing procedures that have recently been proposed for use in psychological research: Sequential Probability Ratio Test (SPRT Psychological Methods, 25(2), 206–226, 2020) and the Sequential Bayes Factor Test (SBFT Psychological Methods, 22(2), 322–339, 2017). As soon as sufficient information has been obtained, data collection is terminated. In a sequential hypothesis test, the analyst checks at multiple steps during data collection whether sufficient evidence has accrued to make a decision about the tested hypotheses.
0 Comments
Leave a Reply. |