Statistical hypothesis testing is central to many scientific fields. Testing many hypothe-ses simultaneously is called multiple testing. The main concern in multiple testing, is toensure that most...Show moreStatistical hypothesis testing is central to many scientific fields. Testing many hypothe-ses simultaneously is called multiple testing. The main concern in multiple testing, is toensure that most of the rejected null hypotheses are indeed false, i.e., that the numberof incorrect rejections remains low. A major challenge in multiple testing is to accountfor the complex dependencies in the data. A powerful approach in this regard, arepermutation-based multiple testing methods. These methods make few distributionalassumptions. In fact, they often make only one assumption, called joint exchangeabil-ity. In this thesis we investigate the robustness of the methods to violations of thisassumption. We do this by means of simulations, where we focus on case-control data.We find that, while the theoretical literature always makes the mentioned assumption,it is often not necessary in practice. Thus, this thesis provides further evidence for thevalidity of these powerful methods in practice.Show less
Statistical hypothesis testing is central to many scientific fields. Testing many hypotheses simultaneously is called multiple testing. The main concern in multiple testing, is to ensure that most...Show moreStatistical hypothesis testing is central to many scientific fields. Testing many hypotheses simultaneously is called multiple testing. The main concern in multiple testing, is to ensure that most of the rejected null hypotheses are indeed false, i.e., that the number of incorrect rejections remains low. A major challenge in multiple testing is to account for the complex dependencies in the data. A powerful approach in this regard, are permutation-based multiple testing methods. These methods make few distributional assumptions. In fact, they often make only one assumption, called joint exchangeability. In this thesis we investigate the robustness of the methods to violations of this assumption. We do this by means of simulations, where we focus on case-control data. We find that, while the theoretical literature always makes the mentioned assumption, it is often not necessary in practice. Thus, this thesis provides further evidence for the validity of these powerful methods in practice.Show less
