Determination of suitable permutation numbers in comparing independent group means: a monte carlo simulation study

Akkartal E., MENDEŞ M., MENDES E.

JOURNAL OF SCIENTIFIC & INDUSTRIAL RESEARCH, vol.69, no.6, pp.422-425, 2010 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 69 Issue: 6
  • Publication Date: 2010
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.422-425
  • Çanakkale Onsekiz Mart University Affiliated: Yes


In this study, suitable number of permutations were tried to be determined empirically for permutation test, one of which lalternatively used in analysis of variance (ANOVA). Random numbers were generated from chi(2) (3). distribution by simulation technique, and type 1 error rates were calculated with their standard errors. For k=2, 3 and 4, data were dealt with what is commonly faced in practice. Number of observation (n) in each group were taken to be 5, 10 and 15 (except for k = 2). Number of permutation changes with respect to k and n. For k=2, 3 and 4, required number of permutation was determined to be 15,000, 25,000 and 30,000 respectively. In general, there is great advantage of not allowing number of permutation under 10,000, if permutation tests are to be used in testing significance of differences of means of groups.