14
Materials and Methods
Laptop - 1GB RAM, 1GHz CPU, Redhat Linux
Parallel Cluster - 1-2 GB RAM per CPU, Sorceror Linux
2.2
Methods
A quantitative experimental approach together with traditional computer science
methods such as prototyping and (parallel) algorithmic design has been used. We
applied statistical methods (briefly described below) for quantitative analysis.
Hypothesis testing
In order to test research hypotheses and say something about the significance of
empirical results we have applied statistical hypothesis tests. The most frequently
used have been the t-test together with output from 10-fold cross validation
experiments in order to compare the average value (in our work: classification
accuracy and computational performance), Cohen [1995]. In paper I where we
compared computational performance and classification accuracy between our
proposed classifier with other classifiers on several datasets, we used pairwise
t-tests on the experimental output from all applicable datasets in order to test
how the classifiers compared overall, Lange [1999].
Factorial Design
In order to test how parameters of the massively multiplayer online game sim-
ulator interacted and controlled the computational performance we used a full
factorial design, Montgomery [1997]. The result from the factorial design is shown
in paper D.