[ English translation ]   [ Swedish original ]

# Results of the Survey

The program MathMoon (version 0.3.1) was tested at the Nybo school (Tibro, Sweden) in May 2005. The pupils were given this questionnaire (in Swedish), which contains questions regarding the program as a whole, whether it was fun playing, the difficulty and the graphics. The results are presented below.

## Respondents

The survey was conducted among 69 pupils in grades 7 to 9 (approximately 13 to 16 years old). Pupils from the sixth grade were also supposed to participate, but they have not tested the program yet. 33 boys and 36 girls answered, most of them in the seventh grade.

### Number of boys and girls in different ages

Boys Girls Total 20 20 40 3 5 8 10 11 21

## The program as a whole

All in all the pupils thought that it was a good program. The pupils in seventh grade liked the program significantly better than those in the ninth, which (considering that the program is intended for the fifth and sixth grades) seems quite natural. Every fifth pupil in the seventh grade even thinks that the program is "very good".

Very good Pretty good Pretty bad Very bad The program was: 8 26 5 1 0 7 1 0 2 10 4 5

The girls liked the program somewhat better than the boys, and hardly any girls think the program was "very bad". One reason why the program was "very bad" was, as some of the boys put it: "no shoot-'em-up game". Boys in the ninth grade must be a difficult group to program for...

Very good Pretty good Pretty bad Very bad The program was: 5 19 4 5 5 24 6 1 10 43 10 6

## Fun

Making a mathematical program boring is easy. Multiplication, subtraction, addition and division really invites the programmer to create lots of boring tasks, comprised by nothing but numbers. More difficult is it if you, without skipping these, want to make a mathematical program fun. My strategy has been to alternate between "number knowledge" and different "graphical" questions which also test mathematical abilities. The room where one is to guess the weight of different animals is probably a good example, where it would be much more boring if I had just jumped straight to unit conversion. Instead, the result is that seven out of ten think the program is fun, and quite many think it is "really fun". As one would expect, the program is more popular amongst the younger pupils.

Really fun Pretty fun Not fun Not at all fun 7 25 7 1 0 6 1 1 2 10 6 3

The biggest difference between boys and girls is a greater spread among the boys. Both sexes have about the same amount of "fun", but the boys are more inclined to choose the extremes: "really fun" or "not at all fun". All in all I'm happy with the result.

Really fun Pretty fun Not fun Not at all fun 5 18 6 4 4 23 8 1 9 41 14 5

## Level of difficulty

The program should ideally be neither too hard nor too easy for the pupils it aims at, in the fifth and sixth grades. In this group it would be desirable if those who think it was "too hard" are approximately as many as those who think it was "too easy", and the majority should be somewhere in between. This survey is done on older pupils, and therefore we don't want anyone to think the program was "too hard".

We can see that the program was unequivocally too easy for pupils in the ninth grade: more than 50% think so, and the rest think it was "pretty easy". Somewhat unexpected, however, was the reaction in the eighth grade; they seem to think it was harder than the pupils in the seventh grade. I seem to have received a weak group of eights. Trying to guess how the program is perceived in grades five and six, I think the program suits its audience pretty well.

Too hard Pretty hard Pretty easy Too easy 0 11 19 10 0 3 3 2 0 0 10 11

## Graphics

I am personally content with the graphics. I have found some nice pictures that works well in the program. In the seventh grade, a vast majority agrees: the graphics are "good" or "very good". The graphics were, on the other hand, less popular in the ninth grade; especially the boys (who I assume are used to three-dimensional shoot-'em-up games) were sceptical. But that doesn't really matter, closer to the intended audience everyone was happy.

Very good graphics Pretty good graphics Pretty bad graphics Very bad graphics 15 22 1 2 4 1 2 1 2 11 4 4

Very good graphics Pretty good graphics Pretty bad graphics Very bad graphics 8 13 6 6 13 21 1 1 21 34 7 7