Question Authors' Forum

Should students be penalised when the JOBE server is offline?

 
Tim at Lone Pine Koala Sanctuary
Should students be penalised when the JOBE server is offline?
by Tim Hunt - Friday, 24 February 2017, 4:53 AM
 

We just did a test of our CodeRunner set-up. We have 2 JOBE servers sitting behind a load-balancer, and what we did is to put the system under some load, using a Jmeter script we had made, and then we restarted one of the two JOBE servers.

The kind of load we were simulating was about 100 responses being submitted per minute, and when the server restart happened, 8 qiuestion submissions got an error. I am pretty happy with that.


However, the point I wanted to raise was that when this happened, the student got marked wrong, as if they had submitted an incorrect response. It seems a bit unfair to penalise the students for this:



Would it not be fairer to treat this case differently? For example, in Moodle question system terms, we could treat this as an 'invalid' response, rather than an incorrect one. That way, students would not get a penalty, and they could just try again later when the server comes back.

This might be something to think about for CodeRunner version 3.2?

(It might also be good to re-word the message to suggest students try again a bit later.)

Picture of Richard Lobb
Re: Should students be penalised when the JOBE server is offline?
by Richard Lobb - Friday, 24 February 2017, 10:11 AM
 

Thanks Tim. Yes, I agree that the student shouldn't be penalised when the Jobe server fails. I was vaguely aware that I should fix that some time but it never got to be a priority, since Jobe never fails :-)

I'll bump it up the priority list for the next version, and think about the error message too. In the meantime, a "regrade all", or regrade of affected students, does of course fix any such problems. 

Richard

Tim at Lone Pine Koala Sanctuary
Re: Should students be penalised when the JOBE server is offline?
by Tim Hunt - Friday, 24 February 2017, 8:34 PM
 
Thanks Richard.