Is it possible to use pretests in CodeRunner?
To run some first tests before final testing.
F.e. students do not pay attantion for the output format,
use tabs as delimeters instead of spaces and so
get zero points for almost right solution.
May be it is possible to check the solution
before finishing test
with one or two first test to avoid that mistakes?
I think you could simulate the desired behavior with a hidden test with the "Hide rest if fail". Put this kind of test at the beginning. I'm not sure whether the rest of the tests will actually be executed, but at least the output should only show up until the first failing "pretest"
I'm not quite sure how you want the "pre-tests" to work, but here are some ideas to explore. If they don't help, please feel free to ask again, with a specific example and stating how you would like CodeRunner to behave.
The case 2 is most apropriate, I think.
Thank you very much!
I think that the best is to make CodeRunner's questions adaptive.
But I don't want to make whole quiz adaptive.
Is it possible to make CR questions only with the "Check" button?
Currently at least, you need to run the entire quiz in Adaptive Mode if you want CodeRunner to behave properly. If you wish to include other questions in the quiz, but you wish them to get marks for them only if their first submission is correct, you can set the penalty to 100%.
Richard
It is not very good to allow students check their answers immidietly
and do not give them ability to correct wrong answers. They will
be worried about this situation all the time...
I don't understand where adaptive_adapted_for_coderunner behavior is.
I don't see it in any list...
Is it selected automatically when I choose "adaptive"?
Just in case I wasn't clear, I meant that you'd use the 100% penalty only on non-CodeRunner questions. We sometimes do that in tests and exams. It essentially just tells the students not to guess. But you're probably right that it's discouraging for a student to attempt a multichoice question, click Check, discover they're wrong, and know that there's nothing they can do about it. A less brutal approach is to use a 50% penalty. True/False questions, of course, must always have a 100% retry penalty.
adaptive_adapted_for_coderunner is indeed the behaviour that's used by a CodeRunner question when the quiz behaviour is set to adaptive. It's a subclass of the base adaptive behaviour class.
Richard
Is it very difficult to add adapted deferredfeedback behavior for CodeRunner?
For showing Check button for CR questions only.
It wouldn't be particularly difficult to implement. I'm just not sure I want to. My concerns:
However, I might yet be persuaded that it's a good idea. Comments and suggestions, anyone?
Richard
There is a precident for "just ignore all the specified behaviours and do their own thing".
Moodle 'Essay' questions, irrespective of what the quiz 'How questions behave' option is set to, use the 'Manually graded' behaviour.
So, it is certainly technically possible to have it so that CodeRunner questions always use qbehaviour_adaptive_adapted_for_coderunner, ignoring the quiz setting. I can see arguments for that approach. For the student, writing code where you cannot run it, see if it works, and then fix it if necessary, is a completely inauthentic experience. Being able to vary the penalty strikes me as sufficient control for the teacher. Always using Adaptive mode strikes me as better then allowing teachers to select a different behaviour, then displaying a message on screen that it does not work properly.
As Richard says, the other way to go would be to make CodeRunner work with all Moodle behaviours, but this would be more work. It would be a lot of work to make ..._adapted_for_coderunner versions of all the existing behaviours. The other approach would be to make changes in Moodle core, so that the the set_qt_var bit is no longer needed. This is a long-standing request. See https://tracker.moodle.org/browse/MDL-30442. I quite like Richard's propsed way to handle this, which is backwards compatible for existing question types. That would only leave
adaptive_adapted_for_coderunner doing the enhanced penalty regime, which woudl be less code, and that bit would not be necessary for other behviours. (Of course, any Moodle core change could only go into Moodle 3.3, which would be released next May, so this is a long-term view.)
(While I am talking about Moodle core issues, https://tracker.moodle.org/browse/MDL-54959 looks like it also have the potential to simplify adaptive_adapted_for_coderunner if it ever gets done.)
Thanks Tim. Interesting. Always forcing the use of adaptive_adapted_for_coderunner isn't something I'd ever considered. I had just assumed that if a quiz were running using behaviour X, whatever behaviour the question type chose had to be a subclass of X
I just tried replacing the qtype_coderunner_question::make_behaviour method with
public function make_behaviour(question_attempt $qa, $preferredbehaviour) {
// Regardless of the preferred behaviour, always use an adaptive
// behaviour.
return new qbehaviour_adaptive_adapted_for_coderunner($qa, $preferredbehaviour);
}
and it seemed to work. I assume you're telling me that's safe? Wunderbar!Richard
Yes, that code is safe if that is the behaviour you want.
There probably also needs to be a matching change in the documentation.
Thanks Tim. I'm not sure if it's exactly the behaviour I want but, as you said above, it is undoubtedly an improvement on what I was doing before, and at near-zero cost.
Documentation already updated :)
Richard