Test case corrector button no longer working

Test case corrector button no longer working

by Chris Nelson -
Number of replies: 9

Hi Richard,

I've had a few reports from STEM colleagues that the "<<" button seems to have broken. It used to overwrite incorrect expected testcase output with the actual value, but doesn't seem to do anything now.


I tested various questions and they have the same issue.

We are using v5.4.1 (2024090600) in our incoming release, and 2024031500 on our production environment. The << button is not functional in either.

Are you aware of this one? If not, we might be able to work on it in the next couple of months, although sadly we're a developer down and feeling the effect! 

Best wishes,

Chris.

(Sorry for the edits, apparently the "<<" can't be displayed in the subject line).

In reply to Chris Nelson

Re: Test case corrector button no longer working

by Richard Lobb -

Many thanks for reporting this Chris. I certainly was not aware of any such problem.

I just checked on two separate servers running 2024090600 and the functionality seems OK on both in Chrome. I just checked with Firefox as well on one of the systems, and again it worked fine.

What browser do you use? Could it have some special security features that are interfering with the functionality? Or is there some extra Moodle security functionality that we don't have enabled in our systems, which has broken the in-page JavaScript functionality? 

Could you check if there are any Console error messages in the Developer Tools window when you click that button, please?

If that doesn't cast any light on the problem, we'll need to dig deeper. What question type are you using? Until recently the functionality was present only with the basic question types that used the default Exact Match grader or similar. A few months ago I extended it to work (mostly - there's a known difficult-to-fix bug) with combinator template graders, which is what all our questions use nowadays. When I got your email I thought that I must have broken the base-level functionality while extending it to combinator graders, but that seems not to be the case. At least, not in my environment.

Thanks again for reporting. I certainly can't fix problems I don't know about :-)

In reply to Richard Lobb

Re: Test case corrector button no longer working

by Michael Fairbank -
I've seen this too, for the first time just last week, on Firefox 131.0.3 Firefox Snap Ubuntu 24.04. It happens inconsistently. If I can replicate it I'll get back to you.
In reply to Michael Fairbank

Re: Test case corrector button no longer working

by Chris Nelson -
Interesting. I'm using Edge on Win 10 (university IT's default browser).

Using our production server, it seems to consistently not work. Using three randomly-selected CodeRunner demo questions...

Python function: sqr - 100% sure that this is one of the demo questions
Edge: << button doesn't work.
Chrome: << button doesn't work.
FF: << button doesn't work.

01.04.Bisection (NumPy) - not 100% sure if this is a demo question or one we made.
Edge: << button doesn't work.
Chrome: << button doesn't work.
FF: << button doesn't work.

C function: print string lengths - 100% sure that this is one of the demo questions
Edge: << button doesn't work.
Chrome: << button doesn't work.
FF: << button doesn't work.

Thanks for the pointers, I'll get our IT developers to see if they can work it out :-)
In reply to Chris Nelson

Re: Test case corrector button no longer working

by Chris Nelson -
One of our developers has had a closer look, and it may be our custom theme that's broken this. Will confirm once we're certain.
In reply to Chris Nelson

Re: Test case corrector button no longer working

by Anton Dil -
I've never known it to work, going back some years.
In reply to Anton Dil

Re: Test case corrector button no longer working

by Richard Lobb -
@Anton Dil
I'm a bit perturbed to hear that, Anton. No-one has ever reported a problem before. Does clicking on the button do nothing at all? If you fire up the Dev Tool panel (Shift+Ctrl+i in Chrome and Firefox) and select the Console tab, do you see any error messages when you click on the "<<" link?
In reply to Richard Lobb

Re: Test case corrector button no longer working

by Anton Dil -
Hi Richard, I think it will turn out to be related to what Chris is saying! I probably should have clarified that.
In reply to Anton Dil

Re: Test case corrector button no longer working

by Richard Lobb -
Sorry Anton, although I probably knew in the past, I had forgotten that you were at OU, too.
In reply to Richard Lobb

Re: Test case corrector button no longer working

by Tim Hunt -
Oh the OU system, there is indeed an error message in the Browser console, and it looks at first sight to be due to a bad interaction between what CodeRunner is doing and the OU's custom theme. We now have an issue on the backlog to investigate and try to fix. So, probably not a CodeRunner issue.