Use ACE editor for test case code in question editor

Use ACE editor for test case code in question editor

por Mike McDowell -
Número de respuestas: 4

Hey folks,

We are wondering how to best go about enabling the ace editor for each test case field for the question author. The plain text fields are cumbersome for editing code, especially for things like indentation, and the color coding of code in ace is handy for catching simple syntax errors. 

My php and JS isn’t tip top but I could hack my way thru it. If someone could offer a higher level overview of things I should be looking for that would be helpful. 

En respuesta a Mike McDowell

Re: Use ACE editor for test case code in question editor

por Richard Lobb -
Thanks for raising the question, Mike. I occasionally feel a bit frustrated with the lack of a good editor in those fields, too. But I think it would be difficult to turn on Ace without compromising the generality, language-agnosticism and accessibility of CodeRunner. Here's why.

You mention syntax colouring/checking but what language would you configure Ace to use for that? There are four fields in each test case: test code, standard input, expected output and test extra. Standard input and expected output aren't usually code fields, so you couldn't syntax colour them. Test extra is sometimes used for code, sometimes not. So that too couldn't really be syntax coloured. That leaves only the test code field, and even that may not contain test code! For example we have a "Write a program that reads a file" question type in which we use the test code field as the contents of the file. You certainly don't want to syntax colour raw text - that's very confusing.

Even in the normal case in which the test code field does contain code, what language should you configure Ace to use? Most of our questions use a Python template regardless of the language of the student answer. See the c_via_python question type for example. So the most likely choice of language to use would be that configured into the Ace language field, unless that is empty in which case you'd want the Sandbox language. But those fields are in the prototype, not a typical question, so are not currently available to the JavaScript that needs to set up Ace. And even that language choice fails on occasion - we have C questions, scripted with a Python template, in which the Test code is a bash script!

It would of course be possible to add UI components to the question authoring form to configure the Ace languages for the different fields, but I'd be reluctant to head down that path: the question authoring form is already too complicated.

A relatively simple fall back would be to use Ace on all the fields, but without a specific language configured. That would kill the syntax colouring/checking, but would give you improved indenting/outdenting capabilities. But even that has a gotcha or two. Tim Hunt has gone to some trouble to ensure that the UI is accessible to visually-impaired students, an important requirement for UK's Open University. To maintain that accessibility, you'd need to do more that simply turn on the Ace editor - you need extra keystroke handlers to support screen readers.

However, if your institution's CodeRunner use is restricted to only a few relatively simple question types and languages, and you're not too concerned with accessibility issues in the question-authoring form, it would be relatively straightforward to turn on the Ace editor in those fields. You could configure a  language for the Test code field (perhaps that used by the question's template) but leave the language unspecified for the other fields. If you wish to explore that option for your own in-house use, I think you would probably want to start by looking at the file amd/src/testareas.js. This configures those text areas in the question authoring form that are not managed by Ace. It used to handle indentation with the tab key, but that behaviour has been compromised by the accessibility-handling code. We probably should revisit that code - it no longer seems to behave as well as it used to. Maybe if indentation and tab handling were improved there, some of your current frustrations would go away, without the need for the full-on capabilities of the Ace editor?


En respuesta a Richard Lobb

Re: Use ACE editor for test case code in question editor

por Richard Lobb -
I just looked into why the old rudimentary indentation and tab-handling code was no longer working properly in the question authoring form test fields. The setupAllTAs function in testareas.js was expecting to find textareas with a class edit_code, which was what edit_coderunner_form.php was requesting as the attributes of the textareas it created. But setupAllTAs wasn't finding any such textareas, so the initTextArea function was never being called. It seems a change in the Moodle-core forms module around Moodle 3.7 moved the requested class into a wrapper div instead!

I've pushed to github a change to textareas.js that re-implements the old functionality. It doesn't do much: just inserts 4 spaces when you hit tab and autoindents lines to match the previous line. But it might deal with at least some of your frustrations! 
En respuesta a Richard Lobb

Re: Use ACE editor for test case code in question editor

por Mike McDowell -
Thanks for that Richard. Just tried it out on my test server and that will definitely help a bit for sure here.

I was thinking about perhaps a checkbox, similar to the "Template uses ace" under Input UIs in the editor. Maybe the same ability here to allow it for test cases? Can you think of a reason this might be a bad idea?
En respuesta a Mike McDowell

Re: Use ACE editor for test case code in question editor

por Richard Lobb -
It's certainly not a bad idea. But there is the complication of determining what language Ace should be using, though using the same language as the sample answer field would cover most cases.

The problem from my perspective is that even relatively simple changes take a lot more time than you'd expect. If you wanted the checkbox to be persistent (which it really should be - it would be annoying to have to re-click it on each save), you'd need to add a field to the database, which means defining a DB update-protocol. Then there's all the testing - new functionality needs new tests to be added to the test suite. And the functionality needs to be documented.

To be blunt, I can't myself be bothered as I don't really feel a need for that functionality. If you're keen enough to implement all that yourself, and if it doesn't clutter the UI too much, we would certainly consider merging a pull request.