CodeRunner: testing JOBE installation gives 35 passed, 1 failed

I just configured our JOBE server, however, I got a single exception when testing the installation:

maybe someone can offer some advice on the possible cause?

/var/www/html/jobe$ python3 testsubmit.py

Supported languages:

c: 5.4.0

cpp: 5.4.0

java: 1.8.0_131

nodejs: 4.2.6

octave: 4.0.0

pascal: 3.0.0

php: 7.0.22

python2: 2.7.12

python3: 3.5.2

Valid Python3 OK

Python3 with stdin OK

Syntactically invalid Python3 OK

Python3 runtime error OK

Python3 file I/O OK

Testing use of interpreter args with Python3 OK

Testing use of runargs args with Python3 OK

Python3 program with customised timeout OK

Python3 program with support files OK

***************** FAILED TEST ******************

{'run_id': None, 'cmpinfo': '', 'stderr': '', 'outcome': 15, 'stdout': 'No config file found, using default configuration\n'}

Valid Python3/pylint program

Successful run

Output:

No config file found, using default configuration

************************************************

Invalid Python3/pylint program OK

Test good C hello world OK

Test compile error C hello world OK

Test use of compileargs with C OK

Test runtime error C hello world OK

Test timelimit on C OK

Test outputlimit on C OK

Memory limit exceeded in C (seg faults) OK

Infinite recursion (stack error) on C OK

C program controlled forking OK

Valid Octave OK

octave with stdin OK

Syntactically invalid Octave (treated as runtime error) OK

Syntactically valid Nodejs hello world OK

Syntactically invalid (non-strict) Nodejs OK

Correct Php program OK

Syntactically incorrect Php program OK

Correct Java program OK

Correct Java program without supplied sourcefilename OK

Syntactically incorrect Java program OK

Java program with a support class (.java) OK

Test good C++ hello world OK

Test compile error C++ hello world OK

Good Hello world Pascal test OK

Fail Hello world Pascal test OK

36 tests, 35 passed, 1 failed, 0 exceptions

Checking parallel submissions

Doing child 0

Doing child 1

Doing child 2

Doing child 3

Doing child 4

Doing child 5

Doing child 6

Doing child 7

Doing child 8

Doing child 9

C program to check parallel submissions OK

All done

Testing a submission with an excessive cputime parameter

Re: testing JOBE installation gives 35 passed, 1 failed

de către Richard Lobb- duminică, 20 august 2017, 13:30

Hi Stefan

That's an error in the configuration of pylint. If you're not planning on using pylint, which is a Python style checker not used by any of the built-in question types, you can ignore the error.

It looks like one line of the Jobe install commands hasn't worked, namely

pylint --reports=no --generate-rcfile > /etc/pylintrc

For this command to work you have to be root; putting sudo in front won't work, because bash will disallow the redirection of standard output into a write-protected directory. So first enter the command sudo -i or sudo bash and then type the above command. I think you'll find that error then disappears.

Richard

Re: testing JOBE installation gives 35 passed, 1 failed

de către stefan weber- luni, 21 august 2017, 21:27

all working now, thanks a lot Richard

Re: testing JOBE installation gives 35 passed, 1 failed

de către Cesar Varela- sâmbătă, 23 decembrie 2017, 08:12

Hello Stefan.

What did you do to solve the error?

Thanks

Re: testing JOBE installation gives 35 passed, 1 failed

de către stefan weber- joi, 28 decembrie 2017, 01:36

exactly what richard told me to do in his post above mine :)

Re: testing JOBE installation gives 35 passed, 1 failed

de către Martin Zwerschke- luni, 12 februarie 2018, 23:56

Having updated my older jobe Server to latest jobe version and to Ubuntu 17.10 I get a similar problem like described in this thread running testsubmit.py:

Python3 program with support files
Jobe result: Successful run

Output:
The first file
Line 2
Second file

=====================================

***************** FAILED TEST ******************

{'run_id': '/home/jobe/runs/jobe_N1P8lg', 'outcome': 15, 'cmpinfo': '', 'stdout': '------------------------------------\n', 'stderr': ''}
Valid Python3/pylint program
Jobe result: Successful run

Output:
------------------------------------


************************************************

=====================================
Invalid Python3/pylint program
Jobe result: Successful run

As you can see, there is no Output like the hint to a missing /etc/pylintrc
I have already checked, that this file was successfully generated.

Re: testing JOBE installation gives 35 passed, 1 failed

de către Richard Lobb- marți, 13 februarie 2018, 22:49

Hi Martin

Thanks for the heads up on this.

It seems that the version of pylint3 you get with Ubuntu 17.10 has a new feature called "score", which prints out the score even for a program that passes all the tests. You need to disable the score in the pylintrc file. You can do this by running the following command as root (sudo bash first), which replaces the version in README.md for newer versions of Ubuntu.

pylint3 --reports=no --score=n --generate-rcfile > /etc/pylintrc

-- Richard

Re: testing JOBE installation gives 35 passed, 1 failed

de către Martin Zwerschke- miercuri, 14 februarie 2018, 04:51

Hi Richard,

this worked for me, thanks a lot.

And because I integrated a Mono-C#-Test into testsubmit.py I now have 40 of 40 tests passed.