You can do pretty much anything you like if you write your own high level script (template) to control the execution. One of our staff members here has questions in a compiler course where students submit their implementation of a simple compiler in Python. The script compiles a test program using the student's compiler. The output from that is JVM assembly code and the script then runs that code with the JVM.
To see how to script questions see http://coderunner.org.nz/mod/book/view.php?id=198&chapterid=831 or my second-to-last posting in this recent forum thread.