Thanks for this Daniel it works pretty well!
I'm not a Claude subscriber but host my personal OpenWeb UI instance and can say it works well on using Gemini Flash (not lite) and DeepSeek-v3.2. Previously I've used "knowledge" for this in the past but your honing of of the skill works better for me and was as simple as plug-and-play in OpenWeb UI. I only teach Python so have only used it for those questions. If you're using API costing I've found Gemini Flash and Deepseek 3.2 to be the best bang for buck. They give nicely designed questions and come in between 1-2 cents per question.
Have you looked at implementing the randomization options? For those of us in a world of reassessment it would be super helpful. If you have some thoughts let me know.
I'm not a Claude subscriber but host my personal OpenWeb UI instance and can say it works well on using Gemini Flash (not lite) and DeepSeek-v3.2. Previously I've used "knowledge" for this in the past but your honing of of the skill works better for me and was as simple as plug-and-play in OpenWeb UI. I only teach Python so have only used it for those questions. If you're using API costing I've found Gemini Flash and Deepseek 3.2 to be the best bang for buck. They give nicely designed questions and come in between 1-2 cents per question.
Have you looked at implementing the randomization options? For those of us in a world of reassessment it would be super helpful. If you have some thoughts let me know.
Additionally, have you thought of making some of your design choices easy to adjust? Number of tests, making them hidden, etc? I played around with it to taylor to my needs but that makes it tougher to update as well.