OOPtopus

Install Deno

To run the tool, Deno must be installed on your system.

Step 1: Clone the repository and open the folder in your terminal.

Step 2: Create a new assignment using natural language instructions via a custom GPT:

https://chatgpt.com/g/g-67da948c14048191a2a867494c4ba951-oop-evaluator?model=gpt-4o

Step 3: Extract the perfect-solution structure generated by GPT → this will produce an expectedStructure.json file:

deno run --allow-all src/main.ts -s="path\to\PerfectSolution.java" extract-structure

Step 4: Go to the online web-app to generate the grading.json file.

Inputs:

• expectedStructure.json generated in Step 3
• The JUnit test file generated in Step 1
• The points assigned to compilation and to each class/interface

https://v0-grading-json-generator.vercel.app/

Step 4: Evaluate the student’s code:

• For a single student:

  deno run --allow-all src/main.ts -t="path\to\JUnitTestFile.java" -g="path\to\grading.json" -e="path\to\ExpectedStructure.json" -s="path\to\StudentSolution.java" evaluate

• For a batch of solutions, add the -b flag (each folder in solutions/ must contain a single file Solution.java, and the folder name will be used as the student’s identifier):

  deno run --allow-all src/main.ts -t="path\to\JUnitTestFile.java" -g="path\to\grading.json" -e="path\to\ExpectedStructure.json" -s="path\to\solutions" -b evaluate

Step 5: View the results:

• Open the generated HTML in the reports folder to see the evaluation for a single student.
• Open all_solutions_metrics.csv to see the results for a batch of solutions.