As the name implies, the automated grading service automates grading tasks. This is a huge time saver, particularly for organizations that have large numbers of remote students. Manual grading consists of having a human review and grade assignment answers. Graders also have the option of adding comments to the Jupyter Notebook file so students have more insight on the accuracy of their answers.
After all (hopefully) students have submitted their assignments, the grader needs to collect the assignments so that they can complete the grading tasks. At first, it will look like there are no submissions since the number of submissions is set to 0:
After clicking on the icon located in the
Collect column, the
# Submissions integer value should reflect the number of students submissions. Since we are only testing with one user, this value is
After collecting the assignments click on the integer value within the
# Submissions column to view the submissions in a table, where the rows represent the student and the actions you can take for each student submission.
Notice how a badge appears with the
needs autograding label, which indicates that the user should initiate the auto-grader job. To run the auto-grading job, simply click on the icon located within the
Once the Auto-Grading service completes, a modal will appear letting you know that the grading task has completed successfully. Additionally, a new badge will appear under the
Status column which should indicate that manual grading is pending. Also, notice that we have our first points assigned to the grade, which correspond to the automated grading cells only.
To get started with manual grading, click on the link in the
Student Name column. If the student does not have a first name or last name then the
None, None values appear instead. Click on this link to open the learner's assignment items, which in this case are
In the example below, notice how a checkmark appears in the
Needs manual grade? column. Also, the points value for each grading type are displayed:
Code score: points related to code cells that were designated as auto-graded tests and answers
Written score: related to cells that were designated as manually graded answer
Task score: related to cells that were designated as a manually graded task
Let's go ahead and start the manual grading process by clicking on one of the
Notebook ID items. Actually, you can click on any of the
Notebook ID items to open the manual grading interface. Then, within the manual grading interface, you can click on
Previous to access any of the
Notebook IDs for the student's assignment.
The manual grading interface is where graders can provide additional feedback, regardless of whether the cell was set up for manual or auto-grading!
Cells that were defined as
Automated Answers when setting up the original source assignment are titled
Student's Answer. The grader may add comments to this cell, even though the cell has already been graded by the auto-grader. This is also known as providing
Feedback. (In the next section, we will go over how to distribute this feedback back to the learners):
Cells designated as
Automated test have the cell id as the cell identifier and also have the points fields where the grader can adjust the points calculated by the auto-grader.
Let's complete the grading process by adding some comments with markdown. Adding comments with markdown will help learners view the text in richer formats, such as lists and sections with headers. Also, you can click on the
Full credit and the
No credit buttons or full points or 0 points, respectively:
Your comments and points values are automatically saved once you click on the
Next button and have finished viewing the last
Notebook ID within the assignment.
Before we move on to the next section, where we will collect feedback as students let's click on the icon located in the
Generate Feedback column to send feedback to your students. Students can then collect feedback (although they aren't forced to) to enhance their understanding of the material.
Once feedback is released, a badge with the
released label will appear in the
Status column, as depicted in the image above.
Woot! You have completed your grading tasks and have submitted feedback to your learners. There are only two steps left!
Collect and view feedback as a learner
Send the assignment's grades to the Learning Management System (LMS)