Grader guide

While the grader is the intended audience here, others are welcome to read it.

General info

• Responsibilities section of the job post

• Schedule

• In grading/Discussions:

  • We want to try giving students just enough hints to figure it out without giving them the answer.

    • If they seem totally lost, direct them to office hours.

  • Don’t spend a ton of time trying to figure out something that you don’t understand; feel free to escalate to the instructor.

• For students seeking one-on-one help, direct them to office hours.

  • If someone asks to meet with you specifically, you’re welcome to do so, but not required.

• Log hours for any time you put in related to this class, including any learning you’re needing to do yourself to answer questions.

• Subscribe to all the Discussion Topics so you get notified.

• Keep an eye out for students who I should encourage to apply as a grader next term. Things to look for:

  • Being consistently helpful in the Discussions

  • Clean, well-documented solutions for the homeworks

  • Asking good questions

Weekly cadence

Weeks start/end at the beginning of each class.

• Grading assignment submissions and resubmissions and releasing grades for your section

  • Please try and be done with grading of an assignment within four days after it’s due (so they have time for resubmission)

  • Feel free to grade things as they come in, in the order received, to give those students more time for resubmission

  • Info about anonymous grading

Between-class participation tracking

• We can be fairly forgiving/generous with what counts as completion

• Every student should have each week marked one way or the other

• The instructor will mark participation for students that came to office hours

Discussions

• We are trying to strike a balance between students getting accurate answers quickly and encouraging students to help one another to cement their learning

• Ensure Discussion questions have answers within the specified timeline.

  • Wait 24 hours to respond to questions that could be answered by another student, giving them a chance to do so.

    • Make sure homework questions have an answer within 48 hours, since they are time-sensitive.

    • The day before homework is due, answer questions sooner than that to get students unstuck.

• Please give corrections/clarifications on student answers where necessary.

Check-in meeting

• How’s the workload?

• Anything you need clarification on?

• What came up in Discussions/assignments (common problems, etc.) that might be useful to cover in class?

Assignments

• Use annotations to leave comments within the PDFs.

• Scoring and regrade rules

• How to give extensions — see “Add special access to an assignment”

  • Grant any request for 1-2 days made before the deadline; escalate others to the instructor

  • Set the End Date to the original late submission deadline or the new due date, whichever is later

  • Don’t give extensions on the resubmission deadline unless authorized by the instructor

• Solutions folder will be shared with you from Google Drive

  • Instructor will share them with students via JupyterHub

  • The students don’t need to match the provided solution exactly, as long as they do what the question is asking

• Grader will manually apply late penalty

Checks

The following should be true for each Assignment:

• The description is a link to the assignment page on the site

• Points

  • 100 points per Assignment, potentially split up

  • Percentage of the overall grade matches the breakdown in the syllabus

• Grouped in a logical way

• Display Grade as: Percentage

• Submission Type: Online, Website URL

• Anonymous grading

• Dates are correct:

  • Due dates should match the schedule

  • End Dates should match the late submission deadline rules, at the same time

• Associated with the Homework gradebook category

• Visible

Final Project

Proposals

• Students are encouraged to submit before the deadline to get feedback sooner

  • We aim to turn around feedback on the proposals sooner than later, so that students can get started.

• If the proposal shows effort and follows the format, full credit should be given

• Things to look for (don’t spend too long on these):

  • Will their dataset answer their question?

  • Do they have a question that is objectively answerable?

  • Will it be the right level of challenge for the duration of the project and their skills, not too much, not too little?

• The feedback you will likely give the most often will be something like:

  Your question is good, but you’ll probably be able to answer it in relatively few lines of code. Think about what your follow-up question(s) will be.

Peer review

The Final Projects themselves are peer graded. We’re using PeerMark to facilitate the peer grading. Once the peer review deadline passes:

1. Open each submission.

2. Calculate the median of the scores from the peers, using that as the final grade.

3. In the Gradebook, give points to the reviewer under the Final Project Peer Review.

   • As long as thoughtful feedback was given, give full points.