Category Archives: grading

Grading Students or Grading Work?

My belief in rubric-based grading actually began long before I became a teacher. I was a TA in high school, and had been invited by my mentor teacher to “grade” assignments. The teacher gave me an answer key and a rubric for the assignments. I say “grade” loosely because I was really just identifying key pieces of information against a rubric.   The teacher gave the ultimate grade and score, and I never touched the gradebook. One of the memorable moments came from the reading of the short answers in the quiz on “Watership Down”. I had not read the book and could not discern whether the students met the requirements outlined by the rubric. So, I asked the instructor for a copy of the book, read it over the weekend, and then went back to “grading” the quizzes.  What I discovered was that the issue was less about my lack of knowledge and more about the rubric itself. Once I had the context I needed, I could see clearly that the rubric did not align with what the quiz question was actually asking. It was a valuable lesson, not just in content knowledge, but in how a poorly constructed rubric can undermine even a well-intentioned assessment. It was actually a very daring experience for me when I went to point out to the instructor the shortcomings of their rubric.  Luckily for me, the teacher was encouraging and received my feedback graciously, agreeing that the rubric needed revision.   

Since that time, I have been active in my approach to rubric use and invite the students to use a rubric on their own essays as a part of their peer review process.  I find that they become more capable of recognizing the requirements of an assignment and can give better feedback to their peers with a clear rubric. So, they first evaluate their own essays with a rubric and then have the opportunity to give feedback to their peers with the same rubric.  The students have consistently told me that they appreciate seeing where they might have gone in the wrong direction using the rubric.  

When I was a new teacher, I tried to be clear but fair and grade based on the students’ demonstrated skills as required by the university I worked for. I thought I was doing a pretty good job until I had a weekend grading rush. I discovered my own biases when I had a stack of papers to grade and no time to look up which paper was which. I graded fast, using my rubric and making comments on the papers, but so fast that I did not see the names on the papers until I was inputting them into the Blackboard system. That was when I realized that a student I had thought really had an understanding of the coursework was completely misunderstanding the content. The student had been so active in the class and involved in the class discussions, one of my most vocal and engaged students, that I had completely missed the fact that they didn’t really understand the content. Combined, these experiences have influenced my current grading philosophy, to grade blind and to have a clear rubric for the process. 

Shortly after my rushed grading weekend, I came across an article that discussed the “halo”  effect and the opposite of it, the “horns” effect. Teachers don’t intentionally start out having favorites, but there are always students who participate in class who may not have the strongest skills in their actual work.  The halo effect is caused when the grader allows their bias to subconsciously influence their grading based on the student’s perceived effort, participation, or behavioral compliance rather than their actual skills and knowledge. The horns effect is allowing the bias of a student’s perceived lack of effort, lack of participation, or misbehavior to influence grading subconsciously. I recognized my own epiphany reflected in the article. 

Looking back on those experiences, the rushed grading night that revealed my own bias and the weekend I spent reading a novel just to be a TA, it is clear they shaped my approach to grading. A good rubric is not just a grading tool, and blind grading is more than just a procedural safeguard. Blind grading with a good rubric is a commitment to fairness, and it protects both the student and the teacher from the very human tendency to let impressions get in the way of honest assessment.

Can AI Grade My Essays For Me?

I made a joke with Beth a few days ago about how I wished AI would grade my essays for me. And then I really thought about that, and now I can’t stop. I mean seriously if AI can write the students’ papers for them, what about us? Why can’t it grade papers too? Well, guess what. It can. I tried it. Shhh. Now don’t tell on me. I used both ChatGPT and Microsoft’s tool built into Bing. GPT is much better.

First off, it was a lot of work, probably equal to if I’d just graded them myself, but the benefit was far better for the student. It spat out paragraph long feedback on what was wrong, how the paper did or didn’t meet each rubric standard, and how to improve the work. I was simply amazed. If I were to leave that kind of feedback on a paper, it would take me days to grade instead of hours. As it is, I’ve already moved to grading by recording my feedback, so I can say more and make it easier for students to understand what I’m saying, but this was amazing.

But like a said. It wasn’t easy or quick. I first began by asking the AI to find a rubric for a news article using a summary lead and following the inverted pyramid style. It quickly pulled up a rubric that was adequate, but it was only on a 10-point scale. I used it anyway to see how it would work. Then my next prompt asked Maud, remember, I named her Maud in my last post. I asked her to grade this news article using that rubric, and pasted in a student’s news article. Surprisingly, it worked. She put the two prompts together and graded the article. It was okay, but there wasn’t much detail and it didn’t really meet the standards I was looking for. I decided instead to ask Maud to build me a rubric and added the essential things and the total points I needed. She created this.

Okay, that was interesting, but could she grade a news article using that rubric? I wondered. Yep! She gave the article a 47/60, provided the tally from the rubric AND added this feedback:

Strengths:

  • The article follows the inverted pyramid structure.
  • The information provided is relevant to the target audience.
  • The article includes quotes from reliable sources.

Weaknesses:

  • The lead is weak and could benefit from being more focused.
  • The article could use more clarity in its presentation of information.
  • The article could be more concise.
  • The article could be more explicit in identifying biases or opinions.

Suggestions for Improvement:

  • The lead should be more specific and focused on the key point of the article.
  • The article should be more clear and concise, with shorter paragraphs and simpler language.
  • The author should explicitly identify any biases or opinions and explain how they might influence the article’s content.
  • The author should consider additional sources to provide a more complete understanding of the issue.

Crazy, right? I probably would have scored it a bit higher, but I noticed Maud didn’t say anything about grammar and punctuation in her feedback and I found a couple of specific errors, so I asked her about them. I typed in, “What about grammar and punctuation?” She replied:

As an AI language model, I don’t have the capability to fully analyze grammar and punctuation, but I can tell you that there are a few errors in the article. For example, in the sentence “This issue goes for not only students but members of the community who live downtown,” the phrase “goes for” should be replaced with “applies to.” Additionally, there are a few instances where punctuation could be improved for clarity and readability. Overall, however, the article is well-written and understandable.

She was right. In another instance, Maud pointed out two run-on sentences in the article and offered a suggestion for how to fix it. Amazing.

Yep, I’m obsessed, but that took a lot of work. In fact, I paused playing so I could quickly grade those news articles and get them back to students. This was going to take all day. First, Maud would forget my rubric after a few follow-up questions about the article she graded, so I’d have to start all over. Then sometimes she would ignore my rubric and just give a paragraph analysis of the article or she would leave out key elements. Basically, she was not consistent and I had to keep retraining her. She gave good feedback, but not the same feedback for each student.