Thursday, April 7, 2022

Grade Distribution

What is the appropriate distribution of grades in a university class? Is there a standard that is readily accepted? These kinds of questions often motivate grade discussions amongst university instructors. 

Some general points of consensus: larger classes more often fit normal distributions (i.e. grade curves) than do smaller classes. Larger lower-level classes tend to have a lower average than smaller upper-level classes. There should be some kind of consistency across equivalent classes so that students don’t think grades are totally subjective and potentially unfairly distributed. 

Up until a few years ago the Faculty of Arts had a grading guideline that recommended a typical grade distribution in which no more than 75% grades could be in the A and B range; that A grades should be between 5 and 25% of the total grades distributed, and; that no more than 20% of the grades should be a fail. This guideline was maintained (as a policy recommendation) in the anthropology department up until the present. Some faculty feel constrained by the above guidelines while other consider it too lenient. 

It is helpful to ask what grades are supposed to measure. If they are a measure of relative rank that leads us in one direction. If they are a measure of quality/quantity of learning that might take us in a different direction. It would seem that instructors generally consider them some measure of learning (but that’s where consensus starts to break down). Students often seem to consider that grades are correlated to the amount of time they invest in completing an assignment or preparing for an exam. What we do know is how grades are used: to allocate access to scarce resources like awards and admission to graduate and professional programs. 

There is a big literature on grading. There is a lot of talk about finding the best way to grade authentically. To give formative feedback to learners. There’s even a critical literature focused on “ungrading.” Both standard beliefs and radical critiques often ignore the reality that capitalist society is graded all the time. Of course we can be compassionate, we can care about our students (and trust they extend that same care to us), but that doesn’t belie the reality of our ranked, hierarchical, scarce resource driven society. Grades are just one more part of that bigger system. 

So. Why not resist the power and refuse to grade? Or, if not total refusal, change the means of grading more in line with so-called ungrading (which still results in a final grade). Why not indeed. Radical ungrading would be best, but for most of us the reality is that ungrading ends up being more work (arguably better feedback for students) and the same normative grading as before. So ungrading becomes another plank in the ubiquitous student-centric learning model in which grades are seen as rewards for showing up and trying. 

There is another augment used against grading – the social economic discrimination thesis. Here the augment is that grading norms white social norms (more accurate would be the claim they replicate specific class values, not racial values). Here students achieve differentially (and their grades are thought to reflect this) according to their demographic marginalization from whitestream middle class society. They are kneecapped before they start the course. Here an argument is made to use grades to counter inequities of history. Ignore obvious errors in composition, for example, and focus on ‘content’ mastery instead. 

Then there is the weakest (in my opinion) argument against grading: “the other guys are skewing their grade distributions higher than we are and thus our students lose out. This isn’t so much a critique of grading as an accommodation to grade inflation. 

I personally hate grading, and this is something that I think many colleagues would agree with. It can be tiresome, anxiety producing, and leave one feeling a deep sense of futility. As a consequence, I have shifted the types of assignments I give my students (more weight on completion graded assignments – if you complete at standard defined, you get full points- this does tend to skew class averages positively). I have also tried to lay out the grading criteria clearly so that there is no ambiguity in what I am grading. I try to use strength-based assessments (I identity where an essay, for example could be improved as opposed to explaining everything that is wrong with it). All this is still grading and at the end of the day I am responsible for submitting a number on a grade sheet. 

At the same time that I hate grading I also value the opportunity to facilitate learning, revision, and transformation through discussion and collaborative reading and reviewing of student work. Some quick witted observer will probably realize that’s really marking without numbers. Ideally, in my field of work, the formative part is guiding learners toward improvements, marking (assigning a value to that process) is simply one small piece. But, it’s the piece we end up focussing on. 

At the end of the day grade distributions have no natural level. They are indeed arbitrary. But because we use them for allocating access to scarce resources we have an obligation and a responsibility to be consistent with how we distribute them. Ideally, we should be consistent across a university, not just a department. My personal preference is toward criteria referenced (or standards-based) grading were there is some clear standard that we expect learners to obtain. It would be based on a combination of knowledge growth within the individual and in comparison to how that individual learned relative to a pre-set criteria. We aren’t in that world though and thus must be content with some variation of normative ranking.

Friday, April 1, 2022

Update On "Taking Action on Russia's Invasion of Ukraine at the UBC-V Senate"

On Tuesday, March  29, 2022, the joint committees met again to consider their action on the motion I had originally proposed for the March 16, 2022 meeting. 

The committees decided to split the motion into two separate motions: one dealing with Russia specifically and the other calling for expanded support of the Scholars at Risk initiatives in view of the many ongoing conflicts around the world. The committees are still micro editing  the motions so no definitive version is available. Their intent is to submit a revised package of motions to agenda for Senate’s April 20 meeting.

Saturday, March 26, 2022

Taking Action on Russia's Invasion of Ukraine at the UBC-V Senate

Russia invaded the sovereign territory of Ukraine in between the February and March meetings of the UBC-V Senate. Given the urgency of the situation and the lack of decisive action on the part of UBC, I proposed a motion (at the March 16, 2022 meeting of senate) condemning the invasion and calling for a temporary end of all academic relations between UBC and Russian entities.  After a long debate the motion was referred to committee, essentially ending debate and introducing a potentially long period of deliberation before the motion might return (in some form) to the floor of the senate.  As a proponent of the motion I was invited to the joint committee meeting held to discus the motion on March 25, 2022).

During the previous senate meeting (March 16, 2022), while a few senators spoke explicitly in favour of the motion, many expressed qualified support. Those in the latter category would begin by saying how they might support the motivation behind the motion, but that they took issue with how it might undermine academic freedom or directly effect individuals at UBC or in Russia. Others said there are many other acts of aggression by other states, why now, why in response to Russia's invasion of Ukraine? 

As with many debates, a good number of senators spoke against things that weren't part of the motion. One senator said that Yeman had been bombed on February 24th. Another obliquely mentioned conflict in the middle east (implying since nothing was done about that, nothing should be done about this). Yet another mentioned internment of civilians during pervious wars. While all seemed to generally agree Russia's actions were problematic, they also seemed concerned that temporarily ending academic relations with Russian state entities was too harsh, unwarranted, and ultimately counter to a the ideals of liberal individualism. 

One sole senator spoke up to point out that right now, as we speak, all Ukrainian research has stopped and that thousands (if not millions) of individual Ukrainians have had their lives forcibly disrupted. They also pointed out that yes indeed individuals at UBC will be affected by such a cessation of academic relations (I would note that not many formal agreements actually exist at UBC, and most of those that do have already been halted, and under UBC's student safety travel plans any travel to Russia and region is already not permitted). 

So the motion was referred to committee by a vote of 33 to 21.  The majority of ex officio Deans, administrative leadership, and other appointed senators voted to defer. The majority of those who voted against deferring (and making a decision when it mattered) were elected faculty senators and some student senators. 

At the open (though hard to access if one is not in the know or invited) joint senate committee meetings on Friday I was asked to offer my explanation as to why the motion should be adopted.  I have, like many of us, watched with shock the unwarranted Russian act of aggression and its impact on the people of Ukraine. I have seen the hard to comprehend warmongering of a country led by ruling class as notable for their super yachts as for their lack of concern with democracy. Along with many others I listened to newscasts itemizing the Russian military build up along their border with Ukraine, thinking they can't possibly be planning to use those troops. But they have. Then came the strong statements of outrage. But what is outrage without action?  UBC doesn't have a lot of sway in these matters, but it can lead by example. One example is to not reward a bully by ignoring the bully's acts of violence. Our own anti harassment and anti-bully policies at UBC are clear and punitive against bullying, harassment, and aggression. Why should we manage our academic relations otherwise? But, apparently when it comes to state bullying we use a different argument (note the continued existence of partnership agreements with Chinese and Hong Kong post secondary sectors, or honourary degrees to architects and managers of anti-Indigenous genocide, or research collaborations with universities in states already illegally occupying and subjugating other people and their lands). It has to stop. Isn't it time that UBC started applying its oft stated principles of global citizenship, empathy, and concern for social justice through meaningful actions?

The bulk of the speakers at the joint committee meeting who spoke were more interested in speaking about the faults and flaws with the motion, its omissions, it's knee jerk reactions, and its overreach.  In typical academic '2nd reviewer' fashion, senator followed senator calmly laying out all the faults but, with rare exception, providing no thought on what might be a better resolution in their mind (those rare exceptions were appreciated).  I guess it's important that we are all heard. Yet, hearing a dissertation on the ills of boycotts and sanctions, even if prefaced with a nice complement on my passion and intent, seems to miss the point: don't tell me what's wrong, tell me what works or what might work better. Or the intervention that talked about Afghanistan, women and the Taliban (which left out the fact that the problem was likely the result of legacy of a history of British, Soviet, and American imperialism). Then the, for me non sequitur argument that biodiversity collaboration with Russia might be disrupted - what? I really didn't get that one.

One speaker spoke about the immediate and individual effects the illegal invasion was having on graduate students they know. I too know of a student who has family in the Ukraine, they lost a family member early on during the illegal invasion. I confess to being more concerned about these individuals than a colleague who might have to forego a research collaboration right now, or an undergrad wanting a go global experience,  in order for UBC to take a more principled stand.

I am not certain what will be the outcome of this motion. I had to depart the meeting before they came to a resolution (and I don't believe they arrived at one before the meeting ended).  There is a draft resolution being prepared that will include elements of the 'whereas' statement I wrote while completely replacing the 'be it resolved' portion; simultaneously strengthening and narrowing the scope of that actions of the motion.  Once I know I can share that draft, I will (right now it's not clear that I can).