on grades and grading
Posted by Marty Siegel on October 2, 2009
I suspect that many of you were a bit shocked when you saw your grade for Project 1. How can this be? 61? 48? 72? (The average was 69 and there were many grades lower than that.) I’d like to give you some perspective on grades and grading.
Part of the shock, I suspect, emerges from the educational system in which we’ve been raised. We live in a grade-oriented society. From the earliest days of elementary school, parents and teachers conditioned us to value grades—from gold stars to monetary rewards to special privileges. Even our speech is filled with phrases like “making the grade.” Entrance into college or graduate school is based on grades. “What’s your GPA?” is an often-asked question by a program recruiter. So we’ve come to see grades as important and to associate our self-worth with these letter symbols: A, B, C, D, and F!
And those of us who have “made it” to an advanced undergraduate course or a graduate course (or program) has certainly learned how to play the grading game. We know what it takes to get an A or B in a class, and I suspect that we’re all very good at this game—at least compared to most people in the population.
But then comes along this course called “Interactive Design Practice” and the rules of the game seem to change. It appears to be more of a critique culture where positives and negatives are provided through commentary. It sometimes is difficult to know the basis for the comments or even if they’re valid. And to receive them from people who are hardly more advanced than we, makes it that more difficult to accept. There’s a new kind of game that’s being played and it’s not clear how it’s played or even if it’s worth playing. These are anxious feelings and, if we’re honest with ourselves, they evoke a little fear.
Why the fear? Perhaps it’s because the new game is not synchronous with our image of self. Our academically successful self (image) may be at odds with current messages. “Something is wrong,” we think; “it’s either the system (the course, the instructor, the mentors) or it’s me.” And accepting the later is a somewhat scary proposition.
My answer may surprise you. It’s neither. What you’re feeling is genuine learning—intellectual and emotional growth. You don’t recognize it because it’s not felt very often; but there it is.
And you will experience more genuine learning if you just allow it to happen. The more you resist it, the more you delay the pleasures of learning. Your tool is not perfection but failure. Fail early and fail often so that you may learn. A “how to” manual only hinders the insights; rather, experience and reflection within realistic settings are the paths to insight.
You are learning a complex skill. Even the simplest of designs requires a great deal of expertise. No real problem is simple; they’re messy and ill-structured; they’re wicked problems. And it takes a great deal of skill to both understand the problem and then to address it. How long does it take to develop that expertise? A long time; it requires a lot of practice. (Malcolm Gladwell, in his book, Outliers, claims that it takes approximately 10,000 hours to get good at anything.)
Look at this segment of Stephen Sondheim leading a master’s class to this young and talented singer, teaching her to sing his famous song “Send in the Clowns.” [http://www.youtube.com/watch?v=8-VXXZLh2a0] What did you learn from watching this master teacher/student interaction? Notice that she began as quite an accomplished singer; to our untrained ear we may not have noticed anything wrong in her phrasing or pronunciation. But to the expert perception of Sondheim, subtle problems are exposed.
* * *
So here’s what you need to do to get better. Keep trying. A low score is just an indication of where you are today. It is as honest an assessment as we can make it. And fortunately, it’s not a particularly good predictor of where you’ll be at the end of the semester (and why this score is worth only 60 points out of 1000). What separates you from excellence is hard work and more practice.
The post-it notes are a set of judgments. With some you may agree. With others you may reject outright. Still others you may not be sure about. Keep the post-it notes with which you agree. Remove the post-it notes that you reject (but make sure you have a very good reason for the rejection). And for the comments that confuse you, talk to a mentor or me about them; learn from these comments.
Yes, some of the comments may appear contradictory. But that’s no different than two movie reviewers providing conflicting reviews of the same movie. Both reviewers understand their craft, but each chooses to focus on different things. Oddly, both are correct.
It reminds me of an old joke I heard years ago (and told by Meyer Levin, http://www.meyerlevin.com/joke.html):
In a small town in Russia, people brought their complaints to the Rabbi to settle their differences. This day, two men were before the Rabbi.
He listened to one man and said, “You are right.”
He listened to the second man and said, “You are right.”
When they left, his wife, who was listening in the next room, said to him, “You’re supposed to be some kind of judge? How can they both be right?”
He listened to her and said, “You know? You’re right, too.”
In the end we must develop our own truths about what makes for good design. As we progress through the semester you will learn some big concepts about good design (I refer to these as the “seven themes”). And you will learn a framework for creating a design rationale or a design argument (Eli Blevis and I refer to this as the PRInCiPleS framework). These tools will help you. But only through experience, hard work, and exploring alternatives under varying contexts will you begin to create your internal criteria for good design. And when you’ve done that, you can say, “I am a designer.”
[Postscript. In all the years I have talked to recruiters and employers, not a single one has asked me about a student’s grades. Instead, they ask me how this person gets along with others; how this person leads a team; how this person collaborates; and how this person designs. But not once was I asked, “What grades did this person achieve?” Ironically, after many years of being taught the importance of grades, they don’t matter. Performance does. Being a good human being does.]
Jenna said
Not being enrolled in the course you discuss here, I of course have no idea what project you’re referring to or what the context for the grades is. But ignorance has never stopped me from weighing in.
::drags soapbox into middle of room::
I am fully on board with the learning through failure model, as long as the failure is productive–that is, as long as it clarifies some important idea or motivates the learner to try again. The higher you get in education, the more valuable and productive failure becomes (until you get your Ph.D., of course, and then you’re not allowed to fail professionally anymore because they’ll take your funding or tenure potential away).
But too often, productive failure is linked to a summative assessment: a grade, which, unless the student can return to the project and redo it for a potentially higher grade, sticks around all semester. Failure is formative unless it’s treated summatively. Failure is formative unless it comes at too high a cost.
The F/L/OSS movement supports what Clay Shirky calls a “failure for free” model, which constrasts sharply with the “failure at too high a cost” model embraced by corporations and, increasingly, institutions of education.
::puts soapbox away::
That having been said, I wish I was in this class. It sounds fantastic.
Holt Ellis said
For some reason when I read these posts many emotions seem to fill me. The very last line of the postscript is what got me…
‘Being a good human being does’
So much of group dynamics come back to this very idea, to respect people, and to always be thinking about things from others perspectives and not always your own is so important. We never know what people are going through, and it is so important to keep that in mind. I apologize because this is not really a comment on ‘grading’ but I just wanted to throw my two cents in.
navreddy said
“The post-it notes are a set of judgments. With some you may agree. With others you may reject outright. Still others you may not be sure about. Keep the post-it notes with which you agree. Remove the post-it notes that you reject (but make sure you have a very good reason for the rejection). And for the comments that confuse you, talk to a mentor or me about them; learn from these comments.”
Marty ! I probably will never forget what you said in yesterday’s class ” Every great artist takes in the criticism which he feels is truly right and the rest is all bullshit”
Evan Lipton said
I remember last year as an undergraduate in I441 – I was absolutely stunned by my first grade – probably about 25% lower than I had expected. But by this time last semester, I had other things on my mind that took priority over school and grades. In a way, that was a blessing. I don’t advise any of you experience a distraction to the magnitude of importance that mine was, as only a few things could be more important than my overall academics; I’ve been there. And I am still not done. I’m still going, and my first project (yes it was the SAME one) this year, it only improved by ~15%. But it has risen! This is great because with my mathematical mind, i am able to now visibly see my progress with learning design.
I guess I am just throwing out a bunch of ‘half baked’ thoughts — but here is my point… You may be scared for your grade… but I promise it will work itself out in the end. It is all about the journey, not the destination.
“Why the fear? Perhaps it’s because the new game is not synchronous with our image of self. Our academically successful self (image) may be at odds with current messages. “Something is wrong,” we think; “it’s either the system (the course, the instructor, the mentors) or it’s me.” And accepting the later is a somewhat scary proposition.” — Marty Siegel
Marty clearly knows what we’re going through, as he has watched countless students progress through the stages over the years. He will not let us down, I know this. Last year while I was having a difficult time with life outside of school, I thought that the ’scary proposition’ was the right answer… but I realized through real life experiences and reflection, and Marty’s class last year………. that it is only that scary proposition if you allow it to be.
I am more than willing to talk to any undergraduates that may want to discuss concerns with their progress, as I was once in your shoes. I’ll help you out, talk to you about ideas, and show you some cool shit along the way! This invitation is of course extended to anyone – but I thought I’d offer it to the noobs since its their first time in the IDP curriculum
Evan Lipton said
Also- it is all the way you look at things – that ‘blessing’ I had last year was actually the worst experience of my life. It’s situational: either half full or half empty. Find a hobby. Find time to go for a run. Find time to call a friend (ie; me) and go play some soccer. Find something to do BESIDES school.
Brian Oppenlander said
It’s somewhat sickening to think about the grading system in the U.S. Everyone cares about how you look on paper more than the actual person. We’ve all been trained to do the bare minimum in order to get the grade that we want – we are experts at that.
micah_gideon said
I agree with this philosophy. I’m certainly much more interested in improving my skills than I am in hearing how weak or strong they are. If I was awarded consistent As and nothing but praise, I’d probably question why I was in this class in the first place.
For further reading, I recommend taking a look at one of my favourite articles, How Not to Talk to Your Kids by Po Bronson.
ninamehta said
I really agree with this too. In the Wednesday night class, Marty asked/suggested all the students in the room were top-notch students in undergrad.
Not me. During the first chunk of undergrad so many of my grades were based on regurgitating information onto an exam for the grade which was incredibly difficult for me. So, my grades suffered. There was a disconnect, my grades soared in the essay portions but it seemed like someone completely different took the multiple choice selections. Finally I was enrolled in proper journalism, design and political science theory classes and I could finally perform in my classes but there have been a lot of stretch marks along the way.
In high school my closest friends had come from the magnet school and were in AP classes. They were stellar exam takers and I was not. But, then, I learned how to study and how to work hard. I used to wonder if I was “smart” because I felt like such a dope. I don’t do that as much anymore.
I always felt like I was working twice as hard to get half the grades in non-fancy “advanced placement” classes. But then, something magical happened. When all of a sudden, I realized, grades weren’t getting people jobs or experiences, I developed “working” skills, developed a lot of cool projects at the IDS, made a strong network in my then professional community.
At the time, I got what was my dream job, or at least pretty close. Whereas some (not all) friends with AP credits, straight As (is it A’s? The A is not possessive), 1600s on the SAT were having a trouble finding work or not even sure what they wanted to do. Because traditional school was so difficult for me, I had to find other places to be successful, like IU student media which led me down my journalism career path. I had so many non-academic experiences and tools on my belt to take with me because I had such a tough time with “grades.”
Getting “crappy” grades taught me to be good at a lot of other good things. It never gets easier to see low scores on something where you worked hard.
Before I came to this program, I met with Marty to “state my case” for why I wanted to join HCId at IU. I explained my grades and GRE scores. I remember exactly what he said that struck a strong chord with me. He said, there’s no one thing that will keep you out of the program (grades, work experience, nationality, etc) but one thing that will help you get in is: the ability work hard. After that, I relaxed and knew this is where I needed to be next.
Ravi said
Inspiring stuff Nina !!
Truly moved
With great respect.
Ravi