Every time we automate something new, it sparks ecstasy and terror. That's true even for something as mundane as automated essay grading, which has been around for a while, but was added to the EdX platform earlier this year and then heralded in a New York Times article.
The National Council of Teachers of English responded with a statement, "Machine Scoring Fails the Test," listing nine reasons computers can't teach writing. The English teachers' manifesto was vivid, emotive and foolish. They miss the point entirely. Automated essay grading needs to happen, and English teachers should be screaming for it, especially in K-12.
Others hammered EdX for perpetrating hype. The "breathless story weaves a tale of robo-professors taking over the grading process, leaving professors free to kick back their feet and take a nap, and subsequently inviting universities, ever-focused on the bottom-line, to fire all the professors," wrote Elijah Mayfield on the e-Literate blog.
First, the New York Times story doesn't mention napping. Second, when the new school year starts, nobody who teaches writing will be taking any naps thanks to automated essay graders. Instead, teachers will be losing sleep trying to give feedback to scores of students who desperately need more of it. Or, more likely, the students just won't get the feedback they need to improve as writers.
[ So, what about math? Read For Algebra, Spreadsheets Beat Newer Teaching Tools. ]
The EdX tool itself is in alpha; it's been used in two EdX courses, neither of which were writing courses (one is a chemistry class, the other a course on public health). It does use artificial intelligence to give feedback on (and, yes, grade) writing assignments, but it does not have to -- the tool has three possible ways to give feedback: the artificial intelligence-driven tool, peer-grading and assessment, and self-assessment. Teachers can use any or all of them, in any order they like.
The interface is not simple enough, confesses Vik Paruchuri, the EdX machine-learning engineer leading its automated essay-grading tool.
Talking with Paruchuri makes it clear that he's not some evil engineer trying to seize the day from the local high school's beloved Mr. Keating. I have not seen the EdX tool in action, but it is clear that it is not ready for grading papers, and -- at least for now -- is not intended to be that sort of tool.
What it does is help kids learn basics. Paruchuri says comments on the tool from EdX students who've used it are clear: They like that it gives them feedback. Most students do not get enough feedback on their writing, even when they're at good schools. I've taught high school students coming from private schools and been stunned by the obvious lack of feedback they've received on the basics.
An automated essay grading tool like EdX's can give feedback quickly and repeatedly, with consistent comments on what the student could do to improve, and what's working well. It's like giving students one-on-one access to a grammar instructor who will always remain patient, even to the nth time the kid splits an infinitive.
They cannot get such feedback now.