Mobile // Mobile Devices
Commentary
8/5/2013
09:59 AM
Connect Directly
RSS
E-Mail
50%
50%

Automated Essay Grading Software Stirs Debate

Some educators say the benefits of EdX's writing-grading software have been over-hyped. But I see a role for automation in the classroom.

10 Tech Tools To Engage Students
10 Tech Tools To Engage Students
(click image for larger view)
Technology automates. It does other things, too, but its main value, and the thing we fear about it, is its ability to automate.

Every time we automate something new, it sparks ecstasy and terror. That's true even for something as mundane as automated essay grading, which has been around for a while, but was added to the EdX platform earlier this year and then heralded in a New York Times article.

The National Council of Teachers of English responded with a statement, "Machine Scoring Fails the Test," listing nine reasons computers can't teach writing. The English teachers' manifesto was vivid, emotive and foolish. They miss the point entirely. Automated essay grading needs to happen, and English teachers should be screaming for it, especially in K-12.

Others hammered EdX for perpetrating hype. The "breathless story weaves a tale of robo-professors taking over the grading process, leaving professors free to kick back their feet and take a nap, and subsequently inviting universities, ever-focused on the bottom-line, to fire all the professors," wrote Elijah Mayfield on the e-Literate blog.

As if.

First, the New York Times story doesn't mention napping. Second, when the new school year starts, nobody who teaches writing will be taking any naps thanks to automated essay graders. Instead, teachers will be losing sleep trying to give feedback to scores of students who desperately need more of it. Or, more likely, the students just won't get the feedback they need to improve as writers.

[ So, what about math? Read For Algebra, Spreadsheets Beat Newer Teaching Tools. ]

The EdX tool itself is in alpha; it's been used in two EdX courses, neither of which were writing courses (one is a chemistry class, the other a course on public health). It does use artificial intelligence to give feedback on (and, yes, grade) writing assignments, but it does not have to -- the tool has three possible ways to give feedback: the artificial intelligence-driven tool, peer-grading and assessment, and self-assessment. Teachers can use any or all of them, in any order they like.

The interface is not simple enough, confesses Vik Paruchuri, the EdX machine-learning engineer leading its automated essay-grading tool.

Talking with Paruchuri makes it clear that he's not some evil engineer trying to seize the day from the local high school's beloved Mr. Keating. I have not seen the EdX tool in action, but it is clear that it is not ready for grading papers, and -- at least for now -- is not intended to be that sort of tool.

What it does is help kids learn basics. Paruchuri says comments on the tool from EdX students who've used it are clear: They like that it gives them feedback. Most students do not get enough feedback on their writing, even when they're at good schools. I've taught high school students coming from private schools and been stunned by the obvious lack of feedback they've received on the basics.

An automated essay grading tool like EdX's can give feedback quickly and repeatedly, with consistent comments on what the student could do to improve, and what's working well. It's like giving students one-on-one access to a grammar instructor who will always remain patient, even to the nth time the kid splits an infinitive.

They cannot get such feedback now.

Previous
1 of 2
Next
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Page 1 / 2   >   >>
rdokoye
50%
50%
rdokoye,
User Rank: Apprentice
7/9/2014 | 9:45:31 AM
Interesting, my opinion is
I personally like the idea of an automated grading tool, because I think the benefits are two fold, in that they remove prejudice from grading, which is still a major issue and they always make things more clear and cut, there's no grey area, people will know exactly what they've gotten wrong and why. All these applications are the future anyway, as time progresses, we may even transistion to internet schooling.
stephjosh
50%
50%
stephjosh,
User Rank: Apprentice
6/12/2014 | 10:57:41 AM
Very Nice
Your post was good and the information that you giving your post that was really cool. I like it very much. Thanks for posting this. Please
share more information and I will bookmark to my blog sewa mobil jakarta
Stewartagron
50%
50%
Stewartagron,
User Rank: Apprentice
4/3/2014 | 1:36:03 AM
Re: Thanks
My friend wrote a story about his cat that was grammatically correct,and used big words, but made little to no sense. The auto-grader program told him he was approaching PHD level English. So he took his paper into school and showed it to the English teachers who reviled at it. He was like,"Show's what you know, the computer told me I'm university level."How To Get Dissertation Writing Service
<a href="http://www.dissertationarena.co.uk/">Writing Dissertation</a> 
jamesbond7s
50%
50%
jamesbond7s,
User Rank: Apprentice
3/22/2014 | 1:53:02 AM
Thanks
Ya i have check your provided link Education is like other sectors in that technology can -- and should -- be used to leverage what people do best. When technology like this is done well, it can be a boon to teachers and students,

 
Ariella
50%
50%
Ariella,
User Rank: Ninja
12/24/2013 | 9:44:32 AM
re: Automated Essay Grading Software Stirs Debate
Automated scoring for writing has been around for a few years now. I wrote about the debate on the issue in 2012 in Automated Systems 'Grade' Written Work
Helendina
50%
50%
Helendina,
User Rank: Apprentice
12/16/2013 | 9:16:52 AM
re: Automated Essay Grading Software Stirs Debate
Essay grading is informative article and good post.Essay Boutique
Martinberk
50%
50%
Martinberk,
User Rank: Apprentice
12/14/2013 | 12:40:57 PM
re: Automated Essay Grading Software Stirs Debate
One thing I just want to say is that your blog is so perfect.Commercial approaches to essay grading.coursework writing service uk "order coursework now "need coursework
Michael Fitzgerald
50%
50%
Michael Fitzgerald,
User Rank: Moderator
8/9/2013 | 1:54:48 PM
re: Automated Essay Grading Software Stirs Debate
here's a link to an interesting blog post by Vik Paruchuri, quoted in the story above, about the commercial and non-commercial approaches to essay grading. http://vikparuchuri.com/blog/o...
Thx, juliep840
JulieP840
50%
50%
JulieP840,
User Rank: Apprentice
8/8/2013 | 4:14:55 PM
re: Automated Essay Grading Software Stirs Debate
See also this same debate playing out in the medical field: http://www.kevinmd.com/blog/20...
FrankCatalano
50%
50%
FrankCatalano,
User Rank: Apprentice
8/6/2013 | 7:00:38 PM
re: Automated Essay Grading Software Stirs Debate
I know Pearson's WriteToLearn is still actively being sold and is in use in schools. ETS, as I recall, licensed its Criterion service, based on its E-Rater engine, to Houghton Mifflin Harcourt for use in its digital products in K-12 and still offers it directly for other education segments. Vantage Learning's My Access product, based on its IntelliMetric engine, appears to still be available for school and home. (I found active pages for each via Google.)

Side note: Oddly, the harder task is not so much providing good feedback on essays, it's being able to do the same with short answers. That's sort of the Holy Grail of automated text scoring, and I don't know of any organization that has been able to comprehensively nail that.
Page 1 / 2   >   >>
Building A Mobile Business Mindset
Building A Mobile Business Mindset
Among 688 respondents, 46% have deployed mobile apps, with an additional 24% planning to in the next year. Soon all apps will look like mobile apps – and it's past time for those with no plans to get cracking.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek - July 21, 2014
Our new survey shows fed agencies focusing more on security, as they should, but they're still behind the times with cloud and overall innovation.
Flash Poll
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
In this special, sponsored radio episode we’ll look at some terms around converged infrastructures and talk about how they’ve been applied in the past. Then we’ll turn to the present to see what’s changing.
Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.