Dimensions of Difficulty in Translating Natural Language into First Order Logic

Barker-Plummer, Dave, Cox, Richard and Dale, Robert (2009) Dimensions of Difficulty in Translating Natural Language into First Order Logic. In: Proceedings of The Second Annual Conference on Educational Data Mining.

Full text not available from this repository.


In this paper, we present a study of a large corpus of student logic exercises in which we explore the relationship between two distinct measures of difficulty: the proportion of students whose initial attempt at a given natural language to first-order logic translation is incorrect, and the average number of attempts that are required in order to resolve the error once it has been made. We demonstrate that these measures are broadly correlated, but that certain circumstances can make a hard problem easy to fix, or an easy problem hard to fix. The analysis also reveals some unexpected results in terms of what students find difficult. This has consequences for the delivery of feedback in the Grade Grinder, our automated logic assessment tool; in particular, it suggests we should provide different kinds of assistance depending upon the specific difficulty profile of the exercise.

Item Type: Conference or Workshop Item (Paper)
Schools and Departments: School of Engineering and Informatics > Informatics
Depositing User: Richard Cox
Date Deposited: 06 Feb 2012 19:38
Last Modified: 13 Apr 2012 08:48
URI: http://sro.sussex.ac.uk/id/eprint/21624
📧 Request an update