Machine
Scoring of Essays and Computer Analysis: A Bibliography
(lightly keyworded)
Richard
H. Haswell
Texas A&M University, Corpus Christi
August, 2005
Additions Fall 2008
(Thanks to Richard Matzen for a number of items)
Ajay, Helen Beuck. (1973). Strategies for content analysis of essays by computer [doctoral thesis]. Storrs, CT: University of Connecticut. computer-analysis, essay, content, machine-scoring
Ajay, Helen Beuck; Ellis Batten Page. (1973). Analysis of essays by computer (AEC-II) (Final report to the National Center for Educational Research and Development). Washington, D. C.: Office of Education, Bureau of Research. machine-scoring, computer-analysis, ess
Anderson, C. W.; G. E. McMaster. 1982. Computer assisted modeling of affective tone in written documents. Computers and the Humanities 16, pp. 1-9. tone, register, computer-analysis
Andeweg, Bas A.; J. C. de Jong; R. Natadarma. (1996). Improving writing skills through Ganesh. In Rijlaarsdam, Gert; Huub van den Bergh; Michel Couzijn (Eds.), Effective teaching and learning of writing: Current trends in research; Amsterdam: Amsterdam University Press. Pp. 110-123. machine-scoring, Ganesh
Anonymous. (2002, July). Underachieving schools to receive online development tool. USDLA Journal 16.7. <http://www.usdla.org>. school, computer-analysis
Anonymous. (2003). High schools plug into online writing programs. District Administration 39.11, p. 11. machine-scoring, school
Anson, Chris M. Responding to and assessing student writing: The uses and limits of technology. (2002). In Pamela Takayoshi; Brian Huot (Eds.), Teaching writing with computers: An introduction. Boston: Houghton Mifflin. Pp. 234-246. responding, computer-analysis
Attali, Yigal. 2004. Exploring the feedback and revision features of Criterion. Princeton, NJ: Educational Testing Service. http://www.ets.org/research/dload/NCME_2004-Attali.pdf. machine-scoring, Criterion, revising, feedback, data
Baron, Dennis. (1998). When professors get A's and the machines get F's. Chronicle of Higher Education (20 November), p. A56. machine-scoring, computer-analysis, commercial
Barth, Rodney J. (1979). ERIC/RCS report: An annotated bibliography of readings for the computer novice and the English teacher. English Journal 68.1, pp. 88-92. bibliography, annotated, computer, practice, ERIC, machine-scoring
Bejar, Isaac I. 1996. Generative response modeling: Leveraging the computer as a test delivery medium (English Report, No. ETS-RR-96-13). Princeton, NJ: Educational Testing Service. ERIC Document Reproduction Service, ED 401 302. machine-scoring, examination, response
Bennett, Randy E. 1993. Toward intelligent assessment: An integration of constructed-response testing, artificial intelligence, and model-based measurement. In Test theory for a new generation of tests, edited by Norman Frederiksen, Robert J. Mislevy, and Isaac I. Bejar. Hillsdale, NJ: Lawrence Erlbaum. AI, assessment, machine-scoring
Bennett, Randy E., and William C. Ward, eds. 1993. Construction versus choice in cognition measurement: Issues in constructed response, performance testing, and portfolio assessment. Hillsdale, NJ: Lawrence Erlbaum. response, assessment, portfolio, machine-scoring
Bennett, Randy E.; I. I. Bejar. (1998). Validity and automated scoring: It's not only the scoring. Educational Measurement: Issues and Practice 14.4, pp. 9-12. computer-analysis, machine-scoring, validity
Bereiter, Carl. 2003. Foreward. In Automated Essay Scoring: A Cross Disciplinary Perspective, edited by Mark D. Shermis and Jill Burstein, vii-x. Mahwah, NJ: Lawrence Erlbaum. machine-scoring
Bergler, Sabine. 1995. From lexical semantics to text analysis. In Saint-Dizier, Patrick; Evelyne Viegas (Eds.), Computational lexical semantics, Cambridge, England: Cambridge University Press. Pp. 98-124. computer-analysis, lexical, semantic, machine-reading
Bishop, Robert L. 1974. Computing in the teaching of journalistic skills. On-Line 3 (3): 5-12. computer-analysis, machine-scoring, journalism
Borja, Rhea R. (2003, January 6). A. G.: Artifical grader. USA Today, p. 11D. ETS, E-rater, Vantage Learning, IntelliMetric, machine-scoring, human-machine, cost-analysis, cost-efficiency
Breland, Hunter M. (1996). Computer-assisted writing assessment: The politics of science versus the humanities. In White, Edward M.; William D. Lutz; Sandra Kamusikiri (Eds.), Assessment of writing: Politics, policies, practices; New York: The Modern Language Association of America. Pp. 249-256. machine-scoring, electronic-grading
Breland, Hunter M.; Eldon G. Lytle. (1990). Computer-assisted writing skill assessment using WordMAP (paper presented at the American Educational Research Association, Boston, April 1990). http://www.writinglab.com/brelandlytle.html. computer-analysis, machine-scoring, interrater-reliability, data, correlation, WordMAP
Brock, Mark N. 1995. Computerised text analysis: Roots and research. Computer Assisted Language Learning 8.2-3, pp. 277-258. computer-analysis, history
Bulkeley, William M. (1997, December 12). Take good notes, MBA hopefuls, this glitch is a real-world lesson. Wall Stree Journal B, Eastern Edition 230.116, p. B1. GMAT, ETS, process, machine-error
Burstein, Jill, and Daniel Marcu, 2004. A machine learning approach for identification of thesis and conclusion statements in student essays. Computers and the Humanities 37 (4): 455-467. machine-scoring, response, thesis, conclusion
Burstein, Jill, Karen Kukich, S. Wolff, C. Lu, and Martin Chodorow. 1998. Enriching Automated scoring using discourse marking. Paper presented at the workshop on discourse relations and discourse marking at the annual meeting of the Association of Computational Linguistics. Montreal, Canada. machine-scoring, discourse marking
Burstein, Jill, Karen Kukich, S. Wolff, C. Lu, Martin Chodorow, L. Braden-Harder, and M. D. Harris. 1998. Automated scoring using a hybrid feature identification technique. In Proceedings of the Annual Meeting of the Association of Computational Linguistics. Montreal: Association of Computational Linguistics. machine-scoring, feature identification
Burstein, Jill. (1998). Computer analysis of essay content for automated score prediction: A prototype automated scoring system for GMAT analytical writing assessment essays (Research Report RR-98-15). Princeton, NJ: Educational Testing Service. machine-scoring, E-rater, ETS, GMAT, large-scale, assessment, predictive
Burstein, Jill. (1999). Enriching automated essay scoring using discourse marking. COLING-ACL '98 : 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, Aug. 10-14, 1998, Montreal, Quebec, Canada : Proceedings of the conference. machine-scoring, discourse-marking
Burstein, Jill. 2003. The E-rater¨ scoring engine: Automated essay scoring with natural language processing. In Automated essay scoring: A cross-disciplinary perspective, edited by Mark D. Shermis and Jill Burstein, 113-121. Mahwah, NJ: Lawrence Erlbaum. machine-scoring, e-Rater
Burstein, Jill.; S. Wolff; C. Lu. (1999). Using lexical semantic techniques to classify free-responses. In Viegas, Evelyne (Ed.), Depth and breadth of semantic lexicons; Dordrecht; Boston, MA: Kluwer Academic Press. machine-scoring, lexical, semantic, algorithm
Burstein, Jill; Daniel Marcu. (2000). Toward using text summarization for essay-based feedback. Conference presentation, Conference TALN 2000, Lausanne, 16-18 octobre. machine-scoring, GMAT, E-rater, summary-writing, essay-summary, feedback
Burstein, Jill; Daniel Marcu. 2000. Benefits of modularity in an automated essay scoring system. In Proceedings of the workshop on using toolsets and architectures to builod NLP systems, 18th International Conference on Computational Linguistics, Luxembourg, August 2000. http://ftp.ets.org/pub/res/erater_colinga4.pdf. machine-scoring, essay-exam, modularity
Burstein, Jill; Daniel Marcu. 2003. Automated evaluation of discourse structure in student essays. In Shermis, Mark D.; Jill Burstein (Eds.), Automated essay scoring: A cross disciplinary perspective; Mahwah, NJ: Lawrence Erlbaum, pp. 209-230. machine-scoring, essay
Burstein, Jill; Daniel Marcu; S. Andreyev; Martin Chodorow. (2001). Towards automatic classification of discourse elements in essays. In Proceedings of the 39th annual meeting of the Association for Computational Linguistics, France. Pp. 90-92. computer-analysis, machine-scoring, arrangement, measurement, topic-sentence, introduction, conclusion
Burstein, Jill; Derrick Higgins. 2005. Advanced capabilities for evaluating student writing: Detecting off-topic essays without topic-specific training. In Proceedings of the International Conference on Artificial Intelligence in Education, Amsterdam. http://www.ets.org/research/erater.html. machine-scoring, corruptibility, off-topic
Burstein, Jill; Karen Kukich; L. Braden-Harder; Martin Chodorow; S. Hua; B. Kaplan, et al. (1997). Computer analysis of essay content for automatic score prediction: A prototype automated scoring system for GMAT analytical writing assessment (Research report-98-15). Princeton, NJ: Educational Testing Service. machine-scoring, GMAT, assessment
Burstein, Jill; Karen Kukich; S. Wolff; C. Lu; Martin Chodorow. (1998). Computer analysis of essays. Princeton, NJ: Educational Testing Service. machine-scoring
Burstein, Jill; Lawrence T. Frase; April Ginther; Leslie Grant. (1996). Technology and language assessment. Annual Review of Applied Linguistics. machine-scoring, computer-analysis
Burstein, Jill; Martin Chodorow. (1999). Automated essay scoring for nonnative English speakers. In Association for Computational Linguistics (Ed.), 37th annual meeting of the Association for Computational Linguistics: Proceedings of the conference : 20-26 June 1999, University of Maryland, College Park, Maryland, USA; New Brunswick NJ: Association for Computational Linguistics <http://www.ets.org/research/dload/acl99rev.pdf>. machine-scoring, ESL, nonnative
Burstein, Jill; R. M. Kaplan. (1995). On the application of context to natural language processing applied to the analysis of test responses. In IJCAI: Proceedings from the workshop on context in natural language prcessing; Montreal: International Joint Conference on Artificial Intelligence. machine-scoring, testing, contextual, AI, essay-test
Burstein, Jill; S. Wolff; C. Lu. (1999). Using lexical semantic techniques to classify free-responses. In Viegas, Evelyne (Ed.), Breadth and depth of semantic lexicons; New York: Kluwer. Pp. 227-246. machine-scoring, computer-analysis, semantic, lexicon
Byerly, Gayle A. 1978. CAI in College English. Computers and the Humanities 12 (3): 281-285. CAI
Calfee, Robert. (2000). To grade or not to grade. IEEE Intelligent Systems 15.5, pp. 35-37. machine-scoring, grading
Carnevale, Dan. 2005. Professor develops software to help grade essays. Chronicle of Higher Education (August 5), p. A29. machine-scoring, essay, University of Missouri
Chase, Clinton I. (1999). Contemporary assessment for educators. New York: Addison-Wesley Longman. assessment, machine-scoring
Chase, Clinton I. (1999). Contemporary assessment for educators. ERIC Document Reproduction Service, ED 425 177. machine-scoring, assessment, school
Cheville, Julie (2004). Automated scoring technologies and the rising influence of error. English Journal 93.4 (March), pp. 47-52. machine-scoring, error, Criterion, ETS, curriculum, industry, conflict
Chodorow, Martin; Jill Burstein. 2004. Beyond essay length: Evaluating e-rater's performance on TOEFL essays (Report Nos. RR-04-04; TOEFL-RR-73). Princeton, NJ: Educational Testing Service. machine-scoring, essay-length, TOEFL, quality, correlation, ESL
Chodorow, Martin; Claudia Leacock. 2000. An unsupervised method for detecting grammatical errors. Proceedings of the first conference on North American chapter of the Association for Computational Linguistics (ACM International Conference Proceedings Series, Vol. 4). Pp. 140-147. error-detection, computer-analysis, TOEFL
Chung, Gregory K. W. K.; Eva L. Baker. 2003. Issues in the reliability and validity of automated scoring of constructed responses. In Shermis, Mark D.; Jill Burstein (Eds.), Automated essay scoring: A cross disciplinary perspective; Mahwah, NJ: Lawrence Erlbaum, pp. 23-40. machine-scoring, reliability, validity
Chung, Gregory K. W. K.; Harold F. O'Neil, Jr. (1997). Methodological approaches t online scoring of essays (Report No. CSE-TR-461). Los Angeles, CA: University of California, Los Angeles; Center for the Study of Evaluation, Standards, and Student Testing [ERIC Document Reproduction Service, ED 418 101]. direct, machine-scoring, computer-analysis
Cizek, Gregoy J.; Bethany A. Page. 2003. The concept of reliability in the context of automated essay scoring. In Shermis, Mark D.; Jill Burstein (Eds.), Automated essay scoring: A cross disciplinary perspective; Mahwah, NJ: Lawrence Erlbaum, pp. 125-146. machine-scoring, reliability
Clauser, Briam E.; R. G. Subhiyah; Ronald J. Nungester; D. R. Ripkey; Stephen G. Clyman; D. McKinley. (1995). Scoring a performance-based assessment by modeling the judgments of experts. Journal of Educational Measurement 32, pp. 397-415. machine-scoring, performance-based, correlation, expert-rater
Clauser, Brian E.; D. B. Swanson; Stephen G. Clyman. (1999). A comparison of the generalizability of scores produced by expert raters and automated scoring systems. Applied Measurement in Education 12, pp. 281-299. machine-scoring, expert-rater, correlation, generalizability
Clauser, Brian E.; Melissa J. Margolis; Stephen G. Clyman; Linette P. Ross. (1997). Development of automated scoring algorithms for complex performance assessments: A comparison of two approaches. Journal of Educational Measurement 34, pp. 141-161. machine-scoring, algorithm, contrast-group, text-analysis
Clauser, Brian E.; P. Harik; Stephen G. Clyman. 2000. The generlizability of scores for a performance assessment scored with a computer-automated scoring system. Journal of Educational Measurement 37, pp. 245-261. computer-analysis, machine-scoring, diagnosis, medical, machine-human, validity, reliability, regression-analysis
Clayton, Mark. (1999, January 12). Essays get the electronic pen. Christian Science Monitor 91.32, p. 19. Intelligent Essay Assessor, ETS, GMAT, machine-scoring, human-machine, evaluation
Cole, Jason C.; Anthony D. Lutkus. (1997). Score comparisons of ACCUPLACER (computer-adaptive) and COMPANION (paper) reading tests: Empirical validation and school policy. Research in the Schools 04.2, pp. 65-70. machine-scoring, placement, reading, Accuplacer, human-machine, data
College Entrance Examination Board (Ed.). (1991). Computerized Placement Tests: Background readings. ERIC Document Reproduction Service, ED 339 728. machine-scoring, CEEB, assessment, Computerized Placement Test (CPT) placement, predictive
Conference on College Composition and Communication Committee (Kathleen Yancey, Chair). 2005. Position Statement on Teaching, Learning, and Assessing Writing in Digital Environments. College Composition and Communication, 55 (4): 785-789. http://www.ncte.org/groups/cccc/positions/115775.htm. machine-scoring
Coombe, Christine A. (Ed.). (1998). Current trends in English language testing: Conference proceedings for CTELT 1997 and 1998, Vol. 1. ERIC Document Reproduction Service, ED 428 574. machine-scoring, ESL
Coombs, Don H. (1969). Review [of Ellis B. Page and Dieter H. Paulus, The analysis of essays by computer]. Research in the Teaching of English 03.2, pp. 222-228. Ellis B. Page, Dieter H. Paulus, computer-analysis, machine-scoring
Cooper, Charles R. (1974). Research roundup: Oral and written composition: Henry Slotnick, a model of computer essay grading. English Journal 63, pp. 103-104. machine-scoring, computer-analysis, essay-grading, Henry Slotnick
Daigon, Arthur. (1966). Computer grading of English composition. English Journal 55.1, pp. 46-52. machine-scoring, computer-analysis, CEEB, spelling, usage, style
Dale, Robert; Shona Douglas. (1997). Two investigations into intelligent text processing. In Sharples, Mike; Thea van der Geest (Eds.), The new writing environment: Writers at work in a world of technology; Berlin: Springer-Verlag. Pp. 123-145. machine-scoring, computer-analysis
Davies, Roy. 1989. The creation of new knowledge by information retrieval and classification. The Journal of Documentation 45 (4): 273-301. computer-analysis, information retrieval
Dearlove, Des. (2003, October 2). Think you could be a contender? The Times [UK], p. 5. GMAT
Deerwester, Scott, Susan T. Dumais, George W. Furnas, Thomas K. Landauer, & Richard Harshman. 1990. Indexing by latent semantic analysis. Journal of the American Society for Information Science 41: 391-407. computer-analysis, LSA, semantic
DeLoughry, T. J. 1995. Duke professor pushes concept of grading essays by computer. Chronicle of Higher Education (October 20), pp. A24-25. machine-scoring, Duke University, essay
DeWitte, Dave. (2003, December 12). Pearson Education to share GMAT testing contract with Iowa's ACT. The Gazette [Cedar Rapids, IA]. <http://www.gazetteonline.com>. GMAT, ACT, machine-scoring
Dieterich, Daniel J. (1972). Composition evaluation: Options and advice. English Journal 61.8, pp. 1264-1271. evaluation, lay-reader, response, audiotape, machine-scoring, grading
Dobrin, David N. 1985. Limitations on the use of computers in composition. ERIC Document Reproduction Service, ED 261 395. computer-analysis, CAI, composition teaching
Drechsel, Joanne. (1999). Writing into silence: Losing voice with writing assessment technology. Teaching English in the Two Year College 26, pp. 380-387. machine-scoring, assessment, two-year
Ediger, Marlow. (2000). Assessing student progress in spelling. ERIC Document Reproduction Service, ED 439 441. computer-analysis, spelling
Elliot, Scott 2003. Intellimetricª: From here to validity. In Automated essay scoring: A cross-disciplinary perspective, edited by Mark D. Shermis and Jill Burstein, 71-86. Mahwah, NJ: Lawrence Erlbaum. machine-scoring, Intellimetric
Ericsson, Patricia; Richard H. Haswell (Eds.). (Forthcoming). Machine scoring of student essays: Truth and consequence. machine-scoring, validity, theory, data
eSchool News. 2005. Michigan to grade essays via computer. eSchool News (Jan. 25). http://www.eschoolnews.com. machine-scoring, school, Michigan
Ezarik, Melissa. (2004). Vantage Learning. District Administration 40.2, p. 72. machine-scoring, Vantage, school
Felix, Uschi. (1993). Marking: A pain in the neck! The Computer to the rescue. Babel: Australia 28.3, pp. 15-15. computer-analysis, machine-scoring, paperload, commenting
Finn, Patrick J. (1977). Computer-aided description of mature word choices in writing. In Cooper, Charles R.; Lee Odell (Eds.), Evaluating Writing: Describing, Measuring, Judging; Urbana, IL: National Council of Teachers of English. Pp. 69-90. diction, vocabulary, machine-scoring, computer-analysis
Fitzgerald, Kathryn R. (1994). Computerized scoring? A question of theory and practice. Journal of Basic Writing 13.2, pp. 3-17. machine-scoring, computer-analysis, placement, theory
Foltz, Peter B. 1998. Quantitative approaches to semantic knowledge representations. Discourse Processes 25 (2-3): 127-130. computer-analysis, semantic
Foltz, Peter W. 1996. Latent semantic analysis for text-based research. Behavior Research Method, Instruments, and Computers 28, pp. 197-202. computer-analysis, semantic
Foltz, Peter W., Walter Kintsch, and Thomas K. Landauer. 1993. An analysis of textual coherence using latent semantic indexing. Paper presented at the Third Annual Conference of the Society for Text and Discourse. Boulder, CO. computer-analysis, coherence, cohesion, semantic, LSA
Foltz, Peter W.; Darrell Laham; Thomas K. Landauer. (1999). Automated essay scoring: Applications to educational technology. In Collis, Betty; Ron Oliver (Eds.), Ed Media 1999: World conference on educational multimedia, hypermedia & telecommunications, Seattle, Washington, USA, June 19-24, 1999; Charlottesville, VA: Association for the Advancement of Computing in Education. Pp. 939-944. machine-scoring, technology, pedagogy
Foltz, Peter W.; M. A. Britt; C. A. Perfetti. 1994. Where did you learn that? Matching student essays to the texts they have used. Paper presented at the Fourth Annual Conference of the Society for Text and Discourse, Washington D. C. machine-scoring, essay-exam, computer-analysis
Foltz, Peter. 1990. Using latent semantic indexing for information filtering. In Proceedings of the Conference on Office Information Systems, edited by R. B. Allen, 40-47. New York: ACM Press. machine-scoring, LSA, semantic
Forehand, Garlie A. (1987). Development of a computerized diagnostic testing program. Collegiate Microcomputer 05.1, pp. 55-59. machine-scoring, computer-analysis, ETS, feedback, student-opinion, diagnostic
Forehand, Garlie A.; Myrtle W. Rice. (1987) -1988. Diagnostic assessment in instruction. Machine-Mediated Learning 02.4, pp. 287-96. machine-scoring, basic, feedback, validity, pracctice, GUIDES
Foster, Andrea L. (2002). Plagiarism-detection tool creates legal quandary. The Chronicle of Higher Education (May 17), pp. A37. computer-analysis, plagiarism
Hake, Rosemary. (1977). A test to teach to: Composition at Chicago State University. ADE Bulletin, no. 52, pp. 31-37. assessment, machine-scoring, rubric, criteria, Chicago State University, African-Am, error, reliability, teacher-raters, data, frequency, holistic, arrangement, coherence, paragraph, MX, usage, punctuation, error-sheet
Hansen, Brian. (2003). Combating plagiarism. CQ Researcher 13.32 (September 19), pp. 773-796. computer-analysis, plagiarism
Harrington, Susanmarie; Mark D. Shermis; Angela L. Rollins. (2000). The influence of word processing on English placement test results. Computers and Composition 17.2, pp. 197-210. pencil-computer, contrast-group, evaluation
Hartnett, Carolyn G. (1978). Measuring writing skills. ERIC Document Reproduction Service, ED 170 014. evaluation, measurement, holistic, primary-trait, peer-evaluation, t-unit, sentence-combining, machine-scoring, cohesion, direct-indirect, data, predictive, basic, placement
Hearst, Marti A. 2000. The debate on automated essay grading. IEEE Intelligent Systems 15.5, pp. 22-35. http://www.knowledge-technologies.com/papers/IEEEdebate.pdf. machine-scoring, essay
Hermann, Andreaq. (1991). Evaluating computer-supported writing. In Gail E. Hawisher; Cynthia L. Selfe (Eds.), Critical perspectives on computers and computer instruction (pp. 44-69); New York: Teachers College Press. machine-analysis, grammar-check, evaluation
Herrington, Anne; Charles Moran (2001). What happens when machines read our students' writing? College English 63.4, pp. 480-499. machine-scoring, commercial, history, ETS, WritePlacer Plus, Intellimetric, construct validity, text-analysis, evaluation, College Board, Intelligent Essay Assessor, latent semantic analysis, corruptibility, plagiarism
Hiller, Jack H. (1998). Applying computerized text measurement strategies from Project Essay Grade (PEG) to military and civilian organizational needs. ERIC Document Reproduction Service, ED 418 995. machine-scoring, instruction-writing, Project Essay Grade (PEG), feedback, style-analysis, computer-analysis, idiom, nominalization, active-passive, sentence-length, trite, specificity, vagueness
Hirschman, Lynette; Eric Breck; Marc Light; John D. Burger; Lisa Ferro. (2000). Automated grading of short-answer tests. IEEE Intelligent Systems 15.5, pp. 31-35. machine-scoring, essay-exam, short-answer, human-machine, computer-program
Hock, Dennis J. (1990). A correlational study of computer-measured traits and holistic assessment ratings of first-year college students' essays [doctoral thesis]. Indiana, PA: Indiana University of Pennsylvania. computer-analysis, style-checker, machine-scoring, Grammatik III, holistic, correlation, evaluation, machine-human
Honan, William H. (1999, January 27). High tech comes to the classroom: Machines that grade essays. The New York Times 148.51415, p. B8. E-rater, ETS, GMAT, machine-scoring
Howard, Rebecca Moore. (2003). Should educators use commercial services to combat plagiarism? No. CQ Researcher 13.32 (September 19), p. 789. plagiarism, computer-analysius
Huot, Brian. Computers and assessment: Understanding two technologies. (1996). Computers and Composition 13, pp. 231-244. computer-analysis, assessment
Huot, Brian; Michael Neal. Writing assessment: A techno-history. (2005). In Charles A. MacArthur, Steve Graham, & Jill Fitzgerald (Eds.), Handbook of Writing Research (New York: Guilford Press), pp. 403-416. computer-analysis, assessment, machine-scoring, review-of-research
Hurwitz, Sol. (2004, May 19). Indiana essays being graded by computers. The New York Times. <http://www.nytimes.com/2004/05/19/education/19indiana.htm>. state-mandated, large-scale, ETS, E-rater, machine-scoring
Jobst, Jack. (1984). Computer-assisted grading of essays and reports. Computers and Composition 01.2, p. 5. computer, machine-scoring, computer-analysis, electronic-grading
Jobst, Jack. (1984). Computer-assisted grading: The electronic handbook. Journal of Teaching Writing 03.2, pp. 225-235. machine-scoring, computer-analysis, electronic-grading, handbook, computer
Johnson, V. E. (1996). On Bayesian analysis of multirater ordinal data: An application to automated essay grading. Journal of the American Statistical Association 91.433, pp. 42-51. machine-scoring, stastical-method, interrater-reliability
Jones, Brett D. (1999). Computer-rated essays in the English composition classroom. Journal of Educational Computing Research 20.2, pp. 169-187. machine-scoring, essay, teacher-opinion, response
Kaplan, R. M.; R. E. Bennett. (1994). Using the free-response scoring tool to automatically score the formulating-hypothesis item (ETS Technical report GRE 90-02b). Princeton, NJ: Educational Testing Service. machine-scoring, hypothesis-formulation
Kaplan, Randy M.; Susanne Wolff; Jill Burstein; Chi Lu; Bruce Kaplan. 1998. Scoring essays automatically using surface features (GRE Report, No. 94-21P). Princeton, NJ: Educational Testing Service. machine-scoring, data
Keith, Timothy Z. 2003. Validity of Automated Essay Scoring Systems. In Automated essay scoring: A cross-disciplinary perspective, edited by Mark D. Shermis and Jill Burstein, 147-167. Mahway, NJ: Lawrence Erlbaum. machine-scoring, validity
Keith, Timothy Z. Construct validity of PEG. (1998). Paper presented at the annual meeting of the American Educational Research Association. San Diego, CA. April. machine-scoring, PEG
Kelly, P. Adam. (2001). Computerized scoring of essays for analytical writing assessments: Evaluating score validity. ERIC Document Reproduction Service, ED 458 296. machine-scoring, E-rater, ETS, GRE, factoring, human-machine, holistic
Kemp, Fred. (1992). Who programmed this? Examining the instructional attitudes of writing support software. Computers and Composition 9.1, pp. 9-24. CAI, interactive, programming, software
Kladko, Brian. (2001, July 9). Computer technology passes judgment on students' essays. The Record [Hackensack, NJ]. <http://www.bergen.com>. E-rater, GMAT, Intelligent Essay Assessor, ETS, IntelliMetric, machine-scoring
Klein, Davina C. D., Gregory K. W. K. Chung, Ellen Osmundson, Howard E. Herl, and Harold F. OÕNeil, Jr. 2001. Examining the validity of knowledge mapping as a measure of elementary studentsÕ scientific understanding (CSE Technical Report No. 557). Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing (CRESST). computer-analysis, knowledge mapping
Koether, Mary, and Esther Coke. 1973. A scheme for text analysis using FORTRAN. ERIC Document Reproduction Service, ED 074 152. computer-analysis, FORTRAN
Kohut, Gary F.; Kevin J. Gorman. 1995. The effectiveness of leading grammar/style software packages in analyzing business studentsÕ writing. Journal of Business and Technical Communication, 9.3, pp. 341-361. computer-analysis, grammar-checker, style-checker, accuracy
Kucera, Henry. 1992. The odd couple: The linguist and the software engineer: The struggle for high quality computerized language aids. In Svartvik, Jan (Ed.), Directions in corpus linguistics: Proceedings of Nobel Sytmposium 82, Stockholm, 4-8 August 1991 (pp. 401-420). Berlin: Mouton de Gruyter. computer-analysis, spell-check, grammar-check
Kukich, Karen. 2000. Beyond automated essay scoring. IEEE Intelligent Systems 15.5, pp. 22-27. machine-scoring, history, ETS
Landauer, Thomas K., Darrell Laham, and Peter W. Foltz. 2003. Automated scoring and annotation of essays with the Intelligent Essay Assessorª. In Automated essay scoring: A cross-disciplinary perspective, edited by Mark D. Shermis and Jill Burstein, 87-112. Mahwah, NJ: Lawrence Erlbaum. machine-scoring, IEA, Intelligent Essay Assessor
Landauer, Thomas K.; Darrell Laham; Bob Rehder; M. E. Schreiner. (1997). How well can passage meaning be derived without using word order? A comparison of latent semantic analysis and humans. In Shafto, Michael G.; Pat Langley (Eds), Proceedings of the nineteenth annual meeting of the Cognitive Science Society: August 7-10, 1997, Stanford University, Stanford, CA; Mahwah, NJ: Erlbaum. Pp. 412-417. machine-scoring, latent semantic, computer-analysis, correlation, machine-human, lexicon, word-order
Landauer, Thomas K.; Darrell Laham; Peter W. Foltz. (2000). The Intelligent Essay Assessor. IEEE Intelligent Systems 15, pp. 27-31. machine-scoring, computer-analysis, LSA, IEA, Intelligent Essay Assessor
Landauer, Thomas K.; et al. (1998). Computer software grades essays just as well as people, profs announce [press release]. <http://lsa.colorado.edu/essay_press.html> Accessed March, 1999. machine-scoring, LSA
Landauer, Thomas K.; Peter W. Foltz; Darrell Laham. (2000). Introduction to latent semantic analysis. Discourse Processes 25, pp. 259-284. LSA, computer-analysis
Landauer, Thomas K.; S. T. Dumais. (1997). A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction and representation of knowledge. Psychological Review 104, pp. 211-240. computer-analysis, LSA, theory
Larkey, Leah S. (1998). Automatic essay grading using text categorization techniques. In Croft, W. Bruce (Ed.) , SIGIR ninety-eight: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval, August 24-28, 1998, Melbourne, Australia; New York: Association for Computing Machinery. Pp. 90-95. machine-scoring, text-categorization, lexicon
Larkey, Leah S.; W. Bruce Croft. 2003. A text categorization approach to automated essay grading. In Shermis, Mark D.; Jill Burstein (Eds.), Automated essay scoring: A cross disciplinary perspective; Mahwah, NJ: Lawrence Erlbaum, pp. 55-70. machine-scoring, genre, text-categorization
Leacock, Claudia; Martin Chodorow. 2003. Automated grammatical error detection. In Shermis, Mark D.; Jill Burstein (Eds.), Automated essay scoring: A cross disciplinary perspective; Mahwah, NJ: Lawrence Erlbaum, pp. 195-208. machine-scoring, error-detection, accuracy
Lederman, Marie Jean. 1988. The uses of computers in the analysis and assessment of writing [synopsis of the 1988 National Testing Network in Writing Conference presentation by William Wresch and Helen Schwartz]. Notes from the National Testing Network in Writing 8, pp. 26-27. ERIC Document Reproduction Service 301 888. machine-scoring, CAI, grammar-checker, style-checker, spell-checker
Lee, Yong-Won. (2001). The essay scoring and scorer reliability in TOEFL CBT. ERIC Document Reproduction Service, ED 455 253. machine-scoring, TOEFL, direct, ESL, testing, reliability, internet
Lee, Yong-Won; Hunter Breland; Eiji Muraki. (2002). Comparability of TOEFL CBT essay prompts for different native language groups. ERIC Document Reproduction Service, ED 464 963. prompt, bias, TOEFL, language-group, ESL, international, contrast-group
Legg, Sue M.; Dianne C. Buhr. (1992). Computerized adaptive testing with different groups. Educational Measurement: Issues and Practice 11.2, pp. 23-27. machine-scoring, gender, age, ethnicity, multivariate, data, evaluation, bias, validity
Lemaire, Benoit; Philippe Dessus. 2001. A system to assess the semantic content of student essays. Journal of Educational Computing Research 24.3, pp. 305-320. APEX [Assistant for Preparing Exams], machine-scoring, semantic, content, essay-exam
Levy, Lynn B.; Kentner V. Fritz. Status report on the computer grading of essays. ERIC Document Reproduction Service, ED 069 759. machine-scoring, essay
Lewiecki-Wilson, Cynthia; Jeff Sommers; John Paul Tassoni. (2000). Rhetoric and the writer's profile: Problematizing directed self-placement. Assessing Writing 07.2, pp. 165-83. computer-analysis, placement, directed self-placement
Longford, Nicholas T. (1994). A case for adjusting subjectively rated scores in the Advanced Placement tests (Program Statistics Research Technical report, No. 94-5). Princeton, NJ: Educational Testing Service. machine-scoring, score-adjustment, machine-human, minimum squared error score
Macrorie, Ken (1970). Uptaught [chapter 1]. New York: Hayden. machine-scoring, Ellis Page, Dieter Paulus, "Percival", artificial intelligence
Macrorie, Ken. (1969). Review [of E. B. Page and D. H. Paulus, The analysis of essays by computer]. Research in the Teaching of English 03.2, pp. 228-236. machine-scoring, computer-analysis, Ellis Page, Dieter Paulus, singularity, response
Manalo, Jonathan R.; Edward W. Wolfe. (2000). A comparison of word-processed and handwritten essays written for the test of English as a foreign language. ERIC Document Reproduction Service, ED 443 845. computer, access, process, TOEFL, assessment, pencil-machine
Manalo, Jonathan R.; Edward W. Wolfe. (2000). The impact of composition medium on essay raters in foreign language testing. ERIC Document Reproduction Service, ED 443 836. TOEFL, pencil-computer, contrast-group, data
Manzo, Kathleen Kennedy. (2003, May 8). Essay grading goes digital: But critics question the use of software to assess writing. Education Week 22.35, pp. 39-43. machine-scoring, school, validity
Martinez, M. E.; R. E. Bennett. (1992). A review of automatically scorable constructed-response item types for large-scale assessment. Applied Measurement in Education 05, pp. 151-169. machine-scoring, assessment, large-scale
Matalene, Carolyn B.; Nancy Barendse. (1989). Transaction in holistic scoring: Using a computer to understand the process. Journal of Teaching Writing 08.2. 87-107. holistic, scoring, machine-scoring, computer-analysis, WORDS
Mathews, Jay. (2004, August 1). Computers weighing in on the elements of essay: Programs critique structure, not ideas. Washington Post. <http://www.washingtonpost.com/ac@/wp-dyn/A308540200Jul31?1a>. SAT, ACT, GMAT, E-rater, machine-scoring, admissions, placement, holistic scoring, human-machine
McCollum, Kelly. (1998). How a computer program learns to grade essays. Chronicle of Higher Education 45.2, pp. A37-A38. machine-scoring, IEA [Intelligent Essay Assessor], teacher-opinion, apprehension
McCollum, Kelly. (1999). Comuters will help grade essays on Graduate Management Admission Test. The Chronicle of Higher Education 44 (January 29), p. A30. machine-scoring, GMAT
McCurry, Niki. (1992). The computerized inventory of developmental writing traits. ERIC Document Reproduction Service, ED 357 375. machine-scoring, Computerized Inventory of Developmental Writing Traits (CIDWT), human-machine, criteria, holistic, development
McCurry, Niki; Alan McCurry. (1992). Writing assessment for the twenty-first century. The Computing Teacher 19.7, pp. 35-37. machine-scoring, computer-analysis, evaluation
McGee, Tim; Patricia Ericsson. 2002. The politics of the program: MS WORD as the invisible grammarian. Computers and Composition 19.4, pp. 453-470. computer-analysis, Microsoft Word, grammar-check, data
McGinn, Colin. (1999). Hello, HAL. New York Times Book Review (January 10), pp. 11-12. machine-scoring
Meehan, James. (1976). The Metanovel: Writing Stories by Compuer [doctoral thesis]. New Haven, CT: Yale University. machine-composing, literature, novel
Miller, Greg. (2009). Computers as writing instructors. Science 323.2 (January), 59-60. computer-analysis, machine-scoring, science-course
Millman, Jason; Ronald S. Westman. (1989). Computer-assisted writing of achievement test items: Toward a future technology. Journal of Educational Measurement 26.2, pp. 177-90. machine-scoring, computer-analysis, item-analysis, semantic-mapping, discourse-analysis
Moon, Okhee. (1992). An application of computerized adaptive testing to the Test of English as a Foreign Language [doctoral thesis]. Albany, NY: State University of New York at Albany. TOEFL, computer, machine-scoring, testing, ESL
Morgan, Bradford A. 1984. Evaluating student papers with a word processor. Research in Word Processing Newsletter 2 (6): 1-6. computer-analysis, spell-checker, grammar-checker
Myers, Miles 2003. What can computers and AES contribute to a K-12 writing program? In Automated essay scoring: A cross-disciplinary perspective, edited by Mark D. Shermis and Jill Burstein, 3-17. Mahwah, NJ: Lawrence Erlbaum. machine-scoring, school
Myford, Carol M.; Frederick Cline. (2002). Looking for patterns in disagreements: A facets analysis of human raters� and e-rater�s scores on essays written for the Graduate Management Admissions Test (GMAT). Paper presented at the Annual Meeting of the American Educational Research Association, April 1-5, 2002, New Orleans, LA. machine-scoring, E-rater, GMAT, human-machine
Mzumara, Howard R.; Mark D. Shermis; Jason M. Averitt. (1999). Predictive validity of the IUPUI Web-based placement test scores for course placement at IUPUI: 1998-1999. Indianapolis, IN: Indiana University Purdue University Indianapolis. placement, predictive, PEG, course-grade, correlation, machine-scoring
Mzumara, Howard R.; Mark D. Shermis; Jason M. Averitt. 1999. Predictive validity of the IUPUI web-based placement test scores for course placement at IUPUI: 1998-1999. http://www.assessment.iupui.edu/report/VAL1999.pdf. machine-scoring, PEG, IUPUI, predictive, placement, data
Nancarrow, Paula Reed; Donal Ross; Lilian Bridwell-Bowles. 1984. Word processors and the writing process: An annotated bibliography. Westport, CT: Greenwood Press. CAI, computer-analysis, machine-scoring
Ohlsson, Stellan. (1986). Computer simulation and its impact on educational research and practice. ERIC Document Reproduction Service, ED 282 521. machine-scoring, computer-simulation
Ott, Christopher. (1999). Essay questions: How well can computers judge prose--and would you want one grading your exam?. salon.com (May 25) http://www.salonmag.com/tech/feature/1999/05/25/computer_grading/. machine-scoring
Page, Ellis B. (1966). Grading essays by computer: Progress report. Educational Testing Service (Ed.), Proceedings of the Invitational Conference on Testing Problems, October 29, 1966, New York City: Princeton, NJ: Educational Testing Service. Pp. 87-100. machine-scoring
Page, Ellis B. 1966. The Imminence of grading essays by computer. Phi Delta Kappan 48: 238-243. machine-scoring
Page, Ellis B. 1967. Statistical and linguistic strategies in the computer grading of essays. In Proceedings of the second International Conference on Computational Linguistics, Grenoble, France, August 24. machine-scoring, data
Page, Ellis B. 1968. Analyzing student essays by computer. International Review of Education 14: 210-225. machine-scoring
Page, Ellis B. 1985. Computer grading of student essays. In Husen, Torsten; T. Neville Postlethwaite (Eds.), International encyclopedia of educaitonal research: Research and studies; Oxford, England: Pergamon. Pp. 944-946. machine-scoring
Page, Ellis B. 2003. Project Essay Grade: PEG. In Automated essay scoring: A cross-disciplinary perspective, edited by Mark D. Shermis and Jill Burstein, 43-54. Mahwah, NJ: Lawrence Erlbaum. machine-scoring, PEG
Page, Ellis B.; G. A. Fisher; M. A. Fisher. (1968). Project Essay Grade: A FORTRAN program for statisticval analysis of prose. British Journal of Mathematical and Statistical Psychology 21, p. 139. machine-scoring, Project Essay Grade (PEG), computer-analysis, FORTRAN
Page, Ellis B.; John P. Poggio; Timothy Z. Keith. (1997). Computer analysis of student essays: Finding trait differences in student profile (presentation at the AERA/NCME Symposium on Grading Essays by Computer). ERIC Document Reproduction Service, ED 411 316. machine-scoring, Project Essay Grade (PEG), holistic, criteria, residual, diagnostic
Page, Ellis B.; P. I. Tillett; Helen Beuck Ajay. 1989. Computer measurement of subject-matter tests: Past research and future promises. In Proceedings of the first annual meeting of the American Psychological Society; Alexandria, VA: American Psychological Society. machine-scoring, essay-exam
Page, Ellis B.; Timothy Z. Keith; M. J. Lavoie. (1995). Construct validity in the computer grading of essays. Paper presented at the annual meeting of the American Psychological Association (August). machine-scoring, construct validity, PEG
Page, Ellis Batten; Dieter H. Paulus. (1968). The analysis of essays by computer (Final report, Project No. 6-1318). Washington, D. C.: Department of Health, Education, and Welfare; Office of Education; Bureau of Research [ERIC Document Reproduction Service, ED 028 633]. machine-scoring, computer, evaluation, criteria, syntax, MX, direct, essay-rating
Page, Ellis; Nancy S. Petersen. (1995). The computer moves into essay grading: Updating the ancient test. Phi Delta Kappan 76, pp. 561-565. machine-scoring, computer-analysis, essay-grading
Palmer, John; Robert Williams; Heinz Dreher. (2002). Automated essay grading system applied to a first year university subject--can we do it better? InformingScience.org http://proceedings.informingscience.org/IS2002Proceedings/papers/Palme026Autom.pdf. machine-scoring, PEG, Australia, plagiarism, Text Categorisation Technique (TCT)
Pedersen, Elray L. (1983). Computer-assisted evaluation of student papers: I can write anything you can write--faster and better. CALICO Journal 01.2, pp. 39-42. machine-scoring, commenting, grading, software
Pennington, Martha C.; Vance Stevens. 1992. Process and product approaches to computer-assisted composition. In Pennington, Martha C.; Mark N. Brock (Eds.), Computers in applied linguistics: An international perspective, Clevedon, England: Multilingual Matters. Pp. 79-109. computer-analysis, spell-checker, grammar-checker, ESL
Peterson, N. S. (1997). Automated scoring of written essays: Can such scores be valid?. Paper presented at NCME in Chicago, 26 March. machine-scoring, validity
Phelan, J. Greg. (2003). For student essayists, an automated grader. New York Times (September 4), p. G5. machine-grading
Ponisciak, Steve; Valen Johnson. 2003. Bayesian analysis of essay grading. In Automated essay scoring: A cross-disciplinary perspective, edited by Mark D. Shermis and Jill Burstein, 181-190. machine-scoring, statistical analysis, Bayesian, essay
Power, Carol. (2004, July 2). Computerized essay evaluation replacing human markers. The Irish Times. <http://www.k-a-t.com/papers/IrishTimes.shtml. machine-scoring, human-machine
Powers, Donald E.; Jill C. Burstein; Martin S. Chodorow; Mary E. Fowles,; Karen Kukich. (2002). Comparing the validity of automated and human scoring of essays. Journal of Educational Computing Research 26.4, pp. 407-25. machine-scoring, human-machine, graduate
Powers, Donald E.; Jill C. Burstein; Martin S. Chodorow; Mary E. Fowles,; Karen Kukich. (2000). Comparing the validity of automated and human scoring of essays (GRE Board research report, No. 98-08aR). Princeton, NJ: Educational Testing Service. machine-scoring, human-machine, graduate
Powers, Donald E.; Jill C. Burstein; Martin S. Chodorow; Mary E. Fowles,; Karen Kukich. (2001). Stumping E-Rater: Challenging the validity of automated essay scoring (GRE Board research report, No. 98-08bP). Princeton, NJ: Educational Testing Service. machine-scoring, corruptibility, E-Rater
Reid, Stephen; Gilbert Findlay. (1986). Writer's Workbench analysis of holistically scored essays. Computers and Composition 03.2. 6-32. computer-analysis, machine-scoring, style-checker, WRITER'S WORKBENCH, holistic, data, evaluation, correlation, essay-length, spelling, readability
Reitman, Walter R. 1962. Computer models of psychological precesses and some implication for the theory and practice of writing. In Steinberg, Erwin Ray (Ed.), Needed research in the teaching of English: Proceedings of a Project English research conference, May 5-7, 1962; Washington, D. C.: U. S. Department of Health, Education, and Welfare, Office of Education. Pp. 98-106. machine-scoring, CAI
Rice, Joseph A. (1977). The university drags its feet over the iliterate. In Linsell, Norm (Ed.), Focus '77: 24th International Technical Communication Conference proceedings; Milwaukee, WI: Ken Cook; Society for Technical Communication. 188-190. decline, University of Houston, basic, rising-junior, data, pass-frequency, African-Am, Hispanic, machine-scoring, junior-level
Roberts, Carl W.; Roel Popping. 1993. Computer-supported content analysis: Some recent developments. Social Science Computer Review 11, pp. 283-291. computer-analysis, machine-scoring
Rounds, Jeanine C.; Martha J. Kanter; Marlene Blumin. (1987). Technology and testing: What is around the corner?. In Bray, Dorothy; Marcia J. Belcher, (Eds.), Issues in student assessment; San Francisco, CA; Jossey-Bass. Pp. 83-93. assessment, machine-scoring
Roy, Emil L. (1993). Computerized scoring of placement exams: A validation. Journal of Basic Writing 12.2, pp. 41-54. placement, machine-scoring, electronic-grading, computer, validation, prediction, data
Roy, Emil L. Evaluating placement exams with a structured decision system. Computers and Composition 9, pp. 71-86. evaluation, computer-analysis, testing, style-checker, placement
Roy, Emil. 1990. A decision support system for improving first-year writing courses. Computer-Assisted Composition Journal 4 (3): 79-86. computer-analysis, response, FYC
Roy, Sandra; Emil Roy. (1992). Direct mail letters: A computerized linkage between style and success. Journal of Business and Technical Communication 6, pp. 224-234. machine-analysis, letter-writing, evaluation
Rudner, Lawrence M. (2001). Bayesian essay test scoring system--Betsy. http://ericae.net/betsy/. machine-scoring, Bayesian
Rudner, Lawrence M. (2001). Responding to testing needs in the 21st century with an old tool, a very old tool. In Walz, Garry Richard; Jeanne Bleuer (Eds.), Assessment: Issues and challenges for the new millennium; Greensboro, NC: ERIC Clearinghouse on Couseling and Student Services. machine-scoring, Bayesian, statistical-method
Rudner, Lawrence; Phil Gagne. (2001). An overview of three approaches to scoring written essays by computer: ERIC digest. ERIC Document Reproduction Service, ED 458 290. machine-scoring, PEG, IEA [Intelligent Essay Assessor], e-rater, ETS
Rudner, Lawrence; Veronica Garcia; Catherine Welch. (2006). An evaluation of the IntelliMetric essay scoring system. Journal of Technology, Learning, and Assessment 04.4 http://www.jtla.org. machine-scoring, IEA [Intelligent Essay Assessor], validation, data
Russell, Michael. (2000). It's time to upgrade: Tests and administration procedures for the new millennium. ERIC Document Reproduction Service, ED 452 833. pencil-computer, testing, contrast-group, review-of-research, assessment, large-scale
Russell, Michael; Walt Haney. (2000). Bridging the gap between testing and technology in schools. Education Policy Analysis Archives 08.19. assessment, large-scale, process, word-processing, pencil-computer, technology, school
Russell, Michael; Wei Tao. (2004). Effects of handwriting and computer-print on composition scores: A follow-up to Powers, Fowles, Farnum, & Ransey. Practical Assessment, Research, & Evaluation 09.1. <http://www.pareonline.net/getvn.asp?v=9&n=1>. measurement, holistic, scoring, human-machine, correlation, data, bias, paper-screen
Salton, Gerald and Anita Wong. 1976. On the role of words and phrases in automatic text analysis. Computers and the Humanities 10: 69-87. computer-analysis, lexicon, phrase
Sampson, James P., Jr. (1998). Using the internet to enhance test interpretation. ERIC Document Reproduction Service, ED 426 329. machine-scoring, testing, internet
Schachter, R. 2003. A.I.: Something to build on. District Administration. 39 (July): 20-24. machine-scoring
Schachter, Ronald. (2003). A. I.: Something to build on. District Administration 39.7, pp. 20-24. machine-scoring, school
Schuemann, Cynthia M. (1998). An investigation into the comparable effectiveness of two tests of writing administered to college-level English as a second language students: The computerized placement test and holistically scored essay exams [doctoral thesis]. University Park, FL: Florida International University. ESL, testing, computer-analysis, machine-scoring, holistic, contrast-group, concurrent, validity
Schwartz, A. E. 1998. Graded by machine. Washington Post (April 26), p. C07. machine-scoring
Scott, Janny. (1999, January 31). Looking for the tidy mind, Atlas. New York Times 148.51419, Section 4, p. 2. GMAT, ETS, E-rater, holistic, scoring, machine-scoring, human-machine
Segall, Michaela. 1991. Holistic assessment of writing. In Anandam, Kamala (Ed.), Project Synergy: Software support for underprepared students (Software implementation report, September 1991). ERIC Document Reproduction Service, ED 345 803. basic, computer-analysis, response
Shermis, Mark D.; C. M. Koch; Ellis Batten Page; Timothy Z. Keith; Susanne Harrington. (2002). Trait ratings for automated essay grading. Educational and Psychological Measurement 62.1, pp. 5-18. machine-scoring, criteria, evaluation
Shermis, Mark D.; Fellicia D. Barrera (Eds.). 2002. Automated essay scoring for electronic portfolios. San Francisco, CA: Wiley [special issue of Assessment Update 14.4 (July-August), 2002]. machine-scoring, portfolio, digital
Shermis, Mark D.; Howard Mzumara ; Mike Brown; Clo Lillig. (1997). Computerized adaptive testing through the World Wide Web. ERIC Document Reproduction Service, ED 414 536. placement, computer, internet, machine-scoring
Shermis, Mark D.; Jill Burstein (Eds.). (2003). Automated essay scoring: A cross-disciplinary perspective. Mahwah, NJ: Erlbaum. machine-scoring, reliability
Shermis, Mark D.; Jill Burstein; Claudia Leacock. (2005). Applications of computers in assessment and analysis of writing. In Charles A. MacArthur, Steve Graham, & Jill Fitzgerald (Eds.), Handbook of Writing Research (New York: Guilford Press), pp. 403-416. machine-scoring, review-of-research
Shermis, Mark D.; Kathryn E. Daniels. 2003. Norming and scaling for automated essay scoring. In Automated essay scoring: A cross-disciplinary perspective, edited by Mark D. Shermis and Jill Burstein, 169-180. machine-scoring, norming, scaling, statistical analysis
Shukur, Zarina; Edmund Burke; Eric Foxley. (1999). Automatically grading customer confidence in a formal specification. Journal of Computing in Higher Education 11.1, pp. 86-119. technical-writing, computer-science course, machine-scoring, specification-writing
Sidener, Jonathan. (1999, February 1). Educational Testing Service of Princeton, N. J., develops new grading system. The Arizona Republic. E-rater, GMAT, ETS, machine-scoring, human-machine, holistic, scoring
Sirc, Geoffrey. (1989). Response in the electronic medium. In Christ M. Anson (Ed.), Writing and response: Theory, practice, and research (pp. 187-205): Urbana, IL: National Council of Teachers of English. computer-analysis, grammar-check, spell-check
Sirc, Geoffrey. 1989. Response in the electronic medium. In Anson, Chris M. (Ed.), Writing and response: Theory, practice and research; Urbana, IL: National Council of Teachers of English. Pp. 187-208. CAI, computer-analysis, response
Sireci, Stephen G.; Saba Rizavi. (2000). Comparing computerized and human scoring of students' essays. ERIC Document Reproduction Service, ED 463 324. machine-scoring, human-machine, College Board, WritePlacer
Slotnick, Henry B, John V. Knapp; Rodney L. Bussell. (1971). Bits, nybbles, bytes: A view of electronic grading. Journal of Business Communication 08.2, pp. 35-52. machine-scoring, grading, computer-analysis
Slotnick, Henry B. (1972). Toward a theory of computer essay grading. Journal of Educational Measurement 09.4. 253-263. machine-scoring, computer-analysis, theory, measurement, evaluation, content, spelling, diction, syntax, punctuation, paragraph
Slotnick, Henry B. (1974). Computer scoring of formal letters. Journal of Business Communication 11.2, pp. 11-19. letter-writing, experiment, data, machine-scoring, correlation, holistic, vocabulary-variety, word-lenth, spelling, computer-analysis
Slotnick, Henry B.; John V. Knapp. (1971). Easy grading by computers: A laboratory phenomenon?. English Journal 60.1, pp. 75-87. machine-scoring, essay, grading, computer-analysis, strong-weak, evaluation, change
Slotnick, Henry Barry. (1971). An examination of the computer grading of essays [doctoral thesis]. Urbana, IL: University of Illinois at Urbana-Champaign. machine-scoring, computer-analysis, text-analysis, correlation
Slotnick, Henry Barry. (1971). An examination of the computer grading of essays. ERIC Document Reproduction Service, ED 074 504. machine-scoring, essay, high-school, G12, machine-human, correlation
Spinks, Nelda H.; Barron W. Wells; Melanie Meche. (1997). Customizing grammar checking. Business Education Forum 52.1, pp. 24-26. computer-analysis, grammar-check, error-detection, data, business-communication
Stansfield, Charles W. (Ed.). (1986). Technology and language testing: A collection of papers from the annual Colloquium on Language Testing Research (7th, Princeton, New Jersey, April 6-9, 1985). ERIC Document Reproduction Service, ED 365 142. machine-scoring, ESL, testing
Starr, Douglas. (1993). Paper grading on single disc preferable to multi-disc way. Community College Journalist 21.3, pp. 4-6. practice, response, commenting, machine-scoring, computer-analysis, grading, Texas A&M University, journalism-course
Stephens, Derek. (2001). Use of computer assisted assessment: Benefits to students and staff. Education for Information 19, pp. 265-275. machine-scoring, measurement, gender, Question Mark, computer anxiety, apprehension
Stewig, John Wrren. (1984). The key to improving education. Education Digest 49 (May), pp. 10-13. computer, programmed, machine-scoring, commercial
Streeter, Lynn; Joseph Psotka; Darrell Laham; Don MacCuish. (2004). The credible grading machine: Automated essay schoring in the DOD [Department of Defense] http://www.knowledge-technologies.com/papers/essayscoring.pdf. machine-scoring, IEA
Takayoshi, Pamela. (1996). The shape of electronic writing: Evaluating and assessing computer-assisted writing processes and products. Computers and Composition 13, pp. 245-258. computer-analysis
Thompson, Clive. (1999). The attack of the incredible grading machine. http://www.linguafranca.com/9907/nwo.html. Lingua Franca 09.5. machine-scoring, electronic-grading, computer-analysis, commerical
Traxler, Arthur. (1953). The IBM scoring machine: An evaluation. In Educational Testing Service (Ed.), Proceedings of the 1953 Invitational Conference on Testing Problems; Princeton, NJ: Educational Testing Service. machine-scoring, evaluation, validation
United States Distance Learning Association. 2002. Underachiveing schools to receive online development tool. USDLA Journal 16 (July). http://www.usdla.org. machine-scoring, school
University of Houston. (2003). Online writing assessment enables effective, efficient testing. Syllabus (January), pp. 31-32. University of Houston, assessment, machine-scoring, WritePlacer, cost-efficiency, workload
Vantage Learning. 2000. A study of WritePlacer Plusª electronic scoring for college-level placement; RB-380. Yardley, PA: Vantage Learning. machine-scoring, WritePlacer Plus, placement
Vantage Learning. 2005. Vantage Learning extends MY Access!ª writing program with alignment of 25 writing prompts to Open Court Readingª. Gregory FCA Communications (April 11). http://www.gregoryfca.com/prvantage041505.html (accessed May 8, 2005). machine-scoring, concurrent validity, My Access
Wagman, Morton. (1998). Language and Thought in Humans and Computers: Theory and Research in Psychology, Artificial Intelligence, and Neural Science. Westport, CT:P Praeger. human-machine, AI, brain, neurology, language, psychology
Wainer, Howard; Neil J. Dorans. (1990). Computerized adaptive testing: A primer. Hillsdale, NJ: Erlbaum. assessment, computer, machine-scoring
Wall Street Journal. (1999, January 1). Prof Hal 9000: Computers will grade GMAT essays. Wall Street Journal B, Eastern Edition 233.14, p. B14. machine-scoring, measurement, GMAT, software
Weigle, Sara Cushing. (2002). Assessing Writing. Cambridge Language Assessment Series. Cambridge, England: Cambridge University Press. [Cf pp. 234-237]. machine-scoring, E-rater, Latent Semantic Analysis, Project Essay Grade
Weinstein, B. 1998. Software designed to grade essays. Boston Globe Online (June 21). machine-scoring
Whalen, Thomas E. (1971). Assessment of language ability by computer. ERIC Document Reproduction Service, ED 052 206. machine-scoring, computer-analysis, G7, predictive, regression, PEGFOR
Whalen, Thomas E. (1971). The analysis of essays by computer: A simulation of teachers' ratings. ERIC Document Reproduction Service, ED 048 352. PEG [Project Essay Grade], Ellis Page, machine-scoring, school, G7, California Language Test, machine-human, correlation, predictive, criteria
White, Sheida; Connie Smith; Alan Vanneman. (2000). How Does NAEP Ensure Consistency in Scoring?. Focus on NAEP 04.2 [ERIC Document Reproduction Service, ED 450 160]. NAEP, rater-reliability, assessment
Whithaus, Carl. (2004). Teaching and evaluating writing in the age of computers and high-stakes testing. Mahwah, NJ: Erlbaum. CAI, machine-scoring, computer-analysis, evaluation, practice
Whithaus, Carl. (2004). The development of early computer-assisted writing instruction (1960-1978): The double logic of media and tools. Computers and the Humanities 38.2, pp. 149-162. CAI, interactive, practice
Whittington, Dave; Helen Hunt. (1999). Approaches to the computerized assessment of free text responses. In Proceedings of the Third Annual Computer Assisted Assessment Conference; Loughborough [England]: Loughborough University http://cvu.strath.ac.uk/dave/publications/caa99.html. 207-219. machine-scoring
Williams, Robert (2001). Automated essay grading: An evaluation of four conceptual models. In Herrmann, A.; M. M. Kulski (Eds.), Expanding horizons in teaching and learning: Proceedings of the 10th Annual Teaching Learning Forum, February 7-9, 2001; Perth, Western Australia: Curtin University of Technology [http://cea.curtin.edu.au/tlf/tlf2001/williams.html]. machine-scoring, theory, algorithm
Williamson, D. M.; I. I. Bejar; A. S. Hope. (1999). 'Mental model' comparison of automated and human scoring. Journal of Educational Measurement 36, pp. 158-184. machine-scoring, machine-human, correlation, mental-model
Williamson, Michael. (2004). Validity of automated scoring: Prologue for a continuing discussion of machine scoring student writing. Journal of Writing Assessment 01.2, pp. 85-104. machine-scoring, validity, theory
Wirth, Susan Katherine. (1972). A paraphrasing strategy in the content grading of essay examinations by computer [doctoral thesis]. Storrs, CT: University of Connecticut. machine-scoring, computer-analysis, essay-exam, content-analysis
Wonnberger, Carl G. (1955). Judging compositions--machine method. English Journal 44.8, pp. 473-475. evaluation, direct, objective, machine-scoring
Woods, Elinor M. 1970. Recent applications of computer technology to school testing programs. Review of Educational Research 40.4, pp. 525-539. school, CAI
Wresch, William. (1988). Six directions for computer analysis of student writing. Computing Teacher 15.7, pp. 13-16. computer-analysis, style-checker, grammar-checker, practice, error, formatting, audience-awareness, readability, conferencing, peer-evaluation, grading, record-keeping, machine-scoring, assessment, large-scale
Wresch, William. (1993). The imminence of grading essays by computer--25 years later. Computers and Composition 10.2, pp. 45-58. computer, computer-analysis, evaluation, machine-scoring, history
Wresch, William; Helen Schwartz. (1988). The uses of computers in the analysis and assessment of writing [conference presentation synopsis]. Notes from the National Testing Network in Writing 08, pp. 26-27. machine-scoring, taxonomy, error, conferencing, grading, automatic graders, essay-grading, computer-analysis
Yang, Yongwei, Chad W. Buckendahl, Piotr J. Juszkiewicz, and Dennison S. Bhola. 2002. A Review of strategies for validating computer automated scoring. Applied Measurement in Education 15 (4): 391-412. machine-scoring, validation
Young, Jeffrey R. (2001). Plagiarism and plagiarism detection go high tech. The Chronicle of Higher Education (July 6). computer-analysis, plagiarism