Note

1 A comprehensive history of AIG was presented by Haladyna (2013), which covered the period from 1950 with the development of Louis Guttman's facet theory to the early 2000s. Gierl and Lai (2016) provided an update on Haladyna's summary by describing the key developments in both AIG theory and practice from 2005 to 2015.

References

American Educational Research Association, American Psychological Association, National Council on Measurement in Education (2014). Standards for Educational and Psychological Testing. Washington, DC: American Educational Research Association.

Bejar, I. I. (1996). Generative response modelling: Leveraging the computer as a test delivery medium (ETS Research Report No. 96-13). Princeton, N): Educational Testing Service.

Bejar, I. I. (2002). Generative testing: From conception to implementation. In S. H. Irvine & P. C. Kyllonen (Eds.), Item Generation for Test Development (pp. 199-217). Hillsdale, N): Lawrence Erlbaum.

Bejar, I. I., Lawless, R., Morley, M. E., Wagner, M. E., Bennett, R. E., & Revuelta, J. (2003). A feasibility study of on-the-fly item generation in adaptive testing. Journal of Technology, Learning, and Assessment, 2 (3). Retrieved from http://www.jtla.org

Danon, G., & Last, M. (2017). A syntactic approach to domain-specific automatic question generation. arXiv:1 712.09827 [cs.CL],

Du, X., & Cardie, C. (2017). Identifying where to focus in reading comprehension for neural question generation. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (Volume 1: Long Papers), pp. 1342-1352, Vancouver, CA. Association for Computational Linguistics.

Embretson, S. E. (2002). Generating abstract reasoning items with cognitive theory. In S. H. Irvine & R C. Kyllonen (Eds.), Item Generation for Test Development (pp. 219-250). Mahwah, NJ: Lawrence Erlbaum.

Flor, M., & Riordan, B. (2018, June). A sematic role-based approach to open- domain automatic question generation. Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications, New Orleans, LA, pp. 254-263.

Ganji, M., & Esfandiari, R. (2020). Attitudes of language teachers toward multiple-choice item writing guidelines: An exploratory factor analysis Journal of Modern Research in English Language Studies, 7, 115-140.

Gierl, M. J., & Lai, H. (2013). Using automated processes to generate test items. Educational Measurement: Issues and Practice, 32, 36-50.

Gierl, M. J. & Lai, H. (2016). Automatic item generation. In S. Lane, M. Raymond, & T. Haladyna (Eds.), Handbook of Test Development (2nd eel., pp. 410-429). New York: Routledge.

Gierl, M.)., Zhou, J., & Alves, C. (2008). Developing a taxonomy of item model types to promote assessment engineering. Journal of Technology, Learning, and Assessment, 7 (2). Retrieved from http://www.jtla.org

Giitl, C, Lankmayr, K., Weinhofer, )., & Hofler, M. (2011). Enhanced Automatic Question Creator - EAQC: Concept, development and evaluation of an automatic test item creation tool to foster modern e-education. Electronic Journal of e-Learning, 9, 23-38.

Haladyna, T. (2013). Automatic item generation: A historical perspective. In M. J. Gierl & T. Haladyna (Eds.), Automatic Item Generation: Theory and Practice (pp. 13-25). New York, NY: Routledge.

Haladyna, T. M., & Rodriguez, M. C. (2013). Developing and Validating Test Items. New York: Routledge.

Haladyna, T., & Shindoll, R. (1989). Items shells: A method for writing effective multiple-choice test items. Evaluation and the Health Professions, 12, 97-106.

Heilman, M. (2011). Automatic factual question generation from text (Doctoral dissertation). Carnegie Mellon University. Available from ProQuest Dissertations and Theses database.

Higgins, D., Futagi,Y., & Deane, P. (2005). Multilingual generalization of the Model Creator software for math item generation (Research Report No. RR-05-02). Princeton, NJ: Educational Testing Service.

Hively, W., Patterson, H. L., & Page, S. H. (1968). A "universe-defined" system of arithmetic achievement tests, journal of Educational Measurement, 5, 275-290.

International Test Commission. (2017). The ITC Guidelines for Translating and Adapting Tests (2nd ed.). [www.lnTestCom.org].

Jurafsky, D., & Martin, J. H. (2009). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition (2nd ed.). Upper Saddle River, NJ: Pearson.

LaDuca, A., Staples, W. I., Templeton, B., & Holzman, G. B. (1986). Item modelling procedures for constructing content-equivalent multiple-choice questions. Medical Education, 20, 53-56.

Lai, H. (2013). Developing a Framework and Demonstrating a Systematic Process for Generating Medical Test Items (Doctoral Dissertation). Retrieved from doi:10.7939/R3C93H

Lai, H., & Gierl, M. J. (2013). Generating items under the assessment engineering framework. In M. ). Gierl & T. Haladyna (Eds.), Automatic Item Generation: Theory and Practice (pp. 77-101). New York, NY: Routledge.

Lai, H., Gierl, M. J., & Alves, C. (2010, April). Using item templates and automated item generation principles for assessment engineering. In R. M. Luecht, Application of Assessment Engineering to Multidimensional Diagnostic Testing in an Educational Setting. Denver, CO: Symposium conducted at the annual meeting of the National Council on Measurement in Education.

Lane, S., Raymond, M., & Haladyna, R. (2016). Test development process. In S. Lane, M. Raymond, & T. Haladyna (Eds.), Handbook of Test Development (2nded., pp. 3-18). New York, NY: Routledge.

McCarthy, P. M., & Boonthum-Denecke, C, (2012). Applied Natural Language Processing: Identification, Investigation, and Resolution. Hershey, PA: IGI Global.

Minsky, M. (1974). A framework for representing knowledge (Memo No. 306). Cambridge, MA: MIT-AI Laboratory.

Mislevy, R.)., & Riconscente, M. M. (2006). Evidence-centered assessment design. In S. M. Downing & T. Haladyna (Eds.), Handbook of Test Development (pp. 61-90). Mahwah, NJ: Lawrence Erlbaum.

Reiter, E., (1995). NLG vs. templates. arXiv:cmp-lg/9504013.

Reiter, E. & Dale, R. (1997). Building applied natural-language generation systems. Natural Language Engineering, 3, 57-87.

Schmeiser, С. B., & Welch, C. J. (2006). Test development. In R. L. Brennan (Ed.), Educational Measurement (4th ed., pp. 307-353). Westport, CT: National Council on Measurement in Education and American Council on Education.

Singley, M. K., & Bennett, R. E. (2002). Item generation and beyond: Applications of schema theory to mathematics assessment. In S. H. Irvine & P. C. Kyllonen (Eds.), Item Generation for Test Development (pp. 361-384). Mahwah, NJ: Lawrence Erlbaum.

Susanti, Y., lida, R., & Tokunaga, T. (2015, May). Automatic generation of English vocabulary tests. In CSEDU (1) (pp. 77-87).

von Davier, M. (2018). Automated item generation with recurrent neural networks. Psychometrika, 83, 847-857.

Item Generation

4