The Experiences, Challenges, and Acceptance of Item Bank System (IBS) as a Tool for Paper Generation: A Case Study
Using the Item Bank System (IBS) for paper generation is gaining popularity in educational settings. However, limited research has been conducted on the experiences, challenges, and acceptance of IBS. This study explored the challenges educators and head teachers face when implementing IBS for paper generation in educational settings. Thematic analysis of data collected from four participants revealed that technical challenges, such as system integration, maintenance, and interface design, and human resource challenges, including a lack of adequate training and support for educators and resistance to change, impact the effective use of IBS for a paper generation. Addressing these challenges through adequate training, support, and resources can help ensure IBSs successful adoption and use in educational settings. The study highlights the importance of further research to investigate the perceptions and experiences of students and evaluate the effectiveness of IBS in enhancing exam quality and productivity in educational settings.
-
Item Bank System, Paper Generation, Educational Settings
-
(1) Mahboob Ahmad
Department of Education, Superior University, Lahore, Punjab, Pakistan.
(2) Khawaja Hisham Ul Hussan
Department of Education, Superior University, Lahore, Punjab, Pakistan.
(3) Muhammad Tayyab
Department of Education, Superior University, Lahore, Punjab, Pakistan.
- Adesope, O., Lavin, T., Thompson, T. G., & Ungerleider, C. (2010). A Systematic Review and Meta-Analysis of the Cognitive Correlates of Bilingualism. Review of Educational Research, 80(2), 207–245. https://doi.org/10.3102/0034654310368803
- Akhter, N., Ali, M. S., Siddique, M., & Abbas, R. (2021). Exploring the Role and Importance of Career Counselling in Developing Awareness of Graduate Students Career Choices during Covid-19. Multicultural Education, 7(11), 603-615. https://doi.org/10.5281/zenodo.5828067
- Akhter, N., Ali, M. S., Siddique, M., & Akram, M. S. (2021). The Role and Importance of Communicating Science for Building Understanding of Science Applications. Multicultural Education, 7(10), 274-281. https://doi.org/10.5281/zenodo.5563105
- Alavi, M., & Hosseini, M. (2015). Advantages and challenges of using item banks in language assessment. Procedia-Social and Behavioral Sciences, 199, 478-483.
- Ali, M. S., Siddique, M., Siddique, A., Abbas, M., & Ali, S. (2021). Teachers' citizenship behavior as a predictor of teaching performance: Evidence from Pakistani context. Humanities and Social Sciences Reviews, 9(3), 1135-1141. https://doi.org/10.18510/hssr.2021.93112
- Azeem, A., Faiz, Z., Siddique, M. H., Ali, M., & Warraich, W. Y. (2021). School Psychologists Perspectives about Effectiveness of Behavior Therapy for Children with Attention Deficit Hyperactivity Disorder in Pakistan. Humanities & Social Sciences Reviews, 9(3), 1142–1155. https://doi.org/10.18510/hssr.2021.93113
- Chen, L., & Liu, C. (2019). Development and validation of a computerized adaptive testing system for English proficiency. Language Testing, 36(1), 21-44.
- Chen, Y., & Liu, Y. (2019). Adopting computerized adaptive testing in college entrance exams in China: Opportunities and challenges. Frontiers in Psychology, 10, 1-11.
- Cito, J. (2018). Item banking: past, present, and future. Applied Psychological Measurement, 42(7), 485-491.
- Cito, J. (2018). The use of item banks in paper- based testing: From theory to practice. In The Routledge Handbook of Language Testing (pp. 165-178). Routledge.
- Deng, Q., & Wei, H. (2017). Research on the Application of Item Bank in Computer- based Testing. Journal of Higher Education, 38(7), 56-60.
- Deng, Z., & Wei, J. (2017). A research review on item banks in computer-based testing. Journal of Educational Measurement, 54(3), 253-269.
- Faiz, Z., Iqbal, T., Azeem, A., Siddique, M., & Warraich, W. Y. (2021). A Comparative Study between Online and Traditional Counseling for Students with Attention Deficit Hyperactivity Disorder (ADHD): School Psychologists Perspective in the Obsequies of Pandemic COVID-19. Linguistica Antverpiensia, 2021(3), 5763- 5777. https://doi.org/10.5281/zenodo.5843172
- Jabeen, S., Siddique, M., Mughal, K. A., Khalid, H., & Shoukat, W. (2022). School Environment: A Predictor of Students Performance at Secondary Level in Pakistan. Journal of Positive School Psychology, 6(10), 2528-2552.
- Kanwal, W., Qamar, A. M., Nadeem, H. A., Khan, S. A., & Siddique, M. (2022). Effect of Conceptual Understanding of Mathematical Principles on Academic Achievement of Secondary Level Chemistry Students. Multicultural Education, 8(3), 242-254. https://doi.org/10.5281/zenodo.6370449
- Kline, P. (2019). The Handbook of psychological testing (2nd ed.). Routledge.
- Kunnan, A. J., & Chapelle, C. A. (2019). Introduction to Language Assessment: Theories and Methods. Routledge.
- Lakhan, G. R., Ullah, M., Channa, A., ur Rehman, Z., Siddique, M., & Gul, S. (2020). The Effect of Academic Resilience and Attitude on Managerial Performance. Elementary Education Online, 19(3), 3326-3340. https://doi.org/10.17051/ilkonline.2020.03.735498
- Law, N., Wong, K. Y., & Li, Y. (2018). Technology-enhanced assessment in higher education: A critical review of teaching, learning, and assessment frameworks. Educational Research Review, 27, 109-128.
- Lin, S. Y., & Chen, Y. J. (2018). Developing and validating an item bank for a large- scale EFL reading test in Taiwan. Language Testing in Asia, 8(1), 1-23.
- Lu, J. (2017). The application of item bank in college entrance examination. Journal of Guangdong University of Education, 37(3), 55-61.
- Lu, M. (2017). Item banks and computerized adaptive testing: Theory and applications. Routledge.
- Mah Jabeen, S., Aftab, M. J., Naqvi, R., Awan, T. H., & Siddique, M. (2021). Prevalence of Students with Learning Difficulties in Basic Arithmetic Operations in the Subject of Mathematics at Elementary Level. Multicultural Education, 7(5), 444-453. https://doi.org/10.5281/zenodo.5110685
- Martin, M. O., & Kelly, D. L. (2019). Item banking: Past, present, and future. In The Routledge Handbook of Language Testing (pp. 16-32). Routledge.
- Martin, S., & Kelly, R. (2019). Computer- based testing: A review of literature and practice. Journal of Educational Computing Research, 57(4), 940-959.
- Munir, M., Ali, M. S., Iqbal, A., Farid, M. F., & Siddique, M. (2021). Relationship between Learning Environment and Performance of Students at University Level. Humanities & Social Sciences Reviews, 9(3), 877-884. https://doi.org/10.18510/hssr.2021.9385
- Saeed, A., Warraich, W. Y., Azeem, A., Siddique, M., & Faiz, Z. (2021). Use of Social Media Apps for Cyberstalking during Pandemic COVID-19 Lockdown: A Cross-Sectional Survey at University Students of Lahore. Multicultural Education, 7(11), 334-343. https://doi.org/10.5281/zenodo.5705998
- Sajjad, Q., Siddique, M., & Tufail, I. (2022). Teacher-Student Interaction towards Chemistry at Secondary Level. Global Educational Studies Review, VII(II), 167- 174. https://doi.org/10.31703/gesr.2022(VII-II).16
- Siddique, M., Ahmed, M., Feroz, M., Shoukat, W., & Jabeen, S. (2022). Attitude Towards Learning Chemistry: A Case Of Secondary School Students In Pakistan. Journal of Positive School Psychology, 6(12), 1031-1055.
- Siddique, M., Ali, M. S., Nasir, N., Awan, T. H., & Siddique, A. (2021). Resilience and Self-Efficacy: A Correlational Study of 10th Grade Chemistry Students in Pakistan. Multicultural Education, 7(9), 210-222. https://doi.org/10.5281/zenodo.5498287
- Siddique, M., Hassan, K. H. U., & Akmal, F. (2023). The Role of Resilience in Developing the Self-Efficacy Among Chemistry Students in Pakistan. VFAST Transactions on Education and Social Sciences, 11(1), 38-48.
- Siddique, M., Tatlah, I. A., Ali, M. S., Awan, T. H., & Nadeem, H. A. (2021). Effect of Total Quality Management on Students Performance in Chemistry at Secondary Level in Pakistan. Multicultural Education, 7(11), 592-602. https://doi.org/10.5281/zenodo.5828015
- Sun, L., & Qu, Y. (2020). A review of item generation in language assessment. Language Testing in Asia, 10(1), 1-25.
- Taylor, L., & Weir, C. (2020). Language testing research at the intersection of assessment and technology. Annual Review of Applied Linguistics, 40, 4-24.
- Van der Linden, W. J., & Glas, C. A. (2010). Computerized adaptive testing: Theory and practice (2nd ed.). Springer.
- Van der Linden, W. J., & Glas, C. A. W. (2010). Computerized adaptive testing: Theory and practice. Springer Science & Business Media.
- Whiting, B. (2018). Computerized adaptive testing: A primer. Journal of Educational Measurement, 55(2), 141-153. http://ci.nii.ac.jp/ncid/BA49621425
- Whiting, B. (2018). The use of item banks in large-scale language testing: A review of the literature. Language Testing, 35(1), 3- 21.
- Yin, C., Li, X., & Tan, X. (2017). The impact of item banking on English writing assessment: The evidence from Chinese university EFL learners. Journal of English for Academic Purposes, 29, 87-98.
- Zhang, J., & Yang, X. (2021). Investigating the impact of automated item generation on language test development. Language Testing, 38(2), 259-280
- Zhang, Y., & Wang, S. (2021). Exploring the impact of item exposure control methods on test fairness in computerized adaptive testing. Educational and Psychological Measurement, 81(1), 156-172
- Zheng, Y., & Chen, X. (2020). An investigation of the effectiveness of item generation for automated essay scoring. Language Testing, 37(1), 109-131.
- Zhu, Y., Yan, J., & Gao, X. (2021). Implementing an item bank-based placement test in a higher education context. Language Testing in Asia, 11(1), 1-24.
Cite this article
-
APA : Ahmad, M., Hussan, K. H. U., & Tayyab, M. (2023). The Experiences, Challenges, and Acceptance of Item Bank System (IBS) as a Tool for Paper Generation: A Case Study. Global Educational Studies Review, VIII(I), 242-251. https://doi.org/10.31703/gesr.2023(VIII-I).21
-
CHICAGO : Ahmad, Mahboob, Khawaja Hisham Ul Hussan, and Muhammad Tayyab. 2023. "The Experiences, Challenges, and Acceptance of Item Bank System (IBS) as a Tool for Paper Generation: A Case Study." Global Educational Studies Review, VIII (I): 242-251 doi: 10.31703/gesr.2023(VIII-I).21
-
HARVARD : AHMAD, M., HUSSAN, K. H. U. & TAYYAB, M. 2023. The Experiences, Challenges, and Acceptance of Item Bank System (IBS) as a Tool for Paper Generation: A Case Study. Global Educational Studies Review, VIII, 242-251.
-
MHRA : Ahmad, Mahboob, Khawaja Hisham Ul Hussan, and Muhammad Tayyab. 2023. "The Experiences, Challenges, and Acceptance of Item Bank System (IBS) as a Tool for Paper Generation: A Case Study." Global Educational Studies Review, VIII: 242-251
-
MLA : Ahmad, Mahboob, Khawaja Hisham Ul Hussan, and Muhammad Tayyab. "The Experiences, Challenges, and Acceptance of Item Bank System (IBS) as a Tool for Paper Generation: A Case Study." Global Educational Studies Review, VIII.I (2023): 242-251 Print.
-
OXFORD : Ahmad, Mahboob, Hussan, Khawaja Hisham Ul, and Tayyab, Muhammad (2023), "The Experiences, Challenges, and Acceptance of Item Bank System (IBS) as a Tool for Paper Generation: A Case Study", Global Educational Studies Review, VIII (I), 242-251
-
TURABIAN : Ahmad, Mahboob, Khawaja Hisham Ul Hussan, and Muhammad Tayyab. "The Experiences, Challenges, and Acceptance of Item Bank System (IBS) as a Tool for Paper Generation: A Case Study." Global Educational Studies Review VIII, no. I (2023): 242-251. https://doi.org/10.31703/gesr.2023(VIII-I).21