Content Validation of a Scale for Assessing Artificial Intelligence Use in Learning
Keywords:
Content validity, Artificial intelligence, Higher education, Aiken’s V, Instrument validationAbstract
The purpose of this study was to determine the content validity of a scale designed to evaluate the use of artificial intelligence in university learning (EPIA-U). The instrument consists of 28 items distributed across four dimensions—Academic support, Study personalization, Satisfaction with use, and Perceived dependence—and was subjected to the judgment of nine experts with backgrounds in education, technology, and research. The experts assessed each item according to the criteria of clarity, relevance, and congruence, using a four-point Likert scale. Data were analyzed through Aiken’s V coefficient (for items and dimensions) and the Content Validity Coefficient (CVC) proposed by Hernández-Nieto (2011) for the global index. The results showed Aiken’s V values equal to or above the acceptance threshold (≥ .75) for almost all items and across the evaluated dimensions. However, some lower confidence interval bounds fell below the .70 criterion. Complementarily, a global CVC of .90 was obtained, reflecting a high level of agreement among the judges. A minor wording adjustment was made to one item with lower indices, improving its semantic precision. In conclusion, the results provide favorable evidence of content validity for the EPIA-U and support its progression to subsequent phases of psychometric evaluation among university students
References
Abbas, M., Jam, F. A., & Khan, T. I. (2024). Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students. International Journal of Educational Technology in Higher Education, 21(1), 10. https://doi.org/10.1186/s41239-024-00444-7
Abbasi, B. N., Wu, Y., & Luo, Z. (2025). Exploring the impact of artificial intelligence on curriculum development in global higher education institutions. Education and Information Technologies, 30(1), 547–581. https://doi.org/10.1007/s10639-024-13113-z
Airaj, M. (2024). Ethical artificial intelligence for teaching-learning in higher education. Education and Information Technologies, 29(13), 17145–17167. https://doi.org/10.1007/s10639-024-12545-x
Al-Emran, M., Abu-Hijleh, B., & Alsewari, A. A. (2024). Examining the impact of Generative AI on social sustainability by integrating the information system success model and technology-environmental, economic, and social sustainability theory. Education and Information Technologies, 30, 9405–9426. https://doi.org/10.1007/s10639-024-13201-0
Al-Zahrani, A. M., y Alasmari, T. M. (2024). Exploring the impact of artificial intelligence on higher education: Opportunities and challenges. Humanities and Social Sciences Communications, 11(1), 912. https://doi.org/10.1057/s41599-024-02814-2
Anani, G. E., Nyamekye, E., & Bafour-Koduah, D. (2025). Using artificial intelligence for academic writing in higher education: The perspectives of university students in Ghana. Discover Education, 4(1), 46. https://doi.org/10.1007/s44217-025-00434-5
Anani, S., Azzahra, R., y Darmawan, T. (2025). Using artificial intelligence for academic writing: Students’ experiences, challenges, and ethical reflections in higher education. Computers & Education: Artificial Intelligence, 8, 100245. https://doi.org/10.1016/j.caeai.2025.100245
Baidoo-Anu, D., Asamoah, D., Amoako, I., & Mahama, I. (2024). Exploring student perspectives on generative artificial intelligence in higher education learning. Discover Education, 3(1), 98. https://doi.org/10.1007/s44217-024-00173-z
Baig, M. I., & Yadegaridehkordi, E. (2025). Factors influencing academic staff satisfaction and continuous usage of generative artificial intelligence (GenAI) in higher education. International Journal of Educational Technology in Higher Education, 22(1), 5. https://doi.org/10.1186/s41239-025-00506-4
Cai, L., Msafiri, M. M., & Kangwa, D. (2024). Exploring the impact of integrating AI tools in higher education using the Zone of Proximal Development. Education and Information Technologies, 30, 7191–7264. https://doi.org/10.1007/s10639-024-13112-0
Cengiz, S., & Peker, A. (2025). Generative artificial intelligence acceptance and artificial intelligence anxiety among university students: The sequential mediating role of attitudes toward artificial intelligence and literacy. Current Psychology, 44, 7991–8000. https://doi.org/10.1007/s12144-025-07433-7
Chan, C. K. Y., & Hu, W. (2023). Students’ voices on generative AI: Perceptions, benefits, and challenges in higher education. International Journal of Educational Technology in Higher Education, 20(1), 43. https://doi.org/10.1186/s41239-023-00411-8
Chao-Rebolledo, C., & Rivera-Navarro, M. Á. (2024). Usos y percepciones de herramientas de inteligencia artificial en la educación superior en México. Revista Iberoamericana de Educación, 95(1), 57–72. https://doi.org/10.35362/rie9516259
Dabis, A., & Csáki, C. (2024). AI and ethics: Investigating the first policy responses of higher education institutions to the challenge of generative AI. Humanities and Social Sciences Communications, 11(1), 1006. https://doi.org/10.1057/s41599-024-03526-z
De Fine Licht, K. (2024). Generative Artificial Intelligence in higher education: Why the “banning approach” to student use is sometimes morally justified. Philosophy & Technology, 37(3), 113. https://doi.org/10.1007/s13347-024-00799-9
Falebita, O. S., & Kok, P. J. (2024). Strategic goals for artificial intelligence integration among STEM academics and undergraduates in African higher education: A systematic review. Discover Education, 3(1), 151. https://doi.org/10.1007/s44217-024-00252-1
Hernández-Nieto, R. (2011). Instrumentos de recolección de datos en ciencias sociales y ciencias biomédicas. Universidad de los Andes.
Hughes, L., Malik, T., Dettmer, S., Al-Busaidi, A. S., & Dwivedi, Y. K. (2025). Reimagining Higher Education: Navigating the Challenges of Generative AI Adoption. Information Systems Frontiers. https://doi.org/10.1007/s10796-025-10582-6
Luo, G., Niu, C., Lu, L., Wu, L., & Huang, L. (2025). Empirical study on the double-edged effects of generative artificial intelligence on team creativity among university students. Education and Information Technologies, 30, 18853–18878. https://doi.org/10.1007/s10639-025-13527-3
Luo, T., Muljana, P. S., Ren, X., & Young, D. (2024). Exploring instructional designers’ utilization and perspectives on generative AI tools: A mixed methods study. Educational Technology Research and Development, 73, 741–766. https://doi.org/10.1007/s11423-024-10437-y
Mah, D.-K., y Groß, N. (2024). Artificial intelligence in higher education: Exploring faculty use, self-efficacy, and ethical awareness. International Journal of Educational Technology in Higher Education, 21(1), 58. https://doi.org/10.1186/s41239-024-00458-1
Maldonado-Suárez, N., & Santoyo-Telles, F. (2024). Validez de contenido por juicio de expertos: Integración cuantitativa y cualitativa en la construcción de instrumentos de medición. REIRE Revista d'Innovació i Recerca en Educació, 17(2), 1-19.
McGrath, C., Farazouli, A., & Cerratto-Pargman, T. (2024). Generative AI chatbots in higher education: A review of an emerging research area. Higher Education, 89, 1533–1549. https://doi.org/10.1007/s10734-024-01288-w
Merino Soto, C., y Livia Segovia, J. L. (2009). Intervalos de confianza asimétricos para la validez de contenido: Un programa Visual Basic para la V de Aiken. Anales de Psicología, 25(1), 169–171. https://revistas.um.es/analesps/article/view/74821
Penfield, R. D., & Giacobbi, P. R. (2004). Applying a score confidence interval to Aiken’s item content-relevance index. Measurement in Physical Education and Exercise Science, 8(4), 213–225. https://doi.org/10.1207/s15327841mpee0804_3
Pierrès, O., Darvishy, A., & Christen, M. (2024). Exploring the role of generative AI in higher education: Semi-structured interviews with students with disabilities. Education and Information Technologies, 30, 8923–8952. https://doi.org/10.1007/s10639-024-13134-8
Prasad, K. D. V., & De, T. (2024). Generative AI as a catalyst for HRM practices: Mediating effects of trust. Humanities and Social Sciences Communications, 11(1), 1362. https://doi.org/10.1057/s41599-024-03842-4
Shahzad, M. F., Xu, S., & Javed, I. (2024). ChatGPT awareness, acceptance, and adoption in higher education: The role of trust as a cornerstone. International Journal of Educational Technology in Higher Education, 21(1), 46. https://doi.org/10.1186/s41239-024-00478-x
Wang, D., Liu, Y., Jing, X., Liu, Q., y Lu, Q. (2024). Catalyst for future education: An empirical study on the impact of artificial intelligence generated content in higher education. Education and Information Technologies, 29(10), 11802–11825. https://doi.org/10.1007/s10639-024-13135-7
Zawacki-Richter, O., Bai, J. Y. H., Lee, K., Slagter Van Tryon, P. J., & Prinsloo, P. (2024). New advances in artificial intelligence applications in higher education? International Journal of Educational Technology in Higher Education, 21(1), 32, s41239-024-00464–3. https://doi.org/10.1186/s41239-024-00464-3
Downloads
Published
Issue
Section
License
The copyright belongs to the authors of the text. In case the manuscript is accepted for publication, the Sistema de Universidad Virtual of the Universidad de Guadalajara (UDGVirtual) is authorized to modify the text in the correction of style, translate, fix, disseminate, reproduce, publish and market with this. Likewise, the Universidad de Guadalajara is authorized to carry out the above described jointly or through possible third parties. (See the detailed authorization in the copyright letter.)
The authors guarantee to Apertura the right to be the first means of publication of the work. The reproduction of the texts published in the Apertura is authorized, in whole or in part, as long as it is non-profit, the source is cited and the content or design is not modified. Authors may exclusively distribute the final editorial or postprint version in any medium and at any time.
Apertura, its editors and UDGVirtual dissociate themselves from the information provided by collaborators or advertisers. The articles of the contributors do not necessarily represent the point of view of the publisher or UDGVirtual and the content of the advertisements are the sole responsibility of the contractors.
Apertura is registered in the National Institute of Copyright with the ISSN number: 1665-6180 (printed version) and e-ISSN 2007-1094 (electronic version), and with the Certificate of Reservation of Rights to the Exclusive Use of the Title: 04 -2005-120212472000-102.
It is also certified by the Qualifying Commission for Illustrated Publications and Journals of the Ministry of the Interior with the Licensed Certificates of Title number: 13449; and Content Legality: 11022.
