AI literacy beyond tools: Safeguarding human judgment in research and higher education
Main Article Content
Authors
Feng Chia University
Abstract
Artificial intelligence has emerged as a pioneering tool for assisting researchers and students in conducting complex tasks, including designing questionnaires, proofreading academic works, and rebutting reviewers’ criticisms. Beyond being a tool, this advanced technology highlights its impact on the future of research and education and makes the audience feel that their engagement with AI is necessary. However, AI-related ethical issues arise when people apply AI in their learning and research, especially when it involves sensitive information in humanities and social sciences and questions users’ epistemic positions and reflexivity of their studies. The contribution of AI literacy has not yet been fully recognized, as current studies focus on the AI models’ competencies rather than on human capabilities to adapt AI technologies for educational and research purposes in responsible, ethical, and comprehensive ways. This article first discusses the role of AI literacy in academia and higher education. Then, it examines four controversial AI ethical issues that potentially jeopardize research and learning, including biases in AI, sycophantic chatbot services, inaccuracy, randomness, and ethical concerns of AI models’ outputs. This article represents a further step toward developing clear AI literacy guidelines, assuring that audiences’ skills and judgment remain central to responsible AI use.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright remains with the author(s). All articles are published under the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license permits use, sharing, adaptation, distribution, and reproduction in any medium or format, provided that appropriate credit is given to the original author(s) and the source, a link to the license is provided, and any changes are indicated.
How to Cite
References
Abbas, M., Jam, F. A., & Khan, T. I. (2024). Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students. International Journal of Educational Technology in Higher Education, 21(1), 10. https://doi.org/10.1186/s41239-024-00444-7
Alikhani, M. (2025, April 15). Breaking the AI mirror: Sycophancy, productivity, and the future of collaboration. The Brookings Institution. https://www.brookings.edu/articles/breaking-the-ai-mirror/
Allen, L. K., & Kendeou, P. (2024). ED-AI Lit: An Interdisciplinary Framework for AI Literacy in Education. Policy Insights from the Behavioral and Brain Sciences, 11(1), 3–10. https://doi.org/10.1177/23727322231220339
Armitage, R. (2025). Your brain on ChatGPT. British Journal of General Practice, 75(758), 410. https://doi.org/10.3399/bjgp25X743181
Bhuiyan, J. (2025, August 29). ChatGPT encouraged Adam Raine’s suicidal thoughts. His family’s lawyer says OpenAI knew it was broken. The Guardian.
Biesta, G. (2013). Responsive or Responsible? Democratic Education for the Global Networked Society. Policy Futures in Education, 11(6), 733–744. https://doi.org/10.2304/pfie.2013.11.6.733
Boyer, E.L. (1987). College: The Undergraduate Experience in America. Harper and Row.
Britannica (2025, December 27). humanities. Britannica https://www.britannica.com/topic/humanities.
California Faculty Association (2025, March 6). Layoff Notices Continue to Plague the CSU. California Faculty Association. https://www.calfac.org/layoff-notices-continue-to-plague-the-csu/
California Learning Resource Network (2025, July 2). What does educational institution mean? California Learning Resource Network. https://www.clrn.org/what-does-educational-institution-mean/
Casal-Otero, L., Catala, A., Fernández-Morante, C., Taboada, M., Cebreiro, B., & Barro, S. (2023). AI literacy in K-12: A systematic literature review. International Journal of STEM Education, 10(1), 29. https://doi.org/10.1186/s40594-023-00418-7
Cheng, M., Lee, C., Khadpe, P., Yu, S., Han, D. and Jurafsky, D. (2025). Sycophantic AI Decreases Prosocial Intentions and Promotes Dependence. arXiv. https://arxiv.org/abs/2510.01395
Chiu, T. K. F. (2025). AI literacy and competency: definitions, frameworks, development and future research directions. Interactive Learning Environments, 33(5), 3225–3229. https://doi.org/10.1080/10494820.2025.2514372
Choi, A. and Mei, K.X. (2025, March 21). What are AI hallucinations? Why AIs sometimes make things up. The Conversation. https://theconversation.com/what-are-ai-hallucinations-why-ais-sometimes-make-things-up-242896
Chow, R. (2025, June 23). ChatGPT may be eroding critical thinking skills, according to a new MIT study. Time. https://time.com/7295195/ai-chatgpt-google-learning-school/
Connell, R. (2007). Southern theory : the global dynamics of knowledge in social science. Polity.
De Guzman, C. (2025, July 31). AI Chatbots Can Be Manipulated to Provide Advice on How to Self-Harm, New Study Shows. Time.
Desmarais, A. (2025, September 9) Why do AI models make things up or hallucinate? OpenAI says it has the answer and how to prevent it. Euro-news.
Durkheim, E. (1952). Suicide : a study in sociology. Routledge & Kegan Paul.
Forsdike, N. (2025, November 23). How can university lecturers tell students’ assignments are fully generated by AI? [Video]. Rednote. http://xhslink.com/o/5b5vR9Vt1ee
Gomstyn, A. & Jonker, A. (n.d.). AI literacy: Closing the artificial intelligence skills gap. IBM Think. https://www.ibm.com/think/insights/ai-literacy
Goodman, R. (2018, October 12). Why Amazon’s Automated Hiring Tool Discriminated Against Women. American Civil Liberties Union.
Han, J., Qiu, W. and Lichtfouse, E. (2024). ChatGPT in scientific research and writing : a beginner’s guide. Springer.
Harris, T. (2025, March 6) The man who predicted the downfall of thinking [Audio Podcast]. In Center for Humane Technology. www.humanetech.com/podcast/the-man-who-predicted-the-downfall-of-thinking
Ho, K. (2025, December 18) University of Hong Kong professor steps down from associate deanship after AI-generated references scandal. Hong Kong Free Press.
Hung, E. (2025, November 10) Journal defends work with fake AI citations after Hong Kong university launches probe. South China Morning Post.
IBM (n.d.) What is AI ethics? IBM Think. https://www.ibm.com/think/topics/ai-ethics
Iftikhar, Z., Xiao, A., Ransom, S., Huang, J., & Suresh, H. (2025). How LLM Counselors Violate Ethical Standards in Mental Health Practice: A Practitioner-Informed Framework. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, 8(2), 1311-1323. https://doi.org/10.1609/aies.v8i2.36632
Jones, R. A. (1986) Emile Durkheim : an introduction to four major works. Sage.
Kankanhalli, A. (2020). Artificial intelligence and the role of researchers: Can it replace us? Drying Technology, 38(12), 1539–1541. https://doi.org/10.1080/07373937.2020.1801562
Kim, S. and Kim, H.J. (2025). A Dual-Layered Evaluation of Geopolitical and Cultural Bias in LLMs. Preprint. https://arxiv.org/html/2506.21881v1
Li Ka-Shing Foundation (2022). Puji AI jiaoyu zeng gouxiang li zhangwo weilai [Promoting AI education, cultivating imagination and steering the future], Li Ka-Shing Foundation. https://www.lksf.org/popularising-ai-education-enhancing-conceptual-skills-creating-the-future/?lang=hk
Lo, L. (2025) AI Literacy: A Guide for Academic Libraries. College & Research Libraries News, 86(3), 120. https://crln.acrl.org/index.php/crlnews/article/view/26704/34626
Lytton, C. (2024, February 16) AI hiring tools may be filtering out the best job applicants. BBC.
Maher, M.L. (2024, March 22). AI Literacy: The Key to Responsible Use of AI in Education [Video]. YouTube. https://www.youtube.com/watch?v=weemM1r-zaY&list=PLvh_WxOo1WE1pt9L3t2YEDTWI5N97BVDU&index=9
Mayfield, A. (2024, December 5). AI Literacy essentials [Video]. YouTube. https://www.youtube.com/watch?v=Xl1s6fws_Qs&t=5s
McLean, I. (2018, November 20). What is social science? The British Academy. https://www.thebritishacademy.ac.uk/blog/what-social-science/
Mello-Klein, C. (2025, November 24). The AI industry has a problem: Chatbots are too nice. Northeastern Global News. https://news.northeastern.edu/2025/11/24/ai-sycophancy-research/
Milberg, T. (2025, May 22). Why AI literacy is now a core competency in education. World Economic Forum. https://www.weforum.org/stories/2025/05/why-ai-literacy-is-now-a-core-competency-in-education/?gad_source=1&gad_campaignid=22234048793&gbraid=0AAAAAoVy5F74Pif2WC7r9TwWAgCqNYLFU&gclid=Cj0KCQiAprLLBhCMARIsAEDhdPeMVRjZmAgjMcGXjL5Ndft2XztswwTTTmuwTWC7GLijOy_9M3dAPzgaAvfVEALw_wcB
Malik, M. A., Amjad, A. I., Aslam, S., & Fakhrou, A. (2024). Global insights: ChatGPT's influence on academic and research writing, creativity, and plagiarism policies. Frontiers in research metrics and analytics, 9, 1486832. https://doi.org/10.3389/frma.2024.1486832
Murdoch University (2024, May 7). AI technology is showing cultural biases, here’s why and what can be done. Murdoch University.
Naddaf, M. (2025). AI chatbots are sycophants- researchers say it’s harming science. Nature, 647, 13-14. https://www.nature.com/articles/d41586-025-03390
Navigli, R., Conia, S., and Ross, B. (2023). Biases in Large Language Models: Origins, Inventory, and Discussion. Journal of Data and Information Quality 15 (2), 1-21. https://dl.acm.org/doi/10.1145/3597307
Newport, C. (2023, December 18) It’s time to dismantle the technopoly. The New Yorker.
Noble, J. (n.d.) What is LLM Temperature? IBM Think. https://www.ibm.com/think/topics/llm-temperature.
OECD (2025). Empowering learners for the age of AI: An AI literacy framework for primary and secondary education. OECD.
Ng, T.K., Leung, K.L., Su, J., Yim, H.Y., Qiao, S., Chu, K.W. (2023). AI Literacy in K-16 Classrooms. Springer.
Postman, N. (1993) Technopoly: the surrender of culture to technology. Vintage Books.
Purser, R. (2025, December 1). AI is destroying the university and learning itself. Current Affairs.https://www.currentaffairs.org/news/ai-is-destroying-the-university-and-learning-itself.
Roy, A. (2009). The 21st-Century Metropolis: New Geographies of Theory. Regional studies 43(6), 819-830. https://doi.org/10.1080/00343400701809665
Sample, I. (2025, October 24). ‘Sycophantic’ AI chatbots tell users what they want to hear, study shows. The Guardian.
Sanford, J. (2025, August 27). Why AI companions and young people can make for a dangerous mix. Stanford Medicine.
https://med.stanford.edu/news/insights/2025/08/ai-chatbots-kids-teens-artificial-intelligence.html
Seker, O., Kwon, K., & Kocak, O. (2025). Exploring researchers’ artificial intelligence (AI) literacy: The mediating role of digital literacy and data literacy between 21st century skills and AI literacy. Information Development, 0(0).
Sikombe, M. (2025, June 30). Why Diversity in AI Matters: Moving towards inclusivity and away from bias. Jisc.
Singh, A. (2025, August 31). ChatGPT Made Him Do It? Deluded By AI, US Man Kills Mother and Self. NDTV World.
Smyth, N. (2024, December 19). Smash the technopoly! Neil Postman, Marshall McLuhan, and the anxious generation. After Babel. www.afterbabel.com/p/smash-the-technopoly
Sociological Perspectives (2023, n.d.) Education as a Social Institution. Sociological Perspectives. http://sociologicalperspectives.org/?page_id=65
Su, J., Ng, D. T. K., & Chu, S. K. W. (2023). Artificial Intelligence (AI) Literacy in Early Childhood Education: The Challenges and Opportunities. Computers and Education: Artificial Intelligence, 4, 100124. https://doi.org/10.1016/j.caeai.2023.100124
The MIT Sloan (2024, n.d.). When AI Gets It Wrong: Addressing AI Hallucinations and Bias. Massachusetts Institute of Technology. https://mitsloanedtech.mit.edu/ai/basics/addressing-ai-hallucinations-and-bias/
The Princeton Review. (n.d.). Ethical and social implications of AI use. The Princeton Review. https://www.princetonreview.com/ai-education/ethical-and-social-implications-of-ai-use
Thomson, T.J. and Thomas, R. (2023, July 10). Ageism, sexism, classism and more: 7 examples of bias in AI-generated images. The Conversation.
Titheradge, N. and Malchevska, O. (2025, November 6). I wanted ChatGPT to help me. So why did it advise me how to kill myself? BBC.
Wang, J. and Fan, W. (2025). The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis. Humanities and Social Sciences Communications, 12 (621). https://doi.org/10.1057/s41599-025-04787-y
Watson, V. (2012). Planning and the “stubborn realities” of global south-east cities: Some emerging ideas. Planning theory, 12(1), 81-100.
Weise, K. and Metz, C. (2023, May 1). When A.I. chatbots hallucinate. The New York Times.
Yadav, S. (2024, December 17). Global perspectives on AI bias: Addressing cultural asymmetries and ethical implications. Observer Research Foundation.
Zhou, X., Li, Y., Chai, C. S., and Chiu, T. K. F. (2025). Defining, enhancing, and assessing artificial intelligence literacy and competency in K-12 education from a systematic review. Interactive Learning Environments, 33(10), 5766–5788. https://doi.org/10.1080/10494820.2025.2487538
Article Sidebar
Download
No empirical dataset was generated or analyzed in this study. Therefore, data sharing is not applicable.
This work is licensed under a Creative Commons Attribution 4.0 International License.