Document Type : Original Article

Authors

1 Ph.D. Candidate of Knowledge and Information Science, Tarbiat Modares University, Tehran, Iran

2 Professor, Department of Knowledge and Information Science, Tarbiat Modares University, Tehran, Iran

3 Ph.D., Copenhagen Business School, Frederiksberg and Copenhagen, Denmark

Abstract

Purpose: This study systematically reviews the advantages and disadvantages of using ChatGPT in higher education.
Method: This systematic review adheres to PRISMA guidelines. The search was conducted using the terms "ChatGPT" and "chatbot" for the years 2021–2024 in Google Scholar, ResearchGate, Web of Science, and PubMed via Publish or Perish (version 8). A total of 365 records were retrieved, and after screening, 35 relevant studies were included.
Findings: The analysis indicate that 66% of the reviewed studies highlighted the benefits of ChatGPT in higher education, including enhancements in cognitive and learning skills, support for research and writing, improvements in language and communication, and automation of certain tasks to increase efficiency. Additionally, advantages such as 24/7 availability, quick responses, topic diversity, privacy, and easy access to past interactions were noted. Among the advantages that received the most attention are optimization of academic training, enhancement of cognitive and learning skills, and assistance in the research and development process. However, 75% of the studies discussed disadvantages, including concerns about plagiarism, ethical issues, negative perceptions, lack of audiovisual communication, absence of human interaction, technical limitations, and restricted multi-dimensional engagement.  Among the most prominent disadvantages are ethical concerns, plagiarism, and lack of uniformity in responses.
Conclusion: While ChatGPT offers significant benefits in education, its limitations require careful consideration to ensure responsible and effective use. Specifically, to address these disadvantages, practical measures such as the development of policies and ethical guidelines should be implemented to ensure responsible and optimal use of this technology in education.

Keywords

Aczel, B.; Wagenmakers, E. (2023). Transparency Guidance for ChatGPT Usage in Scientific Writing. PsyArXiv, Preprint. https://osf.io/preprints/psyarxiv/b58ex/download/
Aljanabi, M.; Ghazi, M.; Ali, A.; Abed, S. (2023). ChatGpt: Open Possibilities. Iraqi J. Comput. Sci. Math. 4 (1), 62–64. DOI:10.52866/20ijcsm.2023.01.01.0018.
Atlas, S. (2023). ChatGPT for Higher Education and professional development: A guide to conversational AI. https://digitalcommons.uri.edu/cba_facpubs/548?utm_source=digitalcommons.uri.edu%2Fcba_facpubs%2F548&utm_medium=PDF&utm_campaign=PDFCoverPages
Aithal, S., & Aithal, P. S. (2023). Effects of AI-based ChatGPT on higher education 
libraries. International Journal of Management, Technology, and Social Sciences (IJMTS), 8(2), 95-108.‏doi.org/10.2139/ssrn.4453581
Chen, T. J. (2023). ChatGPT and other artificial intelligence applications speed up scientific writing. Journal of the Chinese Medical Association, 86(4), 351-353. DOI:10.1097/JCMA.0000000000000900
Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in education and teaching international, 61(2), 228- 239. DOI:10.35542/osf.io/mrz8h.
Domingos, P. (2015) The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World, 1st ed.; Basic Books, A Member of the Perseus Books Group: New York, NY, USA, 2018; p. 329.
Dempere, J., Modugu, K., Hesham, A., & Ramasamy, L. K. (2023). The impact of ChatGPT on higher education. In Frontiers in Education (Vol. 8, p. 1206936). Frontiers Media SA.‏  doi.org/10.3389/feduc.2023.1206936
Emenike, M. E., & Emenike, B. U. (2023). Was This Title Generated by ChatGPT? Considerations for Artificial Intelligence Text-Generation Software Programs for Chemists and Chemistry Educators. Journal of Chemical Education. DOI: 10.1021/acs.jchemed.3c00063
Smith, P. (2023). ChatGPT threatens university education. Greek Reporter. https://greekreporter.com/2023/02/20/chatgpt-threatens-university-education/
Gordijn, B.; Have, H.t. (2023). ChatGPT: evolution or revolution?. Medicine, health care and philosophy, 26(1), 1-2.
Hasanein, A. M., & Sobaih, A. E. E. (2023). Drivers and consequences of ChatGPT use in higher education: Key stakeholder perspectives. European journal of investigation in health, psychology and education, 13(11), 2599-2614.‏ doi.org/10.3390/ejihpe13110181.
Halaweh, M. (2023). ChatGPT in education: Strategies for responsible implementation. Contemporary Educational Technology, 15(2). ‏ DOI: 10.30935/cedtech/13036
Hassanzadeh, M. (2022). Intelligent agents and knowledge management facilities: ChatGPT and beyond. Information Management Sciences and Techniques, 8(4), 7-22. doi: 10.22091 / stim.2023.2421
Hwang, G. J., & Chang, C. Y. (2021). A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099-4112. https://doi.org/10.1080/10494820.2021.1952615
Jensen, L. X., Buhl, A., Sharma, A., & Bearman, M. (2025). Generative AI and higher education: A review of claims from the first months of ChatGPT. Higher Education, 89(4), 1145-1161.‏
Libai, B., Bart, Y., Gensler, S., Hofacker, C. F., Kaplan, A., Kötterheinrich, K., & Kroll, E. B. (2020). Brave new world? On AI and the management of customer relationships. Journal of Interactive Marketing, 51(1), 44-56. DOI: 10.1016/j.intmar.2020.04.002
Lin, Z. (2023). Why and how to embrace AI such as ChatGPT in your academic life. PsyArXiv, Preprint. DOI: 10.1098/rsos.230658
Lubowitz, J. (2023). ChatGPT, an artificial intelligence chatbot, is impacting medical literature. Arthroscopy, 39(5), 1121-1122. DOI: 10.1016/j.arthro.2023.01.015
Lund, B.; Wang, S. (2023). Chatting about ChatGPT: how may AI and GPT impact academia and libraries?. Library hi tech news, 40(3), 26-29. DOI: 10.1108/LHTN-01-2023-0009
Miah, A. S. M., Tusher, M. M. R., Hossain, M. M., Hossain, M. M., Rahim, M. A., Hamid, M. E., ... & Shin, J. (2024). ChatGPT in Research and Education: Exploring Benefits and Threats. arXiv preprint arXiv:2411.02816.‏  https://doi.org/10.48550/arXiv.2411.02816
Malinka, K., Perešíni, M., Firc, A., Hujňák, O., & Januš, F. (2023). On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready to Obtain a University Degree? arXiv preprint arXiv:2303.11146.‏ DOI: 10.1145/3587102.3588827
M Alshater, M. (2022). Exploring the role of artificial intelligence in enhancing academic performance: A case study of ChatGPT. Available at SSRN.‏ DOI: 10.2139/ssrn.4312358
Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 6, e1000097. DOI: 10.1371/journal.pmed.1000097
Neumann, M., Rauschenberger, M., & Schön, E. M. (2023). “We Need to Talk About ChatGPT”: The Future of AI and Higher Education.‏ In 2023 IEEE/ACM 5th International Workshop on Software Engineering Education for the Next Generation (SEENG) (pp. 29-32). IEEE. DOI: 10.1109/SEENG59157.2023.00010
Editorials, N. (2023). Tools such as ChatGPT threaten transparent science; here are our ground rules for their use. Nature, 613(7945), 612.‏
Parker, L., Carter, C., Karakas, A., Loper, A. J., & Sokkar, A. (2024). Graduate instructors navigating the AI frontier: The role of ChatGPT in higher education. Computers and Education Open, 6, 100166.‏
Okonkwo, C. W., & Ade-Ibijola, A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, 100033.‏ DOI: doi.org/10.1016/j.caeai.2021.100033
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of applied learning and teaching, 6(1), 342-363.‏ doi.org/10.37074/jalt.2023.6.1.9
Sallam, M. (2023). ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare 2023 Mar 19;11(6):887.https://doi.org/10.3390/ healthcare11060887
Shiri, A. (2023). ChatGPT and Academic Integrity. https://informationmatters.org/2023/02/chatgpt-and-academic-integrity/
Stokel-Walker, C. (2023). ChatGPT listed as author on research papers: Many scientists disapprove. Nature, 613, 620–621. DOI: 10.1038/d41586-023-00107-z
Sullivan, M., Kelly, A., & McLaughlan, P. (2023). ChatGPT in Higher Education: Considerations for academic integrity and student learning. Journal of Applied Learning and Teaching, 6(1).‏ DOI: 10.37074/jalt.2023.6.1.17
Sok, S., & Heng, K. (2024). Opportunities, challenges, and strategies for using ChatGPT in higher education: A literature review. Journal of Digital Educational Technology, 4(1), ep2401.‏
Silva, C. A. G. D., Ramos, F. N., De Moraes, R. V., & Santos, E. L. D. (2024). ChatGPT: Challenges and benefits in software programming for higher education. Sustainability, 16(3), 1245. https://doi.org/10.3390/ su16031245
Thorp, H.H. (2023). ChatGPT is fun, but not an author. Science, 379, 313. DOI: 10.1126/science.adg7879
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), 15.‏ DOI: 10.1186/s40561-023-00237-x.
Turing, A. M. (2007). Computing machinery and intelligence. In Parsing the Turing test: Philosophical and methodological issues in the quest for the thinking computer (pp. 23-65). Dordrecht: Springer Netherlands. DOI: 10.7551/mitpress/4626.003.0002
Van Dis, E. A., Bollen, J., Zuidema, W., Van Rooij, R., & Bockting, C. L. (2023). ChatGPT: five priorities for research. Nature, 614(7947), 224-226. DOI: 10.1038/d41586-023-00288-7
Veletsianos, G., Kimmons, R., & Bondah, F. (2023). ChatGPT and higher education: Initial prevalence and areas of interest. Educause Review.‏