Artificial Intelligence Tools and Their Utilization in Academic Research Writing
(A Systematic Review)
Keywords:
Artificial intelligence Applications, Machine Learning, Academic Research Writing, Systematic Review
Abstract
Recent technological advancements, including complex systems such as the Chat GPT, have made artificial intelligence (AI) an integral part of many scientific fields. AI's advanced capabilities are influencing numerous aspects of life, particularly academic research, in constructive ways. Nevertheless, the incorporation of AI in Arab studies related to scientific research writing is still limited. Therefore, this study aims to provide a systematic review of AI's role in scientific research writing, examining literature from November 2022 to October 2023. This review focuses on English-language research papers and conference reports found on Google Scholar. Using the PARISMA method and following set criteria for inclusion and exclusion -out of 388 initially identified publications- 26 articles were included for the final synthesis. The results show a significant increase in the investigation of AI's contribution to writing scientific papers, notably in medicine, with major input from the United States. The reviewed literature recognizes the valuable role of AI but also emphasizes the need for ethical guidelines for its use in academic writing. The study presents a detailed classification of AI's uses that can be effectively applied to different stages of the scientific writing process. From its findings, the study highlights existing gaps and future research directions, offering knowledge expected to be highly beneficial for the scholarly and professional sectors.
References
1. Abhishek, N., Devesh, S., Dinesh, S., Kulal, A., & Suraj, N. (2023). Empowering Education and Advancing Research: Exploring the Benefits, Opportunities, and Challenges of Tech Trends Using AI Tools.
2. Adam, M., Wessel, M., & Benlian, A. (2021). AI-based chatbots in customer service and their effects on user compliance. Electronic Markets, 31(2), 427-445
3. AlBadarin, Y., Tukiainen, M., Saqr, M., & Pope, N. (2023). A Systematic Literature Review of Empirical Research on ChatGPT in Education. Available at SSRN 4562771.
4. Altmäe, S., Sola-Leyva, A., & Salumets, A. (2023). Artificial intelligence in scientific writing: a friend or a foe?. Reproductive BioMedicine Online.
5. Aydın, Ö., & Karaarslan, E. (2022). OpenAI ChatGPT generated literature review: Digital twin in healthcare. Available at SSRN 4308687.
6. AlZaabi, A., ALamri, A., Albalushi, H., Aljabri, R., & AalAbdulsallam, A. (2023). ChatGPT applications in academic research: A review of benefits, concerns, and recommendations. bioRxiv, 2023-08.
7. Buchanan, B. G. (2005). A (Very) Brief History of Artificial Intelligence. The AI Magazine, 26(4). https://doi.org/https://doi.org/10.1609/aimag. v26i4.1848
8. Baker, T., & Smith, L. (2019). Educ-AI-tion rebooted? Exploring the future of artificial intelligence in schools and colleges. Retrieved from Nesta Foundation website: https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf
9. Bom, H. S. H. (2023). Exploring the Opportunities and Challenges of ChatGPT in Academic Writing: a Roundtable Discussion. Nuclear Medicine and Molecular Imaging, 1-3.
10. Briner, R.B., Denyer, D., 2012. Systematic Review and Evidence Synthesis as a Practice and Scholarship Tool. New Year University Press, New York, NY.
11. Chowdhary, K., & Chowdhary, K. R. (2020). Natural language processing. Fundamentals of artificial intelligence, 603-649.
12. Currie, G. M. (2023, May). Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy?. In Seminars in Nuclear Medicine. WB Saunders.
13. Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., ... & Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642.
14. Flowers, J. C. (2019, March). Strong and Weak AI: Deweyan Considerations. In AAAI spring symposium: Towards conscious AI systems (Vol. 2287, No. 7).
15. Geher, G. (2023). ChatGPT, artificial intelligence, and the future of writing. Psychology Today. https://www.psychologytoday.com/us/blog/darwins-subterranean-world/202301/chatgpt-artificial-intelligence-and-the-future-of-writing
16. Golan, R., Reddy, R., Muthigi, A., & Ramasamy, R. (2023). Artificial intelligence in academic writing: a paradigm-shifting technological advance. Nature Reviews Urology, 1
17. Gough, D., Oliver, S., & Thomas, J. (2017). An introduction to systematic reviews, (2nd ed., ). Los Angeles: SAGE.
18. Haigh, T., & Priestley, M. (2019). von Neumann thought Turing's universal machine was' simple and neat.' but that didn't tell him how to design a computer. Communications of the ACM, 63(1), 26-32
19. Hwang, S. I., Lim, J. S., Lee, R. W., Matsui, Y., Iguchi, T., Hiraki, T., & Ahn, H. (2023). Is ChatGPT a “Fire of Prometheus” for non-native english-speaking researchers in academic writing?. Korean Journal of Radiology, 24(10), 952.
20. Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: writing better scientific review articles. American Journal of Cancer Research, 13(4), 1148.
21. Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464.
22. Jaber, T. A. (2022). Artificial intelligence in computer networks. Periodicals of Engineering and Natural Sciences, 10(1), 309-322.
23. Khosravi, H., Shafie, M. R., Hajiabadi, M., Raihan, A. S., & Ahmed, I. (2023). Chatbots and ChatGPT: A bibliometric analysis and systematic review of publications in Web of Science and Scopus databases. arXiv preprint arXiv:2304.05436.
24. Kleespies, M. W., Schneider, S., Emge, D., Feucht, V., Hacke, J., Wenzel, V., & Dierkes, P. W. (2023). How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature.
25. Lee, J. Y. (2023). Can an artificial intelligence chatbot be the author of a scholarly article?. Journal of Educational Evaluation for Health Professions, 20.
26. Liu, H., Azam, M., Bin Naeem, S., & Faiola, A. (2023). An overview of the capabilities of ChatGPT for medical writing and its implications for academic integrity. Health Information & Libraries Journal, 40(4), 440-446.
27. Mai, J., Chen, J., Li, B., Qian, G., Elhoseiny, M., & Ghanem, B. (2023). LLM as A Robotic Brain: Unifying Egocentric Memory and Control. arXiv preprint arXiv:2304.09349.
28. McCarthy, J., Minsky, M. L., Rochester, N., & Shannon, C. E. (2006). A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence: August 31, 1955. AI Magazine, 27(4).
29. Meyer, J. G., Urbanowicz, R. J., Martin, P. C., O’Connor, K., Li, R., Peng, P. C., ... & Moore, J. H. (2023). ChatGPT and large language models in academia: opportunities and challenges. BioData Mining, 16(1), 20.
30. Mondal, H., Juhi, A., Dhanvijay, A. D., Pinjar, M. J., & Mondal, S. (2023). Free software applications for authors for writing a research paper. Journal of Family Medicine and Primary Care, 12(9), 1802-1807.
31. Mosaiyebzadeh, F., Pouriyeh, S., Parizi, R., Dehbozorgi, N., Dorodchi, M., & Macêdo Batista, D. (2023, October). Exploring the Role of ChatGPT in Education: Applications and Challenges. In Proceedings of the 24th Annual Conference on Information Technology Education (pp. 84-89).
32. Muthukrishnan, N., Maleki, F., Ovens, K., Reinhold, C., Forghani, B., & Forghani, R. (2020). Brief history of artificial intelligence. Neuroimaging Clinics, 30(4), 393-399.
33. Petticrew, M., & Roberts, H. (2006). Systematic reviews in the social sciences: A practical guide. Malden; Oxford: Blackwell Pub.
34. Popenici, S., & Kerr, S. (2017). Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and Practice in Technology Enhanced Learning. https://doi.org/10.1186/s41039-017-0062-8.
35. Rahman, M., Terano, HJR, Rahman, N., Salamzadeh, A., Rahaman, S.(2023). ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples. Journal of Education, Management and Development Studies, 3(1), 1-12.
36. Ramalingam, S., Yunus, M. M., & Hashim, H. (2022). Blended learning strategies for sustainable English as a second language education: A systematic review. Sustainability, 14(13), 8051. https://doi.org/10.3390/su14138051
37. Russel, S., & Norvig, P. (2010). Artificial intelligence - a modern approach. New Jersey: Pearson Education.
38. Salimi, A., & Saheb, H. (2023). Large Language Models in Ophthalmology Scientific Writing: Ethical Considerations Blurred Lines or Not at All?. American Journal of Ophthalmology.
39. Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023). Can artificial intelligence help for scientific writing?. Critical care, 27(1), 1-5.
40. Satpute, R. S. (2023). Transforming the Language Teaching Experience in the Age of AI: Ethical, Social, and Cultural Considerations in Implementing AI in Language Education. In Transforming the Language Teaching Experience in the Age of AI (pp. 115-124). IGI Global.
41. Semrl, N., Feigl, S., Taumberger, N., Bracic, T., Fluhr, H., Blockeel, C., & Kollmann, M. (2023). AI language models in human reproduction research: exploring ChatGPT’s potential to assist academic writing. Human Reproduction, 38(12), 2281-2288.
42. Turing, A. M. (1937). On Computable Numbers, with an Application to the Entscheidungsproblem. Proceedings of the London Mathematical Society, s2-42(1), 230–265. https://doi.org/https://doi. org/10.1112/plms/s2-42.1.230
43. Vasilakes, J., Zhou, S., & Zhang, R. (2021). Natural language processing. In Machine Learning in Cardiovascular Medicine (pp. 123-148). Academic Press.
44. Vapnik, V. N. (1998). The Nature of Statistical Learning Theory. Springer. https://doi. org/10.1007/978-1-4757-2440-0
45. Xames, M. D., & Shefa, J. (2023). ChatGPT for research and publication: Opportunities and challenges. Available at SSRN 4381803.
46. Zamfiroiu, A., Vasile, D., & Savu, D. (2023). ChatGPT–A Systematic Review of Published Research Papers. Informatica Economica, 27(1), 5-16.
47. Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators?. International Journal of Educational Technology in Higher Education, 16(1), 1-27.
48. Zybaczynska, J., Norris, M., Modi, S., Brennan, J., Jhaveri, P., Craig, T. J., & Al-Shaikhly, T. (2024). Artificial Intelligence–Generated Scientific Literature: A Critical Appraisal. The Journal of Allergy and Clinical Immunology: In Practice, 12(1), 106-110.
2. Adam, M., Wessel, M., & Benlian, A. (2021). AI-based chatbots in customer service and their effects on user compliance. Electronic Markets, 31(2), 427-445
3. AlBadarin, Y., Tukiainen, M., Saqr, M., & Pope, N. (2023). A Systematic Literature Review of Empirical Research on ChatGPT in Education. Available at SSRN 4562771.
4. Altmäe, S., Sola-Leyva, A., & Salumets, A. (2023). Artificial intelligence in scientific writing: a friend or a foe?. Reproductive BioMedicine Online.
5. Aydın, Ö., & Karaarslan, E. (2022). OpenAI ChatGPT generated literature review: Digital twin in healthcare. Available at SSRN 4308687.
6. AlZaabi, A., ALamri, A., Albalushi, H., Aljabri, R., & AalAbdulsallam, A. (2023). ChatGPT applications in academic research: A review of benefits, concerns, and recommendations. bioRxiv, 2023-08.
7. Buchanan, B. G. (2005). A (Very) Brief History of Artificial Intelligence. The AI Magazine, 26(4). https://doi.org/https://doi.org/10.1609/aimag. v26i4.1848
8. Baker, T., & Smith, L. (2019). Educ-AI-tion rebooted? Exploring the future of artificial intelligence in schools and colleges. Retrieved from Nesta Foundation website: https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf
9. Bom, H. S. H. (2023). Exploring the Opportunities and Challenges of ChatGPT in Academic Writing: a Roundtable Discussion. Nuclear Medicine and Molecular Imaging, 1-3.
10. Briner, R.B., Denyer, D., 2012. Systematic Review and Evidence Synthesis as a Practice and Scholarship Tool. New Year University Press, New York, NY.
11. Chowdhary, K., & Chowdhary, K. R. (2020). Natural language processing. Fundamentals of artificial intelligence, 603-649.
12. Currie, G. M. (2023, May). Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy?. In Seminars in Nuclear Medicine. WB Saunders.
13. Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., ... & Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642.
14. Flowers, J. C. (2019, March). Strong and Weak AI: Deweyan Considerations. In AAAI spring symposium: Towards conscious AI systems (Vol. 2287, No. 7).
15. Geher, G. (2023). ChatGPT, artificial intelligence, and the future of writing. Psychology Today. https://www.psychologytoday.com/us/blog/darwins-subterranean-world/202301/chatgpt-artificial-intelligence-and-the-future-of-writing
16. Golan, R., Reddy, R., Muthigi, A., & Ramasamy, R. (2023). Artificial intelligence in academic writing: a paradigm-shifting technological advance. Nature Reviews Urology, 1
17. Gough, D., Oliver, S., & Thomas, J. (2017). An introduction to systematic reviews, (2nd ed., ). Los Angeles: SAGE.
18. Haigh, T., & Priestley, M. (2019). von Neumann thought Turing's universal machine was' simple and neat.' but that didn't tell him how to design a computer. Communications of the ACM, 63(1), 26-32
19. Hwang, S. I., Lim, J. S., Lee, R. W., Matsui, Y., Iguchi, T., Hiraki, T., & Ahn, H. (2023). Is ChatGPT a “Fire of Prometheus” for non-native english-speaking researchers in academic writing?. Korean Journal of Radiology, 24(10), 952.
20. Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: writing better scientific review articles. American Journal of Cancer Research, 13(4), 1148.
21. Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464.
22. Jaber, T. A. (2022). Artificial intelligence in computer networks. Periodicals of Engineering and Natural Sciences, 10(1), 309-322.
23. Khosravi, H., Shafie, M. R., Hajiabadi, M., Raihan, A. S., & Ahmed, I. (2023). Chatbots and ChatGPT: A bibliometric analysis and systematic review of publications in Web of Science and Scopus databases. arXiv preprint arXiv:2304.05436.
24. Kleespies, M. W., Schneider, S., Emge, D., Feucht, V., Hacke, J., Wenzel, V., & Dierkes, P. W. (2023). How the Connectedness Between Humans and Nature Can Be Increased? Comparing ChatGPT’s Language Use to Scientific Literature.
25. Lee, J. Y. (2023). Can an artificial intelligence chatbot be the author of a scholarly article?. Journal of Educational Evaluation for Health Professions, 20.
26. Liu, H., Azam, M., Bin Naeem, S., & Faiola, A. (2023). An overview of the capabilities of ChatGPT for medical writing and its implications for academic integrity. Health Information & Libraries Journal, 40(4), 440-446.
27. Mai, J., Chen, J., Li, B., Qian, G., Elhoseiny, M., & Ghanem, B. (2023). LLM as A Robotic Brain: Unifying Egocentric Memory and Control. arXiv preprint arXiv:2304.09349.
28. McCarthy, J., Minsky, M. L., Rochester, N., & Shannon, C. E. (2006). A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence: August 31, 1955. AI Magazine, 27(4).
29. Meyer, J. G., Urbanowicz, R. J., Martin, P. C., O’Connor, K., Li, R., Peng, P. C., ... & Moore, J. H. (2023). ChatGPT and large language models in academia: opportunities and challenges. BioData Mining, 16(1), 20.
30. Mondal, H., Juhi, A., Dhanvijay, A. D., Pinjar, M. J., & Mondal, S. (2023). Free software applications for authors for writing a research paper. Journal of Family Medicine and Primary Care, 12(9), 1802-1807.
31. Mosaiyebzadeh, F., Pouriyeh, S., Parizi, R., Dehbozorgi, N., Dorodchi, M., & Macêdo Batista, D. (2023, October). Exploring the Role of ChatGPT in Education: Applications and Challenges. In Proceedings of the 24th Annual Conference on Information Technology Education (pp. 84-89).
32. Muthukrishnan, N., Maleki, F., Ovens, K., Reinhold, C., Forghani, B., & Forghani, R. (2020). Brief history of artificial intelligence. Neuroimaging Clinics, 30(4), 393-399.
33. Petticrew, M., & Roberts, H. (2006). Systematic reviews in the social sciences: A practical guide. Malden; Oxford: Blackwell Pub.
34. Popenici, S., & Kerr, S. (2017). Exploring the impact of artificial intelligence on teaching and learning in higher education. Research and Practice in Technology Enhanced Learning. https://doi.org/10.1186/s41039-017-0062-8.
35. Rahman, M., Terano, HJR, Rahman, N., Salamzadeh, A., Rahaman, S.(2023). ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples. Journal of Education, Management and Development Studies, 3(1), 1-12.
36. Ramalingam, S., Yunus, M. M., & Hashim, H. (2022). Blended learning strategies for sustainable English as a second language education: A systematic review. Sustainability, 14(13), 8051. https://doi.org/10.3390/su14138051
37. Russel, S., & Norvig, P. (2010). Artificial intelligence - a modern approach. New Jersey: Pearson Education.
38. Salimi, A., & Saheb, H. (2023). Large Language Models in Ophthalmology Scientific Writing: Ethical Considerations Blurred Lines or Not at All?. American Journal of Ophthalmology.
39. Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023). Can artificial intelligence help for scientific writing?. Critical care, 27(1), 1-5.
40. Satpute, R. S. (2023). Transforming the Language Teaching Experience in the Age of AI: Ethical, Social, and Cultural Considerations in Implementing AI in Language Education. In Transforming the Language Teaching Experience in the Age of AI (pp. 115-124). IGI Global.
41. Semrl, N., Feigl, S., Taumberger, N., Bracic, T., Fluhr, H., Blockeel, C., & Kollmann, M. (2023). AI language models in human reproduction research: exploring ChatGPT’s potential to assist academic writing. Human Reproduction, 38(12), 2281-2288.
42. Turing, A. M. (1937). On Computable Numbers, with an Application to the Entscheidungsproblem. Proceedings of the London Mathematical Society, s2-42(1), 230–265. https://doi.org/https://doi. org/10.1112/plms/s2-42.1.230
43. Vasilakes, J., Zhou, S., & Zhang, R. (2021). Natural language processing. In Machine Learning in Cardiovascular Medicine (pp. 123-148). Academic Press.
44. Vapnik, V. N. (1998). The Nature of Statistical Learning Theory. Springer. https://doi. org/10.1007/978-1-4757-2440-0
45. Xames, M. D., & Shefa, J. (2023). ChatGPT for research and publication: Opportunities and challenges. Available at SSRN 4381803.
46. Zamfiroiu, A., Vasile, D., & Savu, D. (2023). ChatGPT–A Systematic Review of Published Research Papers. Informatica Economica, 27(1), 5-16.
47. Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators?. International Journal of Educational Technology in Higher Education, 16(1), 1-27.
48. Zybaczynska, J., Norris, M., Modi, S., Brennan, J., Jhaveri, P., Craig, T. J., & Al-Shaikhly, T. (2024). Artificial Intelligence–Generated Scientific Literature: A Critical Appraisal. The Journal of Allergy and Clinical Immunology: In Practice, 12(1), 106-110.
Published
2023-12-20
How to Cite
Dr. Jolin Adeeb Qutub. (2023). Artificial Intelligence Tools and Their Utilization in Academic Research Writing: (A Systematic Review). Journal of Arts, Literature, Humanities and Social Sciences, (98), 443-469. https://doi.org/10.33193/JALHSS.98.2023.1020
Issue
Section
المقالات
