Impact of Artificial Intelligence on academic competence in medical research: A Scoping Review

##plugins.themes.academic_pro.article.sidebar##

Published Dec 27, 2025
https://doi.org/10.62438/tunismed.v103i10.6077
Download
pdf
Vol. 103 No. 10 (2025): Tunis Med Oct 2025

##plugins.themes.academic_pro.article.main##

Mouhamed Baheddine Soula
Research Laboratory “Measurement and Support for Hospital Performance” (LR19SP01), Tunisia
Hamza Gazzeh
Research Laboratory “Measurement and Support for Hospital Performance” (LR19SP01), Tunisia
Salima Bradai
Research Laboratory “Measurement and Support for Hospital Performance” (LR19SP01), Medical Information Systems Department, Sahloul Hospital, Sousse , Tunisia
Youssef Zanina
Research Laboratory “Measurement and Support for Hospital Performance” (LR19SP01), Medical Information Systems Department, Sahloul Hospital, Sousse , Tunisia
Mohamed Khelil
Research Laboratory “Measurement and Support for Hospital Performance” (LR19SP01), Medical Information Systems Department, Sahloul Hospital, Sousse , Tunisia
Ahmed Ben Abdelaziz
Research Laboratory “Measurement and Support for Hospital Performance” (LR19SP01), Medical Information Systems Department, Sahloul Hospital, Sousse , Faculty of Medicine, Sousse, University of Sousse, Tunisia

Abstract

Introduction: The effect of Artificial Intelligence on scientific research is currently controversial (over-use, refusal). The objective of this scoping review was to summarize the impact of Generative Pre-Trained Bots (ChatGPT) on medical research, for optimal use.


Methods: In accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, three electronic databases (MEDLINE, Web of Science, and Scopus) were searched for publications on the use of ChatGPT in medical research up to September 30, 2024. The inclusion criteria encompassed systematic reviews, meta-analyses, and reviews published in English or French. A synthesized and consensual perspective was then derived using the SWOT (Strengths, Weaknesses, Opportunities, and Threats) approach.


Results: Among the 120 articles identified during the study period, 33 publications were reviewed to describe the impact of ChatGPT on medical research skills. It emerged that ChatGPT was considered a tool for generating innovative ideas and analyzing "Big Data," helping researchers execute manually time-consuming processes. However, its responses may be accompanied by "hallucinations," posing a threat to the scientific integrity of medical research.


Conclusion: ChatGPT serves as a valuable aid in medical research, particularly in its conceptualization and writing phases. However, its potential drawbacks, such as "hallucinations," highlight the need to strengthen young researchers' skills in the proper use of Artificial Intelligence.


 

Keywords:

Medical writing , Research , Artificial Intelligence, Publication, Scoping Review

##plugins.themes.academic_pro.article.details##

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

References

  1. Sanmarchi F, Bucci A, Nuzzolese AG, Carullo G, Toscano F, Nante N, et al. A step-by-step researcher’s guide to the use of an AI-based transformer in epidemiology: an exploratory analysis of ChatGPT using the STROBE checklist for observational studies. J Public Health (Berl). 2024;32(9):1761–96.
  2. Ben Abdelaziz A, Sakly N, Melki S, Nouira S, Ben Abdelaziz A, Babba O, et al. The 5x5 approach in scientific biomedical writing. Tunis Med. 2021;99(6):585–600.
  3. Dergaa I, Chamari K, Zmijewski P, Ben Saad H. From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing. Biol Sport. 2023;40(2):615–22.
  4. Chandra A, Dasgupta S. Impact of ChatGPT on Medical Research Article Writing and Publication. Sultan Qaboos Univ Med J. 2023;23(4):429.
  5. Liao W, Liu Z, Dai H, Xu S, Wu Z, Zhang Y, et al. Differentiating ChatGPT-Generated and Human-Written Medical Texts: Quantitative Study. JMIR Med Educ. 2023;9(1):e48904.
  6. Herbold S, Hautli-Janisz A, Heuer U, Kikteva Z, Trautsch A. A large-scale comparison of human-written versus ChatGPT-generated essays. Sci Rep. 2023;13(1):18617.
  7. Gomes WJ, Evora PRB, Guizilini S. Artificial Intelligence is Irreversibly Bound to Academic Publishing — ChatGPT is Cleared for Scientific Writing and Peer Review. Braz J Cardiovasc Surg. 2023;38(4):e202309[65].
  8. International Committee of Medical Journal Editors. Updated recommendations January 2024 [Internet]. 2024 [cited 2024 Oct 24]. Available from: https://www.icmje.org/news-and-editorials/updated_recommendations_jan2024.html.
  9. Normile D. .Chinese firm's Large Language Model makes a splash. Science. 2025 Jan 17;387(6731):238. doi: 10.1126/science.adv9836. Epub 2025 Jan 16.
  10. Ravšelj D, Keržič D, Tomaževič N, Umek L, Brezovar N, Iahad NA, et al. Higher education students' perceptions of ChatGPT: A global study of early reactions. PLoS One. 2025;20(2):e0315011. doi:10.1371/journal.pone.0315011.
  11. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;n71.
  12. Chebil D, Nouira S, Mkacher H, Yahia F, Ben Abdelaziz A, Barhoumi T, et al. How to write your "Research Protocol" in health sciences. Tunis Med. 2020 Jun;98(6):456-65.
  13. Shorey S, Mattar C, Pereira TL-B, Choolani M. A scoping review of ChatGPT’s role in healthcare education and research. Nurse Educ Today. 2024;135:106121.
  14. Bagde H, Dhopte A, Alam MK, Basri R. A systematic review and meta-analysis on ChatGPT and its utilization in medical and dental research. Heliyon. 2023;9(12):e23050.
  15. Wang D, Feng L, Ye J, Zou J, Zheng Y. Accelerating the integration of CHATGPT and other large‐scale AI models into Biomedical Research and Healthcare. MedComm – Future Medicine. 2023 May 17;2(2). doi:10.1002/mef2.43
  16. Semrl N, Feigl S, Taumberger N, Bracic T, Fluhr H, Blockeel C, et al. AI language models in human reproduction research: exploring ChatGPT’s potential to assist academic writing. Hum Reprod. 2023;38(12):2281–8.
  17. Li M, Zhang Y, Sun Y, Cui L, Wang S. AI-based ChatGPT Impact on Medical Writing and Publication. Adv Ultrasound Diagn Ther. 2023;7(2):188–92.
  18. Khalifa AA, Ibrahim MA. Artificial Intelligence (AI) and CHATGPT involvement in scientific and medical writing, a new concern for researchers. A scoping review. Arab Gulf Journal Sci Res 2024 Jan 4;42(4):1770–87. doi:10.1108/agjsr-09-2023-0423
  19. Sharma H, Ruikar M. Artificial intelligence at the pen’s edge: Exploring the ethical quagmires in using artificial intelligence models like ChatGPT for assisted writing in biomedical research. Perspect Clin Res. 2024;15(3):108–15.
  20. Arshad HB, Butt SA, Khan SU, Javed Z, Nasir K. ChatGPT and Artificial Intelligence in Hospital Level Research: Potential, Precautions, and Prospects. Methodist Debakey Cardiovasc J. 2023;19(5):77–84.
  21. Chatterjee S, Bhattacharya M, Pal S, Lee S-S, Chakraborty C. ChatGPT and Large Language Models in orthopedics: from education and surgery to research. J Exp Orthop. 2023;10(1):128.
  22. Keykha A, Behravesh S, Ghaemi F. ChatGPT and Medical Research: A Meta-Synthesis of Opportunities and Challenges. J Adv Med Educ Prof. 2024;12(3):135–47.
  23. Awal SS, Awal SS. ChatGPT and the healthcare industry: a comprehensive analysis of its impact on medical writing. J Public Health [Internet]. 2023; Available from: https://doi.org/10.1007/s10389-023-02170-2.
  24. Fatani B. ChatGPT for Future Medical and Dental Research. Cureus. 2023;15(4):e37285.
  25. Mondal H, Mondal S. ChatGPT in academic writing: Maximizing its benefits and minimizing the risks. Indian J Ophthalmol. 2023;71(12):3600–6.
  26. Jeyaraman M, Ramasubramanian S, Balaji S, Jeyaraman N, Nallakumarasamy A, Sharma S. ChatGPT in action: Harnessing Artificial Intelligence potential and addressing ethical challenges in medicine, education, and scientific research. World J Methodol. 2023;13(4):170–8.
  27. Jeyaraman M, K SP, Jeyaraman N, Nallakumarasamy A, Yadav S, Bondili SK. ChatGPT in Medical Education and Research: A Boon or a Bane? Cureus. 2023;15(8):e44316.
  28. Bhargava DC, Jadav D, Meshram VP, Kanchan T. ChatGPT in medical research: challenging time ahead. Med Leg J. 2023;91(4):223–5.
  29. Fatima A, Shafique MA, Alam K, Fadlalla Ahmed TK, Mustafa MS. ChatGPT in medicine: A cross-disciplinary systematic review of ChatGPT’s (artificial intelligence) role in research, clinical practice, education, and patient interaction. Medicine (Baltimore). 2024;103(32):e39250.
  30. Tan S, Xin X, Wu D. ChatGPT in medicine: prospects and challenges: a review article. Int J Surg. 2024;110(6):3701–6.
  31. Sahu PK, Benjamin LA, Singh Aswal G, Williams-Persad A. ChatGPT in research and health professions education: challenges, opportunities, and future directions. Postgrad Med J. 2023;100(1179):50–5.
  32. Baig MI, Yadegaridehkordi E. ChatGPT in the higher education: A systematic literature review and research challenges. Int J Educ Res 2024;127:102411
  33. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 2023;11(6):887.
  34. Gupta R, Park JB, Bisht C, Herzog I, Weisberger J, Chao J, et al. Expanding Cosmetic Plastic Surgery Research With ChatGPT. Aesthet Surg J. 2023;43(8):930–7.
  35. Garg RK, Urs VL, Agarwal AA, Chaudhary SK, Paliwal V, Kar SK. Exploring the role of ChatGPT in patient care (diagnosis and treatment) and medical research: A systematic review. Health PromotPerspect. 2023;13(3):183–91.
  36. Alshami A, Elsayed M, Ali E, Eltoukhy A, Zayed T. Harnessing the Power of ChatGPT for Automating Systematic Review Process: Methodology, Case Study, Limitations, and Future Directions. Syst J. 2023;11(7).
  37. Hwang SI, Lim JS, Lee RW, Matsui Y, Iguchi T, Hiraki T, et al. Is ChatGPT a “Fire of Prometheus” for Non-Native English-Speaking Researchers in Academic Writing? Korean J Radiol. 2023;24(10):952.
  38. Zangrossi P, Martini M, Guerrini F, de Bonis P, Spena G. Large Language Model, AI and scientific research: why ChatGPT is only the beginning. J Neurosurg Sci. 2024;68(2):216–24.
  39. Patel CR, Pandya SK, Sojitra BM. Perspectives of ChatGPT in Pharmacology Education, and Research in Health Care: A Narrative Review. J Pharmacol Pharmather. 2023;14(3):171–7.
  40. Kim S. Research ethics and issues regarding the use of ChatGPT-like Artificial Intelligence platforms by authors and reviewers: a narrative review. Sci Ed. 2024;11(2).
  41. Mojadeddi ZM, Rosenberg J. The impact of AI and ChatGPT on research reporting. New Zealand Med J. 2023;136(1575):60–4.
  42. Huang J, Tan M. The role of ChatGPT in scientific communication: writing better scientific review articles. Am J Cancer Res. 2023;13(4):1148–54.
  43. Margetts TJ, Karnik SJ, Wang HS, Plotkin LI, Oblak AL, Fehrenbacher JC, et al. Use of AI Language Engine ChatGPT 4.0 to Write a Scientific Review Article Examining the Intersection of Alzheimer’s Disease and Bone. Curr Osteoporos Rep. 2024;22(1):177–81.
  44. Ruksakulpiwat S, Kumar A, Ajibade A. Using ChatGPT in Medical Research: Current Status and Future Directions. J.Multidiscip.Healthc. 2023;16:1513–20.
  45. Lee S-W, Choi W-J. Utilizing ChatGPT in clinical research related to anesthesiology: a comprehensive review of opportunities and limitations. Anesth Pain Med (Seoul). 2023;18(3):244–51.
  46. Omar M, Ullanat V, Loda M, Marchionni L, Umeton R. ChatGPT for digital pathology research. Lancet Digit Health. 2024;6(8):e595–600.
  47. Zhang A, Dimock E, Gupta R, Chen K. The new frontier: utilizing ChatGPT to expand craniofacial research. Arch Craniofac Surg. 2024;25(3):116–22.
  48. Alsadhan A, Al-Anezi F, Almohanna A, Alnaim N, Alzahrani H, Shinawi R, et al. The opportunities and challenges of adopting ChatGPT in medical research. Front Med (Lausanne). 2023;10:1259640.
  49. Biswas S .ChatGPT and the Future of Medical Writing. Radiology. 2023 Apr;307(2):e223312. doi: 10.1148/radiol.223312. Epub 2023 Feb 2. PMID: 36728748.
  50. Doyal AS, Sender D, Nanda M, Serrano RA. ChatGPT and Artificial Intelligence in Medical Writing: Concerns and Ethical Considerations. Cureus. 2023;15(8):e43292.
  51. Cunningham AR, Behm HE, Ju A, Peach MS. Long-Term Survival of Patients With Glioblastoma of the Pineal Gland: A ChatGPT-Assisted, Updated Case of a Multimodal Treatment Strategy Resulting in Extremely Long Overall Survival at a Site With Historically Poor Outcomes. Cureus. 2023;15(3):e36590.
  52. Hwang T, Aggarwal N, Khan PZ, Roberts T, Mahmood A, Griffiths MM, et al. Can ChatGPT assist authors with abstract writing in medical journals? Evaluating the quality of scientific abstracts generated by ChatGPT and original abstracts. PLoS One. 2024;19(2):e0297701.
  53. Wu J, Ma Y, Wang J, Xiao M. The Application of ChatGPT in Medicine: A Scoping Review and Bibliometric Analysis. J MultidiscipHealthc. 2024;17:1681–92.
  54. Sharun K, Banu SA, Pawde AM, Kumar R, Akash S, Dhama K, et al. ChatGPT and artificial hallucinations in stem cell research: assessing the accuracy of generated references – a preliminary study. Ann Med Surg. 2023;85(10):5275–8.
  55. Zimmerman A. A Ghostwriter for the Masses: ChatGPT and the Future of Writing. Ann Surg Oncol. 2023;30(6):3170–3.
  56. Athaluri SA, Manthena SV, Kesapragada VSRKM, Yarlagadda V, Dave T, Duddumpudi RTS. Exploring the Boundaries of Reality: Investigating the Phenomenon of Artificial Intelligence Hallucination in Scientific Writing Through ChatGPT References. Cureus. 2023;15(4):e37432.
  57. Bhattacharyya M, Miller VM, Bhattacharyya D, Miller LE. High Rates of Fabricated and Inaccurate References in ChatGPT-Generated Medical Content. Cureus2023;15(5):e39238.
  58. Hosseini M, Gao CA, Liebovitz D, Carvalho A, Luo Y, MacDonald N, et al.An exploratory survey about using ChatGPT in education, healthcare, and research.PLoS One. 2023;18(10):e0292216.
  59. Guckenberger M, Andratschke N, Ahmadsei M, Christ SM, Heusel AE, Kamal S, et al. Potential of ChatGPT in facilitating research in radiation oncology? Radiother Oncol. 2023;188:109894.
  60. Generative AI Product Tracker [Internet]. Ithaka S+R. 2024 [Last visit: 2024 Oct 24]. Available from: https://sr.ithaka.org/our-work/generative-ai-product-tracker/
  61. Araujo SM, Cruz-Correia R. Incorporating ChatGPT in Medical Informatics Education: Mixed Methods Study on Student Perceptions and Experiential Integration Proposals. JMIR Med Educ. 2024;10(1):e51151.
  62. UygunIlikhan S, Özer M, Tanberkan H, Bozkurt V. How to mitigate the risks of deployment of Artificial Intelligence in medicine? Turk J Med Sci 2024;54(3):483–92.
  63. Dergaa I, Ben Saad H, Glenn JM, Ben Aissa M, Taheri M, Swed S, et al. A thorough examination of ChatGPT-3.5 potential applications in medical writing: A preliminary study. Medicine. 2024;103(40):e39757. doi:10.1097/MD.0000000000039757.
  64. Hachfi H, Kechida M, Kaddoussi R, Rejeb H, Alaya W, Hidouri S, et al. The cover letter in the era of Artificial Intelligence (ChatGPT as an example). Tunis Med. 2024 Dec 5;102(12):985-987. doi:10.62438/tunismed.v102i12.5439.
  65. Car J, Ong QC, Erlikh Fox T, Leightley D, Kemp SJ, Švab I, et al. The Digital Health Competencies in Medical Education Framework: An International Consensus Statement Based on a Delphi Study. JAMA Netw Open. 2025 Jan 2;8(1):e2453131. doi:10.1001/jamanetworkopen.2024.53131.