Volume 12 Issue 4 (2023)

Assessing the Intellectual Structure of the Evolving Knowledge Base on ChatGPT in the Field of Education and Health

pp. 36-64  |  Published Online: November 2023  |  DOI: 10.22521/edupij.2023.124.3

Murat Demirkol and Nedim Malkoc

Abstract

Background/purpose –The unprecedented developments in AI-based technologies and large language models such as ChatGPT have exhibited a brand-new territory to be explored. Since its first release in November 2022, the potential utility of ChatGPT has garnered incremental attention in the scientific world, and has already accumulated a great number of studies from diverse fields. The current study was conducted with the purpose of exploring the scientific landscape of the evolving knowledge base related to the use of ChatGPT in the field of education and health through science mapping analysis of published research.

Materials/methods – Data were retrieved from Web of Science and Scopus, and a comparative, period-based science mapping analysis was conducted using the SciMAT software.

Results – The results showed that the studies published during the first period mostly focused on machine learning, reproductive medicine, education and first-year undergraduate themes. During the second period, though, the studies featured themes that are closely related to the design and performance of ChatGPT such as large language models (LLMs), natural language processing (NLP) and chatbot while abandoning a focus on artificial intelligence. These results imply that discussions and investigations over ChatGPT were being departed from those in the field of artificial intelligence, and the focus was becoming more central to the features of ChatGPT as a language model that can process huge amounts of information to generate human-like texts. Plagiarism and research ethics were also emerging themes during the last period.

Conclusion – The results of the science mapping showed a growing interest into the opportunities and risks of ChatGPT, particularly for fields of education and medicine, and indicated that much research is warranted to discover the potential of GPT technology as an uncharted territory.

Keywords: ChatGPT, education, artificial intelligence (AI); large language models (LLMs); natural language processing (NLP); chatbot; SciMAT

References

Ağaoğlu, E., Altınkurt, Y., Yılmaz, K., & Karakose, T. (2012). Opinions of school administrators and teachers about proficiency of school administrators (In Kütahya). Education and Science, 37(164), 159-175.

Anders, B. A. (2023). Is using ChatGPT cheating, plagiarism, both, neither, or forward thinking? Patterns, 4(3). doi: 10.1016/j.patter.2023.100694

Anders, B.A. (2022). ChatGPT (AI) in education – an overview. Center for Teaching and Learning at the American University of Armenia. Retrieved from https://drive.google.com/file/d/1fTtmGz2Cp2nd65mNfQzPyo3beWXc9j9m/view

Arif, T. B., Munaf, U., & Ul-Haque, I. (2023). The future of medical education and research: Is ChatGPT a blessing or blight in disguise? Medical Education Online28(1), 2181052. doi: 10.1080/10872981.2023.2181052

Badini, S., Regondi, S., Frontoni, E., & Pugliese, R. (2023). Assessing the capabilities of ChatGPT to improve additive manufacturing troubleshooting. Advanced Industrial and Engineering Polymer Research. doi: 10.1016/j.aiepr.2023.03.003

Bakpayev, M., Baek, T. H., van Esch, P., & Yoon, S. (2022). Programmatic creative: AI can think but it cannot feel. Australasian Marketing Journal30(1), 90-95. doi: 10.1016/j.ausmj.2020. 04.002  

Barocas, S., & Selbst, A. D. (2016). Big data's disparate impact. California Law Review 104, 671–732. doi: 10.2139/ssrn.2477899  

Baymurzina, D., Kuratov, Y., Kuznetsov, D., Kornev, D., & Burtsev, M. (2021). Evaluation of conversational skills for commonsense. Dialog 21. doi:10.28995/2075-7182-2021-20-1002-1011  

Biswas, S. (2023). Role of ChatGPT in computer programming.: ChatGPT in computer programming. Mesopotamian Journal of Computer Science2023, 8-16. doi:10.58496/MJCSC/2023/002  

Bogost, I. (2022). ChatGPT is dumber than you think. Retrieved from https://www.theatlantic.com/technology/archive/2022/12/chatgpt-openai-artificial-intelligence-writing-ethics/672386/

Borji, A.A. (2023). Categorical archive of ChatGPT failures. arXiv.  doi:10.48550/arXiv.2302.03494 

Boßelmann, C. M., Leu, C., & Lal, D. (2023). Are AI language models such as ChatGPT ready to improve the care of individuals with epilepsy? Epilepsia64(5), 1195-1199.  doi:10.1111/epi.17570

Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W. (2016). OpenAI gym. arXiv.  doi:10.48550/arXiv.1606.01540

Brown, O. (2023). The story of ChatGPT and OpenAI: The evolution of GPT models. Medium. Retrieved fromhttps://medium.com/illumination/the-story-of-chatgpt-and-openai-the-evolution-ofgpt-models-abf201316a9

Burger, B., Kanbach, D. K., Kraus, S., Breier, M., & Corvello, V. (2023). On the use of AI-based tools like ChatGPT to support management research. European Journal of Innovation Management26(7), 233-241. doi:10.1108/EJIM-02-2023-0156 

Cadamuro, J., Cabitza, F., Debeljak, Z., De Bruyne, S., Frans, G., Perez, S. M., ... & Padoan, A. (2023). Potentials and pitfalls of ChatGPT and natural-language artificial intelligence models for the understanding of laboratory medicine test results. An assessment by the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) Working Group on Artificial Intelligence (WG-AI). Clinical Chemistry and Laboratory Medicine (CCLM). doi:10.1515/cclm-2023-0355

Cañadas, D. C., Perales, A. B., Belmonte, M. D. P. C., Martínez, R. G., & Carreño, T. P. (2022). Kangaroo mother care and skin-to-skin care in preterm infants in the neonatal intensive care unit: A bibliometric analysis. Archives de Pédiatrie29(2), 90-99.  doi:10.1016/j.arcped.2021.11.007

Carlisle, S., Ivanov, S., & Dijkmans, C. (2021). The digital skills divide: evidence from the European tourism industry. Journal of Tourism Futures. doi:10.1108/JTF-07-2020-0114

Carvalho, I., & Ivanov, S. (2023). ChatGPT for tourism: applications, benefits and risks. Tourism Review. doi:10.1108/TR-02-2023-0088

Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023). Evaluating the feasibility of ChatGPT in healthcare: an analysis of multiple clinical and research scenarios. Journal of Medical Systems47(1), 33. doi:10.1007/s10916-023-01925-4  

Castro Nascimento, C. M., & Pimentel, A. S. (2023). Do large language models understand chemistry? A conversation with ChatGPT. Journal of Chemical Information and Modeling63(6), 1649-1655. https://doi.org/10.1021/acs.jcim.3c00285

Chen, C. (2017). Science mapping: a systematic review of the literature. Journal of Data and Information Science2(2), 1-40. doi: 10.1515/jdis-2017-0006

Chen, T. J. (2023). ChatGPT and other artificial intelligence applications speed up scientific writing. Journal of the Chinese Medical Association86(4), 351-353. doi:10.1097/JCMA.0000000000000900

Chervenak, J., Lieman, H., Blanco-Breindel, M., & Jindal, S. (2023). The promise and peril of using a large language model to obtain clinical information: ChatGPT performs strongly as a fertility counseling tool with limitations. Fertility and Sterility. doi:10.1016/j.fertnstert.2023.05.151

Chui M, Roberts R, & Yee L (2022) Generative AI is here: how tools like ChatGPT could change your business. Retrieved from www.mckinsey.com/capabilities/quantumblack/our-insights/generative-ai-is-here-how-tools-like-chatgpt-could- change-your-business.

Cobo, M. J., López‐Herrera, A. G., Herrera‐Viedma, E., & Herrera, F. (2011). Science mapping software tools: Review, analysis, and cooperative study among tools. Journal of the American Society for information Science and Technology62(7), 1382-1402. doi:10.1002/asi.21525 

Cobo, M. J., López‐Herrera, A. G., Herrera‐Viedma, E., & Herrera, F. (2012). SciMAT: A new science mapping analysis software tool. Journal of the American Society for Information Science and Technology63(8), 1609-1630. doi:10.1002/asi.22688

Cooper, G. (2023). Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 1-9. doi:10.1007/s10956-023-10039-y

Cooper, I. D. (2016). What is a “mapping study?”. Journal of the Medical Library Association: JMLA, 104(1), 76-78. doi: 10.3163/1536-5050.104.1.013

Cotton, D. R., Cotton, P. A., & Shipway, J. R. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1–12. doi: 10.1080/14703297.2023.2190148

Crawford, J., Cowling, M., & Allen, K. A. (2023). Leadership is needed for ethical ChatGPT: Character, assessment, and learning using artificial intelligence (AI). Journal of University Teaching & Learning Practice20(3). doi: 10.53761/1.20.3.02

Dale, R. (2021). GPT-3: What’s it good for? Natural Language Engineering27(1), 113-118. doi:10.1017/S1351324920000601

Das, D., Kumar, N., Longjam, L. A., Sinha, R., Roy, A. D., Mondal, H., & Gupta, P. (2023). Assessing the capability of ChatGPT in answering first-and second-order knowledge questions on microbiology as per competency-based medical education curriculum. Cureus15(3). doi: 10.7759/cureus.3603

Dehouche, N. (2021). Plagiarism in the age of massive Generative Pre-trained Transformers (GPT-3). Ethics in Science and Environmental Politics21, 17-23. doi: 10.3354/esep00195

Delouya, S. (2022). I asked ChatGPT to do my work and write an insider article for me. It quickly generated an alarmingly convincing article filled with misinformation. Business Insider.Retrieved from www.businessinsider.com/i-asked-chatgpt-to-write-insider-story-it-was-convincing-2022-12

Devlin, J., Chang, M.W., & Lee, K. Toutanova, K. (2018). Bert: pre-training of deep bidirectional transformers for language understanding. arXiv 10.48550/arXiv.1810.04805

Ebrahimi, B., Howard, A., Carlson, D. J., & Al-Hallaq, H. (2023). ChatGPT: can a natural language processing tool be trusted for radiation oncology use?. International Journal of Radiation Oncology, Biology, Physics. doi:10.1016/j.ijrobp.2023.03.075

Eggmann, F., Weiger, R., Zitzmann, N. U., & Blatz, M. B. (2023). Implications of large language models such as ChatGPT for dental medicine. Journal of Esthetic and Restorative Dentistry. doi:10.1111/jerd.13046

Emenike, M. E., & Emenike, B. U. (2023). Was this title generated by ChatGPT? considerations for artificial intelligence text-generation software programs for chemists and chemistry educators. Journal of Chemical Education100(4), 1413-1418. doi:10.1021/acs.jchemed.3c00063

Farrokhnia, M., Baggen, Y., Biemans, H., & Noroozi, O. (2022). Bridging the fields of entrepreneurship and education: the role of philosophical perspectives in fostering opportunity identification. The International Journal of Management Education20(2), 100632. doi: 10.1016/j.ijme.2022.100632  

Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2023). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 1-15. doi: 10.1080/14703297.2023.2195846

Fergus, S., Botha, M., & Ostovar, M. (2023). Evaluating academic answers generated using ChatGPT. Journal of Chemical Education100(4), 1672-1675. doi: 10.1021/acs.jchemed.3c00087  

Fernandez, P. (2023). “Through the looking glass: envisioning new library technologies” AI-text generators as explained by ChatGPT. Library Hi Tech News40(3), 11-14. doi: 10.1108/LHTN-02-2023-0017

Frieder, S., Pinchetti, L., Griffiths, R. R., Salvatori, T., Lukasiewicz, T., Petersen, P. C., ... & Berner, J. (2023). Mathematical capabilities of ChatGPT. arXiv. doi:10.48550/arxiv.2301.13867

Furstenau, L. B., Sott, M. K., Homrich, A. J. O., Kipper, L. M., Dohan, M. S., López-Robles, J. R., ... & Tortorella, G. L. (2021). An overview of 42 years of lean production: Applying bibliometric analysis to investigate strategic themes and scientific evolution structure. Technology Analysis & Strategic Management, 33(9), 1068-1087. doi:10.1080/09537325.2020.1865530 

Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2022). Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. bioRxiv. doi: 10.1101/2022.12.23.521610

Garg, M., & Goel, A. (2022). A systematic literature review on online assessment security: Current challenges and integrity strategies. Computers & Security113, 102544. doi:10.1016/j. cose.2021.102544  

Gašević, D., Siemens, G., & Sadiq, S. (2023). Empowering learners for the age of artificial intelligence. Computers and Education: Artificial Intelligence, 100130. doi:10.1016/j.caeai.2023.100130    

Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023). How does ChatGPT perform on the United States Medical Licensing Examination? the implications of large language models for medical education and knowledge assessment. JMIR Medical Education9(1), e45312. doi:10.2196/45312 

Gozalo-Brizuela, R., & Garrido-Merchan, E. C. (2023). ChatGPT is not all you need. A State-of-the-art review of large generative AI models. arXiv. doi: 10.48550/arxiv.2301.04655

Gregorcic, B., & Pendrill, A. M. (2023). ChatGPT and the frustrated Socrates. Physics Education58(3), 035021. doi: 10.1088/1361-6552/acc299

Grünebaum, A., Chervenak, J., Pollet, S. L., Katz, A., & Chervenak, F. A. (2023). The exciting potential for ChatGPT in obstetrics and gynecology. American Journal of Obstetrics and Gynecology.doi: 10.1016/j.ajog.2023.03.009

Guo, C., Lu, Y., Dou, Y., & Wang, F. Y. (2023). Can ChatGPT boost artistic creation: The need of imaginative intelligence for parallel art. IEEE/CAA Journal of Automatica Sinica10(4), 835-838. doi: 10.1109/JAS.2023.123555

Gupta, P., Raturi, S., & Venkateswarlu, P. (2023). ChatGPT for designing course outlines: A boon or bane to modern technology. Available at SSRN 4386113. doi:10.2139/ssrn.4386113  

Haman, M., & Školník, M. (2023a). Behind the ChatGPT hype: are its suggestions contributing to addiction?. Annals of Biomedical Engineering, 1-2. doi: 10.1007/s10439-023-03201-5

Haman, M., & Školník, M. (2023b). Using ChatGPT to conduct a literature review. Accountability in Research, 1-3. doi:10.1080/08989621.2023.2185514

Huang, Y., Gomaa, A., Weissmann, T., Grigo, J., Tkhayat, H. B., Frey, B., ... & Putz, F. (2023). Benchmarking ChatGPT-4 on ACR radiation oncology in-training exam (txit): potentials and challenges for AI-assisted medical education and decision making in radiation oncology. arXiv preprint, 2304.11957. doi:10.48550/arXiv.2304.11957

Humphry, T., & Fuller, A. L. (2023). Potential ChatGPT use in undergraduate chemistry laboratories. Journal of Chemical Education100(4), 1434-1436. doi:10.1021/acs.jchemed.3c00006

İpek, Z. H., Gözüm, A. İ. C., Papadakis, S., & Kallogiannakis, M. (2023). Educational applications of the ChatGPT AI System: a systematic review research. Educational Process: International Journal, 12(3), 26-55. doi:10.22521/edupij.2023.123.2

Ivanov, S., & Soliman, M. (2023). Game of algorithms: ChatGPT implications for the future of tourism education and research. Journal of Tourism Futures9(2), 214-221. doi:10.1108/JTF-02-2023-0038

Jeon, J., & Lee, S. (2023). Large language models in education: A focus on the complementary relationship between human teachers and ChatGPT. Education and Information Technologies, 1-20. doi:10.1007/s10639-023-11834-1

Karakose, T. (2023). The utility of ChatGPT in educational research – potential opportunities and pitfalls. Educational Process: International Journal12(2), 7-13. doi:10.22521/edupij.2023.122.1

Karakose, T., & Tülübaş, T. (2023). Digital Leadership and Sustainable School Improvement—A Conceptual Analysis and Implications for Future Research. Educational Process: International Journal, 12(1): 7-18. https://dx.doi.org/10.22521/edupij.2023.121.1

Karakose, T., Demirkol, M., Aslan, N., Köse, H., & Yirci, R. (2023a). A conversation with ChatGPT about the impact of the COVID-19 pandemic on education: a comparative review based on human–AI collaboration. Educational Process: International Journal, 12(3), 7-25. doi:10.22521/edupij.2023.123.1

Karakose, T., Demirkol, M., Yirci, R., Polat, H., Ozdemir, T. Y., & Tülübaş, T. (2023b). A conversation with ChatGPT about digital leadership and technology integration: a comparative analysis based on human–AI collaboration. Administrative Sciences, 13(7), 157.

Karakose, T., Tülübaş, T., Papadakis, S., Yirci, R. (2023). Evaluating the Intellectual Structure of the Knowledge Base on Transformational School Leadership: A Bibliometric and Science Mapping Analysis. Education Sciences, 13, 708. https://doi.org/10.3390/educsci13070708

Katz, A., Wei, S., Nanda, G., Brinton, C., & Ohland, M. (2023). Exploring the efficacy of ChatGPT in analyzing student teamwork feedback with an existing taxonomy. arXiv:2305.11882. doi:10.48550/arXiv.2305.11882

Khan, R. A., Jawaid, M., Khan, A. R., & Sajjad, M. (2023). ChatGPT-reshaping medical education and clinical management. Pakistan Journal of Medical Sciences39(2), 605. doi:10.12669/pjms.39.2.7653

Kirmani, A. R. (2022). Artificial intelligence-enabled science poetry. ACS Energy Letters8, 574-576. doi:10.1021/acsenergylett.2c02758

Kohnke, L. (2022). A pedagogical chatbot: A supplemental language learning tool. RELC Journal. doi:10.1177/00336882211067054  

Kohnke, L. (2023). L2 learners' perceptions of a chatbot as a potential independent language learning tool. International Journal of Mobile Learning and Organisation17(1-2), 214-226. doi:10.1504/IJMLO.2023.10053355

Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal. doi:10.1177/00336882231162868

Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies28(1), 973-1018. doi:10.1007/s10639-022-11177-3

Latifi, S., Noroozi, O., & Talaee, E. (2021). Peer feedback or peer feedforward? Enhancing students’ argumentative peer learning processes and outcomes. British Journal of Educational Technology52(2), 768-784. doi:10.1111/bjet.13054  

Lecler, A., Duron, L., & Soyer, P. (2023). Revolutionizing radiology with GPT-based models: Current applications, future possibilities and limitations of ChatGPT. Diagnostic and Interventional Imaging104(6), 269-274. doi:10.1016/j.diii.2023.02.003  

Lee, H. (2023). The rise of ChatGPT: Exploring its potential in medical education. Anatomical Sciences Education. doi:10.1002/ase.2270

Li, J., Dada, A., Kleesiek, J., & Egger, J. (2023). ChatGPT in healthcare: a taxonomy and systematic review. medRxiv, 2023-03. doi:10.1101/2023.03.30.23287899

Liu, S., Wright, A. P., Patterson, B. L., Wanderer, J. P., Turer, R. W., Nelson, S. D., ... & Wright, A. (2023). Using AI-generated suggestions from ChatGPT to optimize clinical decision support. Journal of the American Medical Informatics Association, ocad072. doi:10.1093/jamia/ocad072

Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., ... & Ge, B. (2023). Summary of chatgpt/gpt-4 research and perspective towards the future of large language models. arXiv:2304.01852. doi:10.48550/arXiv.2304.01852

López-Robles, J. R., Cobo, M. J., Gutiérrez-Salcedo, M., Martínez-Sánchez, M. A., Gamboa-Rosales, N. K., & Herrera-Viedma, E. (2021). 30th anniversary of Applied Intelligence: a combination of bibliometrics and thematic analysis using SciMAT. Applied Intelligence51, 6547-6568. doi:10.1007/s10489-021-02584-z

Marquez, R., Barrios, N., Vera, R., Mendez, M. E., Tolosa, L., Zambrano, F., & Li, Y. (2023). A perspective on the synergistic potential of artificial intelligence and product-based learning strategies in biobased materials education. Education for Chemical Engineers. doi:10.1016/j.ece.2023.05.005

Martínez, M. A., Cobo, M. J., Herrera, M., & Herrera-Viedma, E. (2015). Analyzing the scientific evolution of social work using science mapping. Research on Social Work Practice25(2), 257-277. doi:10.1177/1049731514522101

Min, B., Ross, H., Sulem, E., Veyseh, A. P. B., Nguyen, T. H., Sainz, O., ... & Roth, D. (2021). Recent advances in natural language processing via large pre-trained language models: A survey. arXiv:2111.01243. doi:10.48550/arxiv.2111.01243

Mizumoto, A., & Eguchi, M. (2023). Exploring the potential of using an AI language model for automated essay scoring. Research Methods in Applied Linguistics2(2), 100050. doi:10.2139/ssrn.4373111  

Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & PRISMA Group*, T. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of Internal Medicine151(4), 264-269. doi:10.7326/0003-4819-151-4-200908180-00135

Murgado-Armenteros, E. M., Gutiérrez-Salcedo, M., Torres-Ruiz, F. J., & Cobo, M. J. (2015). Analysing the conceptual evolution of qualitative marketing research through science mapping analysis. Scientometrics102, 519-557. doi:10.1007/s11192-014-1443-z

OpenAI. (2023). ChatGPT Jan 9 Version. Prompts: ‘Does ChatGPT use neural text generation to generate text?’ and ‘Expand on this’. Retrieved from https://chat.openai.com/chat

Ouyang, F., Zheng, L., & Jiao, P. (2022). Artificial intelligence in online higher education: a systematic review of empirical research from 2011 to 2020. Education and Information Technologies27(6), 7893-7925. doi:10.1007/s10639-022-10925-9 

Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism & Mass Communication Educator. doi:10.1177/10776958221149577

Polat, H., Karakose, T., Ozdemir, T.Y., Tülübaş, T., Yirci, R., & Demirkol, M. (2023). An Examination of the Relationships between Psychological Resilience, Organizational Ostracism, and Burnout in K–12 Teachers through Structural Equation Modelling. Behavioral Sciences, 13, 164. https://doi.org/10.3390/bs13020164

Prieto, S. A., Mengiste, E. T., & García de Soto, B. (2023). Investigating the use of ChatGPT for the scheduling of construction projects. Buildings13(4), 857. doi:10.3390/buildings13040857

Qadir, J. (2022). Engineering education in the era of ChatGPT: promise and pitfalls of generative AI for education. TechRxiv. doi:10.36227/techrxiv.21789434.v1.

Qureshi, R., Shaughnessy, D., Gill, K. A., Robinson, K. A., Li, T., & Agai, E. (2023). Are ChatGPT and large language models “the answer” to bringing us closer to systematic review automation?. Systematic Reviews12(1), 72. doi:10.1186/s13643-023-02243-z

Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving language understanding by generative pre-training. Retrieved from www.cs.ubc.ca/_amuham01/LING530/papers/radford2018improving.pdf

Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving language understanding by generative pre-training. Retrieved from www.cs.ubc.ca/_amuham01/LING530/papers/radford2018improving.pdf

Ramos, L., Márquez, R., & Rivas-Echeverría, F. (2023). AI’s next frontier: the rise of ChatGPT and its implications on society, industry, and scientific research. Revista Ciencia e Ingeniería. 44(2).

Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems. doi: 10.1016/j.iotcps.2023.04.003

Rozado, D. (2023). The political biases of ChatGPT. Social Sciences, 12, 148-149. doi:10.3390/socsci12030148

Sadiku, M. N., Musa, S. M., & Chukwu, U. C. (2022). Artificial Intelligence in Education. Bloomington, The USA: iUniverse.

Salazar-Concha, C., Ficapal-Cusí, P., Boada-Grau, J., & Camacho, L. J. (2021). Analyzing the evolution of technostress: A science mapping approach. Heliyon7(4), e06726. doi:10.1016/j.heliyon.2021.e06726

Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare, 11(6), 887. doi:10.3390/healthcare11060887

Santandreu-Calonge, D., Medina-Aguerrebere, P., Hultberg, P., & Shah, M. A. (2023). Can ChatGPT improve communication in hospitals?. Profesional de la información32(2). doi:10.3145/epi.2023.mar.19

Scerri, A., & Morin, K. H. (2023). Using chatbots like ChatGPT to support nursing practice. Journal of Clinical Nursing. doi:10.1111/jocn.16677

Shen, Y., Heacock, L., Elias, J., Hentel, K. D., Reig, B., Shih, G., & Moy, L. (2023). ChatGPT and other large language models are double-edged swords. Radiology307(2), e230163. doi:10.1148/radiol.230163 

Singh, H., & Singh, A. (2023). ChatGPT: Systematic review, applications, and agenda for multidisciplinary research. Journal of Chinese Economic and Business Studies, 1-20. doi:10.1080/14765284.2023.2210482

Skavronskaya, L., Hadinejad, A., & Cotterell, D. (2023). Reversing the threat of artificial intelligence to opportunity: a discussion of ChatGPT in tourism education. Journal of Teaching in Travel & Tourism23(2), 253-258. doi:10.1080/15313220.2023.2196658

Sott, M. K., Bender, M. S., Furstenau, L. B., Machado, L. M., Cobo, M. J., & Bragazzi, N. L. (2020). 100 years of scientific evolution of work and organizational psychology: a bibliometric network analysis from 1919 to 2019. Frontiers in Psychology11, 598676. . doi:10.3389/fpsyg.2020.598676

Su, J., & Yang, W. (2023). Unlocking the power of ChatGPT: a framework for applying generative AI in education. ECNU Review of Education. doi:10.1177/20965311231168423

Susnjak, T. (2022). ChatGPT: the end of online exam integrity? arXiv. doi:10.48550/arXiv. 2212.09292.

Tekinay, O.N. (2023). Curious questions about COVID-19 pandemic with ChatGPT: answers and recommendations. Annals of Biomedical Engineering. doi:10.1007/s10439-023-03209-x

The Guardian. (2023). ChatGPT reaches 100 million users two months after launch. Retrieved from https://www.theguardian.com/technology/2023/feb/02/chatgpt-100-million-users-open-ai-fastest-growing-app

Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education? Smart Learning Environments10(1), 15. doi:10.1186/s40561-023-00237-x

Tülübaş, T., Demirkol, M., Ozdemir, T. Y., Polat, H., Karakose, T., & Yirci, R. (2023). An interview with ChatGPT on emergency remote teaching: a comparative analysis based on human–AI collaboration. Educational Process: International Journal. doi:10.22521/edupij.2023.122.6

Tülübaş, T., Karakose, T., Papadakis, S. (2023). A Holistic Investigation of the Relationship between Digital Addiction and Academic Achievement among Students. European Journal of Investigation in Health, Psychology and Education, 13, 2006–2034. https://doi.org/10.3390/ejihpe13100143

Vaishya, R., Misra, A., & Vaish, A. (2023). ChatGPT: Is this version good for healthcare and research?. Diabetes & Metabolic Syndrome: Clinical Research & Reviews17(4), 102744. doi:10.1016/j.dsx.2023.102744

Wang, L. K. P., Paidisetty, P. S., & Cano, A. M. (2023). The next paradigm shift? ChatGPT, artificial intelligence, and medical education. Medical Teacher, 1-1. doi:10.1080/0142159X.2023.2198663

Wang, S., Scells, H., Koopman, B., & Zuccon, G. (2023). Can ChatGPT write a good Boolean query for systematic review literature search?.arXiv. doi:10.48550/arXiv.2302.03495

Xu, D.L., Lu, Y., & Li, L. (2021). Embedding blockchain technology into IoT for security: A survey. IEEE Internet of Things Journal8(13), 10452-10473. doi:10.1109/JIOT.2021.3060508

Yeadon, W., Inyang, O. O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). The death of the short-form physics essay in the coming AI revolution. Physics Education58(3), 035027. doi:10.1088/1361-6552/acc5cf

Zamfiroiu, A., Vasile, D., & Savu, D. (2023). ChatGPT– a systematic review of published research papers. Informatica Economica27(1), 5-16. doi:10.24818/issn14531305/27.1.2023.01

Zhai, X. (2023). ChatGPT user experience: implications for education. SSRN. Retrieved from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4312418

Zupic, I., & Čater, T. (2015). Bibliometric methods in management and organization. Organizational Research Methods18(3), 429-472. doi:10.1177/1094428114562629

Announcement

EDUPIJ News!

► Journal Metrics

  • 8% acceptance rate
  • 3.4 (2023) CiteScore (Scopus)
  • Q2 (2023) CiteScore Best Quartile
  • 0.42 (2023) Scimago Journal & Country Rank (SJR)

EDUPIJ Statistics from Scopus

CiteScore: 3.4, view Scopus page

SCImago Journal & Country Rank

► Educational Process: International Journal is member of the Committee on Publication Ethics (COPE). 

► New issue coming soon! (Volume 13 Issue 4, 2024)