Treffer: Advancing AI-driven thematic analysis in qualitative research: a comparative study of nine generative models on Cutaneous Leishmaniasis data.

Title:
Advancing AI-driven thematic analysis in qualitative research: a comparative study of nine generative models on Cutaneous Leishmaniasis data.
Authors:
Bennis I; Mohammed VI International School of Public Health, Mohammed VI University of Sciences and Health, Casablanca, Morocco. issambennis@gmail.com., Mouwafaq S; Mohammed VI International School of Public Health, Mohammed VI University of Sciences and Health, Casablanca, Morocco.
Source:
BMC medical informatics and decision making [BMC Med Inform Decis Mak] 2025 Mar 10; Vol. 25 (1), pp. 124. Date of Electronic Publication: 2025 Mar 10.
Publication Type:
Journal Article; Comparative Study
Language:
English
Journal Info:
Publisher: BioMed Central Country of Publication: England NLM ID: 101088682 Publication Model: Electronic Cited Medium: Internet ISSN: 1472-6947 (Electronic) Linking ISSN: 14726947 NLM ISO Abbreviation: BMC Med Inform Decis Mak Subsets: MEDLINE
Imprint Name(s):
Original Publication: London : BioMed Central, [2001-
References:
Qual Health Res. 2007 Dec;17(10):1372-80. (PMID: 18000076)
PLOS Digit Health. 2023 Dec 1;2(12):e0000397. (PMID: 38039286)
BMC Med Res Methodol. 2024 Jun 25;24(1):139. (PMID: 38918736)
Lancet Digit Health. 2024 Aug;6(8):e555-e561. (PMID: 39059888)
PLOS Digit Health. 2024 Jan 23;3(1):e0000433. (PMID: 38261580)
PLoS Negl Trop Dis. 2024 Aug 2;18(8):e0012391. (PMID: 39093848)
J Empir Res Hum Res Ethics. 2024 Jul;19(3):92-102. (PMID: 38881315)
Acad Med. 2014 Sep;89(9):1245-51. (PMID: 24979285)
Glob Health Res Policy. 2022 Sep 26;7(1):34. (PMID: 36163191)
Res Nurs Health. 2017 Feb;40(1):23-42. (PMID: 27686751)
BMC Med Res Methodol. 2008 Jul 10;8:45. (PMID: 18616818)
Perspect Med Educ. 2023 Oct 16;12(1):399-410. (PMID: 37868075)
J R Coll Physicians Edinb. 2015;45(3):201-5. (PMID: 26517098)
Infect Dis Poverty. 2017 Apr 7;6(1):46. (PMID: 28385151)
Qual Health Res. 2024 Jun;34(7):595-606. (PMID: 38064244)
Contributed Indexing:
Keywords: Artificial intelligence in qualitative research; Cutaneous leishmaniasis; Grounded theory development; Large language models; Natural language processing; Research automation; Thematic analysis
Entry Date(s):
Date Created: 20250311 Date Completed: 20250311 Latest Revision: 20250512
Update Code:
20250513
PubMed Central ID:
PMC11895178
DOI:
10.1186/s12911-025-02961-5
PMID:
40065373
Database:
MEDLINE

Weitere Informationen

Background: As part of qualitative research, the thematic analysis is time-consuming and technical. The rise of generative artificial intelligence (A.I.), especially large language models, has brought hope in enhancing and partly automating thematic analysis.
Methods: The study assessed the relative efficacy of conventional against AI-assisted thematic analysis when investigating the psychosocial impact of cutaneous leishmaniasis (CL) scars. Four hundred forty-eight participant responses from a core study were analysed comparing nine A.I. generative models: Llama 3.1 405B, Claude 3.5 Sonnet, NotebookLM, Gemini 1.5 Advanced Ultra, ChatGPT o1-Pro, ChatGPT o1, GrokV2, DeepSeekV3, Gemini 2.0 Advanced with manual expert analysis. Jamovi software maintained methodological rigour through Cohen's Kappa coefficient calculations for concordance assessment and similarity measurement via Python using Jaccard index computations.
Results: Advanced A.I. models showed impressive congruence with reference standards; some even had perfect concordance (Jaccard index = 1.00). Gender-specific analyses demonstrated consistent performance across subgroups, allowing a nuanced understanding of psychosocial consequences. The grounded theory process developed the framework for the fragile circle of vulnerabilities that incorporated new insights into CL-related psychosocial complexity while establishing novel dimensions.
Conclusions: This study shows how A.I. can be incorporated in qualitative research methodology, particularly in complex psychosocial analysis. Consequently, the A.I. deep learning models proved to be highly efficient and accurate. These findings imply that the future directions for qualitative research methodology should focus on maintaining analytical rigour through the utilisation of technology using a combination of A.I. capabilities and human expertise following standardised future checklist of reporting full process transparency.
(© 2025. The Author(s).)

Declarations. Ethics approval and consent to participate: The ethical implications of A.I. utilisation in qualitative research were fully considered in this study, particularly concerning data confidentiality and methodological transparency. All analyses were conducted using ephemeral storage settings, ensuring no analysed data were archived. All AI-generated prompts and results were permanently discarded after hardware download to maintain data security. This study is a secondary analysis of anonymised qualitative data collected in a previous research study on the psychosocial impact of cutaneous leishmaniasis scars (Bennis et al., 2017) [20]. This study is a secondary analysis of anonymised qualitative data collected in a previous research study on the psychosocial impact of cutaneous leishmaniasis scars (Bennis et al., 2017) [20]. The original study was approved by the Ethical Committee of Biomedical Research in Rabat, Morocco (CERB). No additional ethics approval was required, as this study involved secondary data analysis. The dataset used was fully anonymised, and no new interactions with human participants occurred. The authors acknowledge that Grammarly.com for Microsoft Office Version 6.8.263 was used for language editing assistance, but it was not employed for generating original content. Consent for publication: Not applicable. Competing interests: The authors declare no competing interests.