Treffer: Advancing AI-driven thematic analysis in qualitative research: a comparative study of nine generative models on Cutaneous Leishmaniasis data.
PLOS Digit Health. 2023 Dec 1;2(12):e0000397. (PMID: 38039286)
BMC Med Res Methodol. 2024 Jun 25;24(1):139. (PMID: 38918736)
Lancet Digit Health. 2024 Aug;6(8):e555-e561. (PMID: 39059888)
PLOS Digit Health. 2024 Jan 23;3(1):e0000433. (PMID: 38261580)
PLoS Negl Trop Dis. 2024 Aug 2;18(8):e0012391. (PMID: 39093848)
J Empir Res Hum Res Ethics. 2024 Jul;19(3):92-102. (PMID: 38881315)
Acad Med. 2014 Sep;89(9):1245-51. (PMID: 24979285)
Glob Health Res Policy. 2022 Sep 26;7(1):34. (PMID: 36163191)
Res Nurs Health. 2017 Feb;40(1):23-42. (PMID: 27686751)
BMC Med Res Methodol. 2008 Jul 10;8:45. (PMID: 18616818)
Perspect Med Educ. 2023 Oct 16;12(1):399-410. (PMID: 37868075)
J R Coll Physicians Edinb. 2015;45(3):201-5. (PMID: 26517098)
Infect Dis Poverty. 2017 Apr 7;6(1):46. (PMID: 28385151)
Qual Health Res. 2024 Jun;34(7):595-606. (PMID: 38064244)
Weitere Informationen
Background: As part of qualitative research, the thematic analysis is time-consuming and technical. The rise of generative artificial intelligence (A.I.), especially large language models, has brought hope in enhancing and partly automating thematic analysis.
Methods: The study assessed the relative efficacy of conventional against AI-assisted thematic analysis when investigating the psychosocial impact of cutaneous leishmaniasis (CL) scars. Four hundred forty-eight participant responses from a core study were analysed comparing nine A.I. generative models: Llama 3.1 405B, Claude 3.5 Sonnet, NotebookLM, Gemini 1.5 Advanced Ultra, ChatGPT o1-Pro, ChatGPT o1, GrokV2, DeepSeekV3, Gemini 2.0 Advanced with manual expert analysis. Jamovi software maintained methodological rigour through Cohen's Kappa coefficient calculations for concordance assessment and similarity measurement via Python using Jaccard index computations.
Results: Advanced A.I. models showed impressive congruence with reference standards; some even had perfect concordance (Jaccard index = 1.00). Gender-specific analyses demonstrated consistent performance across subgroups, allowing a nuanced understanding of psychosocial consequences. The grounded theory process developed the framework for the fragile circle of vulnerabilities that incorporated new insights into CL-related psychosocial complexity while establishing novel dimensions.
Conclusions: This study shows how A.I. can be incorporated in qualitative research methodology, particularly in complex psychosocial analysis. Consequently, the A.I. deep learning models proved to be highly efficient and accurate. These findings imply that the future directions for qualitative research methodology should focus on maintaining analytical rigour through the utilisation of technology using a combination of A.I. capabilities and human expertise following standardised future checklist of reporting full process transparency.
(© 2025. The Author(s).)
Declarations. Ethics approval and consent to participate: The ethical implications of A.I. utilisation in qualitative research were fully considered in this study, particularly concerning data confidentiality and methodological transparency. All analyses were conducted using ephemeral storage settings, ensuring no analysed data were archived. All AI-generated prompts and results were permanently discarded after hardware download to maintain data security. This study is a secondary analysis of anonymised qualitative data collected in a previous research study on the psychosocial impact of cutaneous leishmaniasis scars (Bennis et al., 2017) [20]. This study is a secondary analysis of anonymised qualitative data collected in a previous research study on the psychosocial impact of cutaneous leishmaniasis scars (Bennis et al., 2017) [20]. The original study was approved by the Ethical Committee of Biomedical Research in Rabat, Morocco (CERB). No additional ethics approval was required, as this study involved secondary data analysis. The dataset used was fully anonymised, and no new interactions with human participants occurred. The authors acknowledge that Grammarly.com for Microsoft Office Version 6.8.263 was used for language editing assistance, but it was not employed for generating original content. Consent for publication: Not applicable. Competing interests: The authors declare no competing interests.