Prompt Engineering as a Safety Feature in Digital Health AI: Designing Conversational Systems for Sensitive Health Awareness
DOI:
https://doi.org/10.51137/wrp.ijdht.845Keywords:
Conversational Artificial Intelligence, Prompt Engineering, Digital Health, Telemedicine, AI Safety, Sensitive Health AwarenessAbstract
Conversational artificial intelligence (AI) is increasingly used in digital health, telemedicine-related services, mental wellness, and behavioral health contexts. Although discussions of AI safety often center on factual accuracy, hallucination, privacy, crisis escalation, and human oversight, less attention has been paid to prompt engineering and response style as safety-relevant design features. This commentary argues that prompt engineering should be understood as a digital health AI safety mechanism because prompts do more than guide content generation; they shape the communicative conditions under which users interpret sensitive health concerns, regulate their responses, and decide whether to reflect, disengage, or seek support. Drawing on self-regulation theory and psychological reactance theory, the article explains how reflective AI responses may support self-monitoring, self-evaluation, and openness to help-seeking, whereas labeling, moralizing, or overly directive responses may increase shame, defensiveness, and disengagement. The commentary concludes by proposing design principles for safer conversational AI in sensitive health-awareness contexts.
References
Adler-Milstein, J., Chen, J. H., & Dhaliwal, G. (2021). Next-generation artificial intelligence for diagnosis: From predicting diagnostic labels to wayfinding. JAMA, 326(24), 2467-2468. https://doi.org/10.1001/jama.2021.22396
Aggarwal, A., Tam, C. C., Wu, D., Li, X., & Qiao, S. (2023). Artificial intelligence-based chatbots for promoting health behavioral changes: Systematic review. Journal of Medical Internet Research, 25, e40789. https://doi.org/10.2196/40789
Ali, K., Fassnacht, D. B., Farrer, L., Rieger, E., Feldhege, J., Moessner, M., Griffiths, K. M., & Bauer, S. (2020). What prevents young adults from seeking help? Barriers toward help-seeking for eating disorder symptomatology. International Journal of Eating Disorders, 53(6), 894-906. https://doi.org/10.1002/eat.23266
Ali, A. M. (2024). The role of prompt engineering in shaping the future of conversational
ai. Journal of Technological Innovations, 5(4). https://doi.org/10.93153/54aatg21
Boit, S., & Patil, R. (2025). A prompt engineering framework for large language model-based mental health chatbots: Conceptual framework. JMIR Mental Health, 12(1), e75078. https://doi.org/10.2196/75078
Brehm, J. W. (1966). A theory of psychological reactance. Academic Press.
Carver, C. S., & Scheier, M. F. (1982). Control theory: A useful conceptual framework for personality-social, clinical, and health psychology. Psychological Bulletin, 92(1), 111-135. https://doi.org/10.1037/0033-2909.92.1.111
Carver, C. S., & Scheier, M. F. (1998). On the self-regulation of behavior. Cambridge University Press.
Daugelat, M. C., Pruccoli, J., Schag, K., & Giel, K. E. (2023). Barriers and facilitators affecting treatment uptake behaviours for patients with eating disorders: A systematic review synthesising patient, caregiver and clinician perspectives. European Eating Disorders Review, 31(6), 752-768. https://doi.org/10.1002/erv.2999
Ding, H., Simmich, J., Vaezipour, A., Andrews, N., & Russell, T. (2024). Evaluation framework for conversational agents with artificial intelligence in health interventions: A systematic scoping review. Journal of the American Medical Informatics Association, 31(3), 746-761. https://doi.org/10.1093/jamia/ocad222
Downs, J., Adams, M., Federici, A., Sharpe, S. L., & Ayton, A. (2025). Equity in eating disorders: a dialectical approach to stigma, expertise, and the coproduction of knowledge. Journal of Eating Disorders, 13(1), 31. https://doi.org/10.1186/s40337-024-01176-9
Feng, X., Tian, L., Ho, G. W. K., Yorke, J., & Hui, V. (2025). The effectiveness of AI chatbots in alleviating
mental distress and promoting health behaviors among adolescents and young adults: Systematic review and meta-analysis. Journal of Medical Internet Research, 27, e79850. https://doi.org/10.2196/79850
Guo, Z., Lai, A., Thygesen, J. H., Farrington, J., Keen, T., & Li, K. (2024). Large language models for mental health applications: Systematic review. JMIR Mental Health, 11, e57400. https://doi.org/10.2196/57400
Li, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C. (2023). Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being. npj Digital Medicine, 6, Article 236. https://doi.org/10.1038/s41746-023-00979-5
Naik, A., Thomas, J., Mandava, T. S., & Vemula, H. R. (2025). Artificial empathy: AI based mental health. arXiv. https://doi.org/10.48550/arXiv.2506.00081
Nayyar, A., Vairamani, A. D., & Kaswan, K. (2025). Mastering Prompt Engineering: Deep Insights for Optimizing Large Language Models (LLMs). Morgan Kaufmann.
Nicula, M., Pellegrini, D., Grennan, L., Bhatnagar, N., McVey, G., & Couturier, J. (2022). Help-seeking attitudes and behaviours among youth with eating disorders: A scoping review. Journal of Eating Disorders, 10, Article 21. https://doi.org/10.1186/s40337-022-00543-8
Olawade, D. B., Wada, O. Z., Odetayo, A., David-Olawade, A. C., Asaolu, F., & Eberhardt, J. (2024). Enhancing mental health with artificial intelligence: Current trends and future prospects. Journal of Medicine, Surgery, and Public Health, 3, 100099. https://doi.org/10.1016/j.glmedi.2024.100099
Rains, S. A. (2013). The nature of psychological reactance revisited: A meta-analytic review. Human Communication Research, 39(1), 47-73. https://doi.org/10.1111/j.1468-2958.2012.01443.x
Teo, S. A. (2025). Artificial intelligence, human vulnerability and multi-level resilience. Computer Law & Security Review, 57, 106134. https://doi.org/10.1016/j.clsr.2025.106134
Tu, T., Schaekermann, M., Palepu, A., Saab, K., Freyberg, J., Tanno, R., et al. (2025). Towards conversational diagnostic artificial intelligence. Nature, 642(8067), 442-450. https://doi.org/10.1038/s41586-025-08866-7
Wang, W., Xia, J., Chen, W., Ye, J., Xie, K., Zhang, Z., ... & Shuid, A. N. (2025). Exploring the interplay of mental health knowledge, stigma, and social distance among clinical nurses: a study in Liaoning, China. Frontiers in Psychiatry, 16, 1478690. https://doi.org/10.3389/fpsyt.2025.1478690
Xue, J., Zhang, B., Zhao, Y., Zhang, Q., Zheng, C., Jiang, J., Zhang, J., & Xiang, X. (2023). Evaluation of the current state of chatbots for digital health: Scoping review. Journal of Medical Internet Research, 25, e47217. https://doi.org/10.2196/47217
Published
Issue
Section
License
Copyright (c) 2026 Yuwen Wan (Author)

This work is licensed under a Creative Commons Attribution 4.0 International License.