Search Articles

View query in Help articles search

Search Results (1 to 10 of 256 Results)

Download search results: CSV END BibTex RIS


Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations

Evaluating Generative AI in Mental Health: Systematic Review of Capabilities and Limitations

The lack of comprehensive and unified evaluation frameworks limited the scope and depth of conclusions the field could draw regarding Gen AI’s capabilities in mental health. The psychoeducation capabilities of Gen AI in providing information related to mental health received the most evidence. This could be related to the single approach of using zero-shot prompting that was shared among almost all studies in this review.

Liying Wang, Tanmay Bhanushali, Zhuoran Huang, Jingyi Yang, Sukriti Badami, Lisa Hightow-Weidman

JMIR Ment Health 2025;12:e70014

Implementation of New Technologies in an Aged Care Social Day Program: Mixed Methods Evaluation

Implementation of New Technologies in an Aged Care Social Day Program: Mixed Methods Evaluation

The Stakeholder Advisory Group was comprised of members of the organization and evaluation project team and a representative from each of the 3 stakeholder-participant groups (clients, family members or carers, and staff of the Social Day Program) and was formed to ensure consumer awareness and the suitability and feasibility of evaluation methods.

Dannielle Post, Kathleen Whitson, Gaynor Parfitt

JMIR Aging 2025;8:e60297

Assessing the Impact on Electronic Health Record Burden After Five Years of Physician Engagement in a Canadian Mental Health Organization: Mixed-Methods Study

Assessing the Impact on Electronic Health Record Burden After Five Years of Physician Engagement in a Canadian Mental Health Organization: Mixed-Methods Study

The survey was developed using a co-design approach with members of the Physician Think Tanks and was informed by the Benefits Evaluation Framework, benchmark survey data, and relevant literature. The survey underwent testing with the Physician Think Tank members to refine its topics, content, and wording. It was available from January to March 2023, with biweekly reminders sent to encourage participation.

Tania Tajirian, Brian Lo, Gillian Strudwick, Adam Tasca, Emily Kendell, Brittany Poynter, Sanjeev Kumar, Po-Yen (Brian) Chang, Candice Kung, Debbie Schachter, Gwyneth Zai, Michael Kiang, Tamara Hoppe, Sara Ling, Uzma Haider, Kavini Rabel, Noelle Coombe, Damian Jankowicz, Sanjeev Sockalingam

JMIR Hum Factors 2025;12:e65656

Education and Symptom Reporting in an mHealth App for Patients With Cancer: Mixed Methods Development and Validation Study

Education and Symptom Reporting in an mHealth App for Patients With Cancer: Mixed Methods Development and Validation Study

For the evaluation process of the “CONTIGO” mobile application, eligibility criteria were established for potential evaluators. This aims to ensure that evaluators possess the necessary expertise to provide meaningful feedback on the application’s functionalities and effectiveness in supporting patients.

Carolina Muñoz Olivar, Miguel Pineiro, Juan Sebastián Gómez Quintero, Carlos Javier Avendaño-Vásquez, Pablo Ormeño-Arriagada, Silvia Palma Rivadeneira, Carla Taramasco Toro

JMIR Hum Factors 2025;12:e60169

Guideline-Incorporated Large Language Model-Driven Evaluation of Medical Records Using MedCheckLLM

Guideline-Incorporated Large Language Model-Driven Evaluation of Medical Records Using MedCheckLLM

One underexplored area is their application for the reliable evaluation of medical documents. The automated evaluation of these documents has the potential to enhance patient safety. The system’s reasoning process must be (1) transparent and comprehensible to human evaluators and (2) guided by established medical guidelines proven to increase patient safety [3].

Marc Cicero Schubert, Stella Soyka, Wolfgang Wick, Varun Venkataramani

JMIR Form Res 2025;9:e53335

Application of an Innovative Methodology to Build Infrastructure for Digital Transformation of Health Systems: Developmental Program Evaluation

Application of an Innovative Methodology to Build Infrastructure for Digital Transformation of Health Systems: Developmental Program Evaluation

A developmental evaluation is utilization focused and should be designed and implemented in ways that maximize utility for the primary intended users [46]. This evaluation approach generates data and findings in near real time, thereby facilitating developmental decision-making and course corrections throughout the development process [44,47]. This evaluation was guided by the following overarching evaluation questions: What factors influenced the CO-Away digital health platform development?

M Claire Buchan, Tarun Reddy Katapally, Jasmin Bhawra

JMIR Form Res 2025;9:e53339

Automatic Human Embryo Volume Measurement in First Trimester Ultrasound From the Rotterdam Periconception Cohort: Quantitative and Qualitative Evaluation of Artificial Intelligence

Automatic Human Embryo Volume Measurement in First Trimester Ultrasound From the Rotterdam Periconception Cohort: Quantitative and Qualitative Evaluation of Artificial Intelligence

This dual evaluation highlights the novelty of our work, offering insights into the reliability and efficiency of AI-based segmentation in clinical workflows. The data used for this study was collected within the Rotterdam Periconception Cohort (Predict Study).

Wietske A P Bastiaansen, Stefan Klein, Batoul Hojeij, Eleonora Rubini, Anton H J Koning, Wiro Niessen, Régine P M Steegers-Theunissen, Melek Rousian

J Med Internet Res 2025;27:e60887

Development and Impact of a Community-Delivered, Multisectoral Lifestyle Management Service for People Living With Type 2 Diabetes (Logan Healthy Living): Protocol for a Pragmatic, Single-Arm Intervention Study

Development and Impact of a Community-Delivered, Multisectoral Lifestyle Management Service for People Living With Type 2 Diabetes (Logan Healthy Living): Protocol for a Pragmatic, Single-Arm Intervention Study

To simultaneously support reporting for the outcome-based funding model and evaluate the real-world impact of a routinely delivered community program, a comprehensive continuous evaluation protocol informed by the RE-AIM framework was developed. The purpose of this paper is to describe the development of Logan Healthy Living and the protocol for program evaluation of this allied health care service.

Sjaan R Gomersall, Denis Y Giguere, Jacqueline Cotugno, Joanna Munro, Wallis J Westbrook, Robyn Littlewood, John Cairney, Elisabeth AH Winkler, Phillip M van der Vliet, Ana D Goode, Tahlia Alsop, Genevieve Nissa Healy

JMIR Res Protoc 2025;14:e69477

ChatGPT’s Performance on Portuguese Medical Examination Questions: Comparative Analysis of ChatGPT-3.5 Turbo and ChatGPT-4o Mini

ChatGPT’s Performance on Portuguese Medical Examination Questions: Comparative Analysis of ChatGPT-3.5 Turbo and ChatGPT-4o Mini

This study has several limitations regarding the performance evaluation of Chat GPT-3.5 Turbo and Chat GPT-4o mini. The analysis was based solely on Chat GPT’s indication of the correct answer, which, while aligning with expectations for human candidates, does not consider other aspects of examination performance. Additionally, the grading did not account for the complexity or length of the questions, providing an incomplete assessment of the models’ performance.

Filipe Prazeres

JMIR Med Educ 2025;11:e65108