This paper is in the following e-collection/theme issue:

Nutrition, Physical Activity, Healthy Lifestyle for Cancer Patients and Survivors (132) Cancer Survivorship (252) Innovations and Technology in Cancer Care (405) Participatory Cancer Care (86) Design and Evaluation of Patient Education Materials (63) Participatory Design and Participatory Research (305) Human Factors and Usability Case Studies (748) User-centred Design Case Studies (564)

Published on in Vol 8, No 2 (2022): Apr-Jun

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/34903, first published .
A Cancer Exercise Toolkit Developed Using Co-Design: Mixed Methods Study

A Cancer Exercise Toolkit Developed Using Co-Design: Mixed Methods Study

A Cancer Exercise Toolkit Developed Using Co-Design: Mixed Methods Study

Authors of this article:

Amy M Dennett1, 2 Author Orcid Image ;   Clarice Y Tang3 Author Orcid Image ;   April Chiu1 Author Orcid Image ;   Christian Osadnik4 Author Orcid Image ;   Catherine L Granger5, 6 Author Orcid Image ;   Nicholas F Taylor1, 2 Author Orcid Image ;   Kristin L Campbell7 Author Orcid Image ;   Christian Barton1 Author Orcid Image
Article Authors Cited by (10) Tweetations (84) Metrics

    Original Paper

    1La Trobe Sport and Exercise Medicine Research Centre, School of Allied Health, Human Services and Sport, La Trobe University, Bundoora, Australia

    2Allied Health Clinical Research Office, Eastern Health, Box Hill, Australia

    3School of Health Sciences, Western Sydney University, Campbelltown, Australia

    4Department of Physiotherapy, School of Primary and Allied Health Care, Monash University, Frankston, Australia

    5Department of Physiotherapy, The University of Melbourne, Parkville, Australia

    6Department of Physiotherapy, The Royal Melbourne Hospital, Parkville, Australia

    7Department of Physical Therapy, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada

    Corresponding Author:

    Amy M Dennett, PhD

    Allied Health Clinical Research Office

    Eastern Health

    Level 2, 5 Arnold St

    Box Hill, 3128

    Australia

    Phone: 61 41128861

    Email: a.dennett@latrobe.edu.au


    Background: Access to exercise therapy for cancer survivors is poor. Professional development to support exercise professionals in delivering these interventions is needed. Few online resources exist for exercise professionals to address this issue.

    Objective: To develop and evaluate a freely available online toolkit to support exercise professionals working with cancer survivors.

    Methods: A 2-phase, experience-based co-design approach was used to develop and evaluate the online toolkit. The two phases were as follows: 1) needs identification and co-design of resources and platform and 2) pilot evaluation. Four co-design workshops were conducted, transcribed, and thematically analyzed to identify key elements for the toolkit. For the pilot evaluation, a customized survey (the Determinants of Implementation Behavior Questionnaire) was distributed to exercise professionals at baseline and 3 months after launch of the online toolkit to determine its usability, utility, and effectiveness in improving their knowledge, confidence, and behavior. Results were reported as the median and interquartile range and changes were calculated using non-parametric tests. Website analytics described site usage after the initial evaluation.

    Results: Twenty-five exercise professionals participated in co-designing 8 key elements of the online Cancer Exercise Toolkit: the homepage and pages for getting started, screening and safety, assessment, exercise prescription, education, locations, and resources. For the pilot evaluation, 277/320 respondents (87% of whom were physiotherapists) from 26 countries completed the survey at baseline, with 58 exercise professionals completing follow-up surveys at 3 months. Exercise professionals’ knowledge, skills, and confidence in delivering exercise therapy to cancer survivors increased 3 months after baseline (items 1, 6, and 8: median score 5, IQR 3 to 6) to follow-up (items 1 and 6: median score 6, IQR 5 to 6; item 8: median score 5, IQR 5 to 7; P<.001) on a 1 to 7 Likert scale. Most participants (35/44, 80%) agreed or strongly agreed they would recommend the toolkit to colleagues. In the 6 months following the pilot evaluation, the toolkit received an average of 866 views per month.

    Conclusions: The co-designed online Cancer Exercise Toolkit was a useful resource for exercise professionals that may increase their knowledge, skills, and confidence in providing exercise therapy to cancer survivors.

    JMIR Cancer 2022;8(2):e34903

    doi:10.2196/34903

    Keywords

    cancer; website; online learning; professional development; physiotherapy; exercise; cancer survivorship; cancer survivor; digital health; online health; online toolkit 


    International guidelines support the integration of exercise into cancer care to improve cancer outcomes [1,2]. Well-established evidence shows exercise therapy can reduce cancer-related impairments such as fatigue and improve the health-related quality of life of cancer survivors [1]. Exercise may prevent development of chronic disease, prolong survival, and prevent cancer recurrence in some cancer cohorts, such as breast, colorectal, and prostate cancer [3,4]. Despite compelling evidence that exercise is important for cancer survivors, access to specialized exercise therapy programs for people with cancer is poor, with just 1 in 200 cancer survivors able to participate in an exercise-based rehabilitation program in Australia [5,6].

    Skilled exercise professionals are critical for the implementation and delivery of exercise therapy to cancer survivors [7]. Exercise professionals, including physiotherapists and exercise physiologists, are well placed to provide exercise therapy given their expertise in prescribing exercise and behavior change for people with chronic health conditions [8,9]. In Australia alone, there are over 40,000 registered exercise professionals who could provide services to people with cancer [10,11]. Despite their professional training, recent surveys of Australian and Irish physiotherapists found they lack confidence in providing care, including exercise therapy, to cancer survivors [12,13]. Education and practical support are required for exercise professionals to safely and effectively prescribe exercise and monitor progress according to current cancer guidelines [1].

    Exercise professionals may be able to develop and consolidate their knowledge through attendance of in-person courses and lectures and passive text-based resources. However, these knowledge sources may be less effective at improving knowledge and skills than active approaches such as e-learning, which provide greater flexibility to cater for individual learning needs [14]. Online material has been shown to be feasible for educating clinicians about exercise, with multimedia innovations, such as video, infographics, quizzes, and podcasts, enhancing clinician engagement [15]. For example, the online Pulmonary Rehabilitation Toolkit [16], developed in Australia over 10 years ago, is now considered an essential reference for physiotherapists and students working in pulmonary rehabilitation [17]. Currently, few similar resources exist to facilitate professional development for exercise professionals working in cancer rehabilitation. With a rapid rise in exercise and cancer research [18,19], it can be challenging for clinicians to keep up with best practices. Online resources may overcome time and cost barriers to professional development and offer convenience for time-poor clinicians [20].

    The primary aim of this study is to develop an online toolkit, based on experience-based co-design [21] methods, to provide support to exercise professionals by delivering evidence-based exercise interventions to cancer survivors. A secondary aim is to evaluate the initial use of the online toolkit and explore its effect on exercise professionals’ knowledge, confidence, and behavior.


    Study Design

    An online toolkit called the Cancer Exercise Toolkit was developed with an experience-based co-design approach [21] using mixed methods between May 2020 and October 2021. Qualitative interviews, workshops, and online surveys informed the toolkit development. The study procedure (Multimedia Appendix 1) was based on the experience-based co-design (EBCD) toolkit [21] and a published study using EBCD to develop a cancer prehabilitation program [22]. EBCD is a collaborative approach to service improvement completed in partnership with end users [21]. Co-design helps researchers build meaningful relationships with research participants [23], whereby users are recognized as experts in their own experiences [24]. The study was completed in two phases: (1) needs identification and co-design of resources for the online platform and (2) pilot evaluation (Figure 1).

    ‎
    Figure 1. Participant recruitment procedure for the creation and evaluation of the Cancer Exercise Toolkit.
    View this figure

    Participants

    Two groups of participants were included in the co-design workshops for toolkit development. Group 1 included “generalist” exercise professionals, defined as physiotherapists and exercise physiologists working in other areas who may have occasional contact with cancer survivors. Group 2 included “expert” or experienced cancer exercise professionals, defined as physiotherapists and exercise physiologists who had worked specifically in cancer for at least 2 years. The workshops did not include patients, as exercise professionals were intended to be the end users of this resource. However, patients who had been diagnosed with cancer and participated in exercise-based cancer rehabilitation were invited to participate in a brief video shown to clinicians in the co-design workshops, setting the scene and direction for the session. Snowball sampling was undertaken to recruit participants over a 2-week period. Exercise professionals were invited to participate in the study through an invitation email distributed by a health service and through local professional networks (eg, the Australian Physiotherapy Association). For workshops 1 and 2, it was estimated that 8 to 10 participants in each group would be sufficient to provide varied experiences and contribute to new knowledge [21].

    For the pilot evaluation phase of the toolkit, a third group of exercise professionals was recruited. We aimed to recruit a convenience sample of at least 100 exercise professionals over a 3-month period. This sample size assumed that 50% of participants would be confident enough to prescribe exercise therapy to cancer survivors and that this would be sufficient for estimating the expected proportion of sufficiently confident participants with 10% absolute precision and 95% CI [25]. Recruitment was not capped, as participants received recognition for continuing professional development as part of participation.

    Procedure

    Phase 1: Needs Identification and Co-Design

    One-hour semi-structured interviews (Multimedia Appendix 2) were completed via teleconference (Zoom Video Communications) with 3 patients who had participated in cancer rehabilitation in a public subacute hospital in Australia. Interviews were conducted by a member of the research team who had previous experience in conducting qualitative interviews and did not have any prior involvement in the treatment of these patients. The interviews included questions exploring the patients’ journey in participating in an exercise-based cancer rehabilitation program. The videos were independently analyzed by 2 research team members (AD and CT) using an inductive approach to identify key touchpoints of the overall cancer rehabilitation experience [21]. The videos were edited into a short video clip and used at the start of workshops 1 and 2 to set the scene for the sessions.

    Separate workshops (workshops 1 and 2, each 1 hour long) with the generalist and expert exercise professionals were conducted to explore areas for health care improvement and identify therapist learning needs. Learning needs identified from the workshop formed the content outline of the new online toolkit. A combined workshop (workshop 3; 1.5-2 hours long) was then held with all the participating exercise professionals to design key content elements and the overall layout of the online toolkit. A prototype online toolkit was developed based on findings from the combined workshop and key cancer rehabilitation literature [1,26,27]. A weblink was sent to exercise professionals attending the workshops to trial the toolkit for 1 month.

    Following 1 month of access to the prototype, a second joint workshop (workshop 4; 1.5 hours long) was conducted to facilitate feedback. In this workshop, participant perceptions regarding the strengths and limitations of the new resource were explored. Further refinements to the toolkit were made by the research team following this workshop before it was formally evaluated by the broader exercise community (Phase 2).

    Workshops were facilitated by a researcher with experience in EBCD (CT). Two members of the study team (AC and AD) generated field notes to assist in triangulation and data trustworthiness. Project team members acted as observers and additional facilitators for the larger joint workshops. Immediately after each workshop, project team members debriefed with the workshop facilitator and discussed their reflections.

    Recordings from all workshops were transcribed, stored, and managed using Microsoft Word and NVivo (version 12). Transcripts were coded independently by 2 reviewers (AD and CT), who used an inductive thematic analysis approach to identify touchpoints from the workshops [28]. The team then came together to discuss and reach consensus on the key touchpoints, which informed the structure and design of the online toolkit. All but 1 team member had experience in conducting qualitative research (Multimedia Appendix 3).

    Phase 2: Pilot Evaluation

    The online toolkit was formally piloted and evaluated with a broader, international sample of exercise professionals, including co-design participants (February 2021 to April 2021). An open online survey, Research Electronic Data Capture (RedCap) [29], was distributed to a large health service and via local professional networks (eg, the Australian Physiotherapy Association and Exercise and Sports Science Australia), as well as international ones (eg, the Canadian Physiotherapy Association and the University of British Columbia Clinical Exercise Physiology Lab) through email and social media pages. Participants gained access to the website after completion of the survey. The survey was completed twice: (1) prior to accessing the website (T0) and (2) 3 months after initially gaining access to the website (T1). The T1 surveys were sent only to participants who provided contact details at the end of the T0 survey. Reminder emails were sent at 7 and 14 days after distribution of the T1 survey. A free professional development event held via webinar was also conducted at follow-up to promote survey completion.

    This anonymous online survey (Multimedia Appendix 4) aimed to explore the website’s effectiveness in addressing knowledge gaps, confidence, and behavior in prescribing exercise according to guidelines [1] along with the usability and utility of the toolkit [16]. It comprised 3 sections and took approximately 10 minutes to complete. Section 1 included demographic data. Section 2 included questions derived from the Determinants of Implementation Behavior Questionnaire (DIBQ), which is based on the theoretical domains framework [30]. Domains in the DIBQ show high discriminant validity, reliability, and internal consistency [30]. The 45-item instrument assessed the impact of continuing professional development activities on health professionals’ knowledge, confidence, and implementation behaviors. Each item was measured on a 7-point Likert scale (ranging from 1, “strongly disagree” to 7, “strongly agree”). Item 45 was reverse scaled. Section 3 related to the usability and utility of the website [31] and was included in the follow-up survey only. This survey was tested by members of the research team (AD, CB, and CO) for readability and functionality prior to its distribution. A short quiz created by the researchers was also embedded as a learning tool within the toolkit to test user knowledge related to published recommendations on exercise and cancer [1,26]. Website views at the end of the 3-month trial period (May to October 2021) were reported to identify engagement with the website.

    Data analysis

    Survey and website metadata were described using proportions, medians, and interquartile ranges. Content analysis was conducted on open-ended survey questions by 2 researchers (AC and CO) independently. Following recommendations for the analysis of anonymous survey data that cannot be paired [32], differences in DIBQ scores between baseline and follow-up were analyzed using the Mann Whitney U test with Bonferroni adjustment for multiple comparisons. A sensitivity analysis was applied to account for dependence in the follow-up survey. This involved using the same sample size at baseline and follow up in a random sample of data from the baseline survey [32]. Data were analyzed using SPSS version 27 (IBM Corp).

    Ethics Approval

    This study was reported in accordance with the Consolidated Criteria for Reporting Qualitative Studies [33] and Good Reporting of A Mixed Methods Study [34] checklists and approved by the hospital and university ethics committees (LR 20-020). Workshop participants provided written informed consent. Consent for the online surveys was implied by survey completion.


    Phase 1: Needs Identification and Co-Design

    Twenty-five exercise professionals (13 experts and 12 generalists) participated in the co-design workshops. The co-design group included 21 physiotherapists and 4 exercise physiologists. Thirteen co-design participants worked in hospital settings in Australia. On average, the exercise professionals had 15 years of total experience (Table 1).

    Table 1. Characteristics of co-design participants.
    Characteristics, n (%)All (N=25)Expert (n=13)Generalist (n=12)
    Profession

    		Physiotherapist21 (84)11 (85)10 (83)

    		Exercise physiologist4 (16)2 (15)2 (17)
    Setting

    		Hospital12 (48)10 (77)3 (25)

    		Community9 (36)1 (8)8 (67)

    		Both1 (4)1 (8)0 (0)
    Funding

    		Public14 (56)8 (62)7 (58)

    		Private2 (8)0 (0)2 (17)

    		Both public and private6 (25)3 (23)3 (23)
    Years of total experience, mean (SD)14.8 (8.6)17.2 (8.0)12.3 (8.6)

    Workshops 1 and 2 identified 5 key touchpoints describing successful cancer rehabilitation programs (Table 2). These touchpoints highlighted the knowledge exercise professionals required to be included in the toolkit for implementation in cancer rehabilitation programs. Overall, touchpoints were similar between the expert and generalist exercise professionals.

    Need easy access to latest guidelines for general knowledge...often difficult to keep up to date...
    [Expert group participant]
    [Need] access [to] article(s), training... [to be] more confident to safely advocate...to other health professionals.
    [Generalist group participant]

    When compared to the generalist group, the experts identified more nuanced, disease-specific knowledge, such as the need for strict infection control procedures and cancer-specific assessments. The importance of practical considerations, understanding the impact of cancer treatment and side effects, and education provision and access were common themes forming the foundational content of the toolkit prototype. These touchpoints informed 8 key sections of the toolkit: the homepage; getting started; screening and safety; assessment; exercise prescription; education; locations; and resources (Multimedia Appendix 5).

    In the joint workshop (workshop 3), the exercise professionals agreed the toolkit needed to be simple, practical, and not duplicate existing resources. Participants provided suggestions for existing resources that could be linked or embedded in the toolkit and described a need for templates that could be used in their clinical practice. Website monitoring and updating were identified as critical for the website’s sustained success. At the conclusion of this workshop, the research team drafted the toolkit content. Freely available multimedia resources (videos, infographics, patient handouts, and podcasts) were sourced to supplement information provided on the website rather than creating new multimedia content.

    Table 2. Key touchpoints from workshops 1 and 2.
    Elements of cancer rehabilitationCommon themesExpert onlyGeneralist only
    Getting startedSetting up the environment, including social support, space, equipment, and group dynamics; communicating with patients how to get started with cancer rehabilitationImportance of infection control due to work with immunocompromised patientsWhether to deliver therapy one-to-one or in groups; uncertainty as to how to integrate cancer patients with other disease populations; standardized templates and letters
    Screening and safety; assessmentUnderstanding impact of cancer treatment; precautions and contraindicationsDiscussion of impairment, performance, and quality of life measures used for assessment, including cancer-specific measuresEmphasis on importance and challenges of goal setting
    Exercise prescriptionIndividualization; modification and progression/regression; monitoring fatigueMore emphasis on guidelines and optimal dosagePatient-centered approach to tailor exercise based on needs and symptoms
    EducationRequirement for multidisciplinary input, including psychological and nutritional support and fatigue management; need for resources for both patients and clinicians; inclusion of patient testimonialsN/AaN/A
    AccessPoor access to cancer rehabilitationAcknowledgement of lack of sufficient suitable programsDifficulty of generating and managing referrals; low confidence of other health professionals to refer patients to cancer rehabilitation

    aN/A: Not applicable. There were no differences in the themes related to education between the 2 groups.

    At the second joint workshop (workshop 4), further refinements were made (Multimedia Appendix 6) including changing the website name to the Cancer Exercise Toolkit [35] and creating a logo. The main feedback was related to navigation and the addition of content. More content was added on special cancer populations, including exercise modifications for specific cancers and side-effects of treatment. The final website was, and still is, a freely available web-based resource that can be self-navigated by users. At the time of evaluation, it comprised 8 sections including relevant information related to implementing exercise-based rehabilitation for cancer survivors (Multimedia Appendix 5 and Multimedia Appendix 7).

    Phase 2: Pilot Evaluation

    The website [31] was launched on World Cancer Day (February 4, 2021) and the baseline survey was accessed by 414 people, 37 of whom did not identify as exercise professionals; the survey was terminated. An additional 57 participants did not complete the survey. Respondents who were exercise professionals included 320 clinicians from 26 countries, with most having 5 years or less of cancer-specific experience (Table 3). The majority were physiotherapists (277/320, 87%). Just 120 of the 320 clinicians (38%) worked exclusively in cancer, palliative care, or lymphedema care. The main motivations for accessing the website were for professional development (142/320, 44%) and to improve patient care (17/320, 22%) (Figure 2).

    Contact details for follow-up surveys were provided by 160 respondents, of whom 58 completed the follow-up survey (for a response rate of 36%). There were no differences in demographics between those who completed the baseline and follow-up surveys (Table 3).

    Table 3. Participant characteristics at baseline and in a 3-month follow-up survey.
    CharacteristicsBaseline (N=320)3-month follow-up (n=58)
    Discipline, n (%)

    		Physiotherapy277 (87)51 (88)

    		Exercise physiology43 (13)7 (12)
    Country or region, n (%)

    		Australia249 (78)50 (86)

    		Europe/United Kingdom38 (12)3 (5)

    		Americas15 (5)3 (5)

    		Asia/Pacific8 (3)0 (0)

    		Africa7 (2)2 (3)

    		Middle East1 (0.3)0 (0)
    City-based, n (%)228 (71)41 (71)
    Setting, n (%)

    		Public159 (50)29 (50)

    		Private116 (36)21 (36)

    		Both public and private36 (11)7 (12)

    		Other9 (3)0 (0)
    Years of experience, mean (SD)14 (10)15 (10)
    Years of cancer-specific experience (if applicable), n (%)

    		<182 (26)9 (16)

    		1-260 (19)12 (21)

    		3-560 (19)12 (21)

    		6-1029 (9)9 (15)

    		>1025 (8)7 (12)
    Primary area of clinical practice, n (%)

    		Cancer/palliative care/lymphedema118 (37)23 (40)

    		Other200 (63)35 (60)
    Proportion of caseload cancer, n (%)

    		76-100%61 (19)14 (24)

    		51-75%26 (8)5 (9)

    		26-50%55 (17)14 (24)

    		≤25%174 (54)25 (43)
    Highest level of qualification, n (%)

    		Undergraduate degree138 (43)24 (41)

    		Post-graduate certificate71 (22)12 (21)

    		Masters by coursework73 (23)17 (29)

    		Masters by research13 (4)1 (2)

    		PhD20 (6)4 (7)
    Cancer-specific professional development completeda

    		Informal training175 (55)0 (0)

    		External courses173 (54)0 (0)

    		Post-graduate education42 (13)0 (0)

    		Other23 (7)0 (0)

    		None45 (14)0 (0)

    aNo responses were gained at follow-up as this question was not asked at follow-up.

    ‎
    Figure 2. Self-reported motivations for accessing the Cancer Exercise Toolkit website (multiple answers possible).
    View this figure

    Usage, Usability, and Utility

    After the 3-month pilot period, the toolkit received on average 866 views per month. Toolkit usage peaked in June 2021 at 1205 views and declined to 731 views in October 2021.

    The most viewed pages were “Locations,” “Patient Education,” and “Precautions and Contraindications” (Multimedia Appendix 8).

    Participants found the website useful, easy to understand, and easy to use (items 1 to 4: median score 6, IQR 5-7) (Table 4). Most participants (35/44, 80%) agreed or strongly agreed that they would recommend the Cancer Exercise Toolkit to colleagues. Open-ended feedback received from 11 participants was positive; the following are representative quotes:

    Great source, filling a gap; like the pulmonary rehab toolkit.
    I had difficulties accessing the toolkit and never got around to sorting out the issue.

    Participants suggested some minor improvements to the website relating to accessibility (n=3), website function (n=2), increasing website scope (n=2), and dissemination (n=2).

    Table 4. Website usability and utility.
    QuestionMedian rating, IQRaRating 6 or 7 (“strongly agree”), n (%)
    Overall, the Oncology Rehabilitation Toolkit website was easy to use (n=44)6, 5-730 (68)
    The content of the Oncology Rehabilitation Toolkit website met my expectations (n=44)6, 5-731 (70)
    Overall, it was easy to understand the organization of the Oncology Rehabilitation Toolkit website screens, especially the menu levels and the flow of the screens (n=42)6, 5-728 (67)
    How useful do you find the Oncology Rehabilitation Toolkit website to be? (n=44)6, 5-729 (66)
    I would recommend the Oncology Rehabilitation Toolkit website to my colleagues (n=44)7, 6-735 (80)

    aNumbers are Likert scales ranging from 1 (“strongly disagree”) to 7 (“strongly agree”)

    Determinants of Implementation Behavior Questionnaire

    At baseline, participants rated themselves highest on items relating to their capability to deliver exercise rehabilitation according to guidelines and lowest on items relating to their training and ability to practice delivering exercise rehabilitation (Table 5, Multimedia Appendix 9).

    At the 3-month follow-up, participants self-reported significantly higher scores on items related to knowledge and skills (items 1-7, P<.001) and confidence to deliver exercise therapy according to guidelines (items 8 and 9, P<.001) (Figure 3, Table 5).

    Table 5. Determinants of Implementation Behavior Questionnaire. The significance level was set at P<.001 (Bonferroni adjustment). Italics indicate significance after the sensitivity analysis was applied. A total of 47 subjects did not complete this section of the survey at baseline. At follow-up, an additional 3 responses were excluded as participants indicated they never accessed the website.
    QuestionBaseline
    (N=273)    		Follow-up
    (n=55)    		Between-group difference
    (P value)
    Knowledge, median (IQR)

    		I know how to deliver Exercise Oncology Rehabilitation following the guidelines.5 (3-6)6 (5-6)<.001

    		Objectives of Exercise Oncology Rehabilitation and my role in this are clearly defined for me.4 (3-6)5 (5-6)<.001

    		With regard to Exercise Oncology Rehabilitation, I know what my responsibilities are.5 (3-6)6 (5-6)<.001

    		In my work with Exercise Oncology Rehabilitation, I know exactly what is expected from me.4 (3-5)6 (5-6)<.001
    Skills, median (IQR)

    		I have been trained in delivering Exercise Oncology Rehabilitation following the guidelines.4 (1-5)6 (4-6)<.001

    		I have the skills to deliver Exercise Oncology Rehabilitation following the guidelines.5 (3-6)6 (5-6)<.001

    		I am practiced to deliver Exercise Oncology Rehabilitation following the guidelines.4 (2-5)6 (4-6)<.001
    Confidence, median (IQR)

    		I am confident that I can deliver Exercise Oncology Rehabilitation following the guidelines.5 (3-6)5 (5-7)<.001

    		I am confident that I can deliver Exercise Oncology Rehabilitation following the guidelines even when other professionals with whom I deliver Exercise Oncology Rehabilitation do not do this.4 (3-6)5 (5-6)<.001

    		I am confident that I can deliver Exercise Oncology Rehabilitation following the guidelines even when there is little time.4 (3-5)5 (4-6)<.001

    		I am confident that I can deliver Exercise Oncology Rehabilitation following the guidelines even when participants are not motivated.4 (3-5)5 (4-6)<.001
    ‎
    Figure 3. Differences in Determinants of Implementation Behavior (DIBQ) scores between baseline and 3-month follow-up. Figure legend: Shaded data refer to Likert scales ranging from 1 ("strongly disagree") to 7 ("strongly agree"), numbers refer to absolute number of participants who answered survey question.
    View this figure

    Triangulation of Data

    Qualitative data obtained from clinician workshops converged with quantitative survey data. Participants expressed a need to access information related to published exercise guidelines and described information related to exercise screening and safety as a priority. Areas of traffic on the toolkit were highest for pages related to safety and education (Multimedia Appendix 8). This aligned with survey item scores related to guidelines (“I know how to deliver Exercise Oncology Rehabilitation following the guidelines”; “I have been trained in delivering Exercise Oncology Rehabilitation following the guidelines”; “I have the skills to deliver Exercise Oncology Rehabilitation following the guidelines”; “I am confident that I can deliver Exercise Oncology Rehabilitation following the guidelines”) improving at follow-up.


    Principal Findings

    This study identified key learning needs of exercise professionals related to cancer care and facilitated development of the co-designed online Cancer Exercise Toolkit. Learning needs included knowledge of practical considerations for starting a cancer rehabilitation program; how to perform assessment, screening, and safety; and how to prescribe exercise, including tailoring and monitoring. Other important elements described by participants were facilitating access to care, clinician and patient education, and inclusion of templates and forms to support practice. The toolkit had international reach and was described as useful and easy to navigate. The pilot evaluation suggests the Cancer Exercise Toolkit may also improve exercise professionals’ knowledge, skills, and confidence to deliver exercise therapy to cancer survivors.

    Knowledge, skills, and confidence of exercise professionals to provide exercise therapy according to guidelines were rated higher after access to the Cancer Exercise Toolkit. This finding indicates that online toolkits such as this could be a useful knowledge translation strategy, supporting previous research showing that online platforms can support delivery of evidence-based practice [36]. The areas of highest traffic on the website after initial piloting included sections related to education, safety, and access. This aligns with the learning needs identified in the co-design workshops and with previous research indicating that these are the areas exercise professionals most lack confidence when managing people with cancer [12]. Building workforce capacity through development of high-quality education and broad dissemination is high on the agenda for the “Moving Through Cancer” movement to embed exercise as part of standard care by 2029 [37]. By improving the knowledge and skills of exercise professionals, it is likely to lead to better quality of care for cancer survivors and improve access to specialized cancer rehabilitation programs.

    Most toolkit users were exercise professionals who did not specialize in cancer but were motivated to obtain professional development and improve patient care. Initial survey respondents and users indicated that we achieved a global reach, with more than 400 health professionals from 26 countries accessing the toolkit. This reach is important considering that recent national [38] and international guidelines [1] call for increased access and uptake of exercise services for cancer survivors. Highlighting the need for resources like the Cancer Exercise Toolkit, very few exercise professionals registered in Australia have specialist qualifications or training in cancer care. Moreover, many exercise professionals feel underprepared to practice in cancer care after their entry-level training [12]. Many professional bodies have only started developing post-graduate career pathways in cancer care in the past 5 years [39]. This study found that most clinicians receive their professional development through informal training, which may reflect the scarcity of professional development opportunities traditionally available in this area [12]. The Cancer Exercise Toolkit developed in this study provides generalist and specialist clinicians new opportunities to improve their cancer-specific knowledge and skills to meet increasing demand.

    The toolkit appeared to meet clinician needs, being described as easy and useful, with most survey respondents agreeing they would recommend it to their colleagues. Characteristics of the toolkit informed by the co-design process reflected effective web design, such as easy navigation; inclusion of images, logos, and multimedia content; optimal organization, including a hierarchical structure; and content utility, determined by sufficiency, relevancy, quality, and motivational power of the information [40]. While there was a high initial uptake of the website, usage decreased over time. It is possible that participants obtained what they needed from the website when they initially accessed it, and that they therefore did not need to continue visiting it. Planning for ongoing promotion of the toolkit and updates with new content may also be required to improve user engagement. Planned strategies for ongoing sustainability include sharing and promotion via social media and seeking endorsement by key professional bodies. Maintenance of the toolkit will be imperative to ensure its ability to disseminate up-to-date exercise and cancer knowledge and meet clinicians’ professional development needs in the future.

    Strengths and Limitations

    This is the first study to describe the development of a freely available toolkit to support exercise professionals working with cancer survivors. The co-design approach ensured end user learning needs were met through tailoring the toolkit based on clinician experience [23]. The effectiveness of co-design in health is not well established. However, qualitative reports indicate that participants in the co-design process have a positive experience, and materials derived from co-design projects are more applicable and acceptable to end users [23]. Co-design methods have commonly been used in curriculum design for secondary and tertiary education [41,42], but not for developing professional development toolkits in a health setting. Applicability of the toolkit was optimized by involving exercise professionals from a variety of clinical settings with a broad range of experience. Our broad dissemination approach, including engaging exercise professionals worldwide, also enhanced the generalizability of the end product.

    There were limitations to this study. In the evaluation, only one-third of the original exercise professional participants completed the follow-up survey. Despite multiple attempts to improve engagement with the follow-up survey, including reminder emails and hosting a webinar where survey completion was promoted, the follow-up response rate remained low. This low response rate is consistent with other clinician surveys designed to evaluate physiotherapy professional development initiatives [43] and may be due to lack of time or motivation. To improve response rate, clinicians could be provided with further incentives to complete follow-up surveys, such as prizes, accredited professional development points, or certificates of completion. We were also unable to match participant responses due to the anonymous nature of the survey. It is also possible that the follow-up responses we did receive were from participants who were more interested and invested in cancer rehabilitation; these participants may have reported higher scores. However, the demographics of the participants who completed the follow-up survey were similar to the overall cohort. Additionally, a sensitivity analysis to account for the issue of dependence was conducted to increase the confidence in our results. Our inclusion of exercise professionals involved in the co-design of the toolkit during the evaluation phase also could have biased the outcome. However, we included this group to optimize the sample size available for evaluation, and to ensure that the changes made following the workshops were appropriate. Other health professionals, such as occupational therapists, dietitians, nurses, and doctors, were excluded, as they are not traditionally involved with specialist exercise prescription for cancer survivors. The website was developed for the Australian context. Health systems in other parts of the world may differ, and the content may need to be adapted to meet their needs. Despite this, positive feedback was received from participants from other countries, indicating that cross-cultural adaptation would likely be acceptable. Lastly, online resources may not be as effective at improving clinician behavior as more active learning strategies, such as workshops and mentoring [44].

    Conclusion

    This study described the development of the co-designed Cancer Exercise Toolkit. The toolkit was accessed by physiotherapists and exercise physiologists who described the website as valuable and easy to use. Exercise professionals rated their knowledge, skills, and confidence higher after accessing the website, indicating that it may be an effective alternative or complement to traditional professional development. The Cancer Exercise Toolkit may help improve access to exercise therapy and improve the effectiveness of care for cancer survivors through greater capability of the exercise professional workforce.

    Acknowledgments

    We would like to thank our steering committee, the co-design participants, and the consumers who helped with the development of the Cancer Exercise Toolkit. Thank you to Joshua Stopper for his contribution to web design. This project was funded by a grant from the Pat Cosh Trust.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Experience-based co-design (EBCD) steps.

    DOCX File , 22 KB
    ‎
    Multimedia Appendix 2

    Patient interview schedule.

    DOCX File , 24 KB
    ‎
    Multimedia Appendix 3

    Backgrounds of the research team.

    DOCX File , 12 KB
    ‎
    Multimedia Appendix 4

    Evaluation survey.

    DOCX File , 338 KB
    ‎
    Multimedia Appendix 5

    Description of website content.

    DOCX File , 12 KB
    ‎
    Multimedia Appendix 6

    Website changes.

    DOCX File , 13 KB
    ‎
    Multimedia Appendix 7

    Screenshot example of Cancer Exercise Toolkit.

    DOCX File , 2993 KB
    ‎
    Multimedia Appendix 8

    Cancer Exercise Toolkit Visits.

    DOCX File , 13 KB
    ‎
    Multimedia Appendix 9

    Full Determinants of Implementation Behavior Questionnaire (DIBQ) outcomes.

    DOCX File , 46 KB
    1. Campbell KL, Winters-Stone KM, Wiskemann J, May AM, Schwartz AL, Courneya KS, et al. Exercise guidelines for cancer survivors: consensus statement from International Multidisciplinary Roundtable. Med Sci Sports Exerc 2019 Nov;51(11):2375-2390. [CrossRef] [Medline]
    2. Schmitz KH, Campbell AM, Stuiver MM, Pinto BM, Schwartz AL, Morris GS, et al. Exercise is medicine in oncology: Engaging clinicians to help patients move through cancer. CA Cancer J Clin 2019 Nov;69(6):468-484 [FREE Full text] [CrossRef] [Medline]
    3. Friedenreich CM, Stone CR, Cheung WY, Hayes SC. Physical activity and mortality in cancer survivors: a systematic review and meta-analysis. JNCI Cancer Spectr 2020 Feb;4(1):pkz080 [FREE Full text] [CrossRef] [Medline]
    4. Patel AV, Friedenreich CM, Moore SC, Hayes SC, Silver JK, Campbell KL, et al. American College of Sports Medicine Roundtable Report on Physical Activity, Sedentary Behavior, and Cancer Prevention and Control. Med Sci Sports Exerc 2019 Nov;51(11):2391-2402 [FREE Full text] [CrossRef] [Medline]
    5. Canestraro A, Nakhle A, Stack M, Strong K, Wright A, Beauchamp M, et al. Oncology rehabilitation provision and practice patterns across Canada. Physiotherapy Canada 2013 Jan;65(1):94-102. [CrossRef]
    6. Dennett AM, Peiris CL, Shields N, Morgan D, Taylor NF. Exercise therapy in oncology rehabilitation in Australia: A mixed-methods study. Asia Pac J Clin Oncol 2017 Oct;13(5):e515-e527. [CrossRef] [Medline]
    7. Committee on Improving the Quality of Care Cancer. Addressing the challenges of an aging population, Board on Health Care Services, Institute of Medicine, an Aging Population BoHCS, Institute of Medicine. In: Levit L, Balogh E, Nass S, Ganz PA, editors. Delivering High-Quality Cancer Care: Charting a New Course for a System in Crisis. Levit L BE, Nass S. Ganz PA editors. Washington, DC: National Academies Press (US); Dec 27, 2013:-309.
    8. Allied Health Professionals Australia. Physiotherapy. 2021.   URL: https://ahpa.com.au/allied-health-professions/physiotherapy/ [accessed 2021-11-04]
    9. Allied Health Professionals Australia. Exercise Physiology. 2021.   URL: https://ahpa.com.au/allied-health-professions/exercise-physiology/ [accessed 2021-11-04]
    10. Australian Health Practitioner Regulation Agency (AHPRA). AHPRA and National Boards annual report 2019/20.   URL: https://www.physiotherapyboard.gov.au/News/Annual-report.aspx [accessed 2022-01-18]
    11. Exercise and Sport Science Association Australia. Annual Report '20. 2020.   URL: https:/​/www.​essa.org.au/​Public/​About/​Annual_Report/​Public/​ABOUT_ESSA/​Annual_Reports.​aspx?hkey=d2479c18-64d0-4f7a-ad7e-c1fb6be71898 [accessed 2020-09-20]
    12. Dennett A, Rowe A, Mortimer J, Gordon C, Glagovski S, Osadnik C. Perceptions and work-readiness of Australian physiotherapists in cancer care: a national evaluation. Physiotherapy 2021;113:1-7. [CrossRef]
    13. Sheill G, Guinan E, O Neill L, Hevey D, Hussey J. Physical activity and advanced cancer: The views of chartered physiotherapists in Ireland. Physiother Theory Pract 2018 Jul;34(7):534-541. [CrossRef] [Medline]
    14. Scott SD, Albrecht L, O'Leary K, Ball GDC, Hartling L, Hofmeyer A, et al. Systematic review of knowledge translation strategies in the allied health professions. Implement Sci 2012 Jul 25;7:70 [FREE Full text] [CrossRef] [Medline]
    15. Barton CJ, Merolli MA. It is time to replace publish or perish with get visible or vanish: opportunities where digital and social media can reshape knowledge translation. Br J Sports Med 2017 Nov 16;53(10):594-598. [CrossRef]
    16. Lung Foundation Australia. Pulmonary Rehabilitation Toolkit. 2016.   URL: https://pulmonaryrehab.com.au/ [accessed 2021-11-04]
    17. Dale M. Media: Review - Pulmonary Rehabilitation Toolkit: a physiotherapist's perspective. J Physiother 2018 Oct;64(4):275-276 [FREE Full text] [CrossRef] [Medline]
    18. Stout NL, Baima J, Swisher AK, Winters-Stone KM, Welsh J. A systematic review of exercise systematic reviews in the cancer literature (2005-2017). PM R 2017 Sep;9(9S2):S347-S384 [FREE Full text] [CrossRef] [Medline]
    19. Dennett AM, Elkins MR. Cancer rehabilitation. J Physiother 2020 Apr;66(2):70-72 [FREE Full text] [CrossRef] [Medline]
    20. Barton CJ, Ezzat AM, Bell EC, Rathleff MS, Kemp JL, Crossley KM. Knowledge, confidence and learning needs of physiotherapists treating persistent knee pain in Australia and Canada: a mixed-methods study. Physiotherapy Theory and Practice 2021 Apr 19:1-13. [CrossRef]
    21. EBCD Experience-based co-design toolkit. The Point of Care Foundation. 2016.   URL: https://www.pointofcarefoundation.org.uk/resource/experience-based-co-design-ebcd-toolkit/ [accessed 2021-09-17]
    22. Tang CY, Turczyniak M, Sayner A, Haines K, Butzkueven S, O’Connell HE. Adopting a collaborative approach in developing a prehabilitation program for patients with prostate cancer utilising experience-based co-design methodology. Support Care Cancer 2020 Feb 18;28(11):5195-5202. [CrossRef]
    23. Slattery P, Saeri AK, Bragge P. Research co-design in health: a rapid overview of reviews. Health Res Policy Sys 2020 Feb 11;18(1):17. [CrossRef]
    24. Visser FS, Stappers PJ, van der Lugt R, Sanders EB. Context mapping: experiences from practice. CoDesign 2005 Apr;1(2):119-149. [CrossRef]
    25. Dhand N, Khatkar M. Statulator: An online statistical calculator. 2014.   URL: http://statulator.com/SampleSize/ss1P.html [accessed 2021-10-05]
    26. Santa Mina D, Langelier D, Adams SC, Alibhai SMH, Chasen M, Campbell KL, et al. Exercise as part of routine cancer care. Lancet Oncol 2018 Sep;19(9):e433-e436. [CrossRef] [Medline]
    27. Stout NL, Brown JC, Schwartz AL, Marshall TF, Campbell AM, Nekhlyudov L, et al. An exercise oncology clinical pathway: Screening and referral for personalized interventions. Cancer 2020 Jun 15;126(12):2750-2758 [FREE Full text] [CrossRef] [Medline]
    28. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. International Journal of Qualitative Methods 2016 Nov 29;5(1):80-92. [CrossRef]
    29. Harris P, Taylor R, Minor B, Elliott V, Fernandez M, O'Neal L. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform 2019:103208 [FREE Full text] [CrossRef]
    30. Huijg JM, Gebhardt WA, Dusseldorp E, Verheijden MW, van der Zouwe N, Middelkoop BJ, et al. Measuring determinants of implementation behavior: psychometric properties of a questionnaire based on the theoretical domains framework. Implementation Sci 2014 Mar 19;9(1):33. [CrossRef]
    31. Coursaris CS, Whitten P. Chapter 12 usability and accessibility of e-Health websites enabling nutrition and physical activity education for blind and low vision internet users. In: Evaluating Websites and Web Services: Interdisciplinary Perspectives on User Satisfaction 2014. Hershey, PA: IGI Global; 2014:E-23.
    32. Wang H. Using different methods to analyze the pre-post no-matching survey data in medical practical research. J Appl Computat Math 2015;4(5):55. [CrossRef]
    33. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care 2007 Dec;19(6):349-357 [FREE Full text] [CrossRef] [Medline]
    34. O'Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Health Serv Res Policy 2008 Apr;13(2):92-98. [CrossRef] [Medline]
    35. Cancer Exercise Toolkit. 2021.   URL: https://cancerexercisetoolkit.trekeducation.org [accessed 2021-10-20]
    36. Camden C, Rivard LM, Hurtubise K, Héguy L, Berbari J. Can a community of practice improve physical therapists' self-perceived practice in developmental coordination disorder? Phys Ther 2017 Jul 01;97(7):746-755. [CrossRef] [Medline]
    37. Schmitz KH, Stout NL, Maitin-Shepard M, Campbell A, Schwartz AL, Grimmett C, et al. Moving through cancer: Setting the agenda to make exercise standard in oncology practice. Cancer 2021 Feb 01;127(3):476-484. [CrossRef] [Medline]
    38. Cormie P, Atkinson M, Bucci L, Cust A, Eakin E, Hayes S, et al. Clinical Oncology Society of Australia position statement on exercise in cancer care. Med J Aust 2018 Aug 20;209(4):184-187. [Medline]
    39. Stuiver MM, Stout NL, Dennett AM, Speksnijder CM, Campbell KL. An international perspective on integrating physiotherapists in oncology care. Journal of Physiotherapy 2019 Oct;65(4):186-188. [CrossRef]
    40. Garett R, Chiu J, Zhang L, Young SD. A literature review: website design and user engagement. Online J Commun Media Technol 2016 Jul;6(3):1-14 [FREE Full text] [Medline]
    41. Wu J, Atit K, Ramey KE, Flanagan-Hall GA, Vondracek M, Jona K, et al. Investigating students’ learning through co-designing with technology. J Sci Educ Technol 2021 Jan 25;30(4):529-538. [CrossRef]
    42. Tissenbaum M, Lui M, Slotta J. Co-Designing collaborative smart classroom curriculum for secondary school science. J Univers Comput Sci 2012;18:327-352. [CrossRef]
    43. Barton C, Kemp J, Roos E, Skou S, Dundules K, Pazzinatto M. Program evaluation of GLA:D® Australia: Physiotherapist training outcomes and effectiveness of implementation for people with knee osteoarthritis. Osteoarthritis Cartilage Open 2021:100175 [FREE Full text] [CrossRef]
    44. Leahy E, Chipchase L, Calo M, Blackstock F. Which learning activities enhance physical therapist practice? part 1ystematic review and meta-analysis of quantitative studies. Phys Ther 2020;100(9):1469-1483. [CrossRef]

    ‎
    DIBQ: Determinants of Implementation Behavior Questionnaire
    EBCD: experience-based co-design

    Edited by A Mavragani; submitted 11.11.21; peer-reviewed by M Lozano-Lozano, J Gorzelitz, N Waespe; comments to author 01.02.22; revised version received 17.02.22; accepted 26.03.22; published 21.04.22

    Copyright

    ©Amy M Dennett, Clarice Y Tang, April Chiu, Christian Osadnik, Catherine L Granger, Nicholas F Taylor, Kristin L Campbell, Christian Barton. Originally published in JMIR Cancer (https://cancer.jmir.org), 21.04.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Cancer, is properly cited. The complete bibliographic information, a link to the original publication on https://cancer.jmir.org/, as well as this copyright and license information must be included.