This paper is in the following e-collection/theme issue:

Emotional, Social, Psychological Support for Cancer (194) Caregiving and Parenting for Chronic Pediatric Diseases (81) Supporting Home Care and Family Caregivers (185) Family Skills and Family-based Interventions to Support Communication and Social Ties Within Families (18) Pediatrics (198) Supporting Partners and Informal Caregiver of Cancer Patients (40) Children and Young People With Cancer, Pediatric Oncology (58) Health Services in Resource-Poor Settings and LMICs (402)

Published on in Vol 10 (2024)

This is a member publication of Bibsam Consortium

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/54715, first published .
Association of Family-Centered Care With Psychological Distress Among Caregivers of Children With Cancer at a Tertiary-Level Hospital in Ethiopia: Cross-Sectional Study

Association of Family-Centered Care With Psychological Distress Among Caregivers of Children With Cancer at a Tertiary-Level Hospital in Ethiopia: Cross-Sectional Study

Association of Family-Centered Care With Psychological Distress Among Caregivers of Children With Cancer at a Tertiary-Level Hospital in Ethiopia: Cross-Sectional Study

Authors of this article:

Leul Deribe1 Author Orcid Image ;   Eshetu Girma2 Author Orcid Image ;   Nataliya Lindström3 Author Orcid Image ;   Abdulkadir Gidey4 Author Orcid Image ;   Solomon Teferra4 Author Orcid Image ;   Adamu Addissie2 Author Orcid Image
Article Authors Cited by Tweetations Metrics

    Original Paper

    1School of Nursing and Midwifery, College of Health Sciences, Addis Ababa University, Addis Ababa, Ethiopia

    2School of Public Health, College of Health Sciences, Addis Ababa University, Addis Ababa, Ethiopia

    3Department of Applied Information Technology, University of Gothenburg, Goteborg, Sweden

    4School of Medicine, College of Health Sciences, Addis Ababa University, Addis Ababa, Ethiopia

    *all authors contributed equally

    Corresponding Author:

    Nataliya Lindström, PhD

    Department of Applied Information Technology

    University of Gothenburg

    Forskningsgången

    Goteborg

    Sweden

    Phone: 46 733268716

    Email: nataliya.berbyuk.lindstrom@ait.gu.se


    Background: Psychological distress (PD) is a common mental health problem faced by caregivers of children with cancer. The involvement of families in childcare was found to be associated with lower levels of distress.

    Objective: The study aims to determine the associations between family-centered care (FCC) and PD among caregivers of children with cancer receiving treatment at Tikur Anbessa Specialized Hospital (TASH), Ethiopia.

    Methods: An institution-based, cross-sectional study was conducted from June to December 2022. Caregivers of children with cancer aged 0-14 years receiving cancer treatment at the pediatric oncology unit completed a face-to-face, interviewer-administered, structured questionnaire during a routine inpatient or outpatient visit. The questionnaire included questions on the characteristics of the child and caregiver, PD (measured by the Kessler Psychological Distress Scale [K10]), FCC (measured by the Measure of Processes of Care [MPOC-20]), and social support (measured by the Oslo-3 Social Support Scale [OSS-3]). Data were collected using the Kobo toolbox and exported to SPSS (version 26; IBM Corp) for cleaning and analysis. A multivariable logistic regression model was used. An odds ratio with a 95% CI was calculated, and a P value less than .05 was considered statistically significant.

    Results: A total of 384 caregivers of children with cancer participated in the study. The total PD score ranged from 10 to 50, with a mean score of 17.30 (SD 8.96; 95% CI 16.84-18.60). The proportion of caregivers found to have mild, moderate, and severe levels of PD was 43 (11.2%), 35 (9.1%), and 51 (13.3%), respectively. The overall prevalence of mild to severe PD symptoms was 33.6% (95% CI 28.9%-38.3%). A statistically significant negative association was found between FCC and PD (adjusted odds ratio [AOR] 0.68, 95% CI 0.53-0.86). In addition, having no formal education (AOR 2.87, 95% CI 1.28-6.45), having a history of relapse (AOR 3.24, 95% CI 1.17-9.02), beginning cancer treatment at TASH (AOR 2.82, 95% CI 1.4-4.85), beginning treatment within the last 3 months (AOR 3.99, 95% CI 1.73-9.23), and beginning treatment within the last 4 to 18 months (AOR 2.68, 95% CI 1.25-5.76) were significantly associated with higher level of PD.

    Conclusions: A total of 1 in 3 caregivers have reported PD. FCC was found to be protective of PD. The finding of this study suggests the need for FCC intervention to improve the mental health condition of caregivers. In addition, the intervention needs to consider the educational status of the caregivers, the time since the cancer diagnosis, and the history of relapse.

    JMIR Cancer 2024;10:e54715

    doi:10.2196/54715

    Keywords

    child cancer; psychological distress; Ethiopia; parent; caregivers; family 


    A diagnosis of childhood cancer has been described as a life-changing experience for caregivers that causes significant disruptions in a child’s and family’s life. Caregivers face multiple and inescapable stressors associated with their child’s illness, diagnostic procedures, and cancer treatment [1]. Childhood cancer increases the risk of long-term emotional strain [2] and the risk of developing psychosocial distress [3]. Psychological distress (PD) often refers to an undifferentiated combination of symptoms, which is a state of emotional distress characterized by symptoms of depression and anxiety [4]. Distress is defined by the National Comprehensive Cancer Network (NCCN) [5] as follows:

    an unpleasant experience of a mental, physical, social, or spiritual nature. This affects the way people think, feel, or act and interferes with the ability to cope with cancer, its physical symptoms, and its treatment.

    Caregivers of children with cancer have a higher risk of developing negative emotional states and poor health behaviors [6]. Thus, the prevalence of PD was higher at the time of diagnosis and remained significant during and even after the end of treatment [3,7,8]. It was also found that PD universally affects caregivers of children with cancer. In the United States, 50% of pediatric cancer caregivers are highly distressed and 16% meet the criteria for serious PD [8]. In the United Kingdom, 66% of caregivers of children with cancer have PD [9]. Similarly, 56.0% and 70.5% of caregivers in Lebanon [10] and in Iraq [11] were depressed, respectively. In African studies, PD was reported by 45% and 66.7% of caregivers of children with cancer in Uganda [12] and Tanzania [13], respectively. According to a study conducted in Ethiopia, 72.4% of caregivers of children with cancer had depression [14].

    It has also been indicated that parental PD can be affected by various factors. These factors include prognosis and stage of child cancer, child symptom level, treatment status, side effects of chemotherapy, knowledge about treatment modality, treatment cost, employment status, sex of the parent, number of hospital admissions, and family support [8,15-19]. Studies have reported that family-centered care (FCC), which provides holistic care and is planned around the family, is associated with lower PD [20]. Caregivers receiving FCC have been found to have better parental psychosocial health scores, decreased psychological stress, and higher levels of psychological well-being [21-23]. Improved communication and receiving enough information, which are the main components of FCC, are also indicated to have an association with enhanced levels of psychological health in families of children with cancer [24,25].

    Although childhood cancer is becoming a significant health burden in Africa [26] and Ethiopia in particular [26], few studies have explicitly examined the level of PD and underlying factors among caregivers of children with cancer. Research on FCC primarily focuses on defining and surveying families and health care providers, with limited exploration of its relationship with family outcomes [20]. To this end, understanding the degree of association between PD and the level of perceived FCC will help to improve the care provided for caregivers of children with cancer. In addition, better insight into factors associated with PD may help to design and implement supportive interventions for caregivers, which reflect their needs in low-income countries. Accordingly, the objective of this study was to describe PD and examine the association between PD and FCC among caregivers of children with cancer receiving treatment at Tikur Anbessa Specialized Hospital (TASH), Ethiopia.


    Study Area and Study Design

    This study used a cross-sectional design from June to December 2022. The hospital is situated in Addis Ababa, the capital city of Ethiopia. With more than 800 beds, TASH is the largest tertiary university teaching hospital. The hospital offers the most thorough cancer care with over 120 million people nationwide. Patients with cancer from every region were referred to this hospital. The pediatric oncology unit has 26 beds, along with nurses, residents, hemato-oncologists, and hematopathologists. According to pediatric oncology unit registration, between 500 and 600 new children with cancer get both inpatient and outpatient care each year [27].

    Study Participants

    Caregivers of children with cancer aged 0-14 years receiving cancer treatment at the TASH pediatric oncology unit were recruited for the study. Due to the restricted number of patients seen during the study period, we did not precalculate the sample size. Instead, we consecutively invited all caregivers who visited the unit during the study period to participate in the study. Accordingly, 393 caregivers of children with cancer were interviewed in this study. A mother or father was selected if they were available with other family members during data collection. If both mothers and fathers were available, the parent who reported spending more time with the child and more frequently visited the health facility was selected.

    The inclusion criteria for this study were caregivers or guardians of children with all types of cancer visiting the TASH pediatric oncology unit, having at least 1 previous visit, attending either an inpatient or outpatient department, and at least 1 month had passed since the child’s diagnosis. The term “caregiver” or “guardian” refers to the person who decides on most things for the child daily, both inside and outside the medical environment. The study excluded caregivers or guardians of children with known mental health problems before their child’s cancer diagnosis. A total of 3 caregivers were excluded because they identified themselves as being in treatment for mental health conditions before knowing their child’s cancer diagnosis and 4 caregivers did not provide complete data for the dependent variable.

    Data Collection

    The study used a face-to-face, interviewer-administered, structured questionnaire (see Multimedia Appendix 1). The questionnaire was prepared in English and independently translated into Amharic by 2 bilingual translators. A third reviewer, who provided feedback at a reconciliation meeting, checked the translated version. After obtaining the agreement, another language checker translated the Amharic version into English. Any inconsistencies were corrected, and a final Amharic translation was used to collect the data. The caregivers were recruited to the interview consecutively as they come to the pediatric oncology unit for regular visits. The participants’ responses were instantly entered into a Kobo toolbox data collection tool by the data collector at the time of the interview. The face-to-face interviews were approximately 20 minutes.

    Measurements

    Overview

    The survey included questions regarding caregivers’ sociodemographic characteristics, children’s health status, parental distress, and caregivers’ satisfaction with the treatment received. Information on sociodemographic characteristics was obtained by interviewing caregivers using a standard questionnaire. Data regarding the children’s clinical characteristics were obtained from their medical records using a structured data-retrieving checklist with the assistance of an MSc oncology nurse in the pediatric oncology unit.

    Kessler Psychological Distress Scale

    The Kessler Psychological Distress Scale (K10) is a tool consisting of 10 items originally developed to measure PD [28]. It is made of a 5-point Likert-type scale ranging from 1=none of the time to 5=all of the time. The tool assesses the experience of symptoms of mental distress over the past 30 days. The total score of the tool ranges from 10 to 50. Owing to the lack of a universally accepted method for categorizing K10 scores, various methods were used based on the purpose and context of the study. Considering the absence of a specific threshold in Ethiopia’s setting and our aim to screen caregivers of children with cancer for the likelihood of having a mental disorder, we chose the most commonly used grouping for K10 scores to assess PD in primary health care settings. Therefore, the total score was categorized as 10-19, indicating “likely to be well”; 20-24, “likely to have a mild mental disorder”; 25-29, “likely to have a moderate mental disorder”; and above 30, “likely to have a severe mental disorder” [29-32]. Finally, a score less than or equal to 19 was coded as 0 for no mental disorder, and the presence of likelihood of mental disorder for a score greater than or equal to 20 was coded as 1. The K10 scale has been validated and confirmed to effectively assess PD in Ethiopian settings, with Cronbach α of 0.86 and 0.83 reliability [33,34].

    Measure of Processes of Care

    To evaluate the family-centeredness of care, the Measure of Processes of Care (MPOC-20) was used [35]. MPOC-20 can assess both families’ experiences and perceptions of the family-centeredness of services received. The tool is translated and validated in about 14 languages [36]. The MPOC-20 contains 20 items and five scales and they are (1) enabling and partnership (3 items), (2) providing general information (3 items), (3) providing specific information about the child (5 items), (4) coordinated and comprehensive care for the family and child (4 items), and (5) respectful and supportive care (5 items). Patients respond using a 7-point scale that ranges from “not at all” (score=1) to “to a very great extent” (score=7) [35]. MPOC-20 is a widely used tool in different setups to evaluate the level of FCC. For this study, the Cronbach α was found to be 0.92.

    Oslo-3 Social Support Scale

    The 3 questions of the Oslo-3 Social Support Scale (OSS-3) cover the reported number of close friends, perceived concern, and practical help from others, and the sum score ranges from 3 to 12. Scores 3-7 are considered poor, scores 8-10 as moderate, and scores 11-12 as strong social support [37].

    Data Quality Control

    The principal investigator guided the data collection process. A total of 2 nurses with MSc in nursing were recruited as supervisors. Six MPH or MSc holders were used as the data collectors. Data collectors and supervisors were not a part of the childcare team. Both supervisors and data collectors received training before data collection. During the training, the need for confidentiality and privacy was emphasized. Different pediatric oncology units at St. Paul Millennium Medical College were used as pretest sites.

    Data Processing and Analysis

    The data were collected using the Kobo toolbox data collection tool and exported to SPSS (version 26). Missing values and outliers were checked and corrected. Descriptive statistics were calculated, and the data were presented as tables, graphs, and frequencies. Variables such as family size, number of children in the household, child’s age, duration in months since the child fell ill, and duration in months since the child was diagnosed with cancer were categorized using the first and third quartiles. The strength of the association between the independent and dependent variables was described using the odds ratio with 95% CI. All variables with P values less than .20 during binary logistic regression were considered candidates for the final model. In addition, we considered the clinical relevance of the variables in the multivariate model. The final fitted multivariable logistic regression model was constructed using the enter method. Variables with P values less than .05 were regarded as having a statistically significant association.

    Ethical Considerations

    Ethical clearance was obtained from the Addis Ababa University College of Health Science institutional review board (protocol 022/22/SPH). Permission was also obtained from the TASH pediatric oncology unit. Written informed consent for the interviewee was obtained from each study participant. A private place was used for the interview session to keep the respondents’ privacy. Participants were assured of their right to withdraw from the interview at any time, and participation in this study or refusal to participate would not affect their ability to access health services or any other services. Names and other personal information, which can violate the confidentiality of the study participants, were not recorded. In addition, no compensation was paid to the interviewed participants.


    Sociodemographic Characteristics of Caregivers

    A total of 393 caregivers of children with cancer were approached and 384 caregivers provided complete responses (response rate of 97.7%). The caregivers’ ages ranged from 18 to 75 years, with a median of 35.17 (IQR 28-40) years; 176 (45.8%) were fathers. From 384 caregivers, the majority of the participants were from urban areas (n=233, 60.7%), attended secondary school (n=135, 35.2%), and were employed (n=232, 60.4%). Most of the families (n=350, 91.1%), were married or living together and 267 (30.5%) had a family size of 5 people or more. A total of 64% (248) of the families had 2 to 4 children. The number of caregivers who stated they could save money was 53 (13.8%). Table 1 provides a detailed overview of the participants.

    Table 1. Sociodemographic characteristics of caregivers of children with cancer at the Tikur Anbessa Specialized Hospital pediatric oncology unit from June to December 2022 (n=384).
    Variables and categoryValues, n (%)
    Caregivers’ gender

    		Mother158 (41.1)

    		Father176 (45.8)

    		Othersa50 (13)
    Sex

    		Male205 (53.4)

    		Female179 (46.6)
    Age of the caregiver or guardian (years)

    		≤29106 (27.6)

    		30-39161 (41.9)

    		≥40117 (30.5)
    Place of residence

    		Urban233 (60.7)

    		Rural151 (39.3)
    Employment status

    		Housewife90 (23.4)

    		Currently not employed62 (16.1)

    		Currently employed232 (60.4)
    Caregiver or guardian’s educational level

    		No formal education62 (16.1)

    		Primary education (grades 1 to 8)88 (22.9)

    		Secondary education (grades 9 to 12)135 (35.2)

    		College and above99 (25.8)
    Marital status

    		Currently married or cohabiting350 (91.1)

    		Not married or not cohabiting34 (8.9)
    Family size

    		≤4 family size117 (30.5)

    		≥5 family size267 (69.5)
    Number of children

    		Single child56 (14.6)

    		2-4 children248 (64.6)

    		≥5 children80 (20.8)
    Looking after siblings at home

    		Yes288 (75)

    		No19 (4.9)

    		No one is left at home77 (20.1)
    Income and household expensesb

    		Your household can save money53 (13.8)

    		Your household spends what it earns215 (56)

    		Your household eats into its assets and savings68 (17.7)

    		Your household gets into debt48 (12.5)

    aGrandparent, brother, sister, uncle, and aunt.

    bThe variable was intended to assess the income and expenses of a household, and it is adapted from the Swiss Household Panel survey questionnaire [38].

    Social Support

    The OSS-3 was used to evaluate the extent of social support among caregivers of children with cancer, with 381 participants offering comprehensive responses. Among them, 282 (72.5%) indicated poor social support, 98 (25.2%) reported moderate support, and 1 caregiver reported high social support.

    Characteristics of Children

    Regarding characteristics of children, from the 384 children receiving treatment, the majority (n=227, 59.1%) were male and 78 (20.3%) were older than 10 years. The majority (n=251, 65.4%) of the children were referred to TASH, 357 (93.0%) had no history of relapse, and 325 (84.7%) were receiving treatment. Of 325 children receiving treatment, 247 (69.6%) were getting chemotherapy. Leukemia was the most common cancer type (n=115, 29.6%). From 211 staged cancer cases, 62 (16.1%) were stage IV and 28 (7.3%) were stage III. The median time since the child was ill and diagnosed with cancer was 12 and 7 months, respectively (Table 2).

    Table 2. Characteristics of children receiving cancer treatment at the Tikur Anbessa Specialized Hospital pediatric oncology unit from June to December 2022 (n=384).
    Variables and categoryValues, n (%)
    Child’s sex

    		Male 227 (59.1)

    		Female157 (40.9)
    Child age (years)

    		≤4153 (39.8)

    		5-9153 (39.8)

    		≥1078 (20.3)
    Place child started treatment

    		In this hospital133 (34.6)

    		Referred from other hospital251 (65.4)
    History of relapse

    		Yes27 (7)

    		No357 (93)
    Time in months since the child is ill

    		≤6103 (26.8)

    		7-25204 (53.1)

    		≥2677 (20.1)
    Time in months since your child is diagnosed with cancer

    		≤3104 (27.1)

    		4-18191 (49.7)

    		≥1989 (23.2)
    Child cancer type

    		Solid cancer207 (53.9)

    		Hematological177 (46.1)
    Type of malignancy

    		Leukemia115 (29.9)

    		Wilms’ tumor64 (16.7)

    		Sarcoma53 (13.8)

    		Hodgkin’s lymphoma45 (11.7)

    		Retinoblastoma32 (8.3)

    		Central nervous system30 (7.8)

    		Non-Hodgkin lymphoma9 (2.3)

    		Others36 (9.4)
    Cancer stage

    		Not staged173 (45.2)

    		Stage I59 (15.4)

    		Stage II62 (16.1)

    		Stage III28 (7.3)

    		Stage IV62 (16.1)
    Treatment status

    		On treatment325 (84.6)

    		Waiting to start treatment19 (4.9)

    		Off treatment40 (10.4)
    Type of treatment (n=325)

    		Chemotherapy only247 (76)

    		Other treatment type78 (24)

    Level of Perceived FCC

    The detailed results related to caregivers’ perception of the level of FCC were published [38]. Families provided feedback on the MPOC-20, yielding scores ranging from 1.00 to 6.90 and a mean score of 3.71 (SD 1.04). Among the original 5 domains of the MPOC-20, the highest mean score of 4.81 (SD 1.32) was attributed to respectful and supportive care, followed by coordinated and comprehensive care, with a mean score of 4.64 (SD 1.19). The lowest mean scores were recorded for providing specific information (2.33, SD 0.80) and general information (2.70, SD 1.23).

    Caregivers’ PD

    The total K10 score reported by caregivers ranged from 10 to 50. It was skewed to the right with a mean of 17.30 (SD 8.96; 95% CI 16.84-18.60) and a median of 14 (IQR 10-23). Of a total of 384 interviewed caregivers, 43 (11.2%) had mild, 35 (9.1%) had moderate, and 51 (13.3%) of the caregivers had severe PD. The overall prevalence of mild to severe PD symptoms was 33.6% (95% CI 28.9-38.3)

    Association of FCC and PD

    Logistic regression was used to examine the association of FCC and PD while controlling other variables. During bivariate logistic regression analysis, FCC, place of residence, educational level, level of income and expense, referral from other facilities, history of relapse, time since the child was diagnosed, type of cancer, and treatment status were found to have a significant association with caregivers PD. Variables such as sex of the caregivers, caregiver age, relationship with the child, working status, marital status, child sex, child age, number of children, perceived social support, and family size did not show any association.

    The final multiple logistic regression model included 9 variables with P values less than .05 from the bivariate logistic regression analysis. The model, as explained between 20.3% (Cox and Snell R2) and 28.1% (Nagelkerke R2) of the variance in PD, correctly classified 76.0% of cases. The model fitness test used the Hosmer-Lemeshow statistic, indicating a good model fit (P=.46).

    After controlling for other variables using multiple logistic regression analysis, FCC was significantly associated with PD. Accordingly, caregivers who reported a unit increase in the level of FCC received were found to reduce PD by 32% (adjusted odds ratio [AOR] 0.68, 95% CI 0.53-0.86). In addition, having no formal education (AOR 2.87, 95% CI 1.28-6.45), having a history of relapse (AOR 3.24, 95% CI 1.17-9.02), starting cancer treatment at TASH (AOR 2.82, 95% CI 1.4-4.85), starting treatment within the last 3 months (AOR 3.99, 95% CI 1.73-9.23), and starting treatment within the last 4 to 18 months (AOR 2.68, 95% CI 1.25-5.76) were significantly associated with higher level of PD (see Table 3).

    Table 3. Logistic regression analysis for factors affecting the level of psychological distress among caregivers of children with cancer.
    Variables or characteristicsDistressedCrud ORa (95% CI)Adjusted OR (95% CI)P value

    		YesNo


    Family-centered care (MPOCb-20 mean score), mean (SD)3.45 (1.07)3.85 (1.01)0.69 (0.56-0.85)0.68 (0.53-0.86).001
    Residential place, n (%)

    		Urban63 (27)170 (73)0.47 (0.31-0.73)0.73 (0.42-1.25).25

    		Rural66 (43.7)85 (56.3)ReferenceReference
    Educational status, n (%)

    		No formal education30 (48.4)32 (51.6)3.28 (1.65-6.53)2.87 (1.28-6.45).01

    		Primary education37 (42.0)51 (58.0)2.54 (1.35-4.79)1.83 (0.87-3.83).10

    		Secondary education40 (29.6)95 (70.4)1.47 (0.80-2.69)1.38 (0.71-2.67).35

    		College and above22 (22.2)77 (77.8)ReferenceReference
    Household income and expenses, n (%)

    		Household can save money13 (24.540 (75.5)ReferenceReference

    		Household spends what it earns69 (32.1)164 (67.9)1.45 (0.73-2.89)1.54 (0.70-3.38).29

    		Household eats into its assets and savings19 (27.9)49 (72.1)1.19 (0.53-2.71)0.70 (0.26-1.87).48

    		Household gets into debt28 (58.3)20 (41.7)4.31 (1.84-10.1)2.35 (0.88-6.29).09
    Child cancer type, n (%)

    		Solid cancer81 (39.1)126 (60.9)1.73 (1.12-2.67)1.54 (0.94-2.53).09

    		Hematological48 (27.1129 (72.9)ReferenceReference
    History of relapse, n (%)

    		Yes14 (51.9)13 (51.9)2.26 (1.03-4.98)3.24 (1.17-9.02).02

    		No115 (32.2)242 (32.2)ReferenceReference
    Time since diagnosis (months), n (%)

    		Below 347 (45.2)57 (54.8)3.49 (1.82-6.72)3.99 (1.73-9.23).001

    		4-1865 (34.0)126 (66.0)2.19 (1.19-4.01)2.68 (1.25-5.76).01

    		Above 1917 (19.1)72 (80.9)ReferenceReference
    Treatment status, n (%)

    		Waiting or off treatment11 (18.6)48 (81.4)0.40 (0.20-0.80)0.55 (0.25-1.23).15

    		On treatment118 (36.3)207 (63.7)ReferenceReference
    Place of starting treatment, n (%)

    		In this hospital68 (51.1)65 (48.9)3.26 (2.09-5.09)2.82 (1.64-4.85)<.001

    		Referred from other hospital61 (24.3)190 (75.7)ReferenceReference

    aOR: odds ratio.

    bMPOC: a measure of process of care.


    Principal Findings

    In this study, the relationships between the perception of FCC and PD in caregivers of children with cancer visiting inpatient and outpatient pediatric oncology units were examined. It is the first study to investigate the level of PD using a locally validated standard tool and investigate its association with FCC. To our knowledge, no study has focused on PD among caregivers of children with cancer receiving treatment in both inpatient and outpatient settings in Ethiopia. The study also evaluated the effect of factors related to caregivers’ sociodemographic, child health, and health facility–related factors on PD among caregivers of children with cancer. The findings from this study provide information on the burden of PD and identify the factors contributing to PD among caregivers.

    Our findings show that 1 in 3 interviewed caregivers reported mild to severe PD, which indicates that parenting a child with cancer can profoundly affect caregivers’ mental health. This finding is higher than the 0.3% mild to severe level of distress reported among the general population scored using the K10 in Ethiopia [33]. This justifies the need to include screening for PD as a critical element of comprehensive psychosocial care for caregivers of children with cancer [39]. This is supported by previous studies that state mental health screening and care for caregivers help to improve child health by facilitating communication among health care providers and caregivers [40].

    The level of mild to severe PD in this study was found to be lower than studies conducted in the United States [8], Lebanon [10], Tanzania [13], and Uganda [12]. This difference in the level of PD may be attributed to sociodemographic differences and differences in the measurement tools used. Notably, in this study, unlike in previous studies, most of the participants were fathers. Since the study was conducted in the leading referral hospitals in Ethiopia, the children came from distant parts of the country. Because of this, primarily fathers bring their sick children to hospitals. Multiple studies have reported that fathers have lower levels of parental distress than mothers [41,42]. Another reason might be due to the fact that this study was conducted in a hospital setting where caregivers consider starting treatment as the main achievement in the cancer care process [43]. In Ethiopia, as caregivers have to wait and go through long bureaucracy and referral systems, starting treatment at TASH may have created a sense of satisfaction and increased hope for a cure. This is supported by previous research, which states that beginning treatment is the main reason for lower stress levels [43].

    In this study, caregivers’ perceptions of FCC were found to be protective against PD. Our finding is consistent with other studies that reported the association of a higher level of perceived FCC with decreased mental health problems [21,22]. Similarly, previous studies indicated improved psychological health among caregivers who received FCC-based intervention [24,25]. The main components of FCC, such as the provision of specific and general cancer-related information [43,44], enabling caregivers to participate in childcare and decision-making [45,46], having good communication [24,25], and providing coordinated and comprehensive care, were found to decrease caregivers’ PD. FCC also reduced parental distress caused by lack of information [43], underscoring the importance of considering the complex nature of caregivers’ needs and integrating FCC into pediatric oncology care. FCC can be incorporated into child cancer treatment by offering information and education, preparing families before a child’s procedures, enhancing communication between caregivers and the health care team, and providing adequate support and empowerment for caregivers [24,25,49-53].

    Our findings show caregivers of children with lower educational levels were more likely to have higher levels of PD than more educated caregivers (college and above), which aligns with previous research [11,16]. Education enables individuals to develop fundamental skills, abilities, and resources for more effective health behaviors, helping them to acquire or create effective means of achieving better health [54,55]. On the contrary, a lower educational level may lead to a higher economic burden, a lower understanding of the information provided to caregivers, and a decreased sense of control over an individual’s surroundings [56,57]. In addition, lower education levels might affect caregivers coping mechanisms; more educated people may be better equipped (have better cognitive skills) to deal with the consequences of childhood cancer [4]. This finding indicates the education level of caregivers needs to be considered when preparing and delivering information and care.

    The results of this study also indicated caregivers of children with a history of relapse had higher levels of PD. This is similar to previous studies [58,59]. Caregivers of children with cancer have uncertainties associated with the fear of negative consequences such as relapse or death [60]. The relapse of children with cancer could lead to prolonged uncertainty, negative expectations about disease progression, increased fear of losing their child, and causing poor emotional and mental health [61,62]. Facing the trajectories of childhood cancer for the second time might also be associated with feelings of sadness and frustration, which increases the sense of helplessness, vulnerability, and lack of control over the events [58,62]. All these conditions are associated with adverse mental health conditions.

    Furthermore, relapse may be considered a sign of treatment failure, complications, or poor disease progression [63]. This perception may also play a role in higher levels of distress. Consequently, the overwhelming distress of relapse has the potential to compromise families’ information-processing abilities and further increase their level of PD. Despite this, previous studies have reported that caregivers of children with relapse reported lower levels of distress than the onset of child cancer because of caregivers’ ability to learn faster and having prior information about the possibility of relapse [64]. Therefore, establishing a screening mechanism for caregivers of children with relapse, creating good communication, and providing adequate information about the possibility and management of relapse will help to reduce caregivers’ PD.

    Another child health–related factor that serves as an independent predictor of PD is the duration since diagnosis. Our study revealed caregivers with a shorter period since diagnosis reported higher levels of PD. Similar findings from previous studies show PD is typically higher during the initial diagnosis and gradually decreases over time [2,3,7,8]. This could be attributed to the highly demanding nature of care provided to children with cancer at the time of diagnosis. Caregivers from low-income countries such as Ethiopia have little or no information about what to do when they first hear their child’s diagnosis. As time passes, caregivers gain more understanding and develop some of the skills required to care for their sick child [43]. Thus, this study indicates the importance of providing well-designed psychosocial support, focusing on the time of diagnosis. Caregivers who started treatment for the first time in their current hospital were also found to have more PD than those referred from other hospitals. According to a qualitative study [43] conducted in a similar setting, hospital-related factors such as long waiting time for both diagnosis and treatment, shortage of chemotherapy drugs, and high patient load might be the reason why patients who started treatment at TASH had higher levels of PD.

    Limitation

    This study should be understood in the setting of potential limitations. Because caregivers participated in the study after their child was diagnosed with cancer, the baseline distress level before the diagnosis of their child was not known. To minimize this limitation, caregivers were asked for known mental health conditions and excluded from the study. But still, it was not possible to identify subclinical and undiagnosed cases before a diagnosis of child cancer. Because of the cross-sectional nature of the study design, it is impossible to formulate cause-and-effect relationships among variables. It will be necessary for follow-up studies to include more detailed relationships among variables. Finally, social desirability bias might be introduced since we conducted interview-based surveys.

    Conclusions and Recommendation

    In this study, the mean K10 was 17.30 (SD 8.96). A total of 1 in 3 caregivers has reported mild to severe levels of PD. Receiving a higher level of FCC was found to be protective for parental PD. In addition, lower educational status, history of relapse, and shorter time since diagnosis and starting treatment at TASH were associated with higher levels of PD. The results suggest that screening for PD following a child’s diagnosis may help to identify distressed caregivers early and potentially lead to earlier psychosocial intervention. Furthermore, in developing evidence-based interventions for caregivers of ill children, it is important to understand the potential risk factors for increased parental distress. The risk factors associated with PD found in this study suggest that interventions need to address the needs of lower socioeconomic conditions, caregivers who had children with relapse, and during the early stage of child diagnosis. Furthermore, conducting further studies, including siblings, will help to get more detailed insight into the mental health effects of childhood cancer at the family level.

    Acknowledgments

    The authors would like to acknowledge all study participants for providing their information and tolerance during the interview. The authors would also like to acknowledge pediatric oncology unit staff for their data collection assistance. This work was supported by the Swedish Research Council (Vetenskapsrådet; grant 2017-05410).

    Data Availability

    All data generated or analyzed during this study are included in this published article.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Structured questionniare.

    DOCX File , 57 KB
    1. Price J, Kassam-Adams N, Alderfer MA, Christofferson J, Kazak AE. Systematic review: a reevaluation and update of the integrative (trajectory) model of pediatric medical traumatic stress. J Pediatr Psychol. 2016;41(1):86-97. [CrossRef] [Medline]
    2. Wijnberg-Williams BJ, Kamps WA, Klip EC, Hoekstra-Weebers JEHM. Psychological adjustment of parents of pediatric cancer patients revisited: five years later. Psychooncology. 2006;15(1):1-8. [CrossRef] [Medline]
    3. Vrijmoet-Wiersma CMJ, van Klink JMM, Kolk AM, Koopman HM, Ball LM, Maarten Egeler R. Assessment of parental psychological stress in pediatric cancer: a review. J Pediatr Psychol. 2008;33(7):694-706. [CrossRef] [Medline]
    4. Drapeau A, Marchand A, Beaulieu-Prevost D. Epidemiology of psychological distress. In: Mental Illnesses - Understanding, Prediction and Control. United Kingdom. INTECH Open Access Publisher; 2012.
    5. NCCN guidelines version 1.2022 distress management. National Comprehensive Cancer Network. 2022. URL: https:/​/www.​nccn.org/​docs/​default-source/​patient-resources/​nccn_distress_thermometer.​pdf?sfvrsn=ef1df1a2_4 [accessed 2023-10-27]
    6. Tsai MH, Hsu JF, Chou WJ, Yang CP, Jaing TH, Hung IJ, et al. Psychosocial and emotional adjustment for children with pediatric cancer and their primary caregivers and the impact on their health-related quality of life during the first 6 months. Qual Life Res. 2013;22(3):625-634. [CrossRef] [Medline]
    7. Hardy KK, Bonner MJ, Masi R, Hutchinson KC, Willard VW, Rosoff PM. Psychosocial functioning in parents of adult survivors of childhood cancer. J Pediatr Hematol Oncol. 2008;30(2):153-159. [CrossRef] [Medline]
    8. Rosenberg AR, Dussel V, Kang T, Geyer JR, Gerhardt CA, Feudtner C, et al. Psychological distress in parents of children with advanced cancer. JAMA Pediatr. 2013;167(6):537-543. [FREE Full text] [CrossRef] [Medline]
    9. Cassidy T, McLaughlin M. Psychological distress of female caregivers of significant others with cancer. Cogent Psychology. 2015;2(1):12. [CrossRef]
    10. Lakkis NA, Khoury JM, Mahmassani DM, Ramia MS, Hamadeh GN. Psychological distress and coping strategies in parents of children with cancer in Lebanon. Psychooncology. 2016;25(4):428-434. [CrossRef] [Medline]
    11. Al-Maliki SK, Al-Asadi J, Al-Waely A, Agha S. Prevalence and levels of depression among parents of children with cancer in Basrah, Iraq. Sultan Qaboos Univ Med J. 2016;16(3):e329-e334. [FREE Full text] [CrossRef] [Medline]
    12. Katende G, Nakimera L. Prevalence and correlates of anxiety and depression among family carers of cancer patients in a cancer care and treatment facility in Uganda: a cross-sectional study. Afr Health Sci. 2017;17(3):868-876. [FREE Full text] [CrossRef] [Medline]
    13. Malangwa G, Mangi EJ. Psychological distress factors among caregivers of children receiving cancer therapy, at Muhimbili National Hospital. East Afr Health Res J. 2022;6(1):70-77. [FREE Full text] [CrossRef] [Medline]
    14. Mekonnen H, Gebreyohannis GT, Cherie A. Depression and associated factors among parents of children diagnosed with cancer at Tikur Anbessa Specialized Hospital, Addis Ababa, Ethiopia. Psycho-Oncology. 2020;29(7):1141-1147. [CrossRef]
    15. Haverman L, van Oers HA, Limperg PF, Houtzager BA, Huisman J, Darlington AS, et al. Development and validation of the distress thermometer for parents of a chronically ill child. J Pediatr. 2013;163(4):1140-1146.e2. [CrossRef] [Medline]
    16. Choi EK, Yoon SJ, Kim JH, Park HJ, Kim JY, Yu ES. Depression and distress in caregivers of children with brain tumors undergoing treatment: psychosocial factors as moderators. Psychooncology. 2016;25(5):544-550. [CrossRef] [Medline]
    17. Al Qadire M, Aloush S, Alkhalaileh M, Qandeel H, Al-Sabbah A. Burden among parents of children with cancer in Jordan: prevalence and predictors. Cancer Nurs. 2020;43(5):396-401. [CrossRef] [Medline]
    18. Cusinato M, Calvo V, Bisogno G, Viscardi E, Pillon M, Opocher E, et al. Attachment orientations and psychological adjustment of parents of children with cancer: a matched-group comparison. J Psychosoc Oncol. 2017;35(6):726-740. [CrossRef] [Medline]
    19. Sultan S, Leclair T, Rondeau E, Burns W, Abate C. A systematic review on factors and consequences of parental distress as related to childhood cancer. Eur J Cancer Care (Engl). 2016;25(4):616-637. [FREE Full text] [CrossRef] [Medline]
    20. Smith W. Concept analysis of family-centered care of hospitalized pediatric patients. J Pediatr Nurs. 2018;42:57-64. [CrossRef] [Medline]
    21. Morishita M, Kamibeppu K. Quality of life and satisfaction with care among family caregivers of patients with recurrent or metastasized digestive cancer requiring palliative care. Support Care Cancer. 2014;22(10):2687-2696. [CrossRef] [Medline]
    22. Acri M, Bornheimer LA, Jessell L, Flaherty HB, McKay MM. The impact of caregiver treatment satisfaction upon child and parent outcomes. Child Adolesc Ment Health. 2016;21(4):201-208. [FREE Full text] [CrossRef] [Medline]
    23. Dix DB, Klassen AF, Papsdorf M, Klaassen RJ, Pritchard S, Sung L. Factors affecting the delivery of family-centered care in pediatric oncology. Pediatr Blood Cancer. 2009;53(6):1079-1085. [CrossRef] [Medline]
    24. Ivéus K, Eklund R, Kreicbergs U, Lövgren M. Family bonding as a result of the family talk intervention in pediatric oncology: siblings' experiences. Pediatr Blood Cancer. 2022;69(3):e29517. [CrossRef] [Medline]
    25. Feraco AM, McCarthy SR, Revette AC, Stevens SE, Das PJ, Al-Sayegh H, et al. Feasibility and acceptability of the "Day 100 Talk": an interdisciplinary communication intervention during the first six months of childhood cancer treatment. Cancer. 2021;127(7):1134-1145. [FREE Full text] [CrossRef] [Medline]
    26. Memirie ST, Habtemariam MK, Asefa M, Deressa BT, Abayneh G, Tsegaye B, et al. Estimates of cancer incidence in Ethiopia in 2015 using population-based registry data. J Glob Oncol. 2018;4:1-11. [FREE Full text] [CrossRef] [Medline]
    27. Hailu D, Fufu Hordofa D, Adam Endalew H, Karimi Mutua D, Bekele W, Bonilla M, et al. Training pediatric hematologist/oncologists for capacity building in Ethiopia. Pediatr Blood Cancer. 2020;67(12):e28760. [CrossRef] [Medline]
    28. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SLT, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med. 2002;32(6):959-976. [CrossRef] [Medline]
    29. Information paper: use of the Kessler Psychological Distress Scale in ABS health surveys, Australia, 2007-08. Australian Bureau of Statistics. 2007. URL: https://www.abs.gov.au/ausstats/abs@.nsf/Lookup/4817.0.55.001Chapter92007-08 [accessed 2024-05-26]
    30. Andrews G, Slade T. Interpreting scores on the Kessler Psychological Distress Scale (K10). Aust N Z J Public Health. 2001;25(6):494-497. [FREE Full text] [CrossRef] [Medline]
    31. Donker T, Comijs H, Cuijpers P, Terluin B, Nolen W, Zitman F, et al. The validity of the Dutch K10 and extended K10 screening scales for depressive and anxiety disorders. Psychiatry Res. 2010;176(1):45-50. [CrossRef] [Medline]
    32. Merson F, Newby J, Shires A, Millard M, Mahoney A. The temporal stability of the Kessler Psychological Distress Scale. Aust Psychol. 2021;56(1):38-45. [CrossRef]
    33. Milkias B, Ametaj A, Alemayehu M, Girma E, Yared M, Kim HH, et al. Psychometric properties and factor structure of the Kessler-10 among Ethiopian adults. J Affect Disord. 2022;303:180-186. [FREE Full text] [CrossRef] [Medline]
    34. Tesfaye M, Hanlon C, Wondimagegn D, Alem A. Detecting postnatal common mental disorders in Addis Ababa, Ethiopia: validation of the edinburgh postnatal depression scale and Kessler scales. J Affect Disord. 2010;122(1-2):102-108. [CrossRef] [Medline]
    35. King G, Kertoy M, King S, Law M, Rosenbaum P, Hurley P. A measure of parents' and service providers' beliefs about participation in family-centered services. Children's Health Care. 2003;32(3):191-214. [CrossRef]
    36. Cunningham BJ, Rosenbaum PL. Measure of processes of care: a review of 20 years of research. Dev Med Child Neurol. 2014;56(5):445-452. [FREE Full text] [CrossRef] [Medline]
    37. Dalgard OS, Bjørk S, Tambs K. Social support, negative life events and mental health. Br J Psychiatry. 1995;166(1):29-34. [CrossRef] [Medline]
    38. Panczak R, Galobardes B, Voorpostel M, Spoerri A, Zwahlen M, Egger M, et al. A Swiss neighbourhood index of socioeconomic position: development and association with mortality. J Epidemiol Community Health. 2012;66(12):1129-1136. [FREE Full text] [CrossRef] [Medline]
    39. Carlson LE, Waller A, Mitchell AJ. Screening for distress and unmet needs in patients with cancer: review and recommendations. J Clin Oncol. 2012;30(11):1160-1177. [CrossRef] [Medline]
    40. Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol. 2004;22(4):714-724. [CrossRef] [Medline]
    41. Masa'Deh R, Collier J, Hall C. Parental stress when caring for a child with cancer in Jordan: a cross-sectional survey. Health Qual Life Outcomes. 2012;10:88. [FREE Full text] [CrossRef] [Medline]
    42. Lindahl Norberg A, Pöder U, Ljungman G, von Essen L. Objective and subjective factors as predictors of post-traumatic stress symptoms in parents of children with cancer--a longitudinal study. PLoS One. 2012;7(5):e36218. [FREE Full text] [CrossRef] [Medline]
    43. Deribe L, Addissie A, Girma E, Abraha A, Adam H, Berbyuk Lindström N. Stress and coping strategies among parents of children with cancer at Tikur Anbessa Specialized Hospital paediatric oncology unit, Ethiopia: a phenomenological study. BMJ Open. 2023;13(1):e065090. [FREE Full text] [CrossRef] [Medline]
    44. Gårdling J, Törnqvist E, Edwinson Månsson M, Hallström I. Parents' lived experiences during their children's radiotherapy. J Pediatr Oncol Nurs. 2017;34(2):140-147. [CrossRef] [Medline]
    45. Wang J, Howell D, Shen N, Geng Z, Wu F, Shen M, et al. mHealth supportive care intervention for parents of children with acute lymphoblastic leukemia: quasi-experimental pre- and postdesign study. JMIR Mhealth Uhealth. 2018;6(11):e195. [FREE Full text] [CrossRef] [Medline]
    46. Khosrobeigi M, Hafezi F, Naderi F, Ehteshamzadeh P. The effectiveness of reality therapy on resilience and psychological distress in parents of children with cancer. Clin Schizophr Relat Psychoses. 2021;15:1-13. [CrossRef]
    47. Deribe L, Addissie A, Girma E, Gidey A, Teferra S, Lindström NB. Level of family centered care and associated factors among parents of children with cancer at tertiary level hospital, Ethiopia. J Pediatr Nurs. 2024;76:e69-e76. [CrossRef] [Medline]
    48. Krisnana I, Sulistyarini H, Diyan Rachmawati P, Arief YS, Dwi Kurnia I. Reducing acute stress disorders in mothers of leukemic children by means of the family centered empowerment module (FACE). Cent Eur J Nurs Midw. 2019;10(2):1035-1040. [CrossRef]
    49. Ångström-Brännström C, Lindh V, Mullaney T, Nilsson K, Wickart-Johansson G, Svärd AM, et al. Parents' experiences and responses to an intervention for psychological preparation of children and families during the child's radiotherapy. J Pediatr Oncol Nurs. 2018;35(2):132-148. [CrossRef] [Medline]
    50. Shoghi M, Shahbazi B, Seyedfatemi N. The effect of the family-centered empowerment model (FCEM) on the care burden of the parents of children diagnosed with cancer. Asian Pac J Cancer Prev. 2019;20(6):1757-1764. [FREE Full text] [CrossRef] [Medline]
    51. Hockenberry M, Haugen M, Slaven A, Skeens M, Patton L, Montgomery K, et al. Pediatric education discharge support strategies for newly diagnosed children with cancer. Cancer Nurs. 2021;44(6):E520-E530. [FREE Full text] [CrossRef] [Medline]
    52. Boshagh F, Hakim A, Alghasi A, Haghighizadeh MH. Effect of family-centered empowerment model on knowledge and caring performance of mothers of children with leukemia: a randomized clinical trial. Jundishapur J Chronic Dis Care. 2022;11(3):e116854. [CrossRef]
    53. Porter LS, Baucom DH, Bonner M, Linardic C, Kazak AE. Parenting a child with cancer: a couple-based approach. Transl Behav Med. 2019;9(3):504-513. [FREE Full text] [CrossRef] [Medline]
    54. Mirowsky J. Education, Social Status, and Health. New York. Routledge; 2017.
    55. Muñoz IG, Santos-Lozada AR. Educational attainment and psychological distress among working-age adults in the United States. SSM Ment Health. 2021;1:100003. [FREE Full text] [CrossRef] [Medline]
    56. Akgul N, Ozdemir L. Caregiver burden among primary caregivers of patients undergoing peripheral blood stem cell transplantation: a cross sectional study. Eur J Oncol Nurs. 2014;18(4):372-377. [CrossRef] [Medline]
    57. Lau S, Lu X, Balsamo L, Devidas M, Winick N, Hunger SP, et al. Family life events in the first year of acute lymphoblastic leukemia therapy: a children's oncology group report. Pediatr Blood Cancer. 2014;61(12):2277-2284. [FREE Full text] [CrossRef] [Medline]
    58. Jurbergs N, Long A, Ticona L, Phipps S. Symptoms of posttraumatic stress in parents of children with cancer: are they elevated relative to parents of healthy children? J Pediatr Psychol. 2009;34(1):4-13. [FREE Full text] [CrossRef] [Medline]
    59. Bruce M, Gumley D, Isham L, Fearon P, Phipps K. Post-traumatic stress symptoms in childhood brain tumour survivors and their parents. Child Care Health Dev. 2011;37(2):244-251. [CrossRef] [Medline]
    60. Davies J, O’Connor M. Mothers’ experiences post-childhood cancer treatment: a qualitative study. J Child Fam Stud. 2022;32(9):2614-2624. [CrossRef]
    61. Björk M, Wiebe T, Hallström I. Striving to survive: families' lived experiences when a child is diagnosed with cancer. J Pediatr Oncol Nurs. 2005;22(5):265-275. [CrossRef] [Medline]
    62. Arruda-Colli MNFD, Lima RAGD, Perina EM, Santos MAD. A recidiva do câncer pediátrico: um estudo sobre a experiência materna. Psicol. USP. 2016;27(2):307-314. [CrossRef]
    63. de Graves S, Aranda S. Living with hope and fear--the uncertainty of childhood cancer after relapse. Cancer Nurs. 2008;31(4):292-301. [CrossRef] [Medline]
    64. Carlsson T, Kukkola L, Ljungman L, Hovén E, von Essen L. Psychological distress in parents of children treated for cancer: an explorative study. PLoS One. 2019;14(6):e0218860. [FREE Full text] [CrossRef] [Medline]

    ‎
    AOR: adjusted odds ratio
    FCC: family-centered care
    K10: Kessler Psychological Distress Scale
    MPOC-20: Measure of Processes of Care
    NCCN: National Comprehensive Cancer Network
    OSS-3: Oslo-3 Social Support Scale
    PD: psychological distress
    TASH: Tikur Anbessa Specialized Hospital

    Edited by N Cahill; submitted 20.11.23; peer-reviewed by M Jarfelt, AW Abate; comments to author 17.04.24; revised version received 26.05.24; accepted 30.07.24; published 10.10.24.

    Copyright

    ©Leul Deribe, Eshetu Girma, Nataliya Lindström, Abdulkadir Gidey, Solomon Teferra, Adamu Addissie. Originally published in JMIR Cancer (https://cancer.jmir.org), 10.10.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Cancer, is properly cited. The complete bibliographic information, a link to the original publication on https://cancer.jmir.org/, as well as this copyright and license information must be included.