Background: Health-related quality of life (HRQoL) is used to evaluate the treatment of metastatic breast cancer. In a long-term therapy setting, HRQoL can be used as an important benchmark for treatment success. With the help of digital apps, HRQoL monitoring can be extended to more remote areas and be administered on a more frequent basis.
Objective: This study aims to evaluate 3 common HRQoL questionnaires in metastasized breast cancer in terms of TTD in a digital, web-based setting. We further aim to examine the development of the HRQoL in different systemic treatment groups in each of these evaluation instruments.
Methods: A total of 192 patients with metastatic breast cancer were analyzed in this bicentric prospective online cohort study at two German university hospitals. Patients completed questionnaires on HRQoL (EuroQol Visual Analog Scale [EQ-VAS], EuroQol 5 Dimension 5 Level [EQ-5D-5L], European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Core 30 item [EORTC QLQ-C30]) via an online platform over a 6-month period. Treatment schedules and medical history were retrieved from medical records. Unadjusted Cox regression analysis on treatment-related factors was performed. We conducted subgroup analyses in regard to TTD events between different treatments.
Results: The EQ-VAS showed a higher rate of deterioration after 8 weeks (84/179, 46.9%) than the EQ-5D-5L (47/163, 28.8%) and EORTC QLQ-C30 (65/176, 36.9%). Unadjusted Cox regression revealed significant connections between known metastases in the liver (P=.03, HR 1.64, 95% CI 1.06-2.52) and pleura (P=.04, HR 0.42, 95% CI 0.18-0.96) in the EQ-VAS. Significant relations between EQ-VAS events and single EQ-5D-5L items and the EQ-5D-5L summary score were demonstrated. All treatment groups significantly differed from the CDK4/6 inhibition subgroup in the EQ-VAS.
Conclusions: Compared to the EQ-5D-5L and QLQ-C30, the EQ-VAS showed a higher rate of deterioration after 8 weeks. Significant connections to certain metastatic locations were only detected in the EQ-VAS. The EQ-VAS is capable of reflecting the distinctive HRQoL profiles of different systemic treatments as well as the different aspects of HRQoL presented in the EQ-5D-5L. TTD with the EQ-VAS is an adequate mean of examining longitudinal development of HRQoL among breast cancer patients.
Breast cancer is the most common cancer in women, with 1 in 8 women being affected throughout their lifetime . Although there has been significant progress made both in detection and treatment, the prognosis of metastatic breast cancer remains poor. The more severe the disease, the more important palliative treatment options become that offer an acceptable health-related quality of life (HRQoL) while still providing the patient with individually optimized and life prolonging treatments [ ]. There is a strong connection between HRQoL and factors such as progression of disease, progression-free survival, and the experience of adverse events during therapy [ - ]. In addition, HRQoL measurements can help with doctor-patient communication and can even be beneficial to the HRQoL itself when discussing the assessments with the physician [ ]. Moreover, patients with fulfilled information needs or higher satisfaction with the received information may also display a higher degree of HRQoL [ ].
Various factors can influence a patient’s HRQoL making it a variable that is both difficult to unify and to diversify. The concept can mean something different to every patient, leading to a variety of interpretative possibilities. Therefore, the concept of HRQoL bares the difficulty of objectifying its content for practical decision making in medical practice. Aspects that play into the concept of HRQoL in modern medicine can vary from independence, stage of disease, the amount and severity of drug side effects to even personal fulfillment. As diverse as the topic itself are the options of evaluating it . In recent years an emphasis has been made on patient-reported outcomes (PRO) as a means of collecting HRQoL data. PROs are characterized by the fact that several validated questionnaires are used simultaneously for HRQoL measurement in order to balance the respective subjectivity [ ].
A PRO is “a measurement based on a report that comes directly from the patient (ie, study subject) about the status of a patient’s health condition without amendment or interpretation of the patient’s response by a clinician or anyone else” . They are an effective module in assessing a patient’s well-being using paper-based and digital data collection [ ]. They are useful in identifying patient distress and assessing new therapeutic methods and can hence improve care [ , ]. A previous study also observed a benefit in overall survival for patients who self-reported their symptoms in an online setting [ ]. However, PRO data depend on factors that may not be health-related or influenced by individual values or other passing momentary conditions [ ]. In addition, practical aspects can influence HRQoL data collection. An overflow of long questionnaires can influence compliance and motivation [ , ]. Furthermore, several studies have reported poor compliance in long-term studies [ , ]. While the findings did not show conclusively if compliance was dependent on the questionnaire format (visual analog or categorical) [ ], the chosen evaluative instrument can have an influence on people’s perception and adoption of it [ ]. These issues play an important role when administering studies digitally, especially to a less technically inclined collective, such as older patients [ ].
Therapeutic decision making, especially in palliative care, can depend on the patient’s reporting of their HRQoL. As data suggest that clinicians may underestimate or miss a large part of adverse effects, there is a need for more clarity in physicians’ evaluation of patient-reported content [- ]. Changes and time to deterioration (TTD) in HRQoL have previously been used to further assess the benefits of cancer medication [ , ], again emphasizing the high potential of a differentiated evaluation of HRQoL assessments in cancer research. With metastatic breast cancer patients usually being treated for a longer period of time at the same care center, detecting change in patient-reported HRQoL presents a type of measurement that allows for long-term HRQoL screening in addition to isolated assessments. Exploring the longitudinal development of HRQoL with the TTD method may help uncover influential factors on HRQoL as well as predictive capabilities of such measurements [ ]. The introduction of digital monitoring systems in the area of HRQoL offers new possibilities in reaching out to patients struggling with the effects of metastatic breast cancer and extend medical care to remote areas. However, the digital application of a longitudinal measurement system needs to be evaluated in terms of effectiveness, acceptance and presentation. Low compliance can be a challenge in longitudinal digital studies [ ], and aspects concerning patients’ expectation regarding quality of life such as response shift can influence the TTD [ ].
This study aimed to evaluate 3 common HRQoL questionnaires (EuroQol Visual Analog Scale [EQ-VAS], EuroQol 5 Dimension 5 Level [EQ-5D-5L], European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Core 30 item [EORTC QLQ-C30]) in a sample of women with metastasized breast cancer in terms of TTD in a digital, web-based setting. We further examined the development of the HRQoL in different systemic treatment groups.
Study Design and Sample
The PEPPER study (Patient Engagement Pilotstudie Mammakarzinom-individualisierte und Ressourcen-effiziente Patient-Reported Outcomes Erfassung durch digitale Therapieunterstuetzungssysteme) was conducted from December 2016 to August 2019 at two German university hospitals (University Hospitals of Heidelberg and Tübingen). It was designed as a bicentric prospective cohort study collecting longitudinal information on HRQoL, physical symptoms, and PROs of metastatic breast cancer patients via the online platform PiiA (Patient-informiert-interaktiv-Arzt,) over a 6-month period. The assessments were scheduled weekly for the first 8 weeks of the cohort study and 4 times monthly for the last 4 months (see ). The digital assessment of QoL allowed for evaluation not bound to treatment schedule and the inclusion of patients not living in close proximity to the care center. Participants were identified through a screening process of their medical history and then approached at their next scheduled appointment. Criteria of eligibility were ≥18 years of age, a sufficient level of the German language, metastatic breast cancer in progressive or stable state of disease undergoing any form of systemic therapy, patients with therapy change, active enrollment in the PRAEGNANT study (a German metastatic breast cancer registry network), and written consent. Exclusion criteria covered patients who were not eligible for observation due to severe comorbidities or unavailability according to the treating physician, patients who were not able to handle a tablet computer or were unable to write as well as patients who were not able to understand the nature and extent of the trial and the procedures required.
The patients assessed for eligibility were radiologically assessed for disease progression every 3 months until death or loss to follow-up using the Response Evaluation Criteria in Solid Tumors . The patients assessed for eligibility were divided into 2 subgroups—patients with stable disease or partial response and those with early progressive disease at the first trimonthly follow-up evaluation.
Upon confirmation of participation, patients were asked to complete the baseline visit on-site on a tablet provided by the staff. Skilled staff was available throughout the baseline visit in person and via email during the entire study period to provide technical support. Further parts of the study were completed on their preferred device at home. Participants of the study were reminded of upcoming or uncompleted visits via email or telephone. The study was conducted in German. Ethics approval was granted by the ethical committees of the University of Heidelberg (S-598/2016) and Tübingen (191/2017BO2).
aEQ-VAS: EuroQol Visual Analog Scale.
bEQ-5D-5L: EuroQol 5 Dimension 5 Level.
cEORTC QLQ-C30: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30 item.
Quantitative Data Collection and Questionnaires
Sociodemographic data was gathered at baseline via the online platform PiiA. In addition, treatment regiments and medical history were retrieved by analyzing medical records of the particular university hospital. To evaluate the QoL of the patients, 3 assessment instruments were used in this study.
We administered 3 common HRQoL questionnaires (EQ-VAS, EQ-5D-5L, EORTC QLQ-C30) over a 6-month period (see). A TTD event is defined as the decline in HRQoL score in the respective questionnaire score by the corresponding minimally important difference (MID) in comparison to the baseline score.
The EQ-VAS is a global self-evaluation of the state of health on a visual analog scale from 0 (worst imaginable state of health) to 100 (best imaginable state of health). It thereby offers a global and momentary insight into the patients’ overall self-reported well-being. The EQ-VAS can be administered as part of the EQ-5D questionnaire [, ]. A difference of ≥7 points was the MID for deterioration detection, which has previously been established in similar studies [ , , , ].
The EQ-5D-5L is a validated questionnaire consisting of 5 questions, each with 5 options, encompassing aspects such as mobility and self-reliance as parts of its HRQoL definition . The EQ-5D-5L is a validated instrument in assessing HRQoL in German [ , ] and has shown to be of use in detecting changes in the state of health of breast cancer patients [ ]. The EQ-5D-5L can be summarized using a score ranking from <0 (worst possible HRQoL) to 1 (best possible HRQoL) [ ]. A decrease in ≥0.08 points was regarded as a MID for deterioration as described previously [ , , , ]. The average completion time for the EQ-5D-5L ranges from 25 to 75 seconds, while the EQ-VAS can be answered in just 5 to 15 seconds.
The EORTC QLQ-C30 constitutes a more detailed questionnaire in regard to HRQoL and is a valid tool in measuring the HRQoL in cancer patients . Consisting of 30 items, the EORTC QLQ-C30 encompasses 5 questions about self-reliance in everyday situations, 23 questions about physical complaints and their impact on HRQoL and social interactions on 4-point Likert scales as well as two global items on the HRQoL and state of health, each on a 7-point Likert scale. The average time to completion of this questionnaire is estimated to range from 150 to 450 seconds. The QLQ-C30 is summed up using a summary score [ ]. The questionnaire has previously been found to be a valid instrument in assessing HRQoL in breast cancer patients via an eHealth medium [ ]. In accordance with similar studies, a decline of ≥10 points was regarded as deterioration [ , , - ]. The pattern, in which questionnaires were implemented in the study, is depicted in .
Treatment Line Grouping
Data about their current treatment regime was assembled from the participants’ medical history. The various lines of treatment were divided into the following 4 groups: cyclin-dependent kinase (CDK) 4/6 inhibition therapy (including any form of endocrine therapy in combination with a CDK4/6 inhibitor), human epidermal growth factor receptor 2 (HER2)-targeted therapy (including trastuzumab, pertuzumab, trastuzumab emtansine, and lapatinib alone or in combination with chemotherapy), chemotherapy (intravenous or oral) alone, and endocrine therapy alone.
We used the programming language R (version 3.6.1, R Foundation for Statistical Computing) for all analyses . Socioeconomic characteristics, questionnaire data, and treatment schedules were first described descriptively using absolute and relative frequencies, means, and standard deviations.
TTD was defined as time to the first clinically meaningful deterioration in the respective HRQoL assessment tool and was illustrated using Kaplan-Meier plots. Furthermore, univariable, unadjusted Cox regression was applied to examine the influence of state of disease and similar characteristics on the TTD for all questionnaires. Moreover, we examined the aforementioned systemic treatment groups as to their TTD events for the EQ-VAS and the EQ-5D-5L using unadjusted Cox regression. Furthermore, predetermined systemic treatment groups within each HRQoL questionnaire were compared using linear mixed models.
Thereupon, EQ-VAS scores were compared to the different questions of the EQ-5D-5L as well as to the EQ-5D-5L summary score. For the patients who experienced a TTD event in the EQ-VAS, the difference of the values between the time of the event and the baseline visit in the respected EQ-5D-5L item were compared by applying the 1-sample Wilcoxon signed-rank test. Thereafter, this difference was compared to the differences of patients without a TTD event using the 2-sample Wilcoxon rank-sum test. In all analyses, P<.05 (2-tailed) was considered indicative of statistically significant differences.
Sociodemographic Characteristics and State of Disease
A total of 192 patients with metastatic breast cancer were analyzed in this bicentric prospective online cohort study at two German university hospitals. During the first 8 weeks of the study, 21.9% (42/192) of participants completed every visit with a satisfactory completion rate of ≥80% showing a considerable loss of patients during follow-up in the overall study. However, the percentage of completed questionnaires after 8 weeks in comparison to baseline was higher with 62.7% (104/166) for the EQ-VAS, 73.2% (82/112) for the EQ-5D, and 62.4% (103/165) for the QLQ-C30. The number of completed questionnaires for each visit are included in. The sociodemographic characteristics of this collective are shown in . The average age at study inclusion was 54.3 years. A total of 49.5% (95/192, 25 missing) of patients had a high education level (university entrance qualification or higher), and 69.8% (134/192, 25 missing) received public health insurance.
|Age at study inclusion (years), mean (SD)||54.3 (10.1)|
|Age at primary diagnosis (years), mean (SD)||47.3 (10.0)|
|Education, n (%)|
|University entrance qualification or higher||95 (49.5)|
|Lower than university entrance||72 (37.5)|
|Health insurance, n (%)|
|Marital status, n (%)|
|Married/in a relationship||142 (74.0)|
|Not married/in a relationship||23 (12.0)|
|Children, n (%)|
The mean age of initial diagnosis was 47.3 years. The average duration between initial diagnosis and study inclusion was 66.6 months. A total of 29.7% (57/192, 57 missing) of patients were already in metastatic stage at initial diagnosis of breast cancer. Further information on the metastatic situation at study enrollment and state of disease of the primary tumor according to TNM classifications can be seen in.
The median number of different treatment regiments before inclusion was 3 (range 0-13, Q1-Q3 2-4) and on average patients received 1 (0-10, 1-2) different chemotherapeutic treatment lines prior to enrollment in the study. Within the first 3 months of study participation, 46 patients (46/192, 24.0%, 11 missing) were diagnosed with disease progression and 21 patients (21/192, 10.9%, 10 missing) experienced a change in treatment. The systemic treatment line patients followed throughout this period is shown in.
|Difference between initial diagnosis of breast cancer and study inclusion (months), median (Q1-Q3)||66.6 (29.4-127.4)|
|Difference between initial diagnosis of breast cancer metastases and study inclusion (months), median (Q1-Q3)||21.5 (6.8-40.1)|
|Characteristics of primary tumor (TNM classification), n (%)|
|Other or N/A||57 (29.7)|
|Other or N/A||83 (43.2)|
|Breast cancer subtype of primary tumor, n (%)|
|Hormone receptor positive + HER2e neu negative||101 (52.6)|
|HER2 neu positive||63 (32.8)|
|Triple negative||14 (7.3)|
|Metastases diagnosed at study inclusion, n (%)|
|Lymph nodes||53 (27.6)|
|Previous treatment regiments before study inclusion (Q1-Q3)|
|Number of treatment regiments, median||3 (2-4)|
|Number of chemotherapeutic treatment lines, median||1 (1-2)|
|Systemic treatment groups during study period, n (%)|
|CDKf 4/6 inhibitors +/– endocrine therapy||41 (21.4)|
|Endocrine therapy||18 (9.4)|
|HER2-targeted therapy||54 (28.1)|
ac/y/pT: Clinical/after neoadjuvant therapy/pathologic classification of tumor extent and size.
bPT: Primary tumor.
cc/y/pN: Clinical/after neoadjuvant therapy/pathologic classification of regional lymph node involvement.
dM: Metastatic spread.
eHER2: human epidermal growth factor receptor 2.
fCDK: cyclin-dependent kinase.
shows the overall state of health at the different visits. On average, patients reported a health status in the upper half of the possible range in each of the questionnaires and at all visits. Furthermore, the differences observed throughout the 6-month study period are fairly small in all questionnaires, indicating a low degree of change in HRQoL during the study period. The EQ-VAS consistently showed a higher variance than the other questionnaires during the entire study period.
TTD With Regression Results
The rate of deterioration (number of patients with deterioration divided by the total number of patients) amounted to 0.47 in the EQ-VAS (84/179), representing the highest rate of TTD events in our sample with an average TTD of 8 weeks. We could identify a rate of deterioration of 0.29 (47/163) in the EQ-5D-5L and 0.37 (65/176) in the QLQ-C30.
Univariate Cox regression analysis on pathologic and treatment-related factors showed a connection between known metastases in the liver (P=.03) and pleura (P=.04) at the time of study inclusion and deterioration, as well as a vague link to the clinical diagnoses of disease progression within the first 3 months of the study in the EQ-VAS (P=.11). As can be seen in, patients with diagnosed disease progression (hazard ratio [HR] 1.48) showed a higher rate of TTD events in the EQ-VAS than in case of no progression with a nonsignificant P value (P=.11), as seen in . For the other questionnaires, we could not detect a link between the reviewed criteria and deterioration. The results of the univariate Cox regression analysis can be found in . A univariate Cox regression analysis with results adjusted for age and progression can be found in .
|Hazard ratio (95% CI)||P value||Hazard ratio (95% CI)||P value||Hazard ratio (95% CI)||P value|
|Age||0.99 (0.97-1.02)||.583||0.98 (0.95-1.01)||.20||1.00 (0.98-1.03)||.83|
|Brain||1.71 (0.74-3.94)||.21||0.32 (0.04-2.31)||.26||1.16 (0.42-3.2)||.78|
|Lymph nodes||1.20 (0.77-1.87)||.42||1.42 (0.79-2.54)||.23||0.95 (0.56-1.63)||.86|
|Bone||0.83 (0.54-1.29)||.41||0.85 (0.47-1.53)||.59||1.4 (0.81-2.43)||.22|
|Lung||1.09 (0.69-1.69)||.71||0.73 (0.39-1.37)||.33||0.97 (0.57-1.65)||.91|
|Pleura||0.42 (0.18-0.96)||.04||0.43 (0.13-1.39)||.16||0.90 (0.41-1.98)||.79|
|Liver||1.64 (1.06-2.52)||.03||1.67 (0.94-2.99)||.08||0.87 (0.51-1.47)||.61|
|Peritoneum||0.96 (0.35-2.63)||.94||0.78 (0.19-3.2)||.73||1.39 (0.5-3.84)||.52|
|Skin||0.55 (0.2-1.52)||.25||0.82 (0.25-2.65)||.74||0.41 (0.1-1.7)||.22|
|Other||0.67 (0.32-1.39)||.28||0.73 (0.26-2.04)||.55||1.79 (0.93-3.46)||.08|
|Progression||1.48 (0.91-2.37)||.11||1.15 (0.60-2.23)||.34||1.05 (0.58-1.88)||.88|
|CDKd 4/6 inhibitors +/– endocrine therapy||Reference||Ref||Ref||Ref||Ref||Ref|
|Chemotherapy||1.72 (0.77-3.85)||.19||1.48 (0.41-5.32)||.55||0.43 (0.2-0.94)||.03|
|Endocrine therapy||2.29 (0.93-5.65)||.07||0.69 (0.11-4.21)||.69||0.60 (0.25-1.5)||.29|
|HER2e-targeted therapy||1.7 (0.76-3.83)||.20||1.42 (0.38-5.4)||.60||0.54 (0.25-1.15)||.11|
aEQ-VAS: EuroQol Visual Analog Scale.
bEQ-5D-5L: EuroQol 5 Dimension 5 Level.
cEORTC QLQ-C30: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Core 30 item.
dCDK: cyclin-dependent kinase.
eHER2: human epidermal growth factor receptor 2.
Systemic Treatment Groups
We divided the patients into 4 groups according to the treatment that they received during the first 3 months of the study. We then proceeded to use Cox regression to compare the subgroups with each other in terms of the TTD. This revealed a difference between CDK4/6 inhibitor therapy and mere endocrine therapy in the EQ-VAS (P=.07) and between CDK4/6 inhibitor therapy and chemotherapy in the QLQ-C30 (P=.03; see).
Using a linear mixed model, we proceeded to compare the predetermined systemic treatment groups within each HRQoL questionnaire. For the EQ-VAS and EQ-5D-5L, a significant difference between treatment groups could be detected. In the EQ-VAS, all treatment groups showed a significant difference in comparison to CDK4/6 inhibitor therapy during the examination period (see). A similar difference showed in our analyses of these subgroups using the QLQ-C30 summary score. An increase in the difference of EQ-VAS values in comparison to baseline is visible for patients receiving CDK4/6 inhibitors. For the EQ-5D-5L, a significant difference between patients receiving chemotherapy and HER2-targeted therapy could be encountered. All results of the subgroup analysis can be examined in .
|Group comparison||EQ-VASa (0-100)||EQ-5D-5Lb (0-1)||EORTC QLQ-C30c (0-100)|
|Estimate||P value||Estimate||P value||Estimate||P value|
aEQ-VAS: EuroQol Visual Analog Scale.
bEQ-5D-5L: EuroQol 5 Dimension 5 Level.
cEORTC QLQ-C30: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire–Core 30 item.
Event Comparison Between the EQ-VAS and the EQ-5D-5L and Patients Without TTD Events
For each patient who showed deterioration in the EQ-VAS, a Wilcoxon signed-rank test with continuity correction was conducted to examine whether significant differences in singular questions and the summary score of the EQ-5D-5L could be detected. Init can be seen that for several EQ-5D-5L items such a significant relation could be registered. Thereupon, a 2-sample Wilcoxon rank-sum test was performed comparing the deteriorating patients to the rest of the sample group to further differentiate between significant subgroup and collective deterioration. The results are depicted in .
|EQ-5D-5La scale||Event: baseline||Event: remaining time steps|
|Mean difference (CI)||P valueb||Mean difference (CI)||P valuec|
|Mobility||0.28 (0.09 to 0.48)||.005||0.34 (0.14 to 0.54)||.001|
|Selfcare||0.15 (–0.01 to 0.31)||.06||0.12 (–0.03 to 0.29)||.12|
|Activities||0.26 (0.05 to 0.47)||.02||0.29 (0.07 to 0.51)||.01|
|Pain||0.26 (0.07 to 0.45)||.009||0.27 (0.07 to 0.47)||.008|
|Anxiety||0.26 (–0.04 to 0.56)||.09||0.23 (–0.07 to 0.54)||.13|
|Summary score||–0.06 (–0.11 to –0.01)||.02||–0.06 (–0.11 to –0.01)||.03|
aEQ-5D-5L: EuroQol 5 Dimension 5 Level.
bWilcoxon signed-rank text.
cWilcoxon rank-sum test.
Objective and Main Findings
In this study, we aimed to examine the longitudinal development of HRQoL using the TTD method in 3 different HRQoL questionnaires among breast cancer patients. We also applied Cox regression to determine possible influencing factors and used the Wilcoxon signed-rank test and the 2-sample Wilcoxon rank-sum test to distinguish our findings further. We then compared common systemic treatment groups in breast cancer treatment to emphasize our results. Mainly, we found the EQ-VAS showing a higher rate of deterioration than the other questionnaires in the same collective. Furthermore, in our sample the EQ-VAS offered a higher variance than the other questionnaires, allowing for more distinction between higher and lower outcome patients than the other instruments. A TTD event in the EQ-VAS also shows relations to disease related determinants as well as clear differentiation both individually between the EQ-VAS and the EQ-5D-5L items and from patients who did not experience a TTD event.
TTD With Regression Results
The highest rate of deterioration using TTD method could be detected in the EQ-VAS, a visual analog scale. The MID that were used for deterioration detection have been previously used in other studies [, , , , - ]. Nonetheless, it should be noted that the sample size for the EQ-VAS was bigger than for the other questionnaires, especially the EQ-5D-5L. It has been described that long questionnaires can result in lower compliance [ ]. This might be explained by the length and timing of the other questionnaires: the other 2 instruments are more extensive and the QLQ-C30 was only included on a monthly basis. Implementing the QLQ-C30 on a monthly rather than a weekly basis was an effort to ensure compliance and motivation as this questionnaire is much longer than the other assessments and as this analysis only constitutes a secondary aim of this study. However, this may have resulted in patient loss within the interval and fewer opportunities to apply the TTD method on this questionnaire. Apart from this, due to the small sample size and the limited HRQoL variance in all questionnaires, we did not perform tests to compare the precision of the questionnaires among each other. Therefore, it cannot be concluded that the EQ-VAS is advantageous in the longitudinal investigation of HRQoL compared to the other questionnaires examined. However, although overall completion rates deteriorated over time as expected, the EQ-VAS showed a higher completion rate than the EQ-5D-5L, which were both included in the visits on a weekly basis. Hence, it can be concluded that the EQ-VAS as a single visual analog scale with decisive wording offers an easy application of HRQoL monitoring in a digital setting.
Using univariate Cox regression analysis on the pathologic and treatment-related factors we discovered a link between metastases in the liver (P=.03) and pleura (P=.04) at the time of study inclusion and deterioration in HRQoL only in the EQ-VAS. As metastases in other organs result in further symptoms, a decrease of HRQoL in this state of disease is very plausible. Patients with progressive disease showed a tendency of a shortened TTD in the EQ-VAS (HR 1.48) when compared to the EQ-5D-5L (HR 1.15) and the QLQ-C30 (HR 1.05). This corresponds to previous research that describes a negative impact of disease progression on HRQoL . This connection might show possible predictive capabilities of this method when using the EQ-VAS, as it may be more sensitive to disease progression than the other questionnaires.
Event Comparison Between the EQ-VAS and EQ-5D-5L
With the EQ-5D-5L and EORTC QLQ-C30 showing less deterioration events in comparison to the EQ-VAS and no significant connections to the above-described factors, we proceeded to further investigate the significance of a TTD event in the EQ-VAS. To accomplish this, we first applied a Wilcoxon signed-rank test with continuity correction. We observed significant changes for patients with an EQ-VAS event in several EQ-5D-5L items. This indicates an internal consistency of deterioration in HRQoL for individuals with an EQ-VAS TTD event among the several different aspects of HRQoL presented in the EQ-5D-5L. Moreover, it offers an assurance that aspects of the HRQoL definition of the EQ-5D-5L are reflected in the open formulation of the EQ-VAS. As the analysis showed only a vague relation to the anxiety question of the EQ-5D-5L, it might suggest a capability of the EQ-VAS to better reflect physical rather than mental aspects of HRQoL in breast cancer patients. However, the EQ-VAS has previously been reported to show a lower score in patients with anxiety and depressive disorders in comparison to healthy participants . Nonetheless, in this sample a TTD event in the EQ-VAS was more strongly reflected in physical aspects of the EQ-5D-5L.
Thereupon, we performed a 2-sample Wilcoxon rank-sum test to contrast patients who experienced a TTD event in the EQ-VAS with patients who experienced no TTD event by comparing their respective differences in the EQ-5D-5L. As these analyses were significant for most items and the overall score, a clear distinction of patients with a TTD event to the inconspicuous participants became apparent. These analyses show that TTD events did not occur randomly but show that patients with a TTD event in the EQ-VAS significantly differ from the rest of the study population. This further supports the EQ-VAS as a valid screening instrument to implement TTD for longitudinal HRQoL management.
Systemic Treatment Groups
Cox regression analyses revealed a vague statistical difference between patients receiving CDK4/6 inhibitors and patients undergoing endocrine therapy alone. As other studies reported factors such as pain reduction and advantageous tumor response for patients receiving a CDK4/6 inhibitor in addition to endocrine therapy, our findings offer a plausible reflection of CDK4/6 inhibitors’ HRQoL profile [, ]. Furthermore, the combination with CDK4/6 inhibitors and endocrine therapy has shown to be beneficial in regard to progression-free survival when compared to endocrine therapy alone, which in turn represents an important factor in HRQoL [ , ].
From further examination of the EQ-VAS score using a linear mixed model (), we again found that CDK4/6 inhibition therapy significantly differs from the other treatment groups. Patients receiving CDK4/6 inhibition therapy showed an overall positive difference to baseline in the EQ-VAS during the entire study period, whereas the other groups showed a steady or even declining level of HRQoL on the questionnaire. As it has previously been reported that patients under CDK4/6 inhibitors have a slower rate of deterioration in HRQoL and experience milder side effects, our findings are reinforced by previous research [ , ]. This again supports our finding that a longitudinal observation of HRQoL through the EQ-VAS questionnaire is an adequate mean of measurement for this variable.
Further investigation of the EQ-5D-5L uncovered a significant difference between patients under chemotherapy and patients receiving HER2-targeted therapy. It has previously been described that patients who receive a combination of HER2-targeted therapy and chemotherapy exhibit better HRQoL than patients who only receive chemotherapy [, ]. It has also been reported that the addition of HER2-targeted medication to a chemotherapy schedule can result in the improvement of adverse effects [ ]. As can be seen in , both groups showed a greater variance in the EQ-5D-5L than the other groups. For the subgroup undergoing HER2-targeted therapy, several extreme outliers with a high positive difference to baseline contribute to the distinction of this group. On the other hand, the boxplots for the chemotherapy subgroup show a discrete tendency toward a reduction in HRQoL on the EQ-5D-5L, which complements previous research.
This subgroup analysis therefore consolidates the representativeness of both our sample and our finding that measuring the TTD can be an adequate method to observe HRQoL, especially with the EQ-VAS.
However, not all treatment groups were of equal size and not all of these groups showed an adequate retention rate in their assessments. Therefore, these findings must be interpreted with proper caution, but in the context of previous studies in this area still represent an important impulse of future research.
Our analysis is based on a relatively small sample size. This might result from poor compliance, length of questionnaire or technical difficulties which, when present, were quickly resolved by the staff [, ].
In addition, we did not account for response shift (“a change in the meaning of one’s self evaluation of a target construct“ ) as this was a secondary aim of this study. However, there are studies that show that by not considering response shift, HRQoL levels can lead to misinterpretation [ , ]. We also defined TTD events in relation to the baseline score. When assessing HRQoL, using the time until definitive deterioration has also been suggested in a metastatic setting [ ]. In accordance with previous research in the field of longitudinal HRQoL monitoring and per not accounting for response shift in our analyses, we decided to apply the TTD method using the baseline score as reference [ , , , , , ].
Therefore, more research is needed to consolidate our findings. Moreover, all questionnaires were administered digitally only. However, the equivalence of electronic and paper-based PRO measurements has previously been established . Furthermore, we detected a rather high and steady level of well-being among all questionnaires in our descriptive analysis, which limits the variance of these findings. We only included patients with internet access at home, as per inclusion criteria. Hence, older patients who are not as technologically inclined were not eligible for participation. Therefore, with an average age of 54.3 years, our sample does not reflect the average age of breast cancer patients [ ]. Furthermore, as Heidelberg and Tübingen reflect economically strong regions in Germany, our sample showed a higher percentage of private health insurance and higher education than the general public [ - ]. As private health insurance in Germany is only available if you have a higher income, it can be concluded that our sample shows a bias in regard to its socioeconomic profile [ ]. In addition, the order of the questionnaires remained the same throughout the study and was not randomized.
In comparison to the EQ-5D-5L and QLQ-C30, the EQ-VAS showed a higher rate of deterioration, significant connections between deterioration and certain locations of metastases, and a better discrimination between progressive and stable disease (HR 1.48). In addition, known differences in HRQoL profiles of various treatment regiments were reflected in the EQ-VAS. We suggest that using the TTD method with the EQ-VAS is an adequate means of examining longitudinal development of HRQoL among breast cancer patients in a digital setting and constitutes a reasonable addition to breast cancer therapy.
This study was funded by Tschira-Stiftung.
KB wrote the manuscript and was involved in data collection along with LS. KB, MF, and TMD planned the data analysis. MF performed the data analysis. MW, TMD, LS, AS, TE, JG, and AH were involved in project development and coordination.
Conflicts of Interest
Supplemental tables and figure.DOCX File , 202 KB
- Krebs in Deutschland 2011/2012. Robert Koch Institute. 2015. URL: https://www.krebsdaten.de/Krebs/DE/Content/Publikationen/Krebs_in_Deutschland/kid_2015/krebs_in_deutschland_2015.pdf?__blob=publicationFile [accessed 2019-09-18]
- Dufresne A, Pivot X, Tournigand C, Facchini T, Altweegg T, Chaigneau L. Impact of chemotherapy beyond the first line in patients with metastatic breast cancer. Breast Cancer Res Treat 2008 Jan;107(2):275-279. [CrossRef] [Medline]
- Müller V, Nabieva N, Häberle L, Taran F, Hartkopf AD, Volz B, et al. Impact of disease progression on health-related quality of life in patients with metastatic breast cancer in the PRAEGNANT breast cancer registry. Breast 2018 Feb;37:154-160. [CrossRef] [Medline]
- Tachi T, Teramachi H, Tanaka K, Asano S, Osawa T, Kawashima A, et al. The impact of outpatient chemotherapy-related adverse events on the quality of life of breast cancer patients. PLoS One 2015;10(4):e0124169 [FREE Full text] [CrossRef] [Medline]
- Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol 2004 Feb 15;22(4):714-724 [FREE Full text] [CrossRef] [Medline]
- Husson O, Mols F, van de Poll-Franse LV. The relation between information provision and health-related quality of life, anxiety and depression among cancer survivors: a systematic review. Ann Oncol 2011 Apr;22(4):761-772 [FREE Full text] [CrossRef] [Medline]
- Wallwiener M, Simoes E, Sokolov AN, Brucker SY, Fasching PA, Graf J. Health-related quality of life in metastatic and adjuvant breast cancer patients. Geburtshilfe Frauenheilkd 2016 Oct;76(10):1065-1073 [FREE Full text] [CrossRef] [Medline]
- Graf J, Moreno B, Wallwiener M, Menzel K, Brucker SY, Simoes E. [Practicability and efficiency of e-Health applications in patient-reported outcomes: state of and need for research]. Gesundheitswesen 2018 Nov;80(11):953-962. [CrossRef] [Medline]
- FDA-NIH Biomarker Working Group. BEST (Biomarkers, EndpointS, and other Tools) Resource. Silver Spring: Food and Drug Administration; 2016. URL: https://www.ncbi.nlm.nih.gov/books/NBK326791/ [accessed 2021-08-31]
- Gwaltney CJ, Shields AL, Shiffman S. Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review. Value Health 2008;11(2):322-333. [CrossRef] [Medline]
- Radoschewski M. Gesundheitsbezogene Lebensqualität - Konzepte und Maße. Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz 2000 Mar 15;43(3):165-189. [CrossRef]
- Basch E. New frontiers in patient-reported outcomes: adverse event reporting, comparative effectiveness, and quality assessment. Annu Rev Med 2014;65:307-317. [CrossRef] [Medline]
- Basch E, Deal AM, Dueck AC, Scher HI, Kris MG, Hudis C, et al. Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment. JAMA 2017 Jun 04;318(2):197-198. [CrossRef] [Medline]
- Lohr KN, Zebrack BJ. Using patient-reported outcomes in clinical practice: challenges and opportunities. Qual Life Res 2009 Feb 25;18(1):99-107. [CrossRef] [Medline]
- Koitsalu M, Eklund M, Adolfsson J, Grönberg H, Brandberg Y. Effects of pre-notification, invitation length, questionnaire length and reminder on participation rate: a quasi-randomised controlled trial. BMC Med Res Methodol 2018 Jan 05;18(1):3 [FREE Full text] [CrossRef] [Medline]
- Tokish JM, Chisholm JN, Bottoni CR, Groth AT, Chen W, Orchowski JR. Implementing an electronic patient-based orthopaedic outcomes system: factors affecting patient participation compliance. Mil Med 2017 Jan;182(1):e1626-e1630. [CrossRef] [Medline]
- Osoba D. Lessons learned from measuring health-related quality of life in oncology. J Clin Oncol 1994 Mar;12(3):608-616. [CrossRef] [Medline]
- Brusniak K, Arndt HM, Feisst M, Haßdenteufel K, Matthies LM, Deutsch TM, et al. Challenges in acceptance and compliance in digital health assessments during pregnancy: prospective cohort study. JMIR Mhealth Uhealth 2020 Oct 14;8(10):e17377 [FREE Full text] [CrossRef] [Medline]
- Kessel KA, Vogel MM, Kessel C, Bier H, Biedermann T, Friess H, et al. Mobile health in oncology: a patient survey about app-assisted cancer care. JMIR Mhealth Uhealth 2017 Jun 14;5(6):e81 [FREE Full text] [CrossRef] [Medline]
- Turner RR, Quittner AL, Parasuraman BM, Kallich JD, Cleeland CS, Mayo/FDA Patient-Reported Outcomes Consensus Meeting Group. Patient-reported outcomes: instrument development and selection issues. Value Health 2007;10 Suppl 2:S86-593 [FREE Full text] [CrossRef] [Medline]
- Sivendran S, Galsky M. Adverse event reporting in oncology clinical trials—lost in translation? Expert Opin Drug Saf 2016 Jul;15(7):893-896. [CrossRef] [Medline]
- Di Maio M, Gallo C, Leighl NB, Piccirillo MC, Daniele G, Nuzzo F, et al. Symptomatic toxicities experienced during anticancer treatment: agreement between patient and physician reporting in three randomized trials. J Clin Oncol 2015 Mar 10;33(8):910-915. [CrossRef] [Medline]
- Di Maio M, Basch E, Bryce J, Perrone F. Patient-reported outcomes in the evaluation of toxicity of anticancer treatments. Nat Rev Clin Oncol 2016 May;13(5):319-325. [CrossRef] [Medline]
- Cella D, Pickard AS, Duh MS, Guerin A, Mishagina N, Antràs L, et al. Health-related quality of life in patients with advanced renal cell carcinoma receiving pazopanib or placebo in a randomised phase III trial. Eur J Cancer 2012 Feb;48(3):311-323. [CrossRef] [Medline]
- Long GV, Atkinson V, Ascierto PA, Robert C, Hassel JC, Rutkowski P, et al. Effect of nivolumab on health-related quality of life in patients with treatment-naïve advanced melanoma: results from the phase III CheckMate 066 study. Ann Oncol 2016 Oct;27(10):1940-1946 [FREE Full text] [CrossRef] [Medline]
- Hamidou Z, Dabakuyo TS, Mercier M, Fraisse J, Causeret S, Tixier H, et al. Time to deterioration in quality of life score as a modality of longitudinal analysis in patients with breast cancer. Oncologist 2011;16(10):1458-1468 [FREE Full text] [CrossRef] [Medline]
- Hamidou Z, Dabakuyo-Yonli TS, Guillemin F, Conroy T, Velten M, Jolly D, et al. Impact of response shift on time to deterioration in quality of life scores in breast cancer patients. PLoS One 2014;9(5):e96848 [FREE Full text] [CrossRef] [Medline]
- Therasse P, Arbuck SG, Eisenhauer EA, Wanders J, Kaplan RS, Rubinstein L, et al. New guidelines to evaluate the response to treatment in solid tumors. European Organization for Research and Treatment of Cancer, National Cancer Institute of the United States, National Cancer Institute of Canada. J Natl Cancer Inst 2000 Feb 02;92(3):205-216. [CrossRef] [Medline]
- Greiner W, Claes C, Busschbach JJV, von der Schulenburg JG. Validating the EQ-5D with time trade off for the German population. Eur J Health Econ 2005 Jun;6(2):124-130. [CrossRef] [Medline]
- van Hout B, Janssen MF, Feng Y, Kohlmann T, Busschbach J, Golicki D, et al. Interim scoring for the EQ-5D-5L: mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Health 2012;15(5):708-715 [FREE Full text] [CrossRef] [Medline]
- Tykodi SS, Schadendorf D, Cella D, Reck M, Harrington K, Wagner S, et al. Patient-reported outcomes with nivolumab in advanced solid cancers. Cancer Treat Rev 2018 Nov;70:75-87 [FREE Full text] [CrossRef] [Medline]
- Pickard AS, Neary MP, Cella D. Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health Qual Life Outcomes 2007 Dec 21;5:70 [FREE Full text] [CrossRef] [Medline]
- Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 2011 Dec;20(10):1727-1736 [FREE Full text] [CrossRef] [Medline]
- Ludwig K, Graf von der Schulenburg J, Greiner W. German value set for the EQ-5D-5L. Pharmacoeconomics 2018 Jun;36(6):663-674 [FREE Full text] [CrossRef] [Medline]
- Kimman ML, Dirksen CD, Lambin P, Boersma LJ. Responsiveness of the EQ-5D in breast cancer patients in their first year after treatment. Health Qual Life Outcomes 2009 Feb 07;7:11 [FREE Full text] [CrossRef] [Medline]
- Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 1993 Mar 03;85(5):365-376. [CrossRef] [Medline]
- Giesinger JM, Kieffer JM, Fayers PM, Groenvold M, Petersen MA, Scott NW, et al. Replication and validation of higher order models demonstrated that a summary score for the EORTC QLQ-C30 is robust. J Clin Epidemiol 2016 Jan;69:79-88 [FREE Full text] [CrossRef] [Medline]
- Wallwiener M, Matthies L, Simoes E, Keilmann L, Hartkopf AD, Sokolov AN, et al. Reliability of an e-PRO tool of EORTC QLQ-C30 for measurement of health-related quality of life in patients with breast cancer: prospective randomized trial. J Med Internet Res 2017 Sep 14;19(9):e322 [FREE Full text] [CrossRef] [Medline]
- Cocks K, King MT, Velikova G, Martyn SM, Fayers PM, Brown JM. Evidence-based guidelines for determination of sample size and interpretation of the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30. J Clin Oncol 2011 Jan 1;29(1):89-96. [CrossRef] [Medline]
- Osoba D, Rodrigues G, Myles J, Zee B, Pater J. Interpreting the significance of changes in health-related quality-of-life scores. J Clin Oncol 1998 Jan;16(1):139-144. [CrossRef] [Medline]
- Cocks K, King MT, Velikova G, de Castro G, Martyn St-James M, Fayers PM, et al. Evidence-based guidelines for interpreting change scores for the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30. Eur J Cancer 2012 Jul;48(11):1713-1721. [CrossRef] [Medline]
- R: a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2019. URL: https://www.r-project.org/ [accessed 2019-10-19]
- Supina AL, Johnson JA, Patten SB, Williams JVA, Maxwell CJ. The usefulness of the EQ-5D in differentiating among persons with major depressive episode and anxiety. Qual Life Res 2007 Jun;16(5):749-754. [CrossRef] [Medline]
- Verma S, O'Shaughnessy J, Burris HA, Campone M, Alba E, Chandiwana D, et al. Health-related quality of life of postmenopausal women with hormone receptor-positive, human epidermal growth factor receptor 2-negative advanced breast cancer treated with ribociclib + letrozole: results from MONALEESA-2. Breast Cancer Res Treat 2018 Aug;170(3):535-545 [FREE Full text] [CrossRef] [Medline]
- Janni W, Alba E, Bachelot T, Diab S, Gil-Gil M, Beck TJ, et al. First-line ribociclib plus letrozole in postmenopausal women with HR+, HER2– advanced breast cancer: tumor response and pain reduction in the phase 3 MONALEESA-2 trial. Breast Cancer Res Treat 2018 Jun;169(3):469-479. [CrossRef] [Medline]
- Tripathy D, Im S, Colleoni M, Franke F, Bardia A, Harbeck N, et al. Ribociclib plus endocrine therapy for premenopausal women with hormone-receptor-positive, advanced breast cancer (MONALEESA-7): a randomised phase 3 trial. Lancet Oncol 2018 Jul;19(7):904-915. [CrossRef] [Medline]
- Eggersmann TK, Degenhardt T, Gluz O, Wuerstlein R, Harbeck N. CDK4/6 inhibitors expand the therapeutic options in breast cancer: palbociclib, ribociclib and abemaciclib. BioDrugs 2019 Apr;33(2):125-135. [CrossRef] [Medline]
- Harbeck N, Iyer S, Turner N, Cristofanilli M, Ro J, André F, et al. Quality of life with palbociclib plus fulvestrant in previously treated hormone receptor-positive, HER2-negative metastatic breast cancer: patient-reported outcomes from the PALOMA-3 trial. Ann Oncol 2016 Jun;27(6):1047-1054 [FREE Full text] [CrossRef] [Medline]
- Osoba D, Burchmore M. Health-related quality of life in women with metastatic breast cancer treated with trastuzumab (Herceptin). Semin Oncol 1999 Aug;26(4 Suppl 12):84-88. [Medline]
- Osoba D, Slamon DJ, Burchmore M, Murphy M. Effects on quality of life of combined trastuzumab and chemotherapy in women with metastatic breast cancer. J Clin Oncol 2002 Jul 15;20(14):3106-3113. [CrossRef] [Medline]
- Wilson IB. Clinical understanding and clinical implications of response shift. Soc Sci Med 1999 Jun;48(11):1577-1588. [CrossRef] [Medline]
- Jansen SJ, Stiggelbout AM, Nooij MA, Noordijk EM, Kievit J. Response shift in quality of life measurement in early-stage breast cancer patients undergoing radiotherapy. Qual Life Res 2000;9(6):603-615. [CrossRef] [Medline]
- Dabakuyo TS, Guillemin F, Conroy T, Velten M, Jolly D, Mercier M, et al. Response shift effects on measuring post-operative quality of life among breast cancer patients: a multicenter cohort study. Qual Life Res 2013 Feb;22(1):1-11. [CrossRef] [Medline]
- Anota A, Hamidou Z, Paget-Bailly S, Chibaudel B, Bascoul-Mollevi C, Auquier P, et al. Time to health-related quality of life score deterioration as a modality of longitudinal analysis for health-related quality of life studies in oncology: do we need RECIST for quality of life to achieve standardization? Qual Life Res 2015 Jan;24(1):5-18 [FREE Full text] [CrossRef] [Medline]
- Eisemann N, Waldmann A, Katalinic A. Epidemiology of breast cancer—current figures and trends. Geburtshilfe Frauenheilkd 2013 Feb;73(2):130-135 [FREE Full text] [CrossRef] [Medline]
- Gesetzliche Krankenversicherung (GKV). Bundesministerium für Gesundheit. URL: https://www.bundesgesundheitsministerium.de/gkv.html [accessed 2020-04-21]
- Bevölkerung im Alter von 15 Jahren und mehr nach allgemeinen und beruflichen Bildungsabschlüssen nach Jahren. Statistisches Bundesamt. URL: https://www.destatis.de/DE/Themen/Gesellschaft-Umwelt/Bildung-Forschung-Kultur/Bildungsstand/Tabellen/bildungsabschluss.html [accessed 2020-04-21]
- Volkswirtschaftliche Gesamtrechnungen der Länder - Einkommensverteilung. Statistische Ämter des Bundes und der Länder. URL: https://www.statistikportal.de/en/node/106466 [accessed 2021-08-30]
|CDK: cyclin-dependent kinase|
|EORTC QLQ-C30: European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Core 30 item|
|EQ-5D-5L: EuroQol 5 Dimension 5 Level|
|EQ-VAS: EuroQol Visual Analog Scale|
|HER2: human epidermal growth factor receptor 2|
|HR: hazard ratio|
|HRQoL: health-related quality of life|
|MID: minimally important difference|
|PEPPER study: Patient Engagement Pilotstudie Mammakarzinom - individualisierte und Ressourcen-effiziente Patient-Reported Outcomes Erfassung durch digitale Therapieunterstuetzungssysteme|
|PRO: patient-reported outcome|
|TTD: time to deterioration|
Edited by D Vollmer Dahlke; submitted 15.11.20; peer-reviewed by K Crew, Y Han; comments to author 03.02.21; revised version received 27.03.21; accepted 21.07.21; published 12.10.21Copyright
©Katharina Brusniak, Manuel Feisst, Linda Sebesteny, Andreas Hartkopf, Joachim Graf, Tobias Engler, Andreas Schneeweiss, Markus Wallwiener, Thomas Maximilian Deutsch. Originally published in JMIR Cancer (https://cancer.jmir.org), 12.10.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Cancer, is properly cited. The complete bibliographic information, a link to the original publication on https://cancer.jmir.org/, as well as this copyright and license information must be included.