In the past decade, digital interventions have commonly been used to target addictive behaviors, including smoking cessation (SC). Several systematic reviews have shown that these SC interventions can be effective, albeit with generally small effect sizes [1-4]. For example, the Cochrane review by Taylor et al [4] showed that the use of web-based SC interventions resulted in significantly higher rates of smoking abstinence compared to nonactive control groups, 6 months after randomization (risk ratio=1.15). Cancer survivors are a growing population who can benefit considerably from SC. Yet, the prevalence of people who smoke is about the same as in the general population, and research on effective digital SC interventions for cancer survivors is scarce [3]. Accordingly, not much is known about active ingredients or engagement factors of SC interventions targeting cancer survivors [5], despite engagement being an important moderator of the effect of digital SC interventions [6]. It is therefore important to look more closely into the predictors and moderators of engagement and outcome among this target group.

Although the primary effects of digital SC interventions are moderately positive on average, there is room for improvement. One possible explanation for the modest effects of digital SC interventions is the generally low adherence rates. Taylor et al [4] found that 18 out of 34 web-based SC studies had more than 50% attrition at follow-up. Analyzing whether the uptake of specific intervention components is related to better intervention outcomes increases the understanding of primary intervention effects [7]. Some studies on addictive behaviors investigated the relationship between intervention engagement and outcome [8-10]. A study by Perski et al [8] found that participants who completed more (varied) exercises had 64% higher odds of SC compared to participants who almost exclusively set an SC goal. Siemer et al [10], examining adherence to a blended SC intervention, revealed a dose-response relationship between the number of executed activities and smoking abstinence. Another study by Ramos et al [9] also found that intervention engagement, in terms of number of logins, forum visits, and number of participation badges, was a strong predictor of successful SC. Not all studies have shown that intervention engagement predicts intervention effectiveness, even contradictory effects are found. For example, Smith et al [11] showed that engagement with particular components of a digital SC intervention can be counterproductive when the content does not fit the participants’ needs.

Behavior change programs targeting SC notoriously encounter challenges when trying to reach target groups with the highest smoking rates (eg, groups with lower socioeconomic status [12] and groups with low literacy [13]). In addition, it could be useful for the improvement of intervention content and implementation to identify which characteristics predict engagement. This will help to improve the content and design of the intervention for the right target group [7,14]. Several studies have related digital SC intervention use to participant characteristics [8,15-17]. These studies showed that digital SC interventions were used longer or more frequently by older participants [8,15] and women [16]. Participants who had lower education, smoked more heavily, and had depressive symptoms were found to be less engaged with the digital SC intervention [17].

There is some evidence on the effects of digital SC interventions for cancer survivors. For example, a meta-analytic study by Mujcic et al [3] showed that digital and nondigital distance-based SC interventions for cancer survivors led to significantly reduced smoking rates compared to baseline (risk difference=0.29). However, research on the predictors and moderators of engagement and outcome of digital SC studies for cancer survivors is limited, while cancer survivors are a growing and diverse population [18]. A pilot study by Bricker et al [18] of an application on SC for cancer survivors showed greater acceptability, use, and effectiveness when compared to the national SC app for the general population.

In this study, we aim to investigate the predictors and moderators of engagement and outcome of a minimally guided digital intervention for cancer survivors called MyCourse-Quit Smoking (in Dutch “MijnKoers-Stoppen met Roken”) in a secondary analysis. The main effects study did not find a differential effect on SC between intervention and control at 6 months. In both groups, around a quarter abstained from smoking, and the number of cigarettes smoked was cut back by half [19]. With this secondary analysis, we aim to answer the following research questions: (1) Are participant characteristics related to intervention engagement at 6-month follow-up? (2) Is intervention engagement associated with tobacco use at 6-month follow-up? (3) Are participant characteristics related to tobacco use at 6-month follow-up?

For this paper, an exploratory secondary data analysis was carried out using data from a randomized controlled trial on the MyCourse-Quit Smoking digital intervention. The data used for this study were collected between November 2016 and September 2019.

Ethics approval for the trial was acquired from an accredited medical research and ethics committee in The Netherlands (Toetsingscommissie Wetenschappelijk Onderzoek Rotterdam e.o. NL55921.101.16). Participants provided digital informed consent before inclusion in the trial [20]. Data were deidentified before processing or analysis. Identifying data were stored separately from research data. For each completed follow-up assessment, they were reimbursed €25 (approximately US $30).

A web-based screening questionnaire on the study website determined whether people were able to participate in the study. Eligible participants received an informed consent form via mail and had 30 days to sign the form. In the meantime, participants had the possibility to contact the research team or an independent physician for more information. After signing the informed consent form, they were asked to fill out a baseline questionnaire and were allocated to either the MyCourse group or the control group. Individuals in the control group were provided access to a noninteractive web-based informational brochure regarding the hazards associated with smoking and strategies for SC. The informational content encompassed both general SC information and content tailored to the unique needs of cancer survivors. Follow-up measurements were conducted at 3, 6, and 12 months after randomization. The study was conducted completely over the web, but after continued nonresponse, participants received a reminder by telephone. A more extensive description of the randomized controlled trial study procedures can be found elsewhere [20].

For the study, 165 adults who were diagnosed with any form of cancer in the past 10 years were recruited. Other eligibility criteria included having a PC or laptop in addition to an internet connection at home, having smoked 5 or more cigarettes per day in the past 7 days, having the intention and ability to participate in the 12-month study, and having the intention to quit smoking cigarettes. People who were pregnant; had insufficient mastery of the Dutch language; or self-reported suicidal ideation, dementia, severe depression, severe alcohol dependence, or acute psychosis were not eligible to participate in the study.

MyCourse-Quit Smoking is a digital minimally guided intervention that provides support for SC among cancer survivors. The intervention is based on empirically evaluated therapeutic approaches for SC in the general population: cognitive behavioral therapy [21], motivational interviewing [22], and acceptance and commitment therapy [23]. The intervention can be accessed via PC, tablet, and smartphone. At first login, participants receive instructions to set up a quit plan and gain access to 13 different exercises, information about smoking, quitting, and cancer, a web-based diary to track their tobacco use, and a peer support platform [20]. Exercises focused on different topics including previous experiences, high-risk situations, self-control measures, reinforcement, relapse prevention, and acceptance and commitment therapy. For the complete structure of the intervention, see Figure 3 in the protocol paper [20]. After the first login, all parts of the intervention could be accessed, and participants were free to choose how often and which parts of the intervention they wanted to use. Participants were only advised to use the intervention daily for 4 weeks.

The primary outcome measure in this study was the number of cigarettes smoked in the past 7 days at 6-month follow-up. Intervention engagement was measured using 3 indicators: the number of logins into the MyCourse-Quit Smoking intervention, the number of self-monitoring registrations of smoking urges and smoked cigarettes, and the number of completed intervention exercises. The following participant characteristics were extracted from the participant records: gender, age, educational level (higher or lower, where the minimum for the higher educational level was an academic university or university of applied sciences degree), and living situation (alone or together). We specifically looked at the presence of lung cancer and breast cancer (yes or no) among the participants in the analyses because lung cancer has a direct relationship with smoking and breast cancer was the most common type of cancer in the sample. In addition, patients with cancer at other sites were included in the analyses. Furthermore, the number of cancer sites (1 or >1) distinguished participants who reported that they had received multiple cancer diagnoses. The severity of nicotine dependence was measured by the 6-item Fagerström Test for Nicotine Dependence (FTND) [24]. Problematic alcohol use was measured using the Alcohol Use Disorders Identification Test (AUDIT) [25], a 10-item questionnaire on alcohol consumption patterns and problems experienced due to alcohol consumption. The AUDIT score was included as a variable because research has shown that people with a high risk of problematic alcohol use have a harder time quitting smoking and may benefit from different types of SC treatment [26,27]. The EQ-5D was used to measure the quality of life [28]. Comorbid anxiety, depression, and somatic symptoms were indicated using the Brief Symptom Inventory-18 questionnaire [29].

Participant characteristics are shown in Table 1. The majority of participants were female (136/165, 82.4%), the mean age was 54.2 (SD 11.2) years, 29.1% (48/165) were living alone, and 41.2% (68/165) had completed higher education. On average, participants had smoked for 34.5 (SD 12.0) years and smoked 100 (SD 51.2) cigarettes per week. The main clinical effects of the MyCourse intervention and the results of the cost-effectiveness analysis can be found elsewhere [19].

Of all 83 participants of the intervention group, 56 people logged into the MyCourse portal at least once and thus were included in the analysis. When comparing the 56 people who logged in at least once with the 27 people who did not log in once at all baseline characteristics mentioned in Table 1, only the number of patients with uterine cancer differed significantly between the 2 groups (P<.05), with 5 patients with uterine cancer who did not log in once and 2 patients with uterine cancer that logged in at least once. In total, 82 participants in the control group were not included in the analysis. Among the 56 MyCourse users, the average number of logins was 21 (SD 41.0; median 5.5, IQR 3-18.5), the average amount of self-monitoring registrations was 31 (SD 53.9; median 5, IQR 2-22), and the average amount of completed exercises was 6.5 (SD 5.1; median 4, IQR 2-12). As shown in Table 2, female participants showed a significantly lower number of logins in the MyCourse-Quit Smoking intervention than male participants (P=.004). The relationship between sex and other indicators of intervention engagement was nonsignificant. Furthermore, a higher AUDIT score at baseline was associated with a significantly higher number of logins (P<.001) and diary registrations (P<.001) but not with the number of completed exercises (P=.05).

Table 3 shows the outcomes of the analysis on the association between intervention engagement and smoking behavior among the 56 participants who logged in to the MyCourse portal at least once. No significant effects were found between intervention engagement and smoking behavior. Table 3 also shows the association between several participant characteristics and smoking behavior among the 83 participants of the intervention group. The results show that a higher FTND score at baseline is associated with a significantly greater reduction of the 7-day sum of smoked cigarettes after 6 months in the intervention group (P=.002). None of the other participant characteristics or measures of engagement predicted smoking behavior at 6 months.

Table 4 reports the outcomes of the moderation analysis on the interaction effect of participant characteristics and study condition on the number of cigarettes smoked in the past 7 days among the 165 participants at 6-month follow-up. No significant effects were found in this analysis.

The association between sex and the number of logins on the nonimputed data did not reach significance after the Bonferroni correction (P=.006). The association between the FTND and 7-day cigarette smoking at 6-month follow-up in the nonimputed data did not reach significance after Bonferroni correction (P=.10). In the moderation analysis, after Bonferroni correction on the nonimputed data, the interaction effect of the number of cancer sites and study condition on smoking behavior reached significance (P=.002). For all other analyses, the results did not change significantly. Detailed results of the sensitivity analyses can be found in Multimedia Appendix 1.

In this study, we evaluated hypothesized predictors and moderators of intervention engagement and smoking behavior in MyCourse-Quit Smoking, a digital SC intervention for cancer survivors. With regard to the relationship between participant characteristics and intervention engagement, it was found that female participants logged on significantly less often than male participants. This effect should nevertheless be interpreted with caution since the number of male participants in the sample was low (n=8). Moreover, previous research shows that female participants are generally more engaged in digital SC interventions than male participants [16,33-37]. A significant positive association between the baseline AUDIT score and intervention engagement was found; a higher AUDIT score at baseline was related to a higher number of logins and diary registrations in the MyCourse intervention. There was no effect of the baseline AUDIT score on the number of completed exercises. Previous studies showed that participants with a higher risk of alcohol dependence had a harder time to quit smoking, and therefore needed more support from the intervention, as demonstrated in several previous studies [26,27]. Toll et al [27] showed that people who drink more heavily were less likely to quit smoking, but problematic alcohol use was not measured. Sells et al [26] pointed out that people with a high risk of problematic alcohol use may need more intensive intervention in order to quit smoking, whereas people with a high risk of problematic alcohol use were defined with an AUDIT score higher than 7. However, in this study, we did not find an effect of the AUDIT score on smoking behavior. Furthermore, participants of the MyCourse-Quit Smoking trial had generally low AUDIT scores (mean 3.6, SD 4.7), and few participants with a score higher than 7 (21/165).

Regarding the association between participant characteristics and smoking behavior, we found that participants of the MyCourse intervention who had higher nicotine dependence scores at baseline showed a greater reduction in the number of smoked cigarettes in the past 7 days at the 6-month follow-up. This negative association between nicotine dependence at baseline and tobacco use at follow-up is a reasonable finding because it is likely that less addicted participants at baseline already smoke fewer cigarettes than highly addicted participants, and therefore, a smaller reduction of cigarettes at 6 months is possible. This finding does not indicate whether heavier nicotine dependence predicts SC, as participants can greatly reduce the number of smoked cigarettes but not enough to completely quit smoking. Previous research shows that, in general, less severe nicotine dependence is associated with a higher SC rate [38,39].

The analyses on the association between intervention engagement (ie, the number of logins, self-monitoring registrations, and exercises) and the outcome did not yield any significant effects. This study showed the overall prevailing pattern of the majority of participants quitting the use of the intervention in the first few days and a smaller group that uses the intervention for a longer period [40]. However, other studies on digital SC interventions have shown a dose-response relationship between intervention engagement and outcome [9,10,41], with higher engagement predicting greater SC rates, although this is sometimes limited to certain engagement measures [34] or with low quality of the evidence due to low follow-up rates [9]. For example, Heminger et al [34] did not find a significant association between program dose and SC, but the use of specific intervention elements (eg, making a pledge toward a smoke-free life and tracking saved money and health benefits gained after quitting) was associated with SC. For future research, it is therefore important to properly define engagement, differentiate between indicators of engagement, and use empirically effective intervention techniques in order to enhance engagement [6].

The moderation analysis did not yield any significant effects. This indicates that being in the intervention group, compared to the control group, does not amplify the effect between any of the participant’s characteristics and tobacco use, and hence no specific participant characteristic renders participants more or less likely to be successful when participating in the MyCourse intervention.

The initial study was 80% powered to detect a relative risk of 2.1 in SC [20], while this explored different outcome variables, potential moderator effects herein, and made comparisons other than between treatment arms. Hence, the initial sample size calculation might not be applicable. Post hoc power analyses were omitted, as these would merely reflect the already obtained P value [42]. While the applied Bonferroni correction accounted for multiple comparisons, it might be overly strict in our case [43]. Furthermore, the tendency to overfit data might also be a problem for linear mixed modeling analyses. The study had missing data, which might have caused bias in the results. On the other hand, as a strength of this study, multiple imputation was applied to compensate for the missing values, and the sensitivity analysis did not reveal any substantial differences in the analyses without imputation. Another limitation is the sample size of the analyses for the first research question, especially for the subgroup analyses of sex and living situation. Since some of the categories of these variables had small group sizes, the outcomes of the analyses should be interpreted with caution.

The MyCourse intervention is presumably more engaging for people who smoke and people with moderate to high alcohol dependence. Furthermore, this study did not identify any specific subgroups where the MyCourse-Quit Smoking intervention might be particularly effective or ineffective.

This study aimed to provide more insight into predictors and moderators of engagement and outcome for a digital SC intervention targeting cancer survivors. Overall, a limited number of associations was found between participant characteristics, engagement, and smoking behavior. Female participants accessed the intervention less often than male participants, and participants with higher AUDIT scores accessed the intervention more often and had more diary registrations than participants with lower AUDIT scores. Greater nicotine dependence at baseline was associated with a greater reduction in number of cigarettes at 6 months. Future studies in a larger sample and with a preregistered analysis plan are needed to corroborate these findings and shed light on how this knowledge can be used to improve the effects of digital SC programs.