Abstract
Introduction
Telemedicine is defined as the “systematic provision of healthcare services over physically separate environments via Information and Communications Technology (ICT)”. 1 In oncology, telemedicine services can help cancer patients cope with long-term impact of the disease. 2 Examples of tele-oncology interventions include cancer tele-genetics, cancer-related tele-applications, remote chemotherapy supervision, symptom management, survivorship care, palliative care, telepathology, and increased access to cancer clinical trials. 3 Teleconsultations were introduced in the National Cancer Centre Singapore (NCCS) in June 2020 and monthly consults have increased from 115 in June 2020 to 231 in May 2021.
Using telemedicine can support patients in self-managing their disease, 4 save time and money,5,6 and improve timeliness of care. 7 Telemedicine can also alleviate caregiver burden, with minimal impact on existing care resources. 8 More recently, the COVID-19 pandemic has driven telemedicine use to continue delivering care remotely, 9 protecting patients from unnecessary exposure to the virus. 10 The value of implementing telemedicine also lies in its potential to refine coordination of patient-centred care. 11
However, studies also reveal a large proportion of patients still prefer traditional in-person care to remote care whenever possible.12,13,14 Numerous barriers such as lack of social support, lack of technological infrastructure and patients’ preferences hampering adoption have been ascertained. 15 Notably, patient acceptance of telemedicine has been perceived as a major determinant of its widespread and sustained uptake,16,17 and assessing it is important during initial development and evaluation of digital health interventions. 18 However, current acceptance among cancer patients is unclear. Acceptability studies so far have heterogeneous study methods and tended to focus on a sole intervention or cancer type, making it difficult to generalise findings to a wider range of services or patient population. 19 Most studies depict telemedicine as a standalone service, and it is unclear if patient acceptance would change if it is unambiguously positioned as an adjunct to traditional care instead.
Rapid technological advancement, coupled with lowered barriers to technology, may lead to a higher acceptance of telemedicine. 20 Encouragingly, other studies have previously found that the Internet is commonly used by cancer patients to search for disease-related information and support.21,22,23 Finally, patients may be more receptive towards telemedicine if reassured that the traditional mode of in-person care would not be replaced completely.
Therefore, our study objectives were to: (1) assess cancer patients’ acceptance of telemedicine as a complement to traditional in-person care in the ambulatory care setting, (2) identify factors which affect this acceptance, and (3) make recommendations based on evidence from study findings.
Methods
Study cohort and design
This was a cross-sectional study conducted at NCCS, a multi-disciplinary cancer centre managing approximately 70% of all public-sector institution cancer patients in Singapore. Ethics review approval with exemption was obtained from the SingHealth Centralised Institutional Review Board (2020/2691).
Participants were recruited via convenience sampling. Patients included were aged 21 years old and above, proficient in English or Mandarin, and had attended at least one in-person consultation at NCCS. Participation was anonymous and voluntary.
Variables and outcome measures
A self-administered patient questionnaire was devised in three overarching parts. The first part collected information on demographics, technology-related factors and past telemedicine experience. Social support items were derived from the Duke Social Support and Stress Scale. 24 The second part was adapted from an extended technology acceptance model (TAM)25,26 to measure telemedicine acceptance and factors affecting acceptance. The final part was on potential advantages and disadvantages of telemedicine 27 to further understand patient attitudes and hence propose better-tailored recommendations. Agreement with statements in the latter two parts were rated on a 5-point Likert scale from “strongly disagree” to “strongly agree”. Respondents were also invited to provide an open-ended remark about their opinion on telemedicine.
The questionnaire was available in either English (Annex 1) or Mandarin (Annex 2). Both versions were hosted on the commercial e-survey platform Qualtrics (Qualtrics, Provo, UT, USA) and distributed via Short Message Service (SMS) to patients who had attended the Ambulatory Treatment Unit at least once in 2020. Data collection ran from 5 to 18 September 2020.
Technology acceptance model
Technology acceptance model is a validated model which predicts and explains user acceptance of new technologies (Figure 1).
26
“Perceived usefulness” is the degree to which the technology is believed to enhance job performance, while “perceived ease of use” is the degree to which use of the technology is seen as effortless.
26
These two variables demonstrated positive correlations with usage intention, the equivalent of user acceptance.
28
Therefore, measuring perceived usefulness and perceived ease of use by end-users enables one to predict their acceptance of a new technology. Diagram of original TAM.
Definitions of additional TAM constructs. 25

Diagram of extended TAM.
Statistical analysis
Descriptive statistics were used to summarise demographic factors and TAM construct scores. A single value for each TAM construct was obtained by averaging scores of items measuring the same construct. Respondents were then categorised into different groups based on their mean usage intention score: those scoring above 3 would have minimally agreed with at least one of the statements measuring usage intention, and therefore were considered part of the “high acceptance” group. Conversely, scores equal to or less than 3 were considered “low acceptance”.
To study factors affecting acceptance, univariate and multivariate logistic regressions were performed. The independent variables were TAM constructs and demographic factors, while the dependent variable was acceptance. TAM constructs were studied as continuous predictors while demographic factors were studied as categorical variables. The independent variables used for multivariate regression contained all TAM constructs and demographic factors significant in the univariate analysis. Odds ratios and their 95% confidence intervals were computed. All statistical analyses were conducted at a significance level of 0.05. Results were analysed in IBM SPSS Statistics for Windows, Version 23.0 (IBM Corp., Armonk, NY, USA).
Perceived advantages and disadvantages were reported descriptively as percentage agreement with each statement. Agreement was defined as a rating of “agree” or “strongly agree”. For open-ended responses, thematic analysis was done to identify recurring themes which could supplement the discussion on perceived advantages and disadvantages. Quotes were labelled and presented in the results if they sufficiently reflected the main sentiment of similar responses.
Results
Demographics
Demographics of respondents.
aRespondents who agree or strongly agree with at least one statement measuring usage intention.
bMore than one option may have been selected.
cThese include clinical trials, radiotherapy, medication for side effects and non-cancer hormone therapy.
Satisfaction with telemedicine.
aRespondents who agree or strongly agree with at least one statement measuring usage intention.
bOn a scale of 1 to 5, where higher values indicate greater satisfaction.
Influence of demographics on acceptance of telemedicine.
aRespondents who agree or strongly agree with at least one statement measuring usage intention.
bValues bolded and marked with an asterisk (*) are significant at the .05 level.
cConfidence is defined as a mean total confidence of ≥3, the equivalent of “quite confident” and above.
Influence of individual technology confidence items on acceptance of telemedicine.
aRespondents who agree or strongly agree with at least one statement measuring usage intention.
bValues bolded and marked with an asterisk (*) are significant at the .05 level.
cConfidence is defined as a rating of 1 = quite confident or 2 = extremely confident for the respective item.
Mean TAM scores and their influence on acceptance of telemedicine.
aRespondents who agree or strongly agree with at least one statement measuring usage intention.
bValues bolded and marked with an asterisk (*) are significant at the .05 level.
Descriptive statistics of TAM constructs
Amongst the mean TAM scores and its influence on acceptance of telemedicine, the highest-scoring facilitator of acceptance was perceived usefulness (mean 3.47, SD 0.78), while the highest-scoring barrier was resistance to use (mean 3.63, SD 0.79). Compare to scores for overall cohort, mean scores of the high acceptance group were generally higher for facilitators and lower for barriers. All TAM constructs, except for resistance to use, were found to significantly affect acceptance in the univariate analysis.
Multivariate regression on factors associated with telemedicine acceptance.
aValues bolded and marked with an asterisk (*) are significant at the .05 level.
Multivariate regression on individual items of significant TAM constructs.
aRespondents who agree or strongly agree with the TAM statement in the first column.
bRespondents who agree or strongly agree with at least one statement measuring usage intention.
cValues bolded and marked with an asterisk (*) are significant at the .05 level.
Perceived advantages and disadvantages of telemedicine
Almost all respondents (261/278, 93.9%) completed this optional section of the survey, while a small proportion gave open-ended responses (64/278, 23.0%). Respondents generally appreciated that there were both advantages and disadvantages to telemedicine, as a fair amount of agreement was observed across most statements.
For perceived advantages, respondents agreed extensively that telemedicine could enable them to receive more convenient support (218/261, 83.5%), enjoy cost savings from travel (162/261, 62.1%), and get more timely care to meet their needs (158/261, 60.5%) (Figure 3(a)). These advantages were frequently reiterated in the free responses. Percentage agreement with each perceived advantage and disadvantage of telemedicine (
Other advantages of telemedicine mentioned were regarding continued and safe care during the COVID-19 pandemic, access to overseas expertise, better flexibility in arranging consultations to accommodate other parties, and more cost-effective healthcare delivery.
The greatest disadvantage was the preference for “being able to see the healthcare worker face-to-face” (181/261, 69.3%) (Figure 3(b)). Respondents expressed strong opinions that telemedicine should remain as a complement to traditional care as it would not suit all situations. A major concern behind this was the apparent infeasibility of physical examinations if done remotely. Other disadvantages re-emphasised from those in Figure 3(b) include security issues such as verification of patient identity (144/261, 55.2%) and lack of adequate technical equipment (126/261, 48.3%). Additional worries raised were related to the patient’s ability to use technology, extent of patient privacy in a teleconsultation, and language barriers. Lastly, numerous respondents stated that they were unaware of telemedicine or had not tried it before, making it challenging to form concrete opinions on the system.
Discussion
Demographics
This study found that more than half (59.7%) of cancer patients expressed “high acceptance” of telemedicine. Respondents who were more inclined to accept telemedicine had a higher monthly income and mainly took private transport to NCCS. Consistent with prior research, this may suggest that higher socioeconomic status positively predicts telemedicine acceptance. 29 Such patients may be more confident in having the resources to use telemedicine, which also affected acceptance in our study. Demographic factors which concur with past findings included technology-related, relating to Internet access, technology confidence (specifically video calls, Internet, and wearables), and past telemedicine use. 30
Respondents who believed that telemedicine would offer them better healthcare access were significantly more likely to accept it. These findings add to current evidence that cancer patients deeply value healthcare which is convenient and readily accessible. 19 The complexity and seriousness of cancer can often be distressing, and thus receiving timely attention can help patients ease their worries and facilitate the recovery progress. 21
Respondents who felt they did not have the necessary resources for telemedicine were significantly less likely to accept it. This is possibly connected with the finding that 37.4% of respondents lacked access to the Internet, which is an unexpectedly substantial proportion compared to other reports. 31 For instance, another recent study found that 26.5% of cancer patients in their sample did not have daily Internet access, while national statistics in 2019 suggested that 11% of the country’s population did not use the Internet. 32 Another likelihood was that most respondents were unfamiliar with telemedicine, which could have caused uncertainty about what the “necessary resources” might have referred to specifically.
A major aim of a tele-oncology system should be to improve the convenience of accessing healthcare. Patients should find it easier and faster to choose a suitable consultation timing using telemedicine compared to physical clinic visits: this outcome could be a measure of the effectiveness of future tele-oncology services. One consideration for design is user friendliness, especially as confidence was subpar in using video calls. As illustrated by the mean sample age (59 years old), cancer patients are usually older. A straightforward navigation system and layout, as well as provision of instructions for use, may boost use confidence in older patients. 33 ’
Within the minority of patients who used telemedicine before, mean satisfaction with the service was high. Past telemedicine use was also a significant driver of telemedicine acceptance on univariate analysis. In their free responses, several respondents mentioned not knowing enough about telemedicine to form a definite opinion on it. Patients might have initially set lower expectations for telemedicine if they were not familiar with it. Therefore, conducting a brief telemedicine trial for patients to explore the system informally is a plausible method of increasing familiarity and hence acceptance. 34 Technical assistance could be provided throughout the trial, especially for first-time or less confident users, to help raise confidence in using the service and its perceived usefulness.
Attention should be paid to the relatively limited Internet access of respondents, which will impede the success of telemedicine. 35 Close to half of respondents were also worried about the equipment for telemedicine not functioning. Nevertheless, general technology access is anticipated to rise with time due to rapid advancements in expanding connectivity, which may promote reception to telemedicine. 8 Alternatively, future research could seek to confirm and investigate the reasons underlying this phenomenon: previously identified barriers include cost, lack of interest, or not perceiving Internet access as useful.36,37 This would enable more targeted decision-making for addressing Internet access rates among patients.
Technology acceptance model constructs
Our findings re-emphasise that telemedicine should only complement and not replace traditional care. Out of all TAM constructs, resistance to use was the highest and did not significantly affect acceptance; this suggests that patients might still choose to receive care via standard practices if it suits them, regardless of acceptance status. 36 Respondents expressed a marked preference to see healthcare workers in-person, and felt that telemedicine would only suit seasoned, stable patients not requiring physical examinations or tests. Providers should reassure patients that telemedicine will be primarily used as an adjunct, and the option of physical clinic visits would always remain available.
Based on the multivariate logistic regression model, significant factors affecting acceptance to telemedicine were facilitating conditions and perceived usefulness. Though our sample had mean age of 59 years old, close to 65% of our patients were older than 65 years old. Based on published studies, elderly patients were reported to require facilitating conditions as a main factor to accepting telemedicine.38,39 For telemedicine to occur, there is a need for sufficient knowledge and competency on operating the technological resource which result in an elderly patient’s barrier to acceptance. 38
The potential for technology to facilitate timely access to healthcare should be perceived as a useful advantage of telemedicine. Telemedicine would enable remote connections among patients and healthcare providers. As a result, this increases the accessibility for patients to healthcare providers. The notion of perceived usefulness in the acceptance to telemedicine from a healthcare providers’ perspective has been published in various studies supporting its use in healthcare systems.40,41
Perceived advantages and disadvantages of telemedicine
Our findings also identify points for patient education, as most respondents seemed unfamiliar with telemedicine. Awareness of telemedicine could be spread via healthcare providers or print material, which were the top few preferred information sources for cancer patients. 22 Resources for telemedicine should be clearly specified, such as the platform’s compatibility with various operating systems or devices. Concerns about online security were observed in more than half of respondents and should be addressed: patients could be reassured that recent guidelines reinforce telemedicine IT policies to adhere to professional standards and state laws such as the Personal Data Protection Act. 1
Limitations
Limitations of our study include selection bias was likely, as respondents were recruited via convenience sampling. As data collection was web-based, this excluded patients who do not use a mobile phone or the Internet. Therefore, actual technology access and confidence may be lower than reported. The small response rate also suggests that non-response bias may exist, and the opinions of non-respondents remain unknown. Non-response rate was consistent with other web-based surveys on telemedicine42,43,44
Conclusion
Our study showed that acceptance of telemedicine was high amongst respondents.
Respondents were largely satisfied with their telemedicine experience. Facilitating conditions such as having necessary resources and perceived improved access were identified as main predictors of high acceptance. Amongst the mean TAM scores and its influence on acceptance of telemedicine, the highest-scoring facilitator of acceptance was perceived usefulness, while the highest-scoring barrier was resistance to use. For perceived advantages, respondents agreed extensively that telemedicine could enable them to receive more convenient support, enjoy cost savings from travel and get timelier care to meet their needs. Telemedicine services should work to improve these aspects, leverage on advantages and address disadvantages brought up by patients.
Supplemental Material
Supplemental Material - Using the technology acceptance model to examine acceptance of telemedicine by cancer patients in an ambulatory care setting
Supplemental Material for Using the technology acceptance model to examine acceptance of telemedicine by cancer patients in an ambulatory care setting by Zhi Yao Chan, Chen Fang Lim, Jo Lene Leow, Feng Yong Chium, Su Wen Lim, Charlotte Hui Min Tong, Jessie Jie Xi Zhou, Moses Min Yuan Tsi, Ryan Ying Cong Tan, and Chew Sui Tjien Lita in Proceedings of Singapore Healthcare
Footnotes
Author contributions
Declaration of conflicting interests
Funding
Ethical approval
Availability of data
Supplemental Material
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
