Abstract
Introduction
Patients with heart failure have significant physical and psycho-emotional concerns.1,2 However, these concerns are often under-detected and reported.3–5 Palliative care services aim to improve the quality-of-life of patients with serious illnesses. Screening of patients using patient and staff reported tools may prove to be an effective way of identifying those who need palliative care. These patients can then be promptly referred to palliative care by their primary clinicians, allowing them to receive palliative care support, in a timely manner.6–11
The Integrated Palliative Care Outcome Scale (IPOS) is a widely used patient-and-staff-reported outcome measure that could be used to screen patients with serious illnesses.12,13 Developed in the United Kingdom, this brief measure is shown to be clinically meaningful with good psychometric properties in the palliative care setting. 14 However, screening tools developed in another country may not be entirely applicable in a new setting due to differing socio-economic-cultural contexts and disease-specific impacts. 15 It is also unknown whether a tool that was developed in a specialist palliative care setting would be readily usable in a setting where most of the care are provided by cardiac specialists who are non-palliative care specialists (generalists) 16 and specialist palliative care services are only available on a consult basis.
Therefore, our team sought to evaluate the validity and reliability of the IPOS locally17,18 as well as seek factors that would influence subsequent IPOS implementation for routine screening of patients with advanced heart failure in Singapore, in the clinical, non-research setting. In
Methods
Study design and setting
This qualitative study is part of a two-phase prospective study that was carried out in the inpatient and outpatient setting of the National Heart Centre Singapore (NHCS). NHCS is a large volume national referral center for heart failure (HF) patients, staffed only by cardiac specialists. 19 Patients with heart failure who have palliative care needs are referred to consult palliative care services in the Singapore General Hospital 20 and the National Cancer Centre Singapore. 21
In the first phase of the project, we validated the IPOS scale (full details are described in the prior published paper). 18 English-speaking patients with heart failure, aged 21 years and above, and who were aware of their diagnosis participated in the study. Patients were given a physical hard copy of the patient IPOS to fill in. For staff participants, nursing and physician staff from the palliative care and heart failure teams who directly cared for the recruited patient participants were asked to fill in a physical hard copy of the staff IPOS for his/her patient. This was done so that each patient’s IPOS would be matched by a staff IPOS. Staff participants were not part of the study team.
In the current study, we purposively invited patient participants who had already completed the IPOS in the first research validation phase for semi-structured interviews. This ensures that they had prior exposure to the IPOS screening tool. We ensured diversity in terms of age, gender, years living with heart failure (for patients) and setting that care was received (inpatient
A female research coordinator (JT), trained in qualitative research, with no dependent relationship and pre-existing bias with the participants was responsible for recruiting participants. Semi-structured interviews focused on understanding their views toward their healthcare and the implementation and use of IPOS in Singapore. The semi-structured interview guide was developed based on existing literature23–25 (Supplemental Appendix 1).
Conceptual framework
Our study was guided by the Consolidated Framework for Implementation Research (CFIR) 25 – a framework commonly used for assessing context and the potential barriers and facilitators to implementation of an intervention within that context. The CFIR contains five major domains that guide program evaluation and implementation. These are: intervention characteristics, outer setting, inner setting, individual characteristics, and process.
Data collection and analysis
Interviews were conducted in a private setting in the clinic, audio-recorded, and transcribed verbatim with field notes taken when needed. The interviews lasted for maximum 1 h. Transcripts were checked for accuracy before coding. Coding was performed independently by two of the authors (SN and JT). Transcripts were thematically analyzed based on Braun and Clark. 26 The coders familiarized with the data and generate initial codes independently before collecting codes into potential categories and subthemes. The categories and subthemes were constantly reviewed and reclassified. We subsequently mapped the code categories and subthemes to the relevant domains of the CFIR. 25 We resolved discrepancies in coding and theme generation through consecutive rounds of discussion between the two coders. Data were managed with Microsoft Excel and an audit trail was kept. Data collection, analysis, and theme generation were iterative processes. We adhered to the consolidated criteria for reporting qualitative research (COREQ) criteria for qualitative research. 27
Results
Participant characteristics
We conducted interviews with 10 patient participants. The average age of patients was 55.8 years, with an equal number of males and females. Most patients (80%) were Chinese. More than half (60%) had secondary school education and above. Patients had an average length of illness of 5.1 years. Majority (90%) were New York Heart Association functional status 1 and 2. Patients were equally distributed between inpatient and outpatient settings.
Out of 12 healthcare staff participants who participated in the validation phase of the study, 9 healthcare staff (75%) participated in the semi-structured interviews phase. The rest could not participate as they had left the institution. The mean age of staff participants was 32.5 years. There were more female staff (77.8%). Four nurses (44.4%) participated, and the rest (55.5%) were physicians. On average, they had 6.2 years of experience with heart failure patients. More staff (77.8%) had a primary specialty of heart failure compared to palliative care (Table 1).
Participant characteristics.
Mean and standard deviation (SD) for continuous variables, frequency (
IPOS, Integrated Palliative Care Outcome Scale.
Themes
We present two major themes. Theme 1 – Facilitators to implementation – is presented inTable 2 while Theme 2 – Barriers to implementation – is presented in Table 3. Table 4 summarizes how our facilitators and barriers relate to the domains in the Consolidated Framework for Implementation Research (CFIR) and this is also visually presented in Figure 1. A succinct version of quotes from patient (PT) and healthcare worker (HCW) is presented in the text. Views of patients
Theme 1 – Facilitators to implementation of the Integrated Palliative Care Outcome Scale (IPOS).
Theme 2 – Barriers to implementation of the Integrated Palliative Care Outcome Scale (IPOS).
PCOC is an outcome assessment scale that is filled in by palliative care staff, during their reviews of palliative care patients.
Relationship of CFIR domains to factors – ‘facilitators’ and ‘barriers’ that potentially influence IPOS implementation.
CFIR, Consolidated Framework for Implementation Research; IPOS, Integrated Palliative Care Outcome Scale.

Relationship of barriers and facilitators to domains on the Consolidated Framework for Implementation Research.
Theme 1: Facilitators for implementation
Subtheme 1a and 1b: Perceptions of utility and minimal complexity (intervention characteristics)
First, the utility of IPOS was commonly recognized. Both patients and staff brought up myriad examples of how IPOS could be used in the local setting. For example, staff believed that the IPOS could be usefully adopted as a guide in cardiology setting for symptom assessment (‘
In general, healthcare staff and patients did not find it difficult to understand the phrasing of the IPOS items – (‘
Subtheme 1c: Conducive culture (outer setting)
In terms of institutional culture and values, both patients and healthcare staff valued the IPOS and felt that it would serve as a means to achieve patient-centered care (‘
Another aspect related to culture that would favorably impact the implementation of IPOS was that of the culture between different clinical teams. One heart failure care staff described a pre-existing strong collaborative culture between the palliative care team and heart failure team to be an advantage (‘
Subtheme 1d: Dedicated resources (inner setting)
In terms of facilitation for administration, having dedicated resources such as coordinators to administer the IPOS was seen as important to aid IPOS implementation (‘
Subtheme 1e: Perception of relatability (individual characteristics)
In addition, the items on the IPOS were relevant to patient participants. For example, one patient said, (‘
Subtheme 1f: Advocates for implementation (process)
Participants highlighted the importance of engaging people at various staff levels within the healthcare system. These would include having opinion leaders amongst the multidisciplinary staff. Opinion leaders could help spread the message about the benefits of using IPOS (‘
It was also mentioned that patients themselves could be a voice for promoting the value of participating in IPOS to other patients (‘
Theme 2: Barriers to implementation of IPOS
Subtheme 2a: Need for adaptation (intervention characteristics)
Both patients and staff felt that there was still a need for the IPOS to be further modified and adapted prior to a large-scale implementation in clinical setting. For example, staff wanted to be able to elaborate on the issues at hand (‘
One patient expressed the importance of tailoring surveys to specific care settings to adequately address distinct concerns. For example, it was suggested (‘
Both patient and staff emphasized the need for adapting to current workflows to seamlessly integrate IPOS (‘If you incorporate into their work, that means you are giving them. . . the assessment form (IPOS).’ – PT48). From a healthcare staff workflow perspective, it was crucial to ensure easy access to IPOS results and their trends (‘something easily retrievable that we can see and compare to the previous IPOS’ – HCW 12).
Subtheme 2b: Cultural concerns (outer setting)
Healthcare staff shared cultural concerns regarding the use of IPOS for screening spiritual concerns. For example, the item of ‘peace’ was seen as subjective (‘
One palliative care staff stated that culturally, sharing about psycho-emotional concerns could be seen as a weakness (‘
Both healthcare staff and patients also shared concerns regarding language literacy. For example, one healthcare staff verbalized that the IPOS would potentially be more suitable for ‘English-speaking participants’ only (‘
Regarding technological literacy, it was stressed that technological aspects related to the use of IPOS were important, because if left unaddressed, these could pose potential barriers to implementation. For example, healthcare staff felt that IPOS should be administered by electronic means for ease of review and integration into the clinical documentation rather than relying on hard copies and that the IPOS interface should be user-friendly (‘
On the other hand, this view was not shared by all patient participants. For example, one patient participant maintained that it was important to consider the technological literacy of different types of patients as it would affect the mode of IPOS administration (‘
Subtheme 2c: Mindsets and role strains (inner setting)
Although a collaborative culture between heart failure team and palliative care team was acknowledged as an important facilitator for IPOS implementation, this view was not consistent across staff. For example, a heart failure staff noted that the pre-existing network between the two teams may paradoxically reduce the motivation to implement IPOS in a setting where cardiologists were the primary care providers (‘
Participants also spoke of the varying degrees of acceptance amongst different disciplines for IPOS implementation. Achieving a balance towards change was, to some extent, related to a mindset towards the acceptability of palliative care (
From the patient perspective, educating patients about palliative care and the benefits of participation in IPOS was an essential first step before the implementation of IPOS (‘
Lastly, heart failure staff, in particular, experienced role strain with regards to expanding their skillsets and role beyond cardiac care. For example, one staff described how personally it felt awkward asking patients about topics on the IPOS as these topics were beyond their heart-related issues (‘
Subtheme 2d: Resource constraints (inner setting)
Although it was described earlier that the time required to complete the IPOS was acceptable by most, there remained considerable time constraints in the clinic. Both staff and patients were concerned if there would be enough time for doing the IPOS assessment or for doctors to respond to the IPOS results (‘
Regarding other members of the multidisciplinary team, there were also concerns about the time constraints for nurses to complete the staff version of the IPOS (‘
Lastly, a participant described that the lack of a dedicated resource for follow-up of palliative care issues after conducting the IPOS survey was also seen as a potential barrier (‘I don’t know whether you can do this in this survey (IPOS) or not? But I think that that is an important part of palliative care. Because if I got a concern and no one is listening to me at home or anywhere. . . I got nowhere to vent. . .maybe that’s where the solution is at.’ – PT25).
Subtheme 2e: Individual needs (individual characteristics)
From the patient perspective, some patients found it important to have a physical document to review while completing the IPOS. Clinical services should also be attentive to provide support in case of any queries related to filling out the IPOS (‘
In terms of the compatibility of IPOS for individual patients, views varied. In an earlier section on facilitators to implementation, one heart failure patient described the IPOS as ‘relatable’. However, this view was held differently by healthcare staff. For example, a heart failure healthcare staff described that the IPOS could be more suitable for use only by a subset of patients (‘
Subtheme 2f: Change process (process related)
Patients also expressed that individual patients might be at different stages of readiness for adopting IPOS (‘
Both palliative care and heart failure staff opined that it would be better to have a trial period before full-scale implementation of IPOS (‘
Relationship to key domains of CFIR
Our analysis revealed that facilitators and barriers to implementation of IPOS spanned all five domains of the CFIR (Table 4). For example, in the ‘outer setting’, cultural factors such as having a ‘conducive culture’ were a facilitator for implementation, yet ‘cultural concerns’ were also a barrier to implementation. This was observed for the other four domains of CFIR – ‘intervention characteristics’, ‘inner setting’, ‘individual characteristics’, and ‘process’. We observed that there were more facilitators to implementation in the ‘intervention characteristics’ as compared to barriers, which would be helpful for advocating for the use of the IPOS screening tool locally. We summarized these findings visually in Figure 1 to illustrate the interactions between different components of the CFIR.
Discussion
Main findings
In this study, we found various factors that could affect the implementation of IPOS. Facilitators include: (i) perception of utility, (ii) perception of minimal complexity, (iii) perception of relatability, (iv)conducive culture, (v) dedicated resources, and (vi) advocates for implementation. Barriers include: (i) need for adaptation, (ii) mindsets/role strains, (iii) resource constraints, (iv) cultural concerns, (v) individual needs, and (vi) change process. Facilitators and barriers cut across all five major domains of the CFIR.
With regard to facilitators, a systematic review in the palliative care setting described the importance of having a coordinator present throughout the implementation process, and that pre-implementation educational component would be crucial.
28
A subsequent systematic review published in 2018 by Foster
Regarding barriers, our findings of mindsets, role strains, resource constraints, individual factors, and change process are similar to what was described in a recently published editorial regarding barriers to implementing cardiology-specific-outcome measures. 30 In that editorial, barriers included factors related to staff reluctance, system factors, difficulties in patient completion, and clinician interpretation.
When considering potential improvement of facilitators and possible modification of barriers, altering factors related to the ‘intervention’ of IPOS itself, such as elaboration or rephrasing of IPOS items, may prove challenging. While there was a suggestion by a patient that there should be an ‘inpatient’ version of the IPOS
Additionally, modifying factors related to the inner culture or the ‘inner setting’ or with regards to ‘mindsets’ would possibly yield more successful implementation of IPOS locally. One example is that of the ‘pre-existing collaborative culture’. Establishing a close network between palliative care team and heart failure team is still more likely than not to foster the integration of palliative care principles into usual cardiac care. A close collaborative network could also facilitate palliative care services in generating a ‘tension for change’ and cultivating a ‘collaborative sharing climate’. This in turn supports co-learning and teaching of principles related to screening of needs for patients potentially requiring palliative care support.31,32
With regard to the inner setting and ‘resource constrains’, ‘time’ has traditionally been a significant issue in Singapore, 33 and most recently exacerbated by the COVID-19 pandemic. 34 With increasing demands on healthcare staff, achieving buy-in for IPOS implementation would almost certainly require significant systemic change related to ‘workflows’, as well as the use of appropriate ‘technological’ support and innovation. 35
Both patients and staff brought up considerations regarding cultural sensitivities ‘literacy’ concerns. Poor technological literacy has been described in local publications.36,37 Cultural views towards palliative care and perceived potential stigma of discussing psycho-emotional issues were also similarly described in our prior work.38,39 Therefore, more efforts would be needed to improve patient engagement regarding the value of patient-reported surveys and how support could be given to individuals who have challenges with palliative specific surveys, before large-scale roll out of IPOS for patients with heart failure in the cardiology setting.
Lastly, process factors such as ‘stage of change’ related well with our prior study on the staff validity of IPOS.
18
We noted that a significant number of staff assessments were incomplete or marked by staff as ‘unable to assess’. These were mainly related to psychosocial issues, such as screening for patient’s anxiety, or screening for practical problems. Having a trial period would facilitate specific support to staff who have challenges regarding screening for subjective psycho-emotional symptoms. Inter-rater differences between patient and staff on outcome measures and surveys have also been reported in other settings.
40
Further work on how best to integrate patient and staff assessments as well as which aspects of palliative care screenings could be done by ‘generalists’
Strengths and limitations
This study has a few strengths. First, its recruitment of both patients and staff allowed for comprehensive assessment of the factors influencing the implementation of the IPOS in a multidisciplinary context. Second, beyond assessing validity and reliability of IPOS, we have also evaluated barriers and facilitators to identify real-world factors that would influence implementation of IPOS. Third, this study was performed in a non-palliative care setting, in contrast to other studies where patients were recruited predominantly from palliative care services.12,13 We have illuminated the potential challenges of implementing a palliative care-specific patient screening tool in a non-palliative care setting. Our study is especially relevant amid the changing demographics of physicians and growing numbers of patients who will need palliative care support. There is a strong need to determine which patients would benefit most from specialist palliative care
A minor limitation of this study was that the IPOS was only validated in English, due to funding constraints on the part of the study team. Therefore, we were unable to recruit Chinese speaking participants in the current study. This may explain why staff participants expressed concerns about the potential limitations of the IPOS, particularly regarding its suitability for ‘non-English-speaking’ patients. However, it should also be noted that the literacy profile of Singaporeans has also improved over time and English is now most frequently spoken at home and thus the IPOS should still be acceptable for use by a significant majority of the patient population. 42 As the IPOS had not been formally implemented in the clinical setting, we did not seek participants’ input on the degree to which they felt the various factors influenced the extent of IPOS implementation.
Another potential limitation of this study is related to the patient sample size. While we did achieve data saturation with 10 patients, and it is worth noting that
Third, although CFIR is a widely used framework for assessing intervention implementation, there is a possibility that our mapping of findings to the CFIR may have overlooked some factors that are relevant to other settings. Consequently, our results may not be fully representative of various settings with different healthcare systems. Lastly, the study primarily relied on staff and patient interviews. Inclusion of other methods such as observations or involving other stakeholders such as healthcare leadership may provide more comprehensive understanding of the implementation process.
Conclusion
This study provided important insights into the various facilitators and barriers to implementation for IPOS in patients with heart failure in Singapore. We also presented possible strategies for ensuring a seamless implementation of IPOS for patients with heart failure who are cared for in a setting primarily managed by generalists, with specialist palliative care services accessible only through consult.
Future studies could be performed with non-English-speaking participants to substantiate our findings. The short-term, medium-term, and long-term fidelity, reach, and adoption of the IPOS tool on a larger scale in the cardiology setting should also be evaluated in the future, following formal IPOS implementation locally for clinical assessment. Further studies should also be done on how to effectively build generalist palliative care capacity and engage patients in palliative care discussion in a culturally safe and appropriate manner.
Supplemental Material
sj-docx-1-pcr-10.1177_26323524231214814 – Supplemental material for Facilitators and barriers to implementation of a patient and staff reported measure for screening of palliative concerns of patients with heart failure: a qualitative analysis using the Consolidated Framework for Implementation Research
Supplemental material, sj-docx-1-pcr-10.1177_26323524231214814 for Facilitators and barriers to implementation of a patient and staff reported measure for screening of palliative concerns of patients with heart failure: a qualitative analysis using the Consolidated Framework for Implementation Research by Shirlyn Hui-Shan Neo, Jasmine Yun-Ting Tan, Elaine Swee-Ling Ng and Sungwon Yoon in Palliative Care and Social Practice
Footnotes
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
