Abstract
Keywords
While work is identified as an important personal goal by individuals living with severe mental illnesses (SMI) such as schizophrenia, bipolar affective disorder, and moderate to severe major depression, anxiety disorders, and personality disorders, employment rates among these people remain unacceptably low worldwide.1,2 According to the Australian Bureau of Statistics, only 26% of people with psychosocial disabilities, particularly those with severe or complex mental health conditions, are employed, compared to 57% of people with other disabilities and 80% of those without disabilities (www.abs.gov.au/articles/psychosocialdisability#employment).
The Individual Placement and Support (IPS) model is the most widely researched form of supported employment designed to help individuals with SMI achieve competitive employment. IPS follows a ‘place-then-train’ approach grounded on eight core principles, supported by a validated fidelity scale. 3 These principles include a focus on competitive employment as the goal, zero exclusion based on diagnosis or symptoms, attention to consumer preferences, integration of vocational services with mental health treatment, benefits counselling, job development based on individual interests, rapid job search, and ongoing support following job placement. 3 Reviews of randomised controlled trials (RCTs) have provided robust evidence that IPS is significantly more effective than traditional vocational rehabilitation or treatment-as-usual approaches for people with SMI to obtain competitive employment.4–6 However, the majority of these RCTs have been conducted in the United States, with relatively few studies from other geographical regions. 7 While the efficacy of IPS has been well-established through controlled trials, pragmatic studies evaluating the effectiveness of IPS in routine clinical practice have been less common and more methodologically challenging. 8 This is particularly true in Asia and Oceania, where research on real-world IPS implementation is limited, and both efficacy and effectiveness trials are sparse,9–14 warranting further investigation.
Furthermore, IPS-related research has revealed that a substantial proportion of the participants with SMI across various geographical regions are not able to obtain competitive employment during their involvement with IPS.4–7 Several factors, such as differences in demographic and clinical characteristics of the participants, IPS programme elements, skills of the employment consultants, economic and job market conditions, and regulatory frameworks, can influence employment outcomes.15,16 A greater understanding of these factors and addressing any modifiable risk factors could enhance the outcomes of IPS programmes. However, there is a lack of comprehensive research, particularly from the Oceania and Asian regions, examining the demographic, clinical, and programme-related variables that influence employment outcomes of IPS programmes. We evaluated the employment outcomes of an IPS programme implemented in partnership between an adult community mental health service in Australia and a disability employment service provider. We examined the demographic, clinical, and service-related factors associated with successful employment outcomes among participants with severe mental illness.
Methods
Study location
This study was conducted at Bentley Health Service, Bentley, Western Australia which serves approximately a population of 300,000 people. The health service provides a comprehensive range of mental health services, including youth, adult, and older adult inpatient and community mental health services. The adult community mental health service provided clinical services to approximately 600 patients with SMI between the ages of 18 and 65 who resided in the community.
Description of the IPS programme
The health service commenced a co-located IPS programme in partnership with a disability employment service provider, Advanced Personnel Management (APM), in November 2017. The IPS team consisted of two employment consultants and a supervisor. The employment consultants and supervisor collaborated closely with the multidisciplinary clinicians of the health service, and referrals were encouraged through ongoing liaison with the clinicians. The IPS programme was implemented adhering to its eight core principles, and a fidelity review of the programme conducted in January 2022 achieved an exemplary rating. Employment consultants maintained detailed records of all referrals, including referral outcomes, services provided, employment outcomes, and duration of service involvement.
Study period and participants
This study period spanned from the commencement of the IPS programme on 30 November 2017 to 31 December 2021. The study sample comprised consecutive participants enrolled in the IPS programme during this period.
Exclusion criteria: • Those who were not receiving social security benefit payments or National Disability Scheme Funding from the Commonwealth government. • Those aged under 18 or over 67 years. • Those who were assessed by Services Australia not to have capacity to work at least 8 hours per week with support. • Those who were in in full time study or were already engaged in work at their assessed capacity.
However, no referred patients were excluded from participation in the IPS programme based on their diagnosis or symptoms.
Data collection
Data for this study were collected between February and April 2024 by a senior psychiatry trainee doctor under the supervision of a senior psychiatrist, ensuring clinical oversight. Information was sourced from the participants’ health service medical records and APM’s IPS service database. The following data was extracted from the IPS dataset maintained by APM: date of referral, date of acceptance, date of commencement of IPS, duration from commencement of IPS to first employer face-to-face contact, length of engagement in the IPS, number and nature of competitive employment positions obtained, wages earned, and the assigned funding levels from the Australian government. Funding was allocated to APM per registered participant, and levels ranged from one to five and were based on factors such as demographic characteristics, duration of unemployment, labour market conditions, identified barriers to employment, disability indicators, and functional capacity. Level 1 indicated the highest likelihood of employment and the lowest support allocation, while Level 5 indicated the lowest likelihood of gaining employment without interventions and was associated with the highest level of funding. Additional outcome-based payments were allocated to APM once participants started a job and remained employed for specific periods. These varied according to employment type, hours worked and duration of employment.
Demographic and clinical characteristics of the patients such as age, gender, accommodation, ICD-10 diagnosis, comorbidities, substance abuse, age of onset of mental illness, age at first hospitalisation, number of psychiatric hospitalisations, and participation in psychosocial interventions such as clinical psychology, occupational therapy, social work, National Disability Insurance Scheme, or intensive case management were extracted from their medical records. In addition, data on the Kessler Psychological Distress Scale (K10), 17 Health of the Nation Outcome Scales (HoNOS), 18 and Life Skills Profile-16 (LSP-16) 19 were extracted from the electronic records. The demographic and clinical data were collected with reference to the time of the participant’s referral to the IPS programme.
The ICD-10 (International Classification of Diseases) was used for psychiatric diagnosis. Psychiatric comorbid conditions were categorised as either present or absent, except for substance use disorders. Substance use disorders were documented separately for lifetime use and current use (within the past 6 months). Medical comorbidities were identified through a detailed review of medical records, including psychiatrist notes, documentation of liaison with general practitioners or specialists, and prescribed medications.
Ethics permission and consent
The study was approved by the Royal Perth Hospital Human Research Ethics Committee and relevant Governance Committees (Project Reference Number RGS0000005270). The ethics committee provided a waiver of the need to obtain consent from individual participants.
Statistics
All statistical analyses were conducted using Jamovi open-source software (version 2.4.11). Descriptive statistics were employed to summarise the variables associated with the IPS programme, providing a clear overview of the data characteristics. A chi-square test was performed to assess the distribution of demographic and clinical variables across the various study groups. The mean score differences between groups were examined using the independent samples
Results
Description of the sample
Demographic and clinical characteristics of patients who participated in the IPS programme.
Comparison of clinical and demographic characteristics of patients who obtained and did not obtain competitive employment
Clinical and demographic characteristics of patients who obtained and did not obtain competitive employment (CE).
aChi-square test.
bIndependent samples
cMann–Whitney U test.
No significant differences were observed between the groups with respect to primary psychiatric diagnosis (schizophrenia spectrum vs other disorders), presence of medical comorbidities, substance use history, duration of illness, age at onset, or psychiatric hospitalisation. Likewise, no differences were found in their engagement with psychosocial intervention and measures of symptom severity, distress, and functional ability assessed using the HoNOS, LSP-16, and K10.
Comparison of the IPS service characteristics between the two groups
IPS service characteristics: Comparison between patients who obtained and did not obtain competitive employment (CE).
aMann–Whitney U test.
Evaluation of prediction factors
A binary logistic regression model was used to predict a ‘good outcome’ of the IPS programme, with competitive employment as the outcome (1 = positive and 0 = negative) as the dependent variable and three independent and clinically relevant variables (age at referral, time from commencement to first employer face-to-face contact, and psychiatric comorbidity). The model was statistically significant (
Discussion
Success of the IPS programme in achieving CE
While efficacy studies of IPS from the USA among people with SMI have reported successful competitive employment outcomes among 65% of participants, studies from Europe, Asia, and Oceania have generally reported lower positive figures. 7 Similarly, a review of the few studies on supported employment programmes implemented in routine clinical settings has reported lower success rates similar to ours. 8 The success rate of 42.9% of IPS participants with SMI obtaining competitive employment in this study is in the middle range of research on the efficacy and effectiveness of IPS among people with SMI from other Australian settings, which have revealed successful outcomes ranging from 12% to 71.2%.9–12 Comparable or higher success rates of 44.4% and 53.6% have been reported from Japan and Hong Kong.13,14 The IPS programme received an exemplary fidelity rating in our study, consistent with many other studies in this area. Thus, variations in programme fidelity alone are unlikely to explain the differences in success rates across studies. Other contextual factors, such as national labour market conditions, disability policies, employment regulations, and client-related clinical and demographic factors, are known to influence IPS outcomes.15,16
Determinants of successful employment outcomes
Despite the well-established effectiveness of IPS, relatively few studies have systematically examined the demographic, clinical, and programme-level predictors of competitive employment outcomes. Our study explored the association of several such variables with employment outcomes. The absence of psychiatric comorbidity and shorter time from programme commencement to first employer face-to-face contact emerged as significant predictors of obtaining competitive employment on logistic regression analysis. Younger age, while significant in univariate analysis, did not emerge as a significant variable in logistic regression. The role of age in obtaining competitive employment with IPS has generated inconsistent results, with some studies reporting that younger patients are more likely to obtain employment. In contrast, others have found no relationship between age or reported that older people are able to sustain obtained employment.15,16,20
Programme engagement emerged as a robust predictor of successful employment outcomes. Participants in IPS who believed they were ready to look for work, were active in seeking work, showed interest and motivation in their employment searches, and demonstrated self-responsibility, self-efficacy, and reciprocity were more likely to find and maintain jobs.21,22 Early face-to-face contact with employers could reflect these traits and the importance of rapid job search is a core principle of the IPS for successful outcomes. Furthermore, it is possible that comorbid psychiatric conditions such as anxiety and depression could increase the severity of symptoms and worsen motivation, self-efficacy, and drive to obtain competitive employment. Our findings highlight the importance of clinicians actively identifying and managing comorbid psychiatric conditions to ensure favourable employment outcomes.
We did not find differences between genders in obtaining competitive employment. Some researchers from Hong Kong have reported that male clients were more likely to find employment because of the physical nature of the work available in the market. 23 Cultural and labour market dynamics may influence gender disparities in employment outcomes. We did not find a significant difference in competitive employment outcomes among those with the diagnosis of schizophrenia spectrum disorders or other diagnoses. However, several authors have observed that IPS showed more favourable outcomes in studies targeting participants with SMI, such as schizophrenia and bipolar disorder, than common mental disorders, such as depression and anxiety.15,24 Interestingly, we found no significant difference in past or recent substance use between those who obtained competitive employment and others. While some researchers have not found a negative impact on IPS outcomes with substance abuse, others support the effectiveness of IPS among those with fewer comorbid substance use problems.25,26 There is increasing interest in the role of employment consultant characteristics in influencing IPS outcomes, with research suggesting that consultants with strong interpersonal, time management, and job development skills are more effective in obtaining competitive employment for their clients.27–29 While no significant differences in outcomes were observed across the employment consultants in our study, the small sample size could have limited the ability to detect such effects.
Our multivariate logistic regression model, including three clinically relevant predictors: age at referral, time from commencement to first employer face-to-face contact, and presence of psychiatric comorbidity, together explained approximately 50% of the variance in competitive employment outcomes. This is consistent with the findings of Corbière et al., 27 who identified predictors such as younger age, shorter unemployment, active job search strategies, and strong alliances, which accounted for 51% of the variance in successful outcomes. However, such modelling studies are relatively rare, and further research using larger, multicentre samples is needed to validate and expand on these findings.
Strengths and limitations
Studies examining a comprehensive set of demographics, clinical, and IPS programme-related variables predicting employment outcomes remain limited. In this study, data were collected by experienced psychiatrists, and the availability of well-maintained clinical and service records enabled the inclusion of multiple variables across a consecutive sample of individuals with SMI who were accepted into the IPS programme. Participants were drawn from a public community mental health service with a large catchment area, which enhances the generalisability of findings to similar clinical settings. However, this study was retrospective and involved collecting documented data from participant’s medical records and IPS databases. While we found the quality of documentation to be good, the accuracy of the data could not be cross-checked through direct patient interviews. While documentation and information extraction bias cannot be excluded, the data was collected after a comprehensive review of records. Furthermore, the sample size was modest and restricted to individuals with SMI, limiting the applicability of findings to other populations or service contexts. Additionally, this was an effectiveness study conducted in a real-world clinical setting rather than a randomised controlled efficacy trial. However, demonstrating that IPS is effective under everyday clinical conditions and ascertaining the predictors of response is important in supporting its broader implementation and sustainability.15,16,30 This study focused specifically on competitive employment outcomes and did not assess other potential benefits of IPS participation, such as improvements in quality of life, symptomatology, or job retention.
Conclusions
Potentially modifiable demographic, clinical, and programme-related parameters can provide valuable insights into the successful outcomes of IPS programmes. The significant number of participants who do not obtain competitive employment through their participation in IPS points towards the need for prospective research involving larger, more diverse samples of people with mental illness across multiple sites and geographical locations to understand the factors associated with successful IPS outcomes.
Footnotes
Acknowledgement
we acknowledge the contributions of Samantha Cooper who worked as Employment Consultant and Manager of the IPS Programme at Bentley Health Service.
Disclosure
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Ethical consideration
The study was approved by the Royal Perth Hospital Human Research Ethics Committee and relevant Governance Committees (Project Reference Number RGS0000005270).
Consent to participate
The HREC granted a waiver of consent, allowing the use of de-identified participant data without requiring individual consent.
Data Availability Statement
Data related to the study is available on reasonable request to the corresponding author once permission is obtained from the ethics committee.
Institution where the work was conducted: Bentley Health Service, Bentley, Western Australia, Australia.
