Abstract
Prostate cancer (PrCA) is the number one nonskin cancer among men with an estimated 174,650 men who will be diagnosed and 31,620 men who will die from the disease in 2019 (Siegel et al., 2019). African American men have PrCA morbidity and mortality at more than two times the rate of their White counterparts (Siegel et al., 2019). Myriad factors contribute to these disparities, including health beliefs and behaviors and having access to health care. None of these factors have definitive associations with PrCA morbidity or mortality (Mordukhovich et al., 2011; Taksler et al., 2012). PrCA disparities are further complicated by the ongoing debate regarding the efficacy of the prostate-specific antigen (PSA) screening exam (Kim & Andriole, 2015), which led to mixed clinical recommendations from health-care providers about screening (Fleshner et al., 2017) and an increase in patients who elect to forego screening (Gibson et al., 2016). PrCA disparities are partly explained by African American men’s lower PrCA knowledge (Dhillon et al., 2017; Owens et al., 2018). To reduce the burden of PrCA, the American Cancer Society (ACS; Wolf et al., 2010), American Urological Association (AUA; Carter et al., 2013), and the United States Preventive Services Task Force (USPSTF; Bibbins-Domingo et al., 2017) recommend that men make an informed decision with their health-care provider about whether to receive PrCA screening. Informed decision-making is when an individual understands a disease as well as risks, benefits, uncertainties, and alternatives to screening and is involved in the decision-making process to the extent that he or she desires (Briss et al., 2004). Based on this definition, many researchers identify knowledge as critical to informed decision-making (Mullen et al., 2006). PrCA knowledge is a focal point for PrCA interventions promoting informed decision-making (Ilic et al., 2015; Riikonen et al., 2018). PrCA knowledge has been measured inconsistently over time with limited psychometric evidence, particularly among African Americans, which limits generalizability across studies. Below is a review of measures used to assess PrCA knowledge among African American men.
A Review of Prostate Cancer Knowledge Measures
The Knowledge and Attitude Survey (Demark-Wahnefried et al., 1993, 1995) is a 24-item, multiple-choice questionnaire that assesses PrCA knowledge and beliefs. Scoring was based on the percentage of questions answered correctly. After administration of the Knowledge and Attitude Survey to 286 African American and White men in nine PrCA Awareness screening events in the southeastern United States, Denmark-Wahnefried et al. (1993, 1995) discovered that African American men were less likely to (a) have a regular doctor, (b) ever have a digital rectal examination (DRE) or PSA test, (c) report that
The Prostate Cancer Knowledge Inventory (Boehm et al., 1995) is a 11-item questionnaire designed to assess African American men’s PrCA knowledge and screening behaviors. Response categories for each item is
Smith et al. (1997) asked 556 African American men seven questions about PrCA knowledge (e.g., risk factors) based on measures developed by Boehm et al. (1995) and Demark-Wahnefried et al. (1995). Responses were grouped by
Abbott et al. (1998) used a pretest–posttest design to compare PrCA knowledge in African American (
The Knowledge of Prostate Cancer Screening Questionnaire (Weinrich et al., 1998) is a six-item questionnaire developed to assess men’s knowledge about PrCA screening, symptoms, and risk factors. This questionnaire was developed by interviewing 99 primarily low-income African American men about their existing PrCA knowledge. Five cancer health professionals were used to establish content validity and the measure was pilot tested on 17 occasions. Dichotomous responses were
Steele et al. (2000) developed a 13-item PrCA Risks, Knowledge, Attitudes and Screening Practices Scale to measure self-perceived risk and knowledge, attitudes, and screening practices of older men (≥50 years). Only 2 of 13 items on the scale measured PSA screening knowledge and the second question assessed men’s awareness of PSA screening. No detailed description of the measure was provided, including the scale’s development, response options, and scoring. The PrCA Risks, Knowledge, Attitudes and Screening Practices Scale was administered via phone to two populations of men in New York: a statewide sample of 631 men (84% White) and 742 African American men (Steele et al., 2000). African American men were discovered somewhat less likely than White men to recognize their higher PrCA risk and significantly less likely to be aware of the PSA screening. No psychometric properties of this scale were reported.
To examine correlates of actual and perceived PrCA knowledge among African American men, Agho and Lewis (2001) developed an original questionnaire based on recommendations from several health authorities (e.g., ACS). The questionnaire consisted of 31 items designed to measure actual PrCA knowledge, perceived PrCA knowledge, use of prostate screening services, and demographic characteristics. The Actual Prostate Knowledge Scale (Agho & Lewis, 2001) was a 21-item self-report measure designed to determine African American men’s factual PrCA knowledge and was similar to PrCA knowledge scales developed prior to 2001 (see measures reviewed above). The Perceived Prostate Cancer Knowledge Scale (Agho & Lewis, 2001) was developed to measure participants’ subjective PrCA knowledge (e.g.,
The Prostate Cancer Knowledge Scale (Wilkinson et al., 2003) is a 12-item self-report measure developed to assess men’s knowledge of PrCA risk factors, symptoms, prevention, screening, and treatment. Response options were multiple choice or
A revised Knowledge of Prostate Cancer Screening Questionnaire (Weinrich et al., 2004) was expanded from 6 (Weinrich et al., 1998) to 12 items, which measured PrCA limitations, symptoms, risk factors, side effects of PrCA treatment, and PrCA screening age guidelines. Response options were
Cormier and colleagues created the PrCA Knowledge Scale (Cormier et al., 2002) by combining 20 items from three aforementioned scales (Boehm et al., 1995; Demark-Wahnefried et al., 1995; Weinrich et al., 1998). Eleven items were from the PrCA Knowledge Screening Questionnaire (Weinrich et al., 2004). Six items were from the PrCA Knowledge Inventory (Boehm et al., 1995). Three multiple-choice items were from the Knowledge and Attitude Survey (Weinrich et al., 1998), which also assessed beliefs (three items on screening, three items on treatment, one item on perceived risk). Constructs include
Magnus (2004) developed a five-item Prostate Cancer Knowledge Scale with guidance from educational information released by the ACS. Items specifically focused on risk factors for multi-ethnic African American men, contained dichotomous response options, and scored based on the percentage of questions answered correctly. Face validity was determined by academicians and public health practitioners. This Prostate Cancer Knowledge Scale was administered to 528 African American, English-speaking Caribbean, Haitian-American, and African men in the United States. Overall, PrCA knowledge among these Black men was moderate to high with mean correct responses at 68%. Although no significant differences in knowledge between the ethnic groups was identified, men with higher incomes and family histories of PrCA had the highest knowledge scores. No psychometric properties of the scale were reported.
Radosevich et al. (2004) developed and systematically evaluated the reliability and validity of the PROCASE Knowledge Index, a 10-item scale measuring
The Cancer Knowledge Survey, developed by Powe et al. (2009), is a 23-item measure that assesses men’s knowledge of PrCA (11 items) and colorectal cancer (12 items), including risk factors, signs, symptoms, and screening recommendations for the two diseases. Response options for all questions were
To assess the impact of a spiritually-based PrCA informed decision-making intervention, Holt et al. (2009) developed two scales: the Knowledge of Prostate Cancer Scale and the Knowledge of the Screening Controversy Scale. The Knowledge of Prostate Cancer Scale is a nine-item measure that assessed PrCA knowledge and risk factors. The Knowledge of the Screening Controversy Scale is a four-item measure developed to assess knowledge of the PrCA screening controversy. One additional, original item assessed men’s knowledge about the relationship between PrCA screening and mortality. Scoring was determined by calculating the percentage of correct responses on each scale. In a sample of 49 men, Holt et al. (2009) discovered that knowledge on the Knowledge of Prostate Cancer Scale and their one, original item increased significantly whether the men received a spiritually-based or non-spiritually based education program. Only men in the spiritually-based intervention (
Ogunsanya et al. (2017) added two items to the Knowledge of Prostate Cancer Screening Questionnaire (Weinrich et al., 2004), which expanded it to a 14-item scale. The two additional items assessed the effects of diet on PrCA and the screening controversy (i.e., efficacy of the PSA test). Response categories were
Owens et al. (2018) modified Cormier et al.’s (2002) PrCA Knowledge Scale by adapting it for computer administration. Items were modified or eliminated if they were (a) unclear or inconsistent with current screening recommendations or (b) inconsistent with the
Review of Prostate Cancer Scales.
Prostate Cancer Knowledge Scale Modifications.
In a sample of 352 African American men, the modified 20-item PrCA Knowledge Scale was administered to evaluate the effectiveness of a computer-based PrCA screening decision aid,
Although multiple studies have measured PrCA knowledge among African American men, most either do not report psychometric properties of their PrCA knowledge measure (Abbott et al., 1998; Demark-Wahnefried et al., 1993, 1995; Magnus, 2004; Smith et al., 1997; Steele et al., 2000; Wilkinson et al., 2003), have low representation of African American men (Demark-Wahnefried et al., 1993, 1995), or have small sample sizes (Powe et al., 2009). For the vast majority of studies reporting the reliability of their PrCA knowledge measure, internal consistency reliability was consistently low (i.e., ranging from .45 to .66; Boehm et al., 1995; Holt et al., 2009; Ogunsanya et al., 2017; Ross et al., 2011). Two studies reporting moderate to high reliability (i.e., α = .77, α = .87) among African American men had small sample sizes and no validity evidence was reported (Agho & Lewis, 2001; Weinrich et al., 2004). Agho and Lewis (2001) also used Cronbach’s α instead of KR-20 to assess internal consistency reliability. The current study evaluated the psychometric properties of the modified PrCA Knowledge Scale (Cormier et al., 2002) in African American men, who have the highest PrCA mortality risk in the world (Siegel et al., 2019). Having a reliable and valid measure of PrCA knowledge is critical for determining whether interventions are effectively informing African American men about PrCA screening options, as recommended by the ACS, AUA, and the USPSTF. See Table 1 for a summary of the review of measures.
Conceptual Framework for the Operationalization of the Prostate Cancer Knowledge Scale in Informed PrCA Decision-Making
Social cognitive theory emphasizes the dynamic interplay between individuals, their physical and social environments, and their behaviors (Bandura & Walters, 1977). In the context of PrCA screening, multiple social and environmental influences determine whether an individual is able to make an informed decision about PrCA screening. Two key individual factors that influence whether an individual has the capacity to engage in informed decision-making about PrCA screening are PrCA knowledge and self-efficacy. PrCA knowledge refers to the information necessary for an individual to understand PrCA (including the prostate’s anatomy and function, PrCA risk factors, types of PrCA screening, and PrCA warning signs) and the risks, benefits, uncertainties of, and alternatives to PrCA screening (basis of the scale). Self-efficacy is the level of confidence an individual possesses to actively involve himself, to the extent that he desires in screening decisions. At the environmental level, several factors influence whether a man engages in informed decisions about PrCA screening, but the most common are access to: PrCA information and a provider. While the measures reviewed in this manuscript focus on PrCA knowledge (one construct associated with PrCA screening decision-making), many of the interventions that utilize PrCA knowledge measures also work to enhance a man’s comfort with speaking with a health-care provider. For example, [Blinded author] sought to enhance PrCA knowledge and self-efficacy, which is consistent with social cognitive theory.
Methods
This cross-sectional study examined the psychometric properties of a modified version of the PrCA Knowledge Scale (Cormier et al., 2002) used in a pretest–posttest design to evaluate PrCA knowledge before and after the administration of
Participants
A purposive sample of 352 African American men aged 40 and older were recruited from multiple venues in South Carolina between July 2015 and February 2016 to participate in a pilot study. Eligible participants were men who (a) self-identified as African American; (b) spoke and comprehended English; (c) had no personal history of PrCA; and (d) had no self-reported history of cognitive decline. All men were provided with study details immediately prior to their study participation through a written informed consent document. Men were asked to sign the consent after asking clarifying questions. Detailed study information is reported in {Blinded}.
Data Analysis
Descriptive statistics were conducted to describe to the sociodemographic characteristics of the men in the sample. Pearson’s correlation assessed the association between factors and subscale items. Internal consistency reliability was assessed using KR-20 for the total scale and each of the four subscales. KR-20 is an alpha used when response categories on a measure are dichotomously scored with 1 for correct responses and 0 for incorrect responses (Waltz et al., 2005).
Exploratory factor analysis (EFA) is a data-driven exploratory technique and that does not require a priori specification of the relationships between latent and observed variables (Brown, 2014; Harrington, 2009; Kline, 2005). Thus, a priori model specification is not required because factor structure and factor loadings are assumed to be unknown. The purpose of EFA is to identify the most parsimonious number of interpretable factors that explain the correlations between observed variables (Thompson, 2004). In this study, EFA was conducted to identify the number of latent constructs (factors) and underlying factor structure of the modified PrCA Knowledge Scale. The number of participants to item ratio is 14:1, which is above the recommended 10:1 often used to determine a priori sample size for EFA (Costello & Osborne, 2005).
EFA was conducted using weighted least square mean and variance (WLSMV) estimation with Geomin rotation. WLSMV is a robust estimator which does not assume normally distributed variables and provides the best option for modeling categorical or ordered data (Brown, 2014). The modified PrCA Knowledge Scale (Cormier et al., 2002) has
Fit indices used to assess model fit included the model chi-square, normed chi-square (χ2/
Results
The frequency distribution for each item of the modified PrCA Knowledge Scale is shown in Table 3. An overwhelming majority (85%,
Frequency Distribution of Items for the PrCA Knowledge Scale.
Using WLSMV, scree plot and eigenvalues suggested six factors for the modified 20-item PrCA Knowledge Scale, but the RMSEA (.03), CFI (.98), TLI (.96), and SRMR (.06) suggested a five-factor solution may provide the best fit (Table 4). In the five-factor solution, 20 items loaded positively on five different factors at 0.30 or above with factor loadings ranging from 0.34 to 0.94. Three items (5, 8, 16) cross-loaded. Seven items (1, 2, 5, 8, 9, 12, 13) loaded on
Model Fit for 19 and 20-Item Prostate Cancer Knowledge Scales.
Because the fit indices of Factors 1, 2, and 3 were below standard cutoffs in the five-factor model (Table 4), a four-factor model was examined, which resulted in better loading patterns and no cross-loadings. Factor loadings ranged from .31 to .86. Seven items (1, 2, 8, 9, 12, 13) loaded on
Exploring a 19-Item Factor Structure for the Prostate Cancer Knowledge Scale
To improve factor structure, item 10 was dropped from the four-factor model. Item 10 was related to prostate biopsy, a diagnostic test used to validate whether cancer is present beyond screening. After item 10 was dropped, the EFA yielded slightly higher fit indices for the four- and five-factor models on the 19-item
Exploring an 18-Item Factor Structure for the Prostate Cancer Knowledge Scale
Because
EFA of the 18-item factor structure resulted on 18 items loading onto a factor. While the four- and five-factor models yielded the best fit indices (Table 5), both models did not have enough items loading onto at least one factor to constitute a subscale. The three-factor model had reasonable model fit based on RMSEA (.05), CFI (.95), and SRMR (.08). For the three-factor model, five items (1, 2, 5, 7, 8, 9, 12, 13) loaded on
Factor Loadings for 18-Item Prostate Cancer Knowledge Scale.
Model Fit for 18-Item Prostate Cancer Knowledge Scale.
Means, Standard Deviations, Reliabilities, and Pearson Correlations for the Total Scale and Three Subscales of PrCA Knowledge.
Discussion
Using EFA, this study employed a multi-step process to determine the most parsimonious and interpretable factor structure for a modified PrCA Knowledge Scale using WLSMV estimation. EFA yielded an 18-item, three-factor structure (
The psychometric evidence of the 18-item, three-factor model of the PrCA Knowledge Scale may be greatly improved compared to evidence on previous versions of the PrCA Knowledge Scale because of methodological differences. The current study had a sample of 352 African American men whereas most prior studies had small samples and subsamples of African American men ranging from 11 to 123, which resulted in low reliability estimates or none reported. Studies with larger sample sizes (286–835) reported minimal or no psychometric evidence. Other PrCA knowledge scales had fewer scale items, and used various factor analytic methods and internal consistency reliability estimates to assess factors structure and reliability for a measure with dichotomous response categories. Factor structure and model fit indices can be sensitive to sample size and number of scale items, and using inappropriate estimation procedures and reliability estimates can bias results (Shultz et al., 2013; Waltz et al., 2005). Overall, this study’s three-factor, 18-item PrCA Knowledge Scale extends prior PrCA psychometric evidence by identifying a measure with more conceptually-relevant scale items, better domain coverage, and a more parsimonious factor structure that includes the most recent PrCA screening recommendations. Additional psychometric tests are needed to confirm this factor structure.
To the author’s knowledge, this is the first study to examine the psychometric properties of a PrCA knowledge scale that includes recent recommendations from the ACS, AUA, and the USPSTF, suggesting men make an informed decision, considering both potential benefits and harms of screening, with their health-care provider before undergoing PrCA screening. Based on the conceptual framework guiding this study, men who have lower knowledge of PrCA (in addition to low decision self-efficacy) may be less prepared to engage in informed decisions with their providers about PrCA as recommended by the ACS, AUA, and the USPSTF. In absence of the informed decisions about PrCA screening, men could receive later diagnoses or undergo unnecessary treatment, both of which can lead to decision regret (Gökce et al., 2017; Orom et al., 2015). Having a knowledge scale that is culturally appropriate for African American men can facilitate the evaluation of culturally targeted interventions for educating African American men about PrCA screening.
Dropping Prostate Cancer Biopsy Items
Item 10 did not load in the 20-item, four-factor structure of the PrCA Knowledge Scale and was consequently dropped. Item 10, which reads “The only way for a man to know for sure if he has PrCA is to have a prostate biopsy” was expected to load with items on
Both items 10 and 11 asked about prostate biopsy. A biopsy is a diagnostic test used to diagnose PrCA, unlike screenings that indicate general abnormalities that could be attributed to factors other than PrCA. For example, the PSA screening can be falsely lowered by medications to treat a swollen prostate or falsely elevated through vigorous physical activity (Cary & Cooperberg, 2013; Smith et al., 2016). The fact that Q10 and Q11 did not load with other screening items can potentially be explained by three rationales: (a) African American men lack biopsy knowledge, (b) prostate biopsy is not clinically or conceptually related to PrCA screening informed decision-making, and (c) question wording lacked clarity. Though some researchers support the notion that men should be informed about the potential next steps in the decision continuum (biopsy, treatment) prior to making a screening decision {Blinded}, most researchers have focused their interventions on empowering men to make each of these decisions separately (Ankerst et al., 2012; Ilic et al., 2015; Violette et al., 2015). Biopsy may not typically be discussed in conversations about PrCA screening or included in decision aids about PrCA screening. For example, Radosevich et al.’s (2004) PROCASE Knowledge Index was the only scale reviewed that measures biopsy knowledge. Consequently, healthy African American men’s knowledge about prostate biopsy may be significantly limited. Further, it is possible, based on poor performance on Q11 at pre- and post-intervention (Table 3), that men may have confused the prostate biopsy and PSA screening procedures. Findings suggest future research assess prostate biopsy and PSA screening as independent constructs and prostate biopsy specifically with more than two scale items.
Cross-Loading Items
Interestingly, Q5 (“African-American men who have fathers or brothers with prostate cancer are more likely to get prostate cancer than those who do not”) and Q7 (“Who do you think is more likely to get prostate cancer?. . ...”) both cross-loaded on
Study strengths included a large community sample of African American men, which exceeded the minimum recommended sample size for EFA (>200; MacCallum et al., 1999). The African American men were from one mid-sized city in a southeastern state and may not be generalizable to African American men who reside in other United States regions or men of younger ages, and other races and ethnicities. Cross-loadings of two items onto a factor to which it was conceptually unrelated suggest that some scale items may need further refinement prior to future scale administration. Despite these limitations, this study provides valuable psychometric evidence, which can contribute to the future development and evaluation of culturally appropriate interventions to facilitate PrCA screening decisions of African American men who are at the highest risk for PrCA mortality. Confirmatory factor analysis is warranted to confirm convergent and discriminate validity of the PrCA Knowledge Scale.
Conclusion
The robust psychometric evidence on the 18-item, three-factor PrCA Knowledge Scale demonstrates the utility of this instrument for measuring PrCA knowledge among African American men, who have the highest mortality rates nationally. Because current PrCA screening recommendations suggest that men make informed decisions with their provider about PrCA screening, there is an emergence of decision aids to enhance men’s PrCA knowledge. However, there is a lack of evidence-based, culturally appropriate scales for evaluating the effectiveness of these decision interventions for enhancing knowledge among African American men. Determining whether African American men are adequately equipped with knowledge about PrCA screening is critical to ensuring that they understand the risk, benefits, and uncertainties of screening; are able to participate in this decision at the level they desire; and ultimately avoid decision regret. Furthermore, engaging in PrCA screening decisions early could ultimately reduce their mortality risk. Therefore, the PrCA Knowledge Scale shows promise not only for being instrumental in reliably evaluating decision interventions among African American men, but also in contributing to the elimination of PrCA disparities among this racial group. The PrCA Knowledge Scale can be used with any PrCA interventions with African Americans. Future psychometric testing including confirmatory factor analysis is warranted to confirm convergent and discriminate validity of the PrCA Knowledge Scale. Future research should also confirm the factor structure of the PrCA Knowledge Scale using a larger and more demographically diverse sample of African Americans.
