US Veterans Who Do and Do Not Utilize Veterans Affairs Health Care Services: Demographic, Military, Medical, and Psychosocial Characteristics

US Veterans Who Do and Do Not Utilize Veterans Affairs Health Care Services: Demographic, Military, Medical, and Psychosocial Characteristics

Brienna N. Meffert, BS, BAa; Danielle M. Morabito, BAa; Danielle A. Sawicki, BAa; Catherine Hausman, MSb; Steven M. Southwick, MDc; Robert H. Pietrzak, PhDc,’ ¡; and Adrienne J. Heinz, PhDa,d,’ ¡,*

ABSTRACT

Objective: To examine sociodemographic and military characteristics of US veterans who do and do not utilize Veterans Affairs (VA) health care services as their primary source of health care and examine the relationship between VA utilization and medical and psychosocial characteristics.

Methods: Participants were a nationally representative sample of 3,152 military veterans (89.8% male, 83.5% white, 6.0% black, mean age = 62.0 [SD = 13.1] years) who completed a survey in 2011 assessing health care utilization, sociodemographic, military service, medical, and psychosocial characteristics. Receiver operator characteristic analyses and logistic and linear regressions were conducted to provide a comprehensive and multivariate examination of factors associated with VA utilization.

Results: Veterans who used VA services were more likely to be black, younger, female, unmarried, and less educated and to have lower household incomes. They were also more likely to have served longer in the military and in combat. VA users were more likely to screen positive for lifetime psychopathology, endorse current suicidality, and report enduring more traumas. VA users were also more likely to report more medical conditions, endorse a disability, and score lower on measures of functioning. The primary factor differentiating VA users from those that did not use VA services was presence of lifetime psychopathology.

Conclusions: Results provide a comprehensive profile of veterans who do and do not utilize VA services and suggest that veterans who use VA services have a substantially elevated health burden compared to other veterans. Results may help inform outreach and engagement initiatives targeting the unique health care needs of veterans who do and do not utilize VA services.

Prim Care Companion CNS Disord 2019;21(1):18m02350

To cite: Meffert BN, Morabito DM, Sawicki DA, et al. US veterans who do and do not utilize Veterans Affairs health care services: demographic, military, medical, and psychosocial characteristics. Prim Care Companion CNS Disord. 2019;21(1):18m02350.

To share: https://doi.org/10.4088/PCC.18m02350

© Copyright 2019 Physicians Postgraduate Press, Inc.

aDissemination and Training Division, National Center for PTSD, Veterans Affairs Palo Alto Healthcare System, Menlo Park, California

bPacific Graduate School of Psychology, Palo Alto University, Palo Alto, California

cClinical Neurosciences Division, National Center for PTSD, US Department of Veterans Affairs Connecticut Healthcare System and Department of Psychiatry, Yale School of Medicine, West Haven, Connecticut

dCenter for Innovation to Implementation, Veterans Affairs Palo Alto Healthcare System, Menlo Park, California

‘ ¡Drs Pietrzak and Heinz are joint senior authors.

*Corresponding author: Adrienne J. Heinz, PhD, 795 Willow Rd (152-MPD), Menlo Park, CA 94025 ([email protected]).

Prior research shows utilization of Veterans Affairs (VA) health care services increased from 20% in 2001 to 48% in 2016.1,2 From 2007 to 2016, the percent of female and male veterans utilizing VA services increased from 35% to 47% and 39% to 48%, respectively.2 Despite significant increases in service utilization, little is known about the sociodemographic and health characteristics of veterans who do not use VA services.1 It is critical to gain a better understanding of these characteristics so that the VA can better engage and serve veterans.

Veterans represent a vulnerable population and are at higher risk for mental and physical health struggles such as posttraumatic stress disorder (PTSD) and hepatitis C.3 PTSD among veterans can be particularly problematic, as it is characterized by additional physical and mental health comorbidities.4,5 According to the Institute of Medicine,6 up to 24% of all returning service members have PTSD, with percentages increasing every year from 2006 to 2012. Further, Jakupcak and colleagues4 found that veterans who screened positive for PTSD were 4 times more likely to report suicidal ideation than veterans who did not. Rates of suicide are disproportionately elevated among veterans, as veterans account for 18% of all deaths from suicide among US adults but constitute only 8.5% of the population.7 Considering the older average age of veterans compared to the general population,8 as well as the increased risk for mental and physical health problems, access to health care and integration of services are critical. Several independent studies9,10 have demonstrated that the VA performs better than or similar to other medical systems on measures of safety, effectiveness, mortality, and morbidity as well as quality of care. The VA has also taken innovative steps to improve integration of care within and outside VA systems. For instance, the computerized patient record system provides a fully integrated electronic system accessible at any VA, and the VA continuity of care document allows veterans to electronically share their health information with non-VA providers. Despite these encouraging findings and developments, many veterans do not use VA health care services for a wide range of reasons (eg, excessive wait times, difficulties navigating services).11,12

The 2016 Congressional report from the Commission on Care13 stated that the VA health care system struggles with staffing, funding, information systems, and gender and minority health care disparities. Many of these obstacles are administrative in nature rather than related to quality of care. Meanwhile, despite a strong record of performance on key clinical outcomes within the VA, patient satisfaction scores have been varied. Average VA satisfaction scores are comparable or worse than other facilities.14 However, 92% of veterans would rather improve the VA system than dismantle it.15

At present, much of the literature on veteran health care utilization focuses on specific groups (eg, lesbian, gay, bisexual, and transgender community; racial minorities) and conditions (eg, PTSD), leaving a significant gap in research on utilization of health care in the broader veteran population. A better understanding of differences between VA and non-VA users may help inform service planning, thereby increasing accessibility and engagement in VA health care. Thus, the aims of the current study were to analyze data from a nationally representative sample of US veterans to (1) characterize sociodemographic and military characteristics of veterans who do and do not utilize the VA as their primary source of health care and (2) employ a novel, multivariable approach of identifying patient-level correlates of VA utilization.

METHODS

Participants

Data were drawn from the National Health and Resilience in Veterans Study (NHRVS), a nationally representative study of 3,157 US military veterans aged 21 and older conducted in 2011 (see Klingensmith et al16 for detailed information on sampling procedures). In the current study, data were analyzed from 3,152 participants who completed a single item about VA health care utilization. Study procedures were approved by the US Department of Veterans Affairs and Yale University Institutional Review Boards, and all participants provided written informed consent.

• Veterans who use Veterans Affairs (VA) health care services have a substantially elevated health burden compared to other veterans.
• There is an increased need for specialty VA services targeting posttraumatic stress disorder, depression, anxiety, social phobia, drug use disorder, and suicidality in veterans.
• Research can inform outreach and engagement initiatives targeting the unique health care needs of veterans who do and do not utilize VA services.

Measures

Demographics and military service history. Participants completed a demographic questionnaire that assessed sex, age, education, race/ethnicity, marital status, household income, employment status, and metropolitan status. VA health care utilization was assessed with a single item, "Is the VA your primary source of health care?" Assessment of military service history included military branch, conflict served, years of service, combat status, level of combat exposure (Combat Exposure Scale17), and whether drafted or enlisted.

Psychiatric and substance use disorder history. Psychopathology was operationalized as endorsement of major depressive disorder (MDD), social phobia, PTSD, or suicide attempt. Substance use disorder (SUD) was characterized as endorsement of alcohol use disorder (AUD) or drug use disorder. Lifetime MDD, social phobia, AUD, and drug use disorder were assessed with the Mini-International Neuropsychiatric Interview.18 Current AUD was assessed using the Alcohol Use Disorders Identification Test19 (AUDIT-C) wherein a score > 5 indicated a positive screen for current (past year) AUD. A score ≥ 3 on the MDD and generalized anxiety disorder (GAD) questions of the Patient Health Questionnaire-420 (PHQ-4) indicated a positive screen for current (past 2 weeks) MDD and GAD. Participants were screened for current suicidal ideation (endorsement of at least 1 of 2 items of the PHQ-9), history of suicide attempts, and prior use of mental health treatment (ie, prescription medication or psychotherapy for a psychiatric or emotional problem). The PTSD Checklist21 for DSM-IV-TR was used to assess lifetime and past-month PTSD symptoms, with a positive screen for lifetime or past-month PTSD indicated by a total score ≥ 44.22 A sum of total lifetime traumas was assessed using a 15-item version of the Trauma History Screen.23 All psychiatric and SUD variables were dichotomous except for total number of lifetime traumas, which was continuous.

Medical history and functioning. A medical conditions checklist was used to assess previous medical diagnoses. All medical history variables were dichotomous except for total number of medical conditions, which was continuous. In addition, the Short Form-8 Health Survey24 (SF-8) was used to assess physical and mental functioning. SF-8 component summary scores range from 0 to 100 with higher scores reflecting better functioning. The Medical Outcomes Study Cognitive Functioning Scale25 assessed cognitive functioning in the past month. High scores reflect better functioning. Disability was assessed using an Activities of Daily Living Checklist26; a physical disability was dichotomously categorized as endorsement of difficulty with any daily living activity.

Data Analysis

First, descriptive statistics were computed on demographic characteristics of the sample (N = 3,152). Second, independent-samples t tests (Spearman ρ correlations in instances of a nonnormal distribution) and Pearson χ2 analyses were conducted to assess differences between veterans who did and did not utilize the VA as their primary source of health care. Third, a series of independent, multivariable logistic and linear regression analyses, adjusted for sociodemographic and military characteristics that differed by VA utilization, were conducted to evaluate the relationship between VA utilization and mental and physical health and functioning measures. Effect sizes were expressed using odds ratios and 95% confidence intervals (95% CIs) for dichotomous outcomes and Cohen d for continuous outcomes. Alphas were adjusted to .01 to help control against both type I and type II errors. Fourth, 2 receiver operating characteristic (ROC) analyses were conducted to identify patient-level correlates of VA utilization and to characterize unique associations of individual psychiatric and medical diagnoses with VA utilization. The primary ROC analysis included significant predictor variables as determined by regression analyses.

ROC analyses were conducted using publicly available ROC software (ROC Version 5.07). ROC analysis is a nonparametric test that allows for examination of multiple predictor variables, identifying homogeneous subgroups of a population with differential likelihood for a specific binary outcome. Although regression analyses identify similar relations, ROC analyses are uniquely able to identify systematic interactions among many categorical and continuous variables. The ROC model uses signal detection analyses to iteratively partition the sample based on the predictors and cut points that best discriminate on the outcome, yielding a hierarchical decision tree. Signal detection has been especially useful in analyses for which predictors are likely to be highly collinear and interactions between independent variables exist.27 For the current study, efficiency was optimized by setting sensitivity (avoiding false negatives) and specificity (avoiding false positives) to 50%. The ROC software searched for cut points that maximized efficiency, balancing sensitivity and specificity in the prediction of VA utilization. The strongest predictor was identified and compared against a stopping rule of P < .05. If the test does not pass the stopping rule, the analysis at that level is complete. If the stopping rule is passed, the sample is divided into subgroups based on that variable. Analyses are rerun on all subgroups until stopping rules are met. Variables associated with P > .05 are excluded from the decision tree. Analyses were again rerun on all subgroups until stopping rules were met. Through this systematic iterative approach, higher-order interactions and subgroups with differential likelihood of utilizing VA health care were yielded.27

To permit generalizability of study results to the entire population of US veterans, raw numbers of participants and weighted prevalence rates and means (SDs) were computed and applied in all analyses involving inferential statistics based on demographic distributions from the contemporaneous US Census Bureau Current Population Survey.28 These weights adjust for any survey nonresponse and any noncoverage, undersampling, or oversampling. Demographic characteristics of the NHRVS sample were consistent with those observed in prior population-based surveys of veterans.29

RESULTS

Descriptive Statistics

Of the full sample (N = 3,152), 16.9% of participants utilized the VA as their primary source of health care. Participants were 89.8% male, 83.5% white, 6.0% black, 4.8% Hispanic, and 5.7% other; the mean age of the sample was 62.0 years (SD = 13.1, range, 21-96). Of the sample, 42.4% had obtained a bachelor’s degree or higher, 52.1% reported a household income ≥ $60,000, 74.4% were married, and 84.3% lived in a metropolitan area.

Group Differences Analyses

Table 1 shows sociodemographic and military characteristics of the full sample and by VA utilization status. Compared with veterans who did not utilize the VA as their primary source of health care, VA utilizers were more likely to be black, younger, female, unmarried, and less educated and to have a lower income. Employed veterans were less likely to utilize VA health care. There were no differences based on living in a metropolitan or rural area (ie, urbanicity). In terms of military experience, veterans utilizing VA services were more likely to have served longer in the military and to have served in the Vietnam, Iraq/Afghanistan, or Persian Gulf conflicts. VA utilizers were more likely to have served in a combat zone and had higher levels of combat exposure. Furthermore, veterans that did not utilize the VA as their main source of health care were more likely to have been drafted and in the Air Force.

Click figure to enlarge

Regression Analyses

Table 2 compares psychiatric, medical, and functioning variables by VA user status. The column labeled "Bivariate Test of Difference" displays a series of independent-samples t and χ2 tests conducted to compare each characteristic by VA utilization status. The column labeled "Multivariable Tests" shows the results of the 13 linear and 36 logistic multivariable regression analyses. This column reports the relation between VA user status and psychiatric, medical, and functioning variables after adjustment for sociodemographic and military variables that differed bivariately (P < .05) by VA user status. Importantly, α was adjusted to 0.01 to help control against both type I and type II errors. Given that predictors for the ROC analysis were determined by the results of these regressions, it was important to identify all variables that could potentially influence prediction of VA utilization. The results showed that veterans who utilized the VA as their primary source of health care were more likely than those who did not to experience lifetime psychopathology. Specifically, they were more likely to screen positive for lifetime PTSD, social phobia, drug use disorder, suicide attempt, current depression, anxiety, and suicidal ideation. They also were more likely to report a history of trauma and a greater number of traumas. VA utilizers were more likely to report receiving prior mental health treatment. In terms of medical conditions, veterans who utilize the VA were more likely to have a history of a medical condition and a greater number of medical conditions. Specifically, veterans utilizing the VA were more likely to have lung conditions (eg, asthma, bronchitis, chronic obstructive pulmonary disease), chronic pain, liver disease, heart disease, high cholesterol and blood pressure, sleep disorder, migraine, osteoporosis/osteopenia, and rheumatoid arthritis. Additionally, VA utilizers were more likely to report a disability and greater difficulties with cognitive, physical, and mental functioning.

Click figure to enlarge

ROC Analyses

Figure 1 displays the results from the primary ROC analyses. This model included significant sociodemographic and military covariates, any disability, lifetime SUD, lifetime psychopathology, sum of medical conditions, lifetime mental health treatment, and suicide attempt. The primary factor that differentiated those who utilize VA services was lifetime psychopathology. Lifetime psychopathology was used to divide the sample into 2 subsamples, and the next predicting variable divides the higher-risk subsample. Specifically, 29.2% of those with a lifetime psychopathology endorsed VA utilization compared to 13.2% of those without. Individuals with lifetime psychopathology were further differentiated by service in a combat zone, whereas 41.8% of those who served in a combat zone utilized the VA compared to 20.9% of those who did not. Among those who served in a combat zone, 51.6% of veterans with ≥ 4 medical conditions reported VA utilization compared to 34.2% of those with < 4 medical conditions. Among those who served in a noncombat zone, 37.8% of veterans who had a physical disability reported VA utilization compared to 16.0% of those who did not.

Click figure to enlarge

Among veterans without lifetime psychopathology, 22.9% of unmarried veterans endorsed VA utilization compared to 10.4% of married veterans. Sum of medical conditions further differentiated unmarried veterans, as 40.0% of those who endorsed ≥ 5 medical conditions utilized the VA compared to 20.0% of those who endorsed < 5 medical conditions. Among those who were married, 15.6% of veterans with a gross income < $60,000 per year reported VA utilization compared to 6.9% of veterans with a gross income ≥ $60,000 per year.

After determining that lifetime psychopathology and sum of medical conditions differentiated those who utilize the VA, we ran a specificity analysis including all lifetime psychiatric and medical conditions (Figure 2). The primary factor that differentiated those who utilize VA services was lifetime PTSD diagnosis. Specifically, 41.2% of those with a lifetime PTSD diagnosis endorsed VA utilization compared to 14.4% of those without a PTSD diagnosis. Individuals with a lifetime PTSD diagnosis were further differentiated by arthritis diagnosis, whereas 50.8% of those who were diagnosed with arthritis utilized the VA compared to 34.1% of those who did not have arthritis. Among those without an arthritis diagnosis, 44.8% of veterans with a drug use disorder reported VA utilization compared to 28.8% of those without a drug use disorder.

Click figure to enlarge

Among those without a lifetime PTSD diagnosis, 21.7% of veterans who had a lifetime MDD diagnosis endorsed VA utilization compared to 13.3% of veterans who did not have MDD. Veterans with MDD were further differentiated by lifetime drug use disorder, whereas 32.9% of those who endorsed a drug use disorder utilized the VA compared to 18.2% of those who did not. Among those without lifetime MDD, 18.0% of veterans with a disability reported VA utilization compared to 12.2% of those without a disability.

DISCUSSION

The present study, to our knowledge, is among the first to identify characteristics associated with a greater likelihood of using the VA as the primary source of health care in the US veteran population. Additionally, this study uses a novel statistical analysis approach to determine significant differences between veterans who do and do not utilize VA services. The use of ROC analyses and logistic and linear regressions provides a comprehensive and multivariate examination of factors associated with VA utilization. ROC analyses are uniquely able to identify systematic interactions among many categorical and continuous variables and are especially useful in analyses in which predictors are likely to be highly collinear and interactions between independent variables exist.27

The study findings are consistent with prior research demonstrating that beliefs about psychiatric problems vary across cultural groups and sex, which may lead to differences in help-seeking attitudes and behaviors.30 For instance, men, especially younger men, are more likely than women to avoid or delay seeking help for medical and mental health concerns.31,32 However, women may be deterred from using the VA due to perceptions that the VA lacks care that is sensitive to issues of women’s health.33

Findings from the current study may help inform resource allocation and program development within the VA. Specifically, results highlight the increased need for specialty services targeting PTSD, depression, anxiety, social phobia, drug use disorder, and suicidality, as these mental health disorders were significantly more prevalent in VA users. Meanwhile, the findings that nearly 1 in 5 VA users (17.7%) are contemplating suicide and 14.5% of VA users have attempted suicide demonstrate the continued need for suicide prevention programs and emergency psychiatric services.

Consistent with prior research, VA users were more likely to have lifetime psychopathology. Importantly, researchers have highlighted the concern that veterans exhibit a gap in rates of mental illness versus help seeking compared to civilians.34 Approximately 25% of recently returning veterans experience mental health challenges.35 Veterans with mental health challenges will often not seek out treatment despite their being eligible for VA care,35 potentially due to low satisfaction with services, perceptions of poor care quality, and difficulty navigating the VA system.12,33,36 Further, combat veterans may need more services, as combat exposure increases the likelihood of experiencing traumatic events such as an attack or ambush, which are in turn linked to elevated risk of PTSD, depression, substance use, and other problems.37 Findings also highlight the importance of targeted services for physical health conditions, as VA users endorsed a greater number of medical conditions. Older veterans, specifically, are more likely to experience co-occurring mental and physical health challenges.38

There are limitations to this study that are worth noting. First, the survey for this study was conducted in 2011. As the VA continues to undergo changes to better meet the evolving demographics and needs of veterans, it is important to reevaluate utilization. Second, women make up about 10% of the sample in this study. Future research should oversample female veterans to better understand their health care utilization patterns. Third, VA utilization status was assessed using a single item that asked if the VA was the primary source of health care. Therefore, it was not possible to differentiate between those who do not utilize VA health care at all and those who utilize the VA as a secondary source of health care. Additionally, it is unknown whether the 83% of veterans who said they did not use the VA as their primary source of health care are receiving health care elsewhere. The current study also did not gauge utilization of specific services.

Notwithstanding these limitations, results of this study have several implications for clinical practice. First, outreach strategies tailored to specific groups of veterans identified as not using the VA could help to improve access. For example, this study found that veterans who did not use the VA as their primary health care source were more likely to be older, and outreach efforts that target older individuals may be beneficial. Rickwood and colleagues32 note that efforts to improve help seeking must enhance both the population’s awareness of the available services and the willingness or motivation to reach out and communicate their needs. Further, Pietrzak and colleagues12 recommend use of education to increase access to information about mental health care, decrease stigma, and help veterans navigate barriers to care. Future research could focus on development and evaluation of programs to raise awareness and educate veterans on the procedures required to access VA services. Education efforts may also target cultural or social norms that interfere with help-seeking behavior in veterans. Additionally, given the importance of social support in help seeking among veterans, support for families caring for veterans represents a potentially high-yield target.12 Future research should evaluate currently offered services, such as the VA Program of Comprehensive Assistance for Family Caregivers, to develop improved efforts for educating and supporting veterans and their families.39

In summary, this study highlights that there are many veterans who do not utilize VA services as their primary source of health care. Through better understanding of the factors that predict use of VA services, research can identify strategies to ensure that more veterans get the care they need. Employment of qualitative methods to gather information from non-VA utilizers could help elucidate the needs of these veterans and deterring factors. Finally, other factors that have been barriers to care for veterans in the past, such as sexual minority status, should be examined to better understand the full picture of VA utilization for more marginalized groups.

Submitted: July 13, 2018; accepted October 5, 2018.

Published online: January 17, 2019.

Potential conflicts of interest: None.

Funding/support: The National Health and Resilience in Veterans Study was funded by the US Department of Veterans Affairs National Center for Posttraumatic Stress Disorder. Preparation of this article was supported in part by a VA Rehabilitation Research and Development Career Development Award-2 (1IK2RX001492-01A1) granted to Dr Heinz.

Role of sponsor: The funding sources had no role in the design, analysis, interpretation, or publication of this study.

Disclaimer: The expressed views do not necessarily represent those of the US Department of Veterans Affairs.

Previous Presentation: Poster presentation at the annual convention of the American Psychiatric Association; May 26, 2018; San Francisco, California. Paper presented at the annual Health Services Research Conference; May 15, 2018; Menlo Park, California.

REFERENCES

1. Bagalman E. The number of veterans that use VA health care services: a fact sheet. Congressional Research Service. https://fas.org/sgp/crs/misc/R43579.pdf. June 3, 2014. Accessed April 24, 2018.

2. VA utilization profile FY 2016. National Center for Veterans Analysis and Statistics. https://www.va.gov/vetdata/docs/Quickfacts/VA_Utilization_Profile.pdf Published November 2017 Nov. Accessed April 24th, 2018 Apr 24

3. Gaziano JM, Concato J, Galea S, et al. Epidemiologic approaches to veterans’ health. Epidemiol Rev. 2015;37(1):1-6. PubMed CrossRef

4. Jakupcak M, Cook J, Imel Z, et al. Posttraumatic stress disorder as a risk factor for suicidal ideation in Iraq and Afghanistan War veterans. J Trauma Stress. 2009;22(4):303-306. PubMed CrossRef

5. Qureshi SU, Pyne JM, Magruder KM, et al. The link between post-traumatic stress disorder and physical comorbidities: a systematic review. Psychiatr Q. 2009;80(2):87-97. PubMed CrossRef

6. Galea S, Basham K, Culpepper L, et al. Treatment for posttraumatic stress disorder in military and veteran populations: initial assessment. The National Academies, July 2012. http://www.nationalacademies.org/hmd/~/media/Files/Report%20Files/2012/PTSD-Initial-Assessment/PTSD_I_RB.pdf. Accessed April 24, 2018.

7. Suicide among veterans and other Americans, 2001-2014. Office of Mental Health and Suicide Prevention. August 3, 2016. https://www.mentalhealth.va.gov/docs/2016suicidedatareport.pdf. Updated August 2017. Accessed April 24, 2018.

8. Profile of veterans: 2016. Data from the American Community Survey. National Center for Veterans Analysis and Statistics, Department of Veterans Affairs. February 2018. https://www.va.gov/vetdata/docs/SpecialReports/Profile_of_Veterans_2016.pdf. Accessed April 26, 2018.

9. RAND corporation. VA health care system faces significant challenges, but meets the needs of most eligible veterans. February 8, 2016. https://www.rand.org/news/press/2016/02/08/index1.html. Accessed April 24, 2018.

10. O’ Hanlon C, Huang C, Sloss E, et al. Comparing VA and non-VA quality of care: a systematic review. J Gen Intern Med. 2017;32(1):105-121. PubMed CrossRef

11. Institute of Medicine. Returning Home from Iraq and Afghanistan: Assessment of Readjustment Needs of Veterans, Service Members, and Their Families. Washington, DC: The National Academies Press; 2013.

12. Pietrzak RH, Johnson DC, Goldstein MB, et al. Perceived stigma and barriers to mental health care utilization among OEF-OIF veterans. Psychiatr Serv. 2009;60(8):1118-1122. PubMed CrossRef

13. Final report of the commission on care. Commission on Care. June 30, 2016 https://s3.amazonaws.com/sitesusa/wp-content/uploads/sites/912/2016/07/Commission-on-Care_Final-Report_063016_FOR-WEB.pdf. Accessed April 24, 2018.

14. The VA healthcare system: a broken system with superior quality. Definitive Healthcare. April 24, 2017. https://blog.definitivehc.com/the-va-healthcare-system-a-broken-system-with-superior-quality. Accessed May 1, 2018.

15. Our care 2017: a report evaluating veteran’s health care. Veterans of Foreign Wars. March 2017. https://vfw-cdn.azureedge.net/-/media/VFWSite/Files/Advocacy/VFW-Our-Care-2017—Executive-Summary.pdf?la=en. Accessed April 24, 2018.

16. Klingensmith K, Tsai J, Mota N, et al. Military sexual trauma in US veterans: results from the National Health and Resilience in Veterans Study. J Clin Psychiatry. 2014;75(10):e1133-e1139. PubMed CrossRef

17. Keane TM, Fairbank JA, Caddell JM, et al. Clinical evaluation of a measure to assess combat exposure. Psychol Assess. 1989;1(1):53-55. CrossRef

18. Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(suppl 20):22-33, quiz 34-57. PubMed

19. Rumpf HJ, Hapke U, Meyer C, et al. Screening for alcohol use disorders and at-risk drinking in the general population: psychometric performance of three questionnaires. Alcohol Alcohol. 2002;37(3):261-268. PubMed CrossRef

20. Kroenke K, Spitzer RL, Williams JB, et al. An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics. 2009;50(6):613-621. PubMed. 10.1016/S0033-3182(09)70864-3

21. Weathers FW, Litz BT, Herman DS, et al. The PTSD Checklist (PCL): reliability, validity, and diagnostic utility. Annual Convention of the International Society for Traumatic Stress Studies, San Antonio, TX, vol. 462; 1993. https://www.researchgate.net/publication/291448760_The_PTSD
_Checklist_PCL_Reliability_validity_and_diagnostic_utility.

22. Blanchard EB, Jones-Alexander J, Buckley TC, et al. Psychometric properties of the PTSD Checklist (PCL). Behav Res Ther. 1996;34(8):669-673. PubMed CrossRef

23. Carlson EB, Smith SR, Palmieri PA, et al. Development and validation of a brief self-report measure of trauma exposure: the Trauma History Screen. Psychol Assess. 2011;23(2):463-477. PubMed CrossRef

24. QualityMetric. SF-8 Health Survey. Boston, MA: Qualitymetric; 2014.

25. Stewart A, Ware JE, Sherbourne CD, et al. Psychological distress/well-being and cognitive functioning measures. In: Stewart AL, Ware JE, eds. Measuring Functioning and Well-Being: The Medical Outcomes Study Approach. Durham, NC: Duke University; 1992:102-142.

26. Hardy SE, Gill TM. Recovery from disability among community-dwelling older persons. JAMA. 2004;291(13):1596-1602. PubMed CrossRef

27. Kiernan M, Kraemer HC, Winkleby MA, et al. Do logistic regression and signal detection identify different subgroups at risk? implications for the design of tailored interventions. Psychol Methods. 2001;6(1):35-48. PubMed CrossRef

28. Current population survey. US Census Bureau website. https://www.census.gov/programs-surveys/cps/data-detail.html. Updated March 6, 2018. Accessed April 26, 2018.

29. Profile of veterans: 2014. Data from the American Community Survey. National Center for Veterans Analysis and Statistics, Department of Veterans Affairs website. https://www.va.gov/vetdata/docs/SpecialReports/Profile_of_Veterans_2014.pdf. March 2016. Accessed April 26, 2018.

30. Sheikh S, Furnham A. A cross-cultural study of mental health beliefs and attitudes towards seeking professional help. Soc Psychiatry Psychiatr Epidemiol. 2000;35(7):326-334. PubMed CrossRef

31. Galdas PM, Cheater F, Marshall P. Men and health help-seeking behavior: literature review. J Adv Nurs. 2005;49(6):616-623. PubMed CrossRef

32. Rickwood D, Deane FP, Wilson CJ, et al. Young people’s help-seeking for mental health problems. Aust eJ Adv Ment Hlth. 2005;4(3):218-251. CrossRef

33. Washington DL, Kleimann S, Michelini AN, et al. Women veterans’ perceptions and decision-making about Veterans Affairs health care. Mil Med. 2007;172(8):812-817. PubMed CrossRef

34. Fortney JC, Curran GM, Hunt JB, et al. Prevalence of probable mental disorders and help-seeking behaviors among veteran and non-veteran community college students. Gen Hosp Psychiatry. 2016;38:99-104. PubMed CrossRef

35. Stecker T, Fortney JC, Hamilton F, et al. An assessment of beliefs about mental health care among veterans who served in Iraq. Psychiatr Serv. 2007;58(10):1358-1361. PubMed CrossRef

36. Blay E Jr, DeLancey JO, Hewitt DB, et al. Initial public reporting of quality at Veterans Affairs vs non-Veterans Affairs hospitals. JAMA Intern Med. 2017;177(6):882-885. PubMed CrossRef

37. Farmer CM, Vaughan CA, Garnett J, et al. Pre-deployment stress, mental health, and help-seeking behaviors among marines. Rand Health Q. 2015;5(1):23. PubMed

38. Qureshi SU, Kimbrell T, Pyne JM, et al. Greater prevalence and incidence of dementia in older veterans with posttraumatic stress disorder. J Am Geriatr Soc. 2010;58(9):1627-1633. PubMed CrossRef

39. Shepherd-Banigan M, Smith VA, Maciejewski ML, et al. The effect of support and training for family members on access to outpatient services for veterans with posttraumatic stress disorder (PTSD). Adm Policy Ment Health. 2018;45(4):550-564. PubMed. 10.1007/s10488-017-0844-8