DCR Csus UEI Deliverable 13 1 FSPIndicatorsWebinar

Feb 22, 2013 This webinar was funded by the Mental Health Services Oversight and Accountability Commission (MHSOAC). Introductions Tim Croisdale, PhD o Kate Cordell, MPH o DCR User Resources Recently Created Resources: o User Manuals  Data Dictionary  Partner Level Reporting Tool (Microsoft Access)  Data Analysis Resources  Self Guided Training Videos  Available via ITWS or at Google Shared Site o Email kate.cordell@clear-data-consulting.com for access to Google  shared site Ongoing Projects  Statewide Data Correction and Cleaning, Nov-Jun, 2013  Statewide FSP Indicators Project, Feb–Sept, 2013  County-Level DCR Data Quality Report, Jun-Nov 2013  Statewide DCR Data Quality Report, Sept 2013-Mar 2014 FSP Indicators Project The MHSOAC is hosting a project to develop four FSP  indicators which can be calculated consistently within every county. We are seeking input from counties to identify four  valuable FSP indicators which can be developed using FSP DCR data. FSP Indicators Project Options Goal: Identify Four Domains of Interest:  Residential 1. Education 2. Employment 3. Financial 4. Legal 5. Emergency 6. Health 7. Substance 8. Discharge Values (+Length of Service) 9. FSP Indicators Project Options Thanks to all counties who contributed examples of how  DCR data are being used! Note:  Example graphs and tables in this presentation may have  been designed for a different purpose Not all parts or designs of examples may be applicable to this  project We want to try to identify aspects of examples which may be  useful for this project The purpose of the examples are to stimulate conversation  not necessarily to choose one we will reproduce in its exact form FSP Indicators Indicators can be calculated for:  All partners  By age group  By program  By provider  Partners served during time frames of service (e.g., fiscal  year, quarter, calendar year, etc.) Combinations of above  1. Residential Indicators  Example Indicators Summary I-1.1: Residence by Setting I-1.2: Homelessness I-1.3: Residential Stability (residential changes) 1. Residential Indicators  Potential Indicators I-1.1: Residence By Setting Percent of partners in setting at PAF compared to discharge a) or date/now Average days before compared to during FSP b) Percentage of days/time before compared to during FSP c) Most recent setting d) I-1.1a Example - % Partners Source: San Diego County Example Data I-1.1a Example Source: San Francisco County Example Data I-1.1a Example - % Partners Source: Sacramento County Example Data I-1.1a Example - % Partners Source: MHSOAC Enhanced Partner-Level Data (PLD) Templates I-1.1a Example Parameters Source: Enhanced PLD Template Reports – Enter Parameters I-1.1b Example – Setting Ave Days Source: Los Angeles County Example Data I-1.1b Example – Setting Ave Days Source: Los Angeles County Example Data I-1.1c Example - % Days by Setting Source: San Francisco County Example Data I-1.1c Example - % Days/Time • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report I-1.1d Example – Recent Setting Source: Mental Health Services Act Evaluation: Report on Prioritized Indicators at Statewide Level Contract Deliverable 2F, Phase II http://www.mhsoac.ca.gov/Evaluations/docs/Eval_PriorityIndicators_IndividualCountyReport_SmallCounti es_Rev_121912.pdf 1. Residential Indicators  Potential Indicators I-1.2: Homelessness Actual count during partnership each month/quarter/year a) Percent change from average b) Average before FSP compared to during FSP (quarterly c) average, annual average, etc.) Percent of partners experience homelessness at any time d) (before compared to during FSP?) I-1.2a Example – Days Homeless Source: Orange County Example Data I-1.2b Example Source: Orange County Example Data I-1.2c Example Source: Los Angeles County Example Data I-1.2d Example – Any Homelessness Source: Mental Health Services Act Evaluation: Report on Prioritized Indicators at Statewide Level Contract Deliverable 2F, Phase II http://www.mhsoac.ca.gov/Evaluations/docs/Eval_PriorityIndicators_IndividualCountyReport_SmallCounti es_Rev_121912.pdf 1. Residential Indicators  Potential Indicators I-1.3: Number of Residential Changes Average number of residential moves/changes by qrt served a) I-1.3a Example – Resid. Changes Source: Sacramento County Example Data 2. Education  Example Indicators Summary I-2.1: School Status and Education Goals I-2.2: Attendance I-2.3: Grades I-2.4: Expulsions & Suspensions 2. Education Indicators  Potential Indicators I-2.1: School Status and Education Goals Partners in school a) Partners in school with education goals b) Partners receiving specialized educational services c) I-2.1a Example – In School Source: Orange County Example Data I-2.1b Example – In School & Goal Source: San Diego County Example Data I-2.1c Example – Spec. Services Source: MHSOAC Data Quality Report Example 2. Education Indicators  Potential Indicators I-2.2: School Attendance Percent of partners with good (“mostly” or better) attendance a) Percent of partners by quality of school attendance b) Change in attendance c) I-2.2a Example – Good Attendance Source: MHSOAC Data Quality Report Example I-2.2b Example – Attendance Quality Source: Mental Health Services Act Evaluation: Report on Prioritized Indicators at Statewide Level Contract Deliverable 2F, Phase II http://www.mhsoac.ca.gov/Evaluations/docs/Eval_PriorityIndicators_IndividualCountyReport_SmallCounti es_Rev_121912.pdf I-2.2c Example – Change in Attendance Source: San Diego County Example Data 2. Education Indicators  Potential Indicators I-2.3: School Grades Percent of partners with good (“Average” or better) grades a) Percent of partners by quality of school grades (no example) b) Change in grades c) I-2.3a Example – Good Grades Source: MHSOAC Data Quality Report Example I-2.3a Example – Grade Quality Source: San Diego County Example Data 2. Education Indicators  Potential Indicators I-2.4: Suspensions & Expulsions Percent of partners with suspension or expulsion before or a) during 1 year of partnership Percent of partners with suspension or expulsion before or after b) receiving 6-12 months of partnership Rate of suspensions or expulsions at baseline and during c) partnership I-2.4a Example – 1 Yr % Exp/Sus Source: MHSOAC Data Quality Report Example I-2.4b – % Exp/Sus Before vs. Begin FSP Source: Mental Health Services Act Evaluation: Report on Prioritized Indicators at Statewide Level Contract Deliverable 2F, Phase II http://www.mhsoac.ca.gov/Evaluations/docs/Eval_PriorityIndicators_IndividualCountyReport_SmallCounti es_Rev_121912.pdf I-2.4c Example – Rate Exp/Sus Source: San Francisco County Example Data 3. Employment  Example Indicators Summary I-3.1: Type of Employment I-3.2: Employed / Unemployment I-3.3: Employed by Employment Goals 3. Employment  Potential Indicators I-3.1: Employment Type Partners employed at intake compared to discharge or a) date/now Days before compared to during FSP b) I-3.1a Ex– % Employed Now by Type Source: Los Angeles County Data Example I-3.1a Ex– Employed at Intake and Now Source: San Diego County Example Data I-3.1a Ex– Employed at Intake and During Source: MHSOAC Data Quality Report I-3.1b Ex – Emp Days by Type Source: Los Angeles County Example Data 3. Employment  Potential Indicators I-3.2: Employed / Unemployed Partners employed anytime during FSP a) Partners employed at intake compared to discharge or b) date/now Days employment before compared to during FSP (no c) example) I-3.2a – % with Any Employment Source: Mental Health Services Act Evaluation: Report on Prioritized Indicators at Statewide Level Contract Deliverable 2F, Phase II http://www.mhsoac.ca.gov/Evaluations/docs/Eval_PriorityIndicators_IndividualCountyReport_SmallCounti es_Rev_121912.pdf I-3.2b Example – Emp by Qrt Source: Sacramento County Example Data 3. Employment  Potential Indicators I-3.3: Employment Goals Partners with employment goals a) Partners employed with employment goals (no example) b) I-3.3a Ex– % with Employment Goals Source: San Diego County Example Data 4. Financial  Example Indicators Summary I-4.1: Type of Financial Support Partners by type of financial support at intake a) Partners by type of financial support this quarter b) Partners by type of financial support at intake and c) discharge/now I-4.1a Ex– % with Fin. Support Type, Intake Source: San Diego County Example Data I-4.1b Ex– % with Fin. Support Type, Qrt Source: Sacramento County Example Data I-4.1c Ex– Financial Support at Intake & Now Source: San Diego County Example Data I-4.1c Ex – Financial Support at Intake & by Qrt • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report Example 5. Legal  Example Indicators Summary I-5.1: Arrests I-5.2: Incarceration Days I-5.3: Legal Status Probation, Parole, Conservatorship, Payee, WI Code  5. Legal  Potential Indicators I-5.1: Arrests Percent of partners with arrests before versus during FSP a) Counts of arrests b) Rates of arrests before and during FSP c) I-5.1a – % with Arrest Before FSP Source: Mental Health Services Act Evaluation: Report on Prioritized Indicators at Statewide Level Contract Deliverable 2F, Phase II http://www.mhsoac.ca.gov/Evaluations/docs/Eval_PriorityIndicators_IndividualCountyReport_SmallCounti es_Rev_121912.pdf I-5.1b Ex– Counts of Arrests by Qrt Source: Sacramento County Example Data I-5.1c Example – Rates of Arrests • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report 5. Legal  Potential Indicators I-5.2: Incarceration Days Total days by time period (e.g., quarter) a) Change in incarceration days b) I-5.2a Example – Days Incarceration Source: Orange County Example Data I-5.2b Ex–Inc. Days Change Source: Orange County Example Data 5. Legal  Potential Indicators I-5.3: Legal Status Percent of partner by status (no example) a) Change in status b) I-5.2b Example – Change in Legal Status • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report 6. Emergency  Example Indicators Summary I-6.1: Emergency Events I-6.2: Psychiatric Hospitalization Days 6. Emergency  Potential Indicators I-6.1: Emergency Events Count of mental health emergency events by partner by a) time period Count of physical health emergency events by partner by b) time period Rate of mental health emergency events before and during c) FSP Rate of physical health emergency events before and during d) FSP I-6.1a&b Example – Counts of Events by Qrt Source: Sacramento County Example Data I-6.1c Example – Rates Mental Health Emerg. Source: San Francisco County Example Data I-6.1d Example – Rates Physical Health Emerg. Source: San Francisco County Example Data I-6.1d Example – Rates Physical Health Emerg. Source: San Francisco County Example Data I-6.1c&d Example – Rates Emergencies • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report 6. Emergency  Potential Indicators I-6.2: Psychiatric Hospitalization Days (from Residential) Count of days before and during FSP a) Change from average b) I-6.2a Example –Days Before and During FSP Source: Los Angeles County Example Data I-6.2b Example – Change Psych Hosp Days Source: San Francisco County Example Data 7. Health  Example Indicators Summary I-7.1: Partner Has a Primary Care Physician Current status for all active partners by quarter a) Percent of partners with physician before compared to b) discharge/now I-7.1a Example – Has Current PCP by Qrt Source: Sacramento County Example Data I-7.1b Example – % with PCP Before and Now Source: San Diego County Example Data I-7.1b Example – % with PCP Before and Qrt • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report I-7.1b Example – % with PCP Before and Qrt Source: MHSOAC Data Quality Report 8. Substance  Example Indicators Summary I-8.1: Partner Co-Occurring Disorder Current partners who have co-occurring disorder a) Percent of partners with co-occurring disorder before and b) during FSP Percent of partners received substance abuse services before c) and during FSP Partners with co-occurring disorder receiving substance d) abuse treatment (no example) I-8.1a Example – Has Co-Occurring Disorder by Qrt Source: Sacramento County Example Data I-8.1b Ex – % with Co-Occ Dis. Before and Qrt • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report I-8.1b Ex – % with Co-Occ Dis. Before and Qrt • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report I-8.1c Ex – % SA Services Before and Qrt • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report I-8.1c Ex – % SA Services Before and Qrt • For evaluation, could restrict to include matched pairs of values only Source: MHSOAC Data Quality Report 9. Discharge Values  Example Indicators Summary I-9.1: Discharge Reason I-9.2: Length of Service I-9.3: Discharge Reason and Length of Service 9. Discharge Values  Potential Indicators I-9.1: Discharge Reason Percent & count of partners by discharge reason a) I-9.1a Example – Count by Discharge Reason Source: MHSOAC Data Quality Report I-9.1a Example – % Discharge Reason by Qrt Source: Sacramento County Example Data I-9.1a Example – % Discharge Reason Source: San Diego County Example Data 9. Discharge Values  Potential Indicators I-9.2: Length of Service Percent partners discharged by length of service categories a) I-9.2a Example – Length of Service Source: San Francisco County Example Data 9. Discharge Values  Potential Indicators I-9.3: Discharge Type and Length of Service Length of service by discharge type a) Discharge type by categories of length of service (no b) example) E.g.,   % discharge reason for those served <1 yr  % discharge reason for those served >= 1 yr  Exclude target criteria category and calculate % ? I-9.3a Ex-Length of Service by Discharge Type Source: MHSOAC Data Quality Report Next Steps  Target four domains of focus  Incorporate feedback and design example/suggested indicators in domains  Create training dataset of programs with quality data (few missing 3Ms and frequent number of KETs)  Create examples of formulated indicators using training dataset  Schedule follow up webinar to discuss examples of formulated indicators from training dataset  Survey to identify four indicator formulations Four Formulated Indicators Identified!  Create documentation on exact formula to calculate indicators  Create calculation templates Excel (user enters counts into designated cells) o Access (Partner-Level Data Templates calculates from o exported DCR CSV files)  Perform regional training on using formulated indicators documentation and templates August, 2013 o Questions? Feb 22, 2013 This webinar was funded by the Mental Health Services Oversight and Accountability Commission (MHSOAC).