WIOA Performance Indicator Specifications
PY 2020 Specifications
PY 2019 Credential Attainment Rate Specification
Measurable Skill Gains (MSG) Rate
MSG Rate Performance Results and Levels: PYs 2017-2021
State VR programs began reporting RSA-911 related to MSG Rate in PY 2017, the first year of WIOA data collection, and have continued to report this data for PYs 2018 and 2019. PY 2020 performance results will be available after State VR programs submit their WIOA Annual Reports by October 1, 2021. In addition to performance results for PYs 2017, 2019, and 2019, this Excel file includes the estimated levels of performance (predicted by the Statistical Adjustment Model), expected levels of performance (proposed by State VR programs), and negotiated levels of performance (agreed to by RSA and State VR programs) for PYs 2020 and 2021. As more data becomes available, RSA will update this information.
Calculating MSG Rate Performance Success or Failure
RSA and the WINTAC developed the Calculating VR Program Performance for MSG in Program Years 2020 and 2021. This technical assistance tool highlights key information from RSA-TAC-20-02 related to establishing performance levels and outlines, using two examples, how RSA will calculate Individual Indicator Scores for MSG Rate after each Program Year ends.
Reporting MSG Data in PY 2020
This technical assistance document discusses how and when to use RSA-911 Data Elements 85 and 401, under PD 19-03, to report whether or not VR program participants should be included in the MSG Rate denominator.
MSG Rate Statistical Adjustment Model for PYs 2020 and 2021
On February 28, 2020, RSA provided VR agencies with the estimated levels of performance for MSG for PYs 2020 and 2021, as predicted by the Statistical Adjustment Model (SAM). In Excel file format, the SAM includes the coefficients and specific values for each variable for each State. These estimated levels may not be altered for the purposes of negotiations, including any changes in participant characteristics or economic conditions anticipated by the state that would result in changes to the levels predicted by the SAM. Any changes in participant characteristics or economic conditions will be reflected in the SAM by using the actual participant characteristics and economic conditions after the close of each Program Year and they will not be factored into the negotiations process. The Excel file also includes MSG performance for PYs 2017 and 2018 for each State VR program.
As discussed in RSA-TAC-20-02, WIOA requires that RSA use a SAM to ensure participant characteristics and economic conditions are accounted for in determining negotiated levels of performance. RSA, and its Federal partners, recognize that the use of the SAM is a new requirement for core programs and believe that it will be critically important to the negotiations process. As more data become available, RSA will periodically review the SAM and refine it as necessary. State performance will be assessed using the iteration of the SAM used to negotiate the levels of performance for that Program Year.
MSG Data Tool
The RehabData Workgroup developed the MSG Data Tool to showcase data reported by VR agencies for PYs 2017 and 2018 and provide National and State-level MSG data to all VR programs while serving as a resource for VR agencies to analyze their MSG data and compare performance to that of the VR program nationally, with similar States, and/or other VR agencies.
RSA and WINTAC developed this MSG Guide to help VR agencies understand the requirements of education and training programs that lead to recognized credentials under WIOA and the five types of MSGs. Further this guide is intended to assist VR agencies with developing their own policies and procedures based on the joint performance accountability guidance (RSA-TAC-17-01).
Credential Attainment Rate
Credential Attainment Scenarios
RSA and the VRTAC-QM developed these scenarios to serve as examples of how participant outcomes, achieved during or after participation in the VR program, are included in Credential Attainment Rate. These scenarios cover a variety of circumstances and pertain to:
- Participants who earned recognized postsecondary credentials;
- Participants who earned secondary credentials and satisfy additional requirements (i.e., employment or postsecondary enrollment) during or after program participation that allow the secondary credential to count; and
- Participants who would not be included in the Credential Attainment Rate numerator and/or denominator.
RSA and WINTAC developed the Credential Guide, similar to the MSG Guide, to support VR agencies as they identify which education and training programs, in their States, culminate in participants earning a credential that meets the definition of a recognized credential under WIOA. The guide includes examples of secondary and postsecondary credentials along with the supporting documentation requirements to which VR agencies must adhere in accordance with the joint data validation guidance (RSA-TAC-19-01).
Effectiveness in Serving Employers (ESE)
ESE Pilot Evaluation Report
The U.S. Department of Labor funded this evaluation of the ESE pilot through a contract with the Urban Institute: Measuring the Effectiveness of Services to Employers: Options for Performance Measures under the Workforce Innovation and Opportunity Act. The study informs the U.S. Departments of Labor and Education about options to consider for the adoption of one or more ESE measures across all WIOA core programs. The ultimate goal for supporting successful implementation of the ESE measures is to improve the effectiveness of services to employers, a primary customer of the public workforce system, and develop a skilled workforce to compete in the global economy. Since PY 2016, States have reported annually on at least two of three pilot measures: Retention with the Same Employer, Employer Penetration Rate, and Repeat Business Customers.
WIOA Peer Learning Group: ESE
On January 28, 2020, political leadership from ETA, OCTAE, and RSA hosted this joint webinar to discuss the Effectiveness in Serving Employers indicator. This included a review of the PY 2018 performance data and a forum for State representatives’ to share their experiences with data collection and reporting along with their ideas for alternative approaches to measurement.
Crosswalk for Employer Services under the VR Program
The WINTAC, in partnership with RSA, developed this Employer Services Crosswalk. RSA and its Federal partners agree that the crosswalk may be a useful technical assistance resource as VR agencies collaborate with their State partners, across all titles of WIOA, to ensure each core program’s efforts to engage with businesses and employers are collected and reported as Federal partners pilot this performance indicator.
Joint ESE Webinar
The U.S. Departments of Education and Labor held a joint webinar titled “Effectiveness in Serving Employers – Another Look” on November 8, 2017 after several State representatives had formed a cohort to discuss their progress with the ESE indicator. In this webinar, some of those State representatives along with a few others discussed their progress with the ESE pilot in their States.
State Wage Interchange System (SWIS) Data Sharing Agreement
On May 3, 2019, the U.S. Departments of Education and Labor made available to the public workforce development system the State Wage Interchange System (SWIS) Data Sharing Agreement. To review the SWIS Agreement, SWIS Background Information, and an Informational Webcast, please visit the Innovation and Opportunity Network (ION). To learn which States have signed the SWIS Agreement, please review this map maintained by the Employment and Training Administration.