Case Service Report (RSA-911) Data Dashboards
Since PY 2017, RSA has shared data dashboards with State VR agencies to support quality assurance, improve data quality, and foster data-driven decision making in the VR program. In PY 2022, RSA partnered with the VRTAC-QM and RehabData Workgroup to redesign the data dashboards. The new tools include not only more data, but historical data and enhanced metrics for all State VR agencies in a single accessible Excel workbook that RSA will update each quarter and provide to State VR agencies. On December 19, 2022, RSA and the VRTAC-QM provided a demonstration of the data dashboards during a live webinar. A recording of the webinar is available at the VRTAC-QM.
PYs 2022 and 2023 WIOA Performance Negotiations Tool
On April 1, 2022, RSA shared its Negotiations Tool for establishing negotiated levels of performance with State VR programs for the performance indicators for PYs 2022 and 2023. This tool includes the estimated levels of performance, produced by RSA's Statistical Adjustment Model, and data related to the other negotiation factors (e.g., continuous improvement and comparative performance) required by section 116 of WIOA.
VR Program Statistical Adjustment Models (SAM)
SAM: Performance Indicators for PYs 2022 and 2023
On February 25, 2022, RSA provided VR agencies with the estimated levels of performance for PYs 2022 and 2023 in its second Statistical Adjustment Model (SAM) under WIOA. This SAM provides estimated levels of performance for five performance indicators. The SAM includes the coefficients, specific values for each variable for each State, and performance results from PY 2017 to PY 2020, as applicable, for each State VR program.
SAM: Measurable Skill Gains Rate for PYs 2020 and 2021
On February 28, 2020, RSA provided VR agencies with the estimated levels of performance for PYs 2020 and 2021 produced by the first Statistical Adjustment Model (SAM) that RSA developed under WIOA. The SAM includes the coefficients, specific values for each variable for each State, and MSG performance results for PYs 2017 and 2018 for each State VR program.
WIOA Performance Accountability Specifications
WIOA Annual Report Specifications
These specifications outline how RSA populates WIOA Annual Reports (ETA-9169) for State VR programs using RSA-911 Data Elements from PD 19-03.
Performance Indicator Specifications
This document details how RSA calculates performance results for the WIOA performance indicators using RSA-911 Data Elements from PD 19-03.
PY 2019 Credential Attainment Rate Specification
This document outlines how RSA calculated Credential Attainment Rate, for the first time in PY 2019, using RSA-911 Data Elements from PD 16-04.
Measurable Skill Gains (MSG) Rate Resources
Calculating MSG Rate Performance Success or Failure
RSA and the WINTAC developed the Calculating VR Program Performance for MSG in Program Years 2020 and 2021. This technical assistance tool highlights key information from RSA-TAC-20-02 related to establishing performance levels and outlines, using two examples, how RSA will calculate Individual Indicator Scores after each Program Year.
Reporting MSG Data in PY 2020
This technical assistance document discusses how and when to use RSA-911 Data Elements 85 and 401, under PD 19-03, to report whether or not VR program participants should be included in the MSG Rate denominator.
MSG Data Tool
The RehabData Workgroup developed the MSG Data Tool to showcase data reported by VR agencies for PYs 2017 and 2018 and provide National and State-level MSG data to all VR programs while serving as a resource for VR agencies to analyze their MSG data and compare performance to that of the VR program nationally, with similar States, and/or other VR agencies.
MSG Guide
RSA and WINTAC developed this MSG Guide to help VR agencies understand the requirements of education and training programs that lead to recognized credentials under WIOA and the five types of MSGs. Further this guide is intended to assist VR agencies with developing their own policies and procedures based on the joint performance accountability guidance (RSA-TAC-17-01).
Credential Attainment Rate Resources
RSA/VRTAC-QM Training
On February 9, 2022, RSA and VRTAC-QM shared technical assistance on Credential Attainment Rate. The training provides an overview of the performance indicator; outlines the RSA-911 data elements used in reporting the indicator; highlights performance results from Program Years 2019 and 2020; specifies how the indicator is calculated; details how to report some of the Credential Attainment Scenarios; answers questions posed to RSA and VRTAC-QM related to the indicator; and links to policy guidance and other technical assistance resources. Complete the training at the VRTAC-QM website.
Credential Attainment Scenarios
RSA and the VRTAC-QM developed these scenarios to serve as examples of how participant outcomes, achieved during or after participation in the VR program, are included in Credential Attainment Rate. These scenarios cover a variety of circumstances and pertain to:
- Participants who earned recognized postsecondary credentials;
- Participants who earned secondary credentials and satisfy additional requirements (i.e., employment or postsecondary enrollment) during or after program participation that allow the secondary credential to count; and
- Participants who would not be included in the Credential Attainment Rate numerator and/or denominator.
Credential Guide
RSA and WINTAC developed the Credential Guide, similar to the MSG Guide, to support VR agencies as they identify which education and training programs, in their States, culminate in participants earning a credential that meets the definition of a recognized credential under WIOA. The guide includes examples of secondary and postsecondary credentials along with the supporting documentation requirements to which VR agencies must adhere in accordance with the joint data validation guidance (RSA-TAC-19-01).
Effectiveness in Serving Employers (ESE) Resources
ESE Rulemaking
On September 14, 2022, ED and DOL published a Notice of Proposed Rulemaking to incorporate a standard definition for the ESE performance indicator in the WIOA joint regulations. The 60-day public comment period closed on November 14, 2022.
Until the ESE performance indicator is defined in final regulations and the Departments have implemented data collection and reporting, States will continue to report piloted ESE measures. This will continue, at a minimum, for Program Year 2022.
ESE Pilot Evaluation Report
DOL funded this evaluation of the ESE pilot through a contract with the Urban Institute: Measuring the Effectiveness of Services to Employers: Options for Performance Measures under the Workforce Innovation and Opportunity Act. The study informed ED and DOL about options to consider for the adoption of one or more ESE measures across all WIOA core programs.
ESE WIOA Peer Learning Group
On January 28, 2020, political leadership from ETA, OCTAE, and RSA hosted this joint webinar to discuss the Effectiveness in Serving Employers indicator. This included a review of the PY 2018 performance data and a forum for State representatives’ to share their experiences with data collection and reporting along with their ideas for alternative approaches to measurement.
Crosswalk for Employer Services under the VR Program
The WINTAC, in partnership with RSA, developed this Employer Services Crosswalk. The crosswalk is a useful technical assistance resource as VR agencies collaborate with their State partners, across all titles of WIOA, to ensure each core program’s efforts to engage with businesses and employers are collected and reported as Federal partners pilot this performance indicator.
Joint ESE Webinar
ED and DOL held a joint webinar titled “Effectiveness in Serving Employers – Another Look” on November 8, 2017 after several State representatives had formed a cohort to discuss their progress with the ESE indicator. In this webinar, some of those State representatives along with a few others discussed their progress with the ESE pilot in their States.
WIOA/IDEA/Perkins V Performance Indicators
In November 2021, two of RSA's technical assistance centers, the NTACT:C and VRTAC-QM, updated the Crosswalk related to the performance indicators under the VR program (WIOA), Special Education (IDEA Part B), and Career and Technical Education (Perkins V). This technical assistance tool is intended to support State agencies administering these programs align priorities for secondary and postsecondary outcomes for students.
State Wage Interchange System (SWIS) Agreement
On May 3, 2019, ED and DOL made available to the public workforce development system the State Wage Interchange System (SWIS) Data Sharing Agreement. An Informational Webcast is available to learn more about SWIS and how the Departments are leading this project. To view which States and programs have signed the SWIS Agreement, please review this map maintained by the Employment and Training Administration.
Proposed Amendments to SWIS Agreement
ED and DOL are facilitating the review of the proposed amendments to the SWIS Data Sharing Agreement. As signatories to the SWIS Agreement, State Unemployment Insurance Agencies and Performance Accountability and Customer Information Agencies are required to participate in the amendment process. For more information, please visit SWIS Amendments.