Academic Program Assessment
I. REASON FOR THIS POLICY
This policy establishes the University’s responsibility and procedures for the assessment of academic programs pursuant to SDBOR Policy 2.3.9 and 2.3.4. The University implements a systematic, continuous process of improvement aligned with its mission with a commitment to embed in its culture meaningful, manageable, and sustainable assessment practices to enhance institutional quality. Credible evidence and focused reflection serve to inform University decision making in instruction, curriculum, and programs for the improvement of student outcomes and institutional effectiveness. University assessment policy and procedures ensure that systematic assessment translates into steps that result in the collection, analysis, and use of data to enhance all student learning.
II. DEFINITIONS
- Academic Assessment Committee. Fulfills a University advisory, monitoring, coordinating, and regulatory role in assessment matters and advises the Provost and Senior Vice President for Academic and Student Affairs on the implementation of the University’s Academic Assessment Plan.
- Academic Program. The degree, major, and as applicable the specialization approved by the Board of Regents for the degree-granting institution.
- Ad-Hoc Program Review. University unplanned, expedited review process in response to significant extenuating circumstances as deemed appropriate by the University President.
- Annual Health Analytics/Evaluation. University examination of program performance based on a set of common metrics: enrollment, student success, instructional activity, faculty, and revenue/expense.
- Assessment. A systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development.
- Curriculum Mapping with PLOs. A method by which faculty identify in what courses the content and instructional activities align with the program learning outcomes (PLOs): Introduced, Developing, and Assessed for Proficiency.
- External Review. A review conducted by individuals outside the University. The University shall establish an external review process appropriate for the program which shall include individuals with the appropriate qualifications and expertise for the review, as deemed appropriate by the University and/or program accreditation requirements.
- Internal Review. A review conducted by individuals from within the University. The University shall establish an internal review process appropriate for the program.
- Program Accreditation Review. Accreditation review process completed by programs where standards are determined by specialized accrediting bodies related to a profession.
The University may use a program accreditation review to satisfy the requirements for the Year-Six (6) Comprehensive Review.
- Program Learning Outcomes (PLOs). What the University expects students to know, do, or believe by the time they complete coursework for an academic program.
- Program Productivity Review. Board of Regents program productivity review analyzing programs that fail to meet the established criteria thresholds.
- Trojan Assessment Profile (TAP). Online repository for assessment plans, results, documentation, and reflection.
- Year-Three (3) Mid-Cycle Analytics/Evaluation. University examination of program performance based on a set of common metrics: enrollment, student success, instructional activity, faculty, and revenue/expense.
- Year-Six (6) Comprehensive Program Review. University extensive analytical and reflective peer review process that analyzes program status and effectiveness to identify strengths, opportunities for improvement, and priorities for the future.
III. STATEMENT OF POLICY
- Assessment of Effectiveness Model. The University’s academic assessment program shall include, but is not limited to, components identified in best-practices literature. [See Model in Section V.]
- Clearly defining intended outcomes and goals.
- Deciding what evidence will inform success.
- Assessing during and after actions implementation (fidelity).
- Analyzing evidence of success from multiple data sources.
- Using assessment results to make adjustments and to keep doing what works.
- Ethical Responsibilities for Program Assessment. The University community shall apply assessment ethics to all components of a continuous improvement process.
- Assessment Methods Aligned with Intended Outcomes. Program assessment results shall inform the degree to which students achieve their learning outcomes.
- Confidentiality. Program assessment results reporting shall follow FERPA guidelines for the release of individual student performance data.
- Reporting Assessment Results. Program assessment reports disclose accurate results, both strengths and opportunities for improvement, relative to achieving outcomes. The University shares assessment reports with those who are in a position to impact program and department quality and processes.
- Security and Accuracy of Data/Information.
- The existence of all program assessment record keeping systems is known and transparent.
- The specific information contained in program assessment recording keeping systems, users of that information, and the purposes for use are transparent.
- Roles, responsibilities, and processes for correcting inaccurate academic program assessment records are transparent.
- Academic program assessment records are reliable.
- Institutional Commitment. To ensure that Regental system and institutional expectations for program assessment are fulfilled, the University charges the following offices, groups, and individuals with operational responsibilities.
- Office of Provost and Senior VP for Academic Affairs and Student Affairs. For purposes of this policy, this office shall manage University processes for the Annual, Year-Three (3) Mid-Cycle, and Year-Six (6) Comprehensive Program Review.
- Establishes the SDBOR academic program assessment plan six-year schedule.
- Coordinates program completion of Year-Six (6) Comprehensive Program Reviews.
- Completes the University response/action to the SDBOR Program Productivity Review by recommending a Moratorium, Teach-Out, or Program Closure if a program does not meet established criteria thresholds, using the appropriate University and institutional accrediting body guidelines and processes.
- Initiates Ad-Hoc Program Review as needed.
- Submits an annual report summary of program reviews to the SDBOR.
- Posts year-six comprehensive self-studies, reviewer reports, and the board report on the University’s website as appropriate.
- Integrates program review results into planning and budgeting processes.
- Office of Institutional Effectiveness, Assessment, and Policy. For purposes of this policy, responsibilities of this office include, but are not limited to, the following:
- Coordinates meetings of the University Academic Assessment Committee.
- Manages the University’s Trojan Assessment Profile (TAP).
- Provides training in program assessment as needed.
- Serves on the SDBOR System Assessment Committee.
- Provides consultation and support for program assessment activities.
- Assists academic programs with program review self-studies as needed during the Year-Six (6) Comprehensive Program Review or specialized Program Accreditation Review.
- Academic Assessment Committee. Its annual functions are, but not limited to, the following responsibilities:
- Advises the Provost and Senior Vice President for Academic and Student Affairs about academic program assessment policy and processes.
- Monitors academic program assessment process, including, but not limited to, the following on a program monitoring cycle developed by the University:
- Program learning outcome (PLO) student proficiency results.
- Cross-curricular skills student proficiency results.
- General education learning outcomes student proficiency results.
- Annual Health Analytics/Evaluation results.
- Year-Three Mid-Cycle Review results.
- Year-Six Comprehensive Program Review results.
- Makes recommendations for improving academic program assessment plans.
- Deans. Each dean shall ensure that academic program assessment is an established priority within her/his respective college through activities that may include, but are not limited to, the following:
- Including program student performance data discussions at college meetings.
- Showcasing use of program student performance data to make program improvements.
- Monitoring faculty participation in competing program assessment responsibilities in the University’s online assessment platform.
- Highlighting academic program assessment in performance evaluations.
- Program Coordinators. Academic Program Coordinators, or designees, shall complete academic program assessment through the University-designated system.
- Develop, in collaboration with faculty, the academic program assessment plan, including, but not limited to, course mapping to PLOs, program learning outcome (PLO) assessment, cross-curricular skills assessment, and SDBOR program review.
- Coordinate the annual reporting of PLO student proficiency level results.
- Complete the SDBOR Annual Health Analytics/Evaluation every year.
- Complete the SDBOR Year-Three Mid-Cycle Review per the University’s schedule.
- Complete the SDBOR Year-Six Comprehensive Program Review self-study and peer review (external review or internal review) per the University’s schedule or as applicable a specialized Program Accreditation Review following the accrediting body requirements.
- Lead program faculty in identifying the root causes of student performance gaps and developing plans to eliminate/reduce those gaps.
- Coordinate the reporting of academic assessment program PLO and SDBOR review results into the University’s online Trojan Assessment Profile (TAP).
- Monitor proficiency results of the BOR cross-curricular skills identified for the academic program.
- Faculty. Full-time and part-time faculty shall participate in academic program evaluation responsibilities upon request, including but not limited to, the following activities:
- Providing PLO student proficiency results.
- Collaborating with Program Coordinators to identify in what courses PLO expectations will be introduced, developed, and assessed for proficiency.
- Participating in discussions focused on analyzing student performance trends and implications for curriculum and instruction.
- Supporting the year-six comprehensive program review process throughout the self-study and onsite visit.
- Making program adjustments informed by program review to improve student results.
- Office of Institutional Research (IR). For purposes of this policy, the responsibilities of this office include, but not limited to, the following:
- Creates the individual program data reports needed for the SDBOR Annual Health Analytics/Evaluation.
- Provides data and data analyses as needed to programs undergoing Year-Six (6) Comprehensive Program Review or specialized Program Accreditation Review.
- Office of Provost and Senior VP for Academic Affairs and Student Affairs. For purposes of this policy, this office shall manage University processes for the Annual, Year-Three (3) Mid-Cycle, and Year-Six (6) Comprehensive Program Review.
Exclusions
If an academic program maintains specialized external accreditation, the University can use the Program Accreditation Review in lieu of the Year-Six (6) Comprehensive Program Review.
Exceptions
The Provost may extend the timeline for a program’s year-six comprehensive program review under special circumstances.
IV. PROCEDURES (MAJOR)
- Program Learning Outcome (PLO) Annual Proficiency Reporting. Program Coordinators, or designees, shall annually implement the following procedures for PLO assessment. [See Annual Academic Assessment Calendar in Section V.]
- August - October
- Facilitate dialogue with faculty about last year’s PLO student proficiency results, cross-curricular skills student proficiency results, and SDBOR program review results from the prior academic year.
- Finalize any academic program assessment plan changes for the current academic year.
- Develop action plan for the current academic year to address PLO opportunities for improvement to be included in the Annual Health Analytics/Evaluation reported in the Trojan Assessment Profile (TAP).
- Finalize the fall term PLO student proficiency data collection process: who, what, when.
- Send fall term PLO reporting assignments to faculty through the University’s online Trojan Assessment Profile (TAP) per the academic program’s assessment plan schedule.
- December - January
- Ensure that all PLO fall term student proficiency results data are collected.
- Analyze fall PLO results.
- Record the use of PLO results data for program improvement.
- February – April
- Finalize the spring term PLO student proficiency data collection process: who, what, when.
- Send spring term PLO reporting assignments to faculty through the University’s online assessment system (TAP) per the academic program’s assessment plan schedule.
- May
- Ensure that all PLO spring term student proficiency results data are collected.
- August - October
- Annual Health Analytics/Evaluation. Program Coordinators, or designees, shall implement the following Annual Health Analytics/Evaluation procedures for each degree program (associate, bachelor, master, doctoral) following the University’s program review cycle. [See Annual Academic Assessment Calendar in Section V.]
- August – December (Every Academic Program Every Year). Complete the SDBOR Annual Health Analytics/Evaluation in TAP for the previous academic year by the deadline established by Academic Affairs containing, but not limited to, the following:
- Student Demand (Applicants, Admitted, Enrolled)
- Yield Rate
- Enrollment (Total, Three-Year Average)
- Retention Rates (All, OL, FT/FT Freshmen, Transfer)
- Graduation Rates (FT/FT Freshmen)
- Degrees Awarded (Annual, Past Five Years)
- Course Efficiency
- Instructional Staff (Full-Time, Part-Time, Underload, Overload)
- Financial Efficacy
- PLO Proficiency
- Program Strengths
- Opportunities for Improvement
- Priority Actions for the Current Academic Year
- Program Productivity Risk
- August – December (Every Academic Program Every Year). Complete the SDBOR Annual Health Analytics/Evaluation in TAP for the previous academic year by the deadline established by Academic Affairs containing, but not limited to, the following:
- Year-Three (3) Mid-Cycle Review. Program Coordinators, or designees, shall implement the following Year-Three (3) Mid-Cycle Review procedures for each degree program (associate, bachelor, master, doctoral) following the University’s program review cycle for that year. [See Annual Academic Assessment Calendar in Section V.]
- August – December (Only Academic Programs On Cycle). Complete the SDBOR Annual Health Analytics/Evaluation in TAP for the previous three academic years by the deadline established by Academic Affairs containing, but not limited to, the following:
- Student Demand (Applicants, Admitted, Enrolled)
- Yield Rate
- Enrollment (Total, Three-Year Average)
- Retention Rates (All, OL, FT/FT Freshmen, Transfer)
- Graduation Rates (FT/FT Freshmen)
- Degrees Awarded (Annual, Past Five Years)
- Course Efficiency
- Instructional Staff (Full-Time, Part-Time, Underload, Overload)
- Financial Efficacy
- PLO Proficiency
- Program Strengths
- Opportunities for Improvement
- Priority Actions for the Current Academic Year
- Program Productivity Risk
- August – December (Only Academic Programs On Cycle). Complete the SDBOR Annual Health Analytics/Evaluation in TAP for the previous three academic years by the deadline established by Academic Affairs containing, but not limited to, the following:
- Year-Six (6) Comprehensive Program Review. Program Coordinators, or designees, shall implement the following procedures for each degree program (associate, bachelor, master, doctoral) following the University’s program review cycle. [See Annual Academic Assessment Calendar in Section V.]
- August – May (Only Academic Programs On Cycle).
Complete the SDBOR Year-Six (6) Comprehensive Program Review by the deadline established by Academic Affairs or a specialized program accreditation review if applicable.- Self-Study. The college dean identifies who will write program’s self-study. The self-study content shall include, but is not limited to, the following:
- Institutional history (brief)
- Program history (brief)
- Academic program and curriculum
- Program enrollments and student placement
- Faculty credentials
- Academic and financial support
- Facilities and equipment
- Assessment Plans and Results (reports accessed in DSU’s online Trojan Assessment Profile)
- Data trends from Annual Data Analytics Reviews and Year-Three Mid-Cycle Reviews
- Program learning outcomes (PLOs)
- Curriculum mapping
- PLO student proficiency results trends
- Cross-curricular student proficiency results trends
- Changes made to curriculum, instruction, and/or program informed by assessment data analyses
- Alum placement
- Program strengths
- Program opportunities for improvement
- External Reviewer. The college dean and self-study writer collaborate to locate an appropriate, outside reviewer.
- Onsite Visit. The college dean and self-study writer develop an onsite visit schedule and invite interviewees.
- Board of Regents Summary Report
- The self-study writer completes the summary year-six comprehensive review report for the Board Office.
- The Provost’s Office submits the summary report to the Board Office.
- Self-Study. The college dean identifies who will write program’s self-study. The self-study content shall include, but is not limited to, the following:
- August – May (Only Academic Programs On Cycle).
V. RELATED DOCUMENTS, FORMS AND TOOLS
- Assessment of Effectiveness Model
- Assessment Principles of Good Practice
- Basic Assessment Definitions
- Learning Outcome, Goal, Target, and Benchmark Development Guidance
- Academic Program Evaluation Six-Year Cycle Graphic
- Year-Six (6) Comprehensive Program Review Self-Study Guide
- Annual Academic Program Assessment Schedule
VI. POLICY HISTORY
Adopted: 09/09/2024