Indirect Measures

Indirect measures include perspectives, input, and other indicators (from students or others) that provide evidence related to program-level student learning outcomes (SLOs) (e.g., perceived gains or confidence in specific skills or knowledge, motivation, satisfaction, the availability or quality of learning opportunities, student progress, etc.). Indirect measures can provide valuable information as to why students learned or did not learn, but they don’t provide direct evidence of what students have learned.

Types of Indirect Measures

Indirect measures come in many forms, and may vary to best meet the needs of the program. WSU encourages programs to choose measures that provide useful information to their faculty and fit with disciplinary expectations. Data from indirect measures may be quantitative (numeric) or qualitative (textual). See Assessment Data Analysis for more information about quantitative and qualitative data.

Student Perspectives and Experience

Indirect MeasureDescription
Focus GroupsStudents discuss their experiences, motivation, and perspective about aspects of their educational experience, skills, or knowledge. See our Focus Groups webpage for more information.
InterviewsOne-on-one dialog with a student to determine his/her perception regarding learning outcome achievement and related academic experiences.
Surveys: Student or AlumniStudents/alumni report their confidence or perceived gains in knowledge, skills and/or abilities related to program-level SLOs, their perspective on aspects of their educational experience, motivations, and rationales. May be locally developed (e.g. a departmental senior exit survey) or a standardized instrument (e.g. the National Survey of Student Engagement). See our Student Surveys (locally developed) and National Survey of Student Engagement webpages for more information.
Course EvaluationsResponses about learning outcomes, academic experiences, perceptions and motivation can provide useful data about curricular effectiveness. See our Course Evaluations webpage for more information.
Student Self-assessments or ReflectionsStudent self-reflection of their performance, experience, or processes, or evaluation of peer performance on a work product.

Professional Perspectives and Input

Indirect MeasureDescription
Advisory BoardsProgram consultations with an advisory group providing professional input on the program and/or skills perceived as important for graduates.
Faculty Reviews of Curriculum, SLOs, Syllabi, or Assignment PromptsFaculty review, evaluate, and document where program-level SLOs are taught and developed in assignments, courses, and curricula.
Feedback from External AccreditorsFeedback from external accreditors providing professional input on the program, including its curriculum or SLOs.
Internship Supervisor, Preceptor, or Employer Feedback on Student Activities, Motivation, or BehaviorTypically a written evaluation of student experiences or general performance in a work setting. See our Quick Guide to Internships and Other Field/Professional Experiences for Program-level Assessment (PDF) for more information.
Employer SurveysPotential employers indicate the job skills they perceive are important for graduates, or provide other professional input on the program.

Indicators of Progress, Success, Retention, etc.

Indirect MeasureDescription
Course GradesCourse grades can give information about cohort progress through the curriculum, which can complement direct measures.
Internal DataCentrally collected data (e.g. registration or course enrollment data, class size data, graduation rates, retention rates, grade point averages) can, for example, give information about cohort success or progress through the curriculum, which can complement direct measures.
Participation RatesStudent participation rates in research, internship, service learning, study abroad, and other activities, especially high impact practices, connected to student learning.

Indirect Measures Resources and Toolkits

The following resources are provided to assist programs and faculty as they choose, develop, implement, and refine indirect measures for assessing program-level SLOs as part of program-level assessment. ACE is available to collaborate with undergraduate degree programs to design indirect measures for program-level assessment; contact us for additional information.

ACE provides resources for programs on particular indirect measures:

Additional Resources and Scholarship

Articles

Montenegro, E. & Jankowski, N. (2020). A New Decade for Assessment: Embedding Equity into Assessment Praxis (PDF) (Occasional Paper No. 42). Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment (NILOA).

Books

Note: Please contact ACE to borrow a book.

Suskie, L. (2018). Part 4: The assessment toolbox. In Assessing Student Learning: A Common Sense Guide. San Francisco, CA: Jossey-Bass.

Other

Suskie, L. Blog posts categorized ‘How to Assess’, A Common Sense Approach to Assessment in Higher Education Blog.

University of Hawaii at Manoa Assessment and Curriculum Support Center. How To: Choose a Method to Collect Data or Evidence Website.