Research & Evaluation Methods
Student Learning Outcomes for All Concentrations
Graduates will be able to:
- Explain similarities and differences among various research paradigms, act as an informed consumer of research, and design and conduct a small-scale social science study.
- Explain basic measurement principles, critique measures in light of various measurement concepts such as validity and reliability, and create a sound measure on an important topic in education and counseling.
- Explain basic statistical concepts and techniques, identify and perform appropriate analyses based on their research question(s), and interpret the results of statistical analyses.
- Explain the essential elements of conceptual frameworks for both program evaluation and the evaluation of persons (typically teachers), and operationalize the elements by designing and/or conducting evaluation studies.
Descriptions of Key Assessments of Student Learning
RSEM 5080
The PBAs are introduced at the beginning of two courses (RSEM5120: Introduction to Research Methods and RSEM5080: Research for Teachers) and applied throughout the course. There are two versions of the PBA due to slightly different course content and audiences for these courses. (Outcome 1)
RSEM 5120
The PBAs are introduced at the beginning of two courses (RSEM5120: Introduction to Research Methods and RSEM5080: Research for Teachers) and applied throughout the course. There are two versions of the PBA due to slightly different course content and audiences for these courses. (Outcome 1)
RSEM 5100
Students submitted project reports and quizzes with hard copy, electronic copy or both throughout the semester. Students demonstrate their understanding of statistics and analysis by collecting, checking assumptions, and analyzing data. Students are particularly expected to be able to: explain basic statistical concepts and techniques, identify and perform appropriate analyses based on their research question(s), and interpret the results of statistical analyses. (Outcome 2)
RSEM 5110
The students in this course demonstrate ability to explain basic measurement principles and critique measures. More emphasis has been placed on the Support for Measure as many students struggled with this area in past years. The data show that this change was effective in helping students learn this concept. (Outcome 3)
RSEM 7210
Students demonstrate their understanding of principles of quantitative statistics by developing, piloting, and analyzing original data. Students are particularly expected to be able to: explain the essential elements of conceptual frameworks for program evaluation, and operationalize the elements by designing and/or conducting evaluation studies. (Outcome 4)
Comprehensive Exam
Take-home essay exam- The primary advisor for the student reviews courses taken during the student’s course of study. The comprehensive exam includes at least one question that is specifically related to the learning objective. Students have 4 weeks to produce a scholarly paper that responds to the question(s). Upon completion of the exam, the advisor and two RSEM colleagues review the paper and come to consensus regarding successful completion of the comprehensive examination. If there is disagreement as to scoring (satisfactory or unsatisfactory) on any question, the majority rating is final. (Outcomes 1, 2, 3, 4)