{"id":265,"date":"2016-06-27T14:44:09","date_gmt":"2016-06-27T19:44:09","guid":{"rendered":"http:\/\/blogs.acu.edu\/ryanjessup\/?page_id=265"},"modified":"2016-09-13T16:47:38","modified_gmt":"2016-09-13T21:47:38","slug":"summary-of-course-evaluation-research-meta-analysis","status":"publish","type":"page","link":"https:\/\/blogs.acu.edu\/rkj95n\/summary-of-course-evaluation-research-meta-analysis\/","title":{"rendered":"Summary of Course Evaluation Research Meta-analysis"},"content":{"rendered":"<p>In a <a href=\"http:\/\/blogs.acu.edu\/rkj95n\/files\/2016\/07\/Clayson-2009-JME-Student-evaluations-of-teaching-Are-they-related-to-what-students-learn.pdf\" target=\"_blank\" rel=\"\">literature review and meta-analysis, Clayson (2009)<\/a>\u00a0finds that (1) course evaluations are higher for courses which give out higher grades, (2) course evaluations are negatively correlated with rigor (the more rigor in the classroom the lower the evaluations) and (3) the more objective the measures used to assess learning, the less the relationship between course evaluations and learning.\u00a0 A few of my favorite quotes from this article are below, all found on p. 27.<\/p>\n<p>&nbsp;<\/p>\n<hr \/>\n<p>\u201cWe might expect, for example, to find no or even a slight negative correlation between evaluations and learning in classes such as marketing research, especially if the course is highly structured and statistical in nature.\u201d \u00a0[I assume that he teaches marketing research and was soon going\u00a0up for tenure.]<\/p>\n<p>\u201cConsumer behavior might show any combination of associations, depending on how the students\u2019 grades were derived.\u00a0 If test material attempted to measure understanding and application of theoretical concepts, we could expect to find no associations between evaluations and learning.\u201d<\/p>\n<p>\u201cOn the other hand, business classes that contain math applications and require more cognitive skills for students to demonstrate their level of competency may find the SET [student evaluations of teaching] to be relatively invalid.\u201d<\/p>\n<hr \/>\n<p>&nbsp;<\/p>\n<p>Personally, I feel that student course evaluations are good for some but perhaps not ideal for all that we ask of them.\u00a0 Students are well-positioned to indicate whether information was clearly presented and whether or not LMS tools were well-organized, among other things.\u00a0 However, students near the end of a course are not necessarily well-positioned to evaluate (1) how much they learned or (2) how useful the course will be for them in their future careers.\u00a0 I have often suspected that perhaps a better way would be to ask students a few years removed from the undergraduate experience what were their most useful courses because they\u00a0are in a better position to evaluate their needs.\u00a0 This method would naturally\u00a0have flaws as well. \u00a0However, I was pleased when hearing that several former students who, upon being invited to\u00a0meet with the COBA Dean\u2019s Advisory Council, listed my courses as being among the most useful, as described in the\u00a0email from associate dean Andy Little (Figure 2.4).<\/p>\n<p><strong>Figure 2.4.<\/strong><em> Email\u00a0from associate dean Andy Little detailing when\u00a0several alumni specifically mentioned my courses as successfully preparing them for their future careers.<\/em><\/p>\n<p><a href=\"http:\/\/blogs.acu.edu\/rkj95n\/files\/2016\/06\/andy_little_email.png\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-1225\" src=\"http:\/\/blogs.acu.edu\/rkj95n\/files\/2016\/06\/andy_little_email.png\" alt=\"andy_little_email\" width=\"1230\" height=\"273\" srcset=\"https:\/\/blogs.acu.edu\/rkj95n\/files\/2016\/06\/andy_little_email.png 1230w, https:\/\/blogs.acu.edu\/rkj95n\/files\/2016\/06\/andy_little_email-150x33.png 150w, https:\/\/blogs.acu.edu\/rkj95n\/files\/2016\/06\/andy_little_email-300x67.png 300w, https:\/\/blogs.acu.edu\/rkj95n\/files\/2016\/06\/andy_little_email-768x170.png 768w, https:\/\/blogs.acu.edu\/rkj95n\/files\/2016\/06\/andy_little_email-490x109.png 490w\" sizes=\"auto, (max-width: 1230px) 100vw, 1230px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<hr \/>\n<h6>&lt;\u00a0<a href=\"teaching\/reflections-on-student-feedback\/\">Reflections on Student Feedback<\/a>\u00a0| Summary of Course Evaluation Research Meta-analysis &gt;<\/h6>\n","protected":false},"excerpt":{"rendered":"<p>In a literature review and meta-analysis, Clayson (2009)\u00a0finds that (1) course evaluations are higher for courses which give out higher grades, (2) course evaluations are negatively correlated with rigor (the more rigor in the classroom the lower the evaluations) and (3) the more objective the measures used to assess learning, the less the relationship between &hellip; <a href=\"https:\/\/blogs.acu.edu\/rkj95n\/summary-of-course-evaluation-research-meta-analysis\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":7493,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-265","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/blogs.acu.edu\/rkj95n\/wp-json\/wp\/v2\/pages\/265","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.acu.edu\/rkj95n\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/blogs.acu.edu\/rkj95n\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.acu.edu\/rkj95n\/wp-json\/wp\/v2\/users\/7493"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.acu.edu\/rkj95n\/wp-json\/wp\/v2\/comments?post=265"}],"version-history":[{"count":5,"href":"https:\/\/blogs.acu.edu\/rkj95n\/wp-json\/wp\/v2\/pages\/265\/revisions"}],"predecessor-version":[{"id":1228,"href":"https:\/\/blogs.acu.edu\/rkj95n\/wp-json\/wp\/v2\/pages\/265\/revisions\/1228"}],"wp:attachment":[{"href":"https:\/\/blogs.acu.edu\/rkj95n\/wp-json\/wp\/v2\/media?parent=265"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}