{"id":2280,"date":"2020-04-07T14:23:15","date_gmt":"2020-04-07T18:23:15","guid":{"rendered":"https:\/\/umaine.edu\/oira\/?p=2280"},"modified":"2020-04-08T09:03:33","modified_gmt":"2020-04-08T13:03:33","slug":"does-giving-class-time-improve-set-response-rates","status":"publish","type":"post","link":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/","title":{"rendered":"Does giving class-time improve SET response rates?"},"content":{"rendered":"

Last month we surveyed all faculty who used Blue for online student evaluations of teaching (SET) during the fall 2019 semester regarding their use of class time for completing their online SETs. Because results from published studies at other institutions suggest a positive relationship between providing in-class time and response rates, we sought to quantify the magnitude of the relationship at 91福利, if one exists.\u00a0 We received responses for 168 unique course sections (thank you to all those who responded!). We limited our analysis to in-person sections with 10 or more students enrolled, in an attempt to avoid extreme response rates that are more likely in low-enrollment courses. After applying the course and enrollment filters we were left with 142 unique course sections. The percentage of these sections where in-class time was given (\u201cyes\u201d) or was not given (\u201cno\u201d) to complete online SETs are indicated in Figure 1.<\/span><\/p>\n

\"\"<\/p>\n

Figure 1:<\/b> Proportion of course sections where instructors gave students in-class time to do their online SETs (yes), versus those that were not (no).<\/span><\/p>\n

We compared the section response rates of these two groups. The distribution of response rates within the groups are shown in Figure 2. The histograms suggest that response rates were better if students were given in-class time (albeit with a lot of overlap).<\/span><\/p>\n

\"\"<\/p>\n

Figure 2:<\/b> Distribution of response rates for course sections where students were given in-class time to do their online SETs (Yes) and those that were not (No).<\/span><\/p>\n


\n<\/span>The mean response rates for the two groups are provided in Table 1.\u00a0 We found the mean difference between the two groups to be 15.1 percentage points. This difference is statistically significant (Welch’s T-Test(83.3)=4.369, p<0.000) and indicates a 15.1 percentage point improvement in response rates for class sections that provided students in-class time to do their SETs.\u00a0 It should be noted that our survey did not include questions about other strategies being used instead of or in addition to providing class time, and these results only apply to the select subset of faculty who responded to the survey. That said, these results do suggest that providing class time can positively impact response rates.\u00a0\u00a0<\/span><\/p>\n

Table 1:<\/i><\/b> Mean response rates for course sections where students were and were not given in-class time to do their online SETs.<\/span><\/i><\/p>\n

\"\"\u00a0<\/span><\/p>\n

Our results are in agreement with published literature that suggests giving in-class time increases response rates, but we acknowledge that additional study is needed to understand what other incentives or strategies are used and how they could impact response rates.\u00a0 Toward that end, we asked the faculty of those courses that did not give in-class time, but also had response rates at or above 70%, to describe their approaches. A summary of strategies and incentives used by those faculty who responded are provided in Table 2. Using such strategies as reminding students, conducting a mid-term feedback survey, and showing students how the feedback is used, in addition to giving in-class time for SETs, might result in even greater improvements in response rates.\u00a0\u00a0\u00a0<\/span><\/p>\n

Another, somewhat unexpected, result was the number of low response rates for sections where in-class time was given for online evaluations to be filled out. We do not have data to address what might have been happening in these situations, but it does imply that simply giving in-class time might not always be enough to result in an adequate number of responses. We recommend that faculty consider using the strategies described in Table 2 regardless of the way SETs are being administered. We provide similar recommendations on the <\/span>OIRA website<\/span><\/a>.<\/span><\/p>\n

 <\/p>\n

Table 2:<\/b> Strategies and incentives used by faculty that had high SET response rates but did not give in-class time for the evaluations. Note: Please check with your department before giving points as an incentive.<\/span><\/p>\n

\"\"<\/p>\n","protected":false},"excerpt":{"rendered":"

Last month we surveyed all faculty who used Blue for online student evaluations of teaching (SET) during the fall 2019 semester regarding their use of class time for completing their online SETs. Because results from published studies at other institutions suggest a positive relationship between providing in-class time and response rates, we sought to quantify […]<\/p>\n","protected":false},"author":781,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_blocks_custom_css":"","_kad_blocks_head_custom_js":"","_kad_blocks_body_custom_js":"","_kad_blocks_footer_custom_js":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[132],"tags":[],"class_list":["post-2280","post","type-post","status-publish","format-standard","hentry","category-april-newsletter"],"yoast_head":"\nDoes giving class-time improve SET response rates? - Office of Institutional Research and Assessment - University of Maine<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Does giving class-time improve SET response rates? - Office of Institutional Research and Assessment - University of Maine\" \/>\n<meta property=\"og:description\" content=\"Last month we surveyed all faculty who used Blue for online student evaluations of teaching (SET) during the fall 2019 semester regarding their use of class time for completing their online SETs. Because results from published studies at other institutions suggest a positive relationship between providing in-class time and response rates, we sought to quantify […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/\" \/>\n<meta property=\"og:site_name\" content=\"Office of Institutional Research and Assessment\" \/>\n<meta property=\"article:published_time\" content=\"2020-04-07T18:23:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-04-08T13:03:33+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart.png\" \/>\n\t<meta property=\"og:image:width\" content=\"540\" \/>\n\t<meta property=\"og:image:height\" content=\"340\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/\"},\"author\":{\"name\":\"\",\"@id\":\"\"},\"headline\":\"Does giving class-time improve SET response rates?\",\"datePublished\":\"2020-04-07T18:23:15+00:00\",\"dateModified\":\"2020-04-08T13:03:33+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/\"},\"wordCount\":618,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/umaine.edu\/oira\/#organization\"},\"image\":{\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart-300x189.png\",\"articleSection\":[\"April Newsletter\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/\",\"url\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/\",\"name\":\"Does giving class-time improve SET response rates? - Office of Institutional Research and Assessment - University of Maine\",\"isPartOf\":{\"@id\":\"https:\/\/umaine.edu\/oira\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart-300x189.png\",\"datePublished\":\"2020-04-07T18:23:15+00:00\",\"dateModified\":\"2020-04-08T13:03:33+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#primaryimage\",\"url\":\"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart.png\",\"contentUrl\":\"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart.png\",\"width\":540,\"height\":340},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/umaine.edu\/oira\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Does giving class-time improve SET response rates?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/umaine.edu\/oira\/#website\",\"url\":\"https:\/\/umaine.edu\/oira\/\",\"name\":\"Office of Institutional Research and Assessment\",\"description\":\"Just another University of Maine Sites site\",\"publisher\":{\"@id\":\"https:\/\/umaine.edu\/oira\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/umaine.edu\/oira\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/umaine.edu\/oira\/#organization\",\"name\":\"Office of Institutional Research and Assessment\",\"url\":\"https:\/\/umaine.edu\/oira\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/umaine.edu\/oira\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2019\/06\/91福利-FullCrest-Office-of-Institutional-Research-and-Assessment-DarkBlue-SPOT.png\",\"contentUrl\":\"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2019\/06\/91福利-FullCrest-Office-of-Institutional-Research-and-Assessment-DarkBlue-SPOT.png\",\"width\":3292,\"height\":1267,\"caption\":\"Office of Institutional Research and Assessment\"},\"image\":{\"@id\":\"https:\/\/umaine.edu\/oira\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"\",\"url\":\"https:\/\/umaine.edu\/oira\/author\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Does giving class-time improve SET response rates? - Office of Institutional Research and Assessment - University of Maine","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/","og_locale":"en_US","og_type":"article","og_title":"Does giving class-time improve SET response rates? - Office of Institutional Research and Assessment - University of Maine","og_description":"Last month we surveyed all faculty who used Blue for online student evaluations of teaching (SET) during the fall 2019 semester regarding their use of class time for completing their online SETs. Because results from published studies at other institutions suggest a positive relationship between providing in-class time and response rates, we sought to quantify […]","og_url":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/","og_site_name":"Office of Institutional Research and Assessment","article_published_time":"2020-04-07T18:23:15+00:00","article_modified_time":"2020-04-08T13:03:33+00:00","og_image":[{"width":540,"height":340,"url":"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Written by":"","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#article","isPartOf":{"@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/"},"author":{"name":"","@id":""},"headline":"Does giving class-time improve SET response rates?","datePublished":"2020-04-07T18:23:15+00:00","dateModified":"2020-04-08T13:03:33+00:00","mainEntityOfPage":{"@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/"},"wordCount":618,"commentCount":0,"publisher":{"@id":"https:\/\/umaine.edu\/oira\/#organization"},"image":{"@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#primaryimage"},"thumbnailUrl":"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart-300x189.png","articleSection":["April Newsletter"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/","url":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/","name":"Does giving class-time improve SET response rates? - Office of Institutional Research and Assessment - University of Maine","isPartOf":{"@id":"https:\/\/umaine.edu\/oira\/#website"},"primaryImageOfPage":{"@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#primaryimage"},"image":{"@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#primaryimage"},"thumbnailUrl":"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart-300x189.png","datePublished":"2020-04-07T18:23:15+00:00","dateModified":"2020-04-08T13:03:33+00:00","breadcrumb":{"@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#primaryimage","url":"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart.png","contentUrl":"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2020\/04\/responses-pie-chart.png","width":540,"height":340},{"@type":"BreadcrumbList","@id":"https:\/\/umaine.edu\/oira\/does-giving-class-time-improve-set-response-rates\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/umaine.edu\/oira\/"},{"@type":"ListItem","position":2,"name":"Does giving class-time improve SET response rates?"}]},{"@type":"WebSite","@id":"https:\/\/umaine.edu\/oira\/#website","url":"https:\/\/umaine.edu\/oira\/","name":"Office of Institutional Research and Assessment","description":"Just another University of Maine Sites site","publisher":{"@id":"https:\/\/umaine.edu\/oira\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/umaine.edu\/oira\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/umaine.edu\/oira\/#organization","name":"Office of Institutional Research and Assessment","url":"https:\/\/umaine.edu\/oira\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/umaine.edu\/oira\/#\/schema\/logo\/image\/","url":"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2019\/06\/91福利-FullCrest-Office-of-Institutional-Research-and-Assessment-DarkBlue-SPOT.png","contentUrl":"https:\/\/umaine.edu\/oira\/wp-content\/uploads\/sites\/502\/2019\/06\/91福利-FullCrest-Office-of-Institutional-Research-and-Assessment-DarkBlue-SPOT.png","width":3292,"height":1267,"caption":"Office of Institutional Research and Assessment"},"image":{"@id":"https:\/\/umaine.edu\/oira\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"","url":"https:\/\/umaine.edu\/oira\/author\/"}]}},"taxonomy_info":{"category":[{"value":132,"label":"April Newsletter"}]},"featured_image_src_large":false,"author_info":{"display_name":"","author_link":"https:\/\/umaine.edu\/oira\/author\/"},"comment_info":0,"category_info":[{"term_id":132,"name":"April Newsletter","slug":"april-newsletter","term_group":0,"term_taxonomy_id":132,"taxonomy":"category","description":"","parent":0,"count":6,"filter":"raw","cat_ID":132,"category_count":6,"category_description":"","cat_name":"April Newsletter","category_nicename":"april-newsletter","category_parent":0}],"tag_info":false,"_links":{"self":[{"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/posts\/2280","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/users\/781"}],"replies":[{"embeddable":true,"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/comments?post=2280"}],"version-history":[{"count":11,"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/posts\/2280\/revisions"}],"predecessor-version":[{"id":2318,"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/posts\/2280\/revisions\/2318"}],"wp:attachment":[{"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/media?parent=2280"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/categories?post=2280"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/umaine.edu\/oira\/wp-json\/wp\/v2\/tags?post=2280"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}