February 2020 Newsletter Archives - Office of Institutional Research and Assessment /oira/category/february-2020-newsletter/ Just another University of Maine Sites site Thu, 06 Jul 2023 21:17:19 +0000 en-US hourly 1 https://wordpress.org/?v=6.8.5 Assessment is about Discovery /oira/assessment-is-about-discovery/ /oira/assessment-is-about-discovery/#respond Tue, 04 Feb 2020 15:01:27 +0000 /oira/?p=2140 Cathy Barrett at Wayne State University uses the analogy of program assessment being like planning a journey with Google Maps. You need to know where you are starting, where you hope to end up, and any potential roadblocks along the way.  Similarly, program assessment provides tools for being reflective about what kinds of skills our […]

The post Assessment is about Discovery appeared first on Office of Institutional Research and Assessment.

]]>
Cathy Barrett at Wayne State University uses the analogy of program assessment being like planning a journey with Google Maps. You need to know where you are starting, where you hope to end up, and any potential roadblocks along the way.  Similarly, program assessment provides tools for being reflective about what kinds of skills our students start with and where they need to arrive by the time they finish a program. Assessment tools also help us understand what students are experiencing in a course sequence and where they might be encountering “roadblocks” on their path to successful completion of a program. Therefore, program assessment is about discovery – discovering how our students are collectively experiencing a program – discovering gaps in teaching and learning – and most importantly, discovering how careful changes can improve our programs.

The OIRA is working to expand our portfolio of professional development opportunities to equip members of our community with helpful tools for doing meaningful assessment work. This semester, we will be offering two workshops (each with two time options) focused on writing strong program/course student learning outcomes and developing program curriculum maps.  Both of these topics are foundational in building a good assessment plan.

Below are the dates and times for the workshops:

  • Learning Outcomes – February 24 at 2 PM (Bangor Room)
  • Learning Outcomes – February 25 at 10 PM (Lown Room)
  • Curriculum Mapping – April 1 at 2 PM (Senior Skulls Room)
  • Curriculum Mapping – April 2 at 9 AM (Senior Skulls Room)

If you are interested in attending any of these workshops, please register . A flyer is available on our website if you would like to promote the upcoming Learning Outcomes Workshop in your unit.

Please contact Mandy Barrington (amanda.barrington@maine.edu) or Ryan Weatherbee (ryan.a.weatherbee@maine.edu) with any questions.

The post Assessment is about Discovery appeared first on Office of Institutional Research and Assessment.

]]>
/oira/assessment-is-about-discovery/feed/ 0
NSSE: National Survey of Student Engagement /oira/nsse-national-survey-of-student-engagement/ /oira/nsse-national-survey-of-student-engagement/#respond Tue, 04 Feb 2020 15:00:34 +0000 /oira/?p=2138 91 will be participating in the National Survey of Student Engagement this spring.  This survey, administered to first-year and senior students, seeks information on their participation in programs and activities, time and effort put into their studies, and their perceptions of various aspects of their experience at 91. Information from this important […]

The post NSSE: National Survey of Student Engagement appeared first on Office of Institutional Research and Assessment.

]]>
91 will be participating in the National Survey of Student Engagement this spring.  This survey, administered to first-year and senior students, seeks information on their participation in programs and activities, time and effort put into their studies, and their perceptions of various aspects of their experience at 91. Information from this important survey will be used to inform planning and measure key indicators relevant to the Strategic Vision and Values framework.

91 last administered the survey in spring 2017.  The response rates for first-years and seniors were 24% and 25%, respectively.   The results compared 91 with other New England Public Universities. Some highlights from that comparison:

  • 91 seniors rate significantly higher than comparison schools on the collaborative learning engagement indicators.  In contrast, first-year students rated lower on the supportive environment engagement indicators.
  • 91 seniors participate in far more High-Impact Practices (e.g., learning communities, service learning, research, internship, study abroad) than seniors at the other schools (72% vs. 64%).
  • First-years and seniors reported more class preparation hours and pages of assigned writing than their peers.

Bar charts comparing responses from 91 and New England Public universities: Average hours per week preparing for class first-year 91 students 15.7 first-year New England Public students 14.6 senior 91 students 16.3 senior New England Public students 14.4; Average pages of assigned writing current year first-year 91 students 52.0 first-year New England Public students 50.7 senior 91 students 85.0 senior New England Public students 79.3

The survey will open in February, with the first email prompt sent on February 17th and reminder prompts sent throughout February and March. Students who respond will be entered into a raffle for an array of prizes:  hockey tickets, a hockey jersey, CCA tickets, and 91 coffee mugs. For more information on the NSSE, please see our website /oira/nsse/.  We will be promoting with flyers, tabling, and social media posts.  We are aiming to boost the response rate this year so please spread the word!  

The post NSSE: National Survey of Student Engagement appeared first on Office of Institutional Research and Assessment.

]]>
/oira/nsse-national-survey-of-student-engagement/feed/ 0
Important Dates for Online Student Evaluations of Teaching – Spring 2020 /oira/important-dates-for-online-student-evaluations-of-teaching-spring-2020/ /oira/important-dates-for-online-student-evaluations-of-teaching-spring-2020/#respond Tue, 04 Feb 2020 14:55:53 +0000 /oira/?p=2136 All important dates as well as other online evaluation resources can be found here: /oira/faculty-services/online-course-evaluations/ Important SET Dates for Spring 2020 The following online student evaluations of teaching event dates apply to standard full-semester courses at 91 and UMM. Please visit the OIRA website for dates that apply to shorter courses. Question Personalization (Faculty add […]

The post Important Dates for Online Student Evaluations of Teaching – Spring 2020 appeared first on Office of Institutional Research and Assessment.

]]>
All important dates as well as other online evaluation resources can be found here: /oira/faculty-services/online-course-evaluations/

Important SET Dates for Spring 2020

The following online student evaluations of teaching event dates apply to standard full-semester courses at 91 and UMM. Please visit the OIRA website for dates that apply to shorter courses.

Question Personalization (Faculty add up to 10 of your own questions):

Begin date: April 7, 2020

End date: April 19, 2020

Survey Opens for Students (Students receive an email with a link to the evaluations):

1st email: April 20, 2020

Reminder email: April 24, 2020

End date: May 1, 2020 at 11:59 pm

Students will receive reminder emails only if they have not completed a submission.

Monitor Response Rates (Faculty watch your response rates):

Begin date: April 20, 2020

End date: May 1, 2020

The post Important Dates for Online Student Evaluations of Teaching – Spring 2020 appeared first on Office of Institutional Research and Assessment.

]]>
/oira/important-dates-for-online-student-evaluations-of-teaching-spring-2020/feed/ 0
Blue Online Evaluation of Teaching Response Rates for Fall 2019 /oira/blue-online-evaluation-of-teaching-response-rates-for-fall-2019/ /oira/blue-online-evaluation-of-teaching-response-rates-for-fall-2019/#respond Tue, 04 Feb 2020 14:54:48 +0000 /oira/?p=2134 Approximately 70% of courses at 91 have adopted online student evaluations of teaching using the Blue system as of fall 2019. Overall response rates are at 53.7%, which is common for online evaluations However, there is room for improvement. 91 encourages providing in-class time for the completion of evaluations, something that other institutions have found […]

The post Blue Online Evaluation of Teaching Response Rates for Fall 2019 appeared first on Office of Institutional Research and Assessment.

]]>
Approximately 70% of courses at 91 have adopted online student evaluations of teaching using the Blue system as of fall 2019. Overall response rates are at 53.7%, which is common for online evaluations However, there is room for improvement. 91 encourages providing in-class time for the completion of evaluations, something that other institutions have found to be effective for increasing response rates.1

In an effort to understand whether there is a relationship between providing in-class time for completing evaluations and response rates, we will examine the response rates for fall 2019 classes evaluated in Blue.  Toward that end, we invite all faculty who used Blue in the fall to take .

We recently sent faculty who used Blue in the fall a newsletter highlighting response rate information and ways students interacted with Blue. Here are a few highlights from that document:

Mean undergrad response rates were consistently around 50% while graduate rates were a bit higher at 64%.

Table showing response rates by course level: 100 level mean 51.1% median 50.0% std dev 19.9% # of sections 666; 200 level mean 49.5% median 48.0% st dev 18.5% # of sections 283; 300 level mean 53.4% median 52.4% st dev 22.2% # of section 292; 400 level mean 52.3% median 50.0% st dev 21.6% # of sections 273; graduate level mean 64.0% median 62.5% st dev 24.2% # of sections 333

In-person and video conference courses had better mean response rates than web-based or blended courses.

Table showing Response Rate by Instructional Mode: blended mean 44.0% median 45.7% st dev 13.7% # of sections 15; in-person mean 54.7% median 52.2% st dev 21.7% # of sections 1607; video con mean 56.7% median 50.0% st dev 23.4% # of sections 7; web mean 47.0% median 43.4% st dev 21.1% # of sections 218

Mondays and Wednesdays had the best response rates.

Table showing Responses by Day of Week: Sunday 1500 Monday 6000 Tuesday 3500 Wednesday 5500 Thursday 3000 Friday 2500 Saturday 2500

Most students used a computer, and not a phone or tablet, to complete their evaluations.

Pie chart showing responses by device type: PC 78% iPhone 17% Generic smartphone 4% Android device 1%

For more information on online student evaluations of teaching, please contact Ryan Weatherbee (ryan.a.weatherbee@maine.edu).

1 Kuch, F., Roberts, R. (2018) Electronic in-class course evaluations and future directions. Assessment & Evaluation in Higher Education, 44(5), 726-731.

Young, K., Joines, J., Standish, T., & Gallagher, V. (2018). Student evaluations of teaching: the impact of faculty procedures on response rates. Assessment & Evaluation in Higher Education,44(1), 37-49. doi:

The post Blue Online Evaluation of Teaching Response Rates for Fall 2019 appeared first on Office of Institutional Research and Assessment.

]]>
/oira/blue-online-evaluation-of-teaching-response-rates-for-fall-2019/feed/ 0
Navigate Update /oira/navigate-update/ /oira/navigate-update/#respond Tue, 04 Feb 2020 14:38:48 +0000 /oira/?p=2132 Navigate implementation is in full swing as we enter the spring semester! Throughout the summer and fall, the student app was heavily promoted to first-year students.  This spring, the Content and Promotion team is creating new content intended to engage sophomores, juniors, and seniors. This content will include information about the Student Symposium, career fairs, […]

The post Navigate Update appeared first on Office of Institutional Research and Assessment.

]]>
Navigate implementation is in full swing as we enter the spring semester! Throughout the summer and fall, the student app was heavily promoted to first-year students.  This spring, the Content and Promotion team is creating new content intended to engage sophomores, juniors, and seniors. This content will include information about the Student Symposium, career fairs, and the graduation checklist. In early February, we will turn on Student-Initiated Appointment Scheduling in the Navigate app, which will provide students the ability to schedule appointments with their advisors through their phone.  (Appointments scheduled will be within the availability parameters created by the advisor.) We expect the new content and added scheduling feature will help boost our adoption rates as we begin heavily promoting the app to sophomores, juniors, and seniors.

Advisors who were unable to attend a training workshop on the Navigate Staff Platform can sign up for workshops scheduled throughout the semester using : . Additional workshops will be added, as needed. If you would like to schedule a refresher for your department or unit, please contact Kim Stewart either through the form above or by emailing kimberly.stewart@maine.edu. We are also happy to announce that a series of training videos and guides will be posted on the Navigate website, , in the coming weeks. Keep an eye on this site as new material is added for students, faculty, and staff. One other exciting website update: the Navigate platform can now be accessed through the MyCampus portal by clicking on the EAB logo on the launchpad:

Campus Portal LaunchPad with Navigate icon circled

The final major focus this month has been the second pilot for Progress Reports and alerts. After a successful small pilot of this feature in the fall, eight courses enrolling just over 1,500 students are involved in an expanded pilot this spring. There are two major changes with this pilot: Advisors will now be notified directly when an alert is issued on one of their advisees and there is an expanded list of alert reasons for faculty to choose from. The first progress report is due on January 30th and will serve as an early alert for those students who have not attended a single class session and/or have not yet accessed a required technology. Two additional alerts, focused on grade concerns, will be due February 17 and April 6.  

The post Navigate Update appeared first on Office of Institutional Research and Assessment.

]]>
/oira/navigate-update/feed/ 0