Spring 2024 Newsletter Archives - Office of Institutional Research and Assessment /oira/category/updates/spring-2024-newsletter/ Just another University of Maine Sites site Mon, 22 Apr 2024 18:09:42 +0000 en-US hourly 1 https://wordpress.org/?v=6.8.5 SWAAC Survey /oira/swaac-survey/ /oira/swaac-survey/#respond Fri, 19 Apr 2024 13:50:03 +0000 /oira/?p=9537 The System Wide Academic Assessment Committee (SWAAC), on which a number of OIRA staff serve, will be offering a system-wide workshop in fall 2024 focused on interpreting results from assessing student learning to support program improvements. This topic was selected based on interest expressed by faculty in a survey last year. We would like your […]

The post SWAAC Survey appeared first on Office of Institutional Research and Assessment.

]]>
The System Wide Academic Assessment Committee (SWAAC), on which a number of OIRA staff serve, will be offering a system-wide workshop in fall 2024 focused on interpreting results from assessing student learning to support program improvements. This topic was selected based on interest expressed by faculty in a survey last year. We would like your feedback on what format would be most useful to you for this and future workshops. Thank you for helping to shape our next workshop!

Our last system-wide workshop in fall 2023 focused on aligning assessment activities to program learning outcomes. Good alignment is an important foundation for being able to interpret and use assessment results. If you couldn’t make the past workshop,

Interpreting results from assessing student learning is a key strategy that supports reflecting on evidence from assessment, making recommendations, and using assessment results to improve courses and programs. These steps are part of a complete assessment cycle, as shown in the diagram below.

Descriptive graphic showing flow of result process.

Hope to see you at the system-wide workshop next fall! Details to be provided by September.

The post SWAAC Survey appeared first on Office of Institutional Research and Assessment.

]]>
/oira/swaac-survey/feed/ 0
First Destination /oira/first-destination/ /oira/first-destination/#respond Fri, 19 Apr 2024 13:49:08 +0000 /oira/?p=9528 We are gearing up to begin collecting First Destination data for students who will graduate in Spring 2024, as well as any students who graduated in Summer or Fall 2023. Students who know their plans for after graduation – whether that be with an employer, enrolling in graduate school, or service in the military, or […]

The post First Destination appeared first on Office of Institutional Research and Assessment.

]]>
We are gearing up to begin collecting First Destination data for students who will graduate in Spring 2024, as well as any students who graduated in Summer or Fall 2023. Students who know their plans for after graduation – whether that be with an employer, enrolling in graduate school, or service in the military, or anything else – are welcome to reply early to the short-form version of the survey in CareerLink. Late in the summer, we will follow up with those graduates and invite them to participate in a long-form version of the survey, and continue data collection through the end of the year via phone interviews and information gathered from the National Student Clearinghouse and LinkedIn.

In our second year of the First Destination project, collecting information from 2022-2023 graduates, the University of Maine System achieved a 53% knowledge rate (the percentage of the graduating cohort for whom we have data), an increase of 8.6% from the first year. This information about recent graduates is valuable for a wide range of stakeholders including institutional research, career centers, alumni and development offices, and chief academic officers. Summaries of recent graduates’ outcomes, as well as responses to survey items about careers services and other university programs, are available in a Power BI dashboard and in one-page infographics for each campus.  The one-page infographic reports for 91 and 91 Machias are here: 

The post First Destination appeared first on Office of Institutional Research and Assessment.

]]>
/oira/first-destination/feed/ 0
IR Data Fellows /oira/ir-data-fellows/ /oira/ir-data-fellows/#respond Fri, 19 Apr 2024 13:27:01 +0000 /oira/?p=9531 The IR Data Fellows Program, aimed at expanding data utilization and literacy across campus, began in January. This initiative seeks to equip staff throughout 91 with the necessary skills to leverage campus data resources effectively, with the goal of establishing a sustainable data literacy strategy. This strategy aims to empower users and foster a broader […]

The post IR Data Fellows appeared first on Office of Institutional Research and Assessment.

]]>
The IR Data Fellows Program, aimed at expanding data utilization and literacy across campus, began in January. This initiative seeks to equip staff throughout 91 with the necessary skills to leverage campus data resources effectively, with the goal of establishing a sustainable data literacy strategy. This strategy aims to empower users and foster a broader utilization of data across various campus functions.

Ten faculty and staff members from 91 and 91 Machias have actively participated in monthly in-person sessions. These sessions have facilitated discussions on the strengths and weaknesses pertaining to data literacy and data-informed decision-making within the university. Additionally, participants have started collaborating on group projects focused on two critical aspects of student success and retention: evaluating the performance of students entering 91 who had graduated from high school with high GPAs, and analyzing the relationship between retention rates and student engagement levels, as measured by the National Survey of Student Engagement.

The year-long program is set to conclude in December, culminating in the presentation of final projects. This initiative has proven to be a valuable opportunity for OIRA to engage in collaborative efforts with faculty and staff, fostering a culture of informed decision-making through engaging discussions and shared insights.

The post IR Data Fellows appeared first on Office of Institutional Research and Assessment.

]]>
/oira/ir-data-fellows/feed/ 0
Website Updates /oira/website-updates/ /oira/website-updates/#respond Fri, 19 Apr 2024 13:26:22 +0000 /oira/?p=9513 New Report Index 鴡’s Report Index provides a complete inventory of public static reports. We recently redesigned the Report Index to be more efficient and easily navigable, featuring dropdown menus organized by report topic. Categories include admissions, enrollment, retention and graduation, the First Destination Survey, student evaluations of teaching, and more. Our Common Data Set […]

The post Website Updates appeared first on Office of Institutional Research and Assessment.

]]>
New Report Index

鴡’s Report Index provides a complete inventory of public static reports. We recently redesigned the Report Index to be more efficient and easily navigable, featuring dropdown menus organized by report topic. Categories include admissions, enrollment, retention and graduation, the First Destination Survey, student evaluations of teaching, and more. Our Common Data Set and IPEDS report archives can also be found here.


Accessibility Improvements

Over the past year OIRA has updated our website to be more accessible. This has included revising our online reports to provide accessible formats, providing alternate text for photos and graphics, ensuring a high contrast between background and text, as well as changing all of our links to use identifying language. Our intent is for all areas of our website to be fully accessible and meet the , not only for those with disabilities or sensory impairments, but for all users that access our site.


New Assessment Pages: Portfolios, Student Voice, Rubrics

Our assessment website has been redesigned (thanks to Graduate Assistant Kaitlyn Groh!) and we have added new resource pages. The new pages include a set of resources and are linked below with short descriptions:

Portfolios for Assessment

Portfolios can be a valuable way for programs without a core curriculum (for instance, individualized or interdisciplinary programs) to assess program learning outcomes. They are also a great way to bring students in as active participants in the assessment process, as well as give them the opportunity to reflect on their learning.

Student Voice

Incorporating student voice into the assessment process is a powerful way to gather important feedback from students’ perspectives to support improvements to the program and assessment process. It can also be valuable for students to be aware of their program learning outcomes and to learn about how those outcomes are assessed.

Building and Using Rubrics in Assessment

Rubrics can be a useful tool to use when identifying levels of learning and achievement, specifically when you align a rubric with your program learning outcomes. Included in this page are example rubrics from other universities with a short discussion on strengths and weaknesses of each one, and how you might implement them in your program.


Report Updates

Non-Yield Reports

Our First-Time Undergraduate and Transfer Undergraduate Non-Yield Reports have been updated for Fall 2023. These reports provide information about where 91’s admitted but non-matriculated students decided to attend college.

SET Response Rates

Student Evaluations of Teaching (SET) Response Rate Reports have been updated for Fall 2023 for both 91 and UMM. We have started providing reports in both PDF and a fully accessible Excel format.

Veterans Report

The 91 Degree-Seeking Veterans Report was recently updated to include data for Fall 2023 and Spring 2024. This report depicts longitudinal trends in the degree-seeking veteran population at 91, and contains term enrollment data going back to Fall 2009.

KPI Updates

91 uses Key Performance Indicators (KPIs) to annually evaluate its long-term goal progress in a number of topic areas originating from its strategic plans. These metrics are laid out on the KPI page of our website, most of which have been updated for the current year. We also recently reorganized this page to display KPI metrics for 91 and 91 Machias in a more clear and succinct manner.

Retention and Graduation Rates

Our reports on Retention and Graduation Rates have been updated to include the Fall 2022 Cohort. Total retention and graduation rates for 91 and 91 Machias are available to view, as well as rates by academic college.

The post Website Updates appeared first on Office of Institutional Research and Assessment.

]]>
/oira/website-updates/feed/ 0
Fall/Spring First-Year Student Success Efforts /oira/fall-spring-first-year-student-success-efforts/ /oira/fall-spring-first-year-student-success-efforts/#respond Fri, 19 Apr 2024 13:25:49 +0000 /oira/?p=9499 Since last summer, OIRA has provided data to Associate Provost Scott Marzilli as he coordinated support for the fall 2023 first year students. This collaboration began with data analysis to identify a set of factors correlated with lower success rates that could be helpful for identifying students who would potentially need extra support to succeed […]

The post Fall/Spring First-Year Student Success Efforts appeared first on Office of Institutional Research and Assessment.

]]>
Since last summer, OIRA has provided data to Associate Provost Scott Marzilli as he coordinated support for the fall 2023 first year students. This collaboration began with data analysis to identify a set of factors correlated with lower success rates that could be helpful for identifying students who would potentially need extra support to succeed in courses and be retained. A set of five pre-enrollment factors were found to be potentially useful for targeting support efforts and Associate Provost Marzilli coordinated efforts on campus to provide additional support to students with two or more of these factors. Further, early alert campaigns were used to collect information for all first-year students to identify those in need of additional support. 181 instructors provided 2-week and mid-term progress reports to alert students to issues with attendance, participation, or poor grades. Each alert triggered individual support from a success team, with 81 faculty and staff providing support to 742 first year students through the fall and spring campaigns.

Through the fall and spring, OIRA analyzed data from early alert campaigns and generated a series of infographics to keep Associate Provost Marzilli and the success teams informed about the impacts of the campaigns. Early analysis was used by Provost Marzilli to make adjustments, including adjusting the timing for the spring campaign and calling on success teams to make extra efforts to reach out to a group of students with alerts from multiple campaigns.

After the fall term, data analysis was completed to investigate academic outcomes for first-year students, with promising results. Overall, fall term GPA for the 2023 first-year full-time cohort was 3% higher than fall term GPA in 2021 or 2022, after adjusting for differences in pre-enrollment factors including high school GPA and percentage of students with one or more of the following characteristics (which we have labeled “barriers to success” due to their statistical correlation with less-favorable academic outcomes in prior cohorts): high school GPA below 3.0, first-generation, Pell eligible, underrepresented minority, and rural. Fall 2023 term GPA was 6% higher than fall 2021 or 2022 for students with two or more barriers to success. (Note: The statistical analyses are correlational in nature and cannot be interpreted as demonstrating a causal relationship between the success efforts and these outcomes.)

The post Fall/Spring First-Year Student Success Efforts appeared first on Office of Institutional Research and Assessment.

]]>
/oira/fall-spring-first-year-student-success-efforts/feed/ 0
Campus Climate Data /oira/campus-climate-data/ /oira/campus-climate-data/#respond Fri, 19 Apr 2024 13:21:59 +0000 /oira/?p=9501 This spring, OIRA continued to provide presentations of the spring 2022 HEDS Diversity and Equity Campus Climate Survey data analysis to stakeholder groups. A presentation and college-level topline summary briefs were provided to college deans. Findings were also shared with the Provost’s Advisory Council on Equity and the Mental Health Task Force to support ongoing […]

The post Campus Climate Data appeared first on Office of Institutional Research and Assessment.

]]>
This spring, OIRA continued to provide presentations of the spring 2022 HEDS Diversity and Equity Campus Climate Survey data analysis to stakeholder groups. A presentation and college-level topline summary briefs were provided to college deans. Findings were also shared with the Provost’s Advisory Council on Equity and the Mental Health Task Force to support ongoing discussions. Please feel free to contact our office if you have questions.

The post Campus Climate Data appeared first on Office of Institutional Research and Assessment.

]]>
/oira/campus-climate-data/feed/ 0
Gateways to Success /oira/gateways-to-success/ /oira/gateways-to-success/#respond Fri, 19 Apr 2024 13:20:34 +0000 /oira/?p=9526 Gateways to Success, one of the UMS Transforms Student Success and Retention initiatives, finished its first pilot semester in fall 2023. Each campus in the University of Maine System was invited to offer proposals aimed at improving outcomes in courses that contribute disproportionately to D, F, W, or L grades by degree-seeking undergraduates. The first […]

The post Gateways to Success appeared first on Office of Institutional Research and Assessment.

]]>
Gateways to Success, one of the UMS Transforms Student Success and Retention initiatives, finished its first pilot semester in fall 2023. Each campus in the University of Maine System was invited to offer proposals aimed at improving outcomes in courses that contribute disproportionately to D, F, W, or L grades by degree-seeking undergraduates. The first round of accepted proposals included fourteen separate projects at all seven campuses, deploying interventions ranging from introducing Maine Learning Assistants or other near-peer mentors to assist with instruction, enhancing professional development for graduate teaching assistants, redesigning curriculum, and deepening coordination with campus writing centers.

Since the end of the fall semester, the Office of Institutional Research and Assessment has been examining the associations between students in classes receiving these new interventions and their final grades, as well as summarizing and analyzing the results of surveys and other assessments. While it will take a few more semesters of data before we can evaluate most projects, we are meeting with Gateways to Success leads for all campuses and projects to start exploring preliminary data.

The post Gateways to Success appeared first on Office of Institutional Research and Assessment.

]]>
/oira/gateways-to-success/feed/ 0
Undergraduate Assessment Update /oira/undergraduate-assessment-update-2/ /oira/undergraduate-assessment-update-2/#respond Fri, 19 Apr 2024 13:19:45 +0000 /oira/?p=9504 Program assessment three-year reports are due by June 30 from the following programs: The 3-year reports consist of: 1.) A 3-year summary report and 2.) Updated learning outcomes data for all program learning outcomes in the annual reporting site.  As always, our assessment staff is ready and available to meet with you to answer any […]

The post Undergraduate Assessment Update appeared first on Office of Institutional Research and Assessment.

]]>
Program assessment three-year reports are due by June 30 from the following programs:

  • All academic programs in the College of Liberal Arts and Sciences and the Honors College at 91
  • All academic programs in the Creative Arts and Professional Studies Division at 91 Machias.

The 3-year reports consist of:

1.) A and

2.) Updated learning outcomes data for all program learning outcomes in the annual reporting site.  As always, our assessment staff is ready and available to meet with you to answer any questions you may have about program assessment and the reporting process. Please submit a 3-year report even if it feels incomplete because there is not data for all program learning outcomes. It is important to us to meet programs where they are in this process, and the information in the 3-year reports helps us identify areas where support may be needed.

The post Undergraduate Assessment Update appeared first on Office of Institutional Research and Assessment.

]]>
/oira/undergraduate-assessment-update-2/feed/ 0
Graduate Assessment Update /oira/graduate-assessment-update-2/ /oira/graduate-assessment-update-2/#respond Fri, 19 Apr 2024 13:18:32 +0000 /oira/?p=9496 Graduate programs have continued to make progress with learning outcomes assessment planning through the fall and winter, with all graduate program coordinators having communicated with OIRA about assessment within the past year. To date, 100 of the 159 active graduate degree programs have program learning outcomes. We have received and provided feedback on assessment plans […]

The post Graduate Assessment Update appeared first on Office of Institutional Research and Assessment.

]]>
Graduate programs have continued to make progress with learning outcomes assessment planning through the fall and winter, with all graduate program coordinators having communicated with OIRA about assessment within the past year. To date, 100 of the 159 active graduate degree programs have program learning outcomes. We have received and provided feedback on assessment plans for 39, and curriculum maps for 58 programs.

In addition to meeting one-on-one with many programs, since September OIRA has offered four roundtable discussions (two for MCEC faculty, one for LAS faculty, and one for COEHD faculty) and two workshops focused on rubric development for program assessment. A roundtable with ELH faculty was held last academic year in May 2023. These events were attended by 31 graduate faculty and 2 associate deans, with some faculty attending both a roundtable discussion and one of the rubric workshops.

CLAS and interdisciplinary graduate programs are scheduled to submit their first 3-year assessment reflection reports by June 30, and we have scheduled reporting info. sessions April 18 (11-12:00) and May 6 (1-2:00) to support this effort (contact laura.millay@maine.edu if you are interested in attending). OIRA and the Assessment Advisory Board will review submitted plans and provide formative feedback. Programs are also encouraged to reach out to OIRA staff any time with questions or to request a meeting.

The post Graduate Assessment Update appeared first on Office of Institutional Research and Assessment.

]]>
/oira/graduate-assessment-update-2/feed/ 0
General Education Summit /oira/general-education-summit/ /oira/general-education-summit/#respond Fri, 19 Apr 2024 13:16:53 +0000 /oira/?p=9535 We are happy to announce our first ever General Education Summit on May 23, 2024. With support from the Davis Educational Foundation and the Office of the Executive Vice President for Academic Affairs & Provost we have invited Dr. Kate McConnell and Dr. Eddie Watson, two renowned speakers from AAC&U, to present their national perspective […]

The post General Education Summit appeared first on Office of Institutional Research and Assessment.

]]>
We are happy to announce our first ever General Education Summit on May 23, 2024. With support from the Davis Educational Foundation and the Office of the Executive Vice President for Academic Affairs & Provost we have invited Dr. Kate McConnell and Dr. Eddie Watson, two renowned speakers from , to present their national perspective on General Education reform and to facilitate various sessions and conversations specific to our context here at 91. We are excited for this opportunity for faculty to come together to discuss, plan and learn from each other and from national experts on General Education curricula. For more information on session topics, and to register, please go to the General Education Summit 2024 website.

The post General Education Summit appeared first on Office of Institutional Research and Assessment.

]]>
/oira/general-education-summit/feed/ 0