Assessing Learning via the Collegiate Learning Assessment and ...

Integrated Learning Experiential Assessment Program (I-LEAP) Julie Burdick Director of Academic Planning & Assessment [email protected] 513-556-4317 www.uc.edu/icl/ILEAP.html What is I-LEAP? I-LEAP is an innovative experiential learning assessment instrument which gathers external reviewers observations of student learning outcomes and skills as demonstrated in contextual learning environments such as: Faculty mentor assessment of students undergraduate research Community partner assessment of students service learning projects Employer assessment of student internships, practicum, clinicals,

and student teaching placements Faculty assessment of students study abroad experiences I-LEAP History In 1999, the US Department of Education Fund for the Improvement of Postsecondary Education [FIPSE] awarded UCs Professional Practice a grant to develop a Corporate Feedback System for Use in Curricular Reform. The objective of the grant is to build a closed-loop system that measures student performance, including General Education learning outcomes, while on co-op and directs this feedback into curricular development. The survey instrument was developed in partnership with 1,500 co-op employers and UC faculty and reviewed by the National Association for Cooperative Education.

Data from this project (400,000 data points per year) are used as evidence of student learning outcomes on page 5 of the UCs College Portrait, part of the Voluntary System of Accountability (http://www.uc.edu/institutionalresearch/CoopLO.htm). Co-op Employer Data found on UCs College Portrait A 2-3 year rolling average is used to increase student numbers for data validity and take into account assessor bias Co-op Employer Data Findings College of Business: found that students scored low in teamwork related questions. A comprehensive First Year Experience was added to the curriculum emphasizing teamwork, leadership, and communication skills. Teamwork scores have improved significantly. Design Architecture Art & Planning (DAAP): found that students entered with high scores and left co-op with high (or slightly lower) scores indicating a ceiling effect. College of Engineering (Computer Engineering): found that students writing ability deteriorated over the co-op years. Computer Engineering will work with the English department to reconsider the content and placement of technical writing in the curriculum.

I-LEAP Timeline September 2008: Pilot the Service Learning I-LEAP using SurveyMonkey January August 2009: Design and development of I-LEAP software March 2009: Pilot the Study Abroad I-LEAP (SurveyMonkey) June 2009: Pilot the Undergraduate Research (SurveyMonkey). Pilot Learning Community Peer Leader I-LEAP July - August 2009: Software testing September 2009: I-LEAP survey launch. (A select number of I-LEAP surveys will include student self-assessment) I-LEAP Service Learning L e a rn in g O u tc o m e University of Cincinnati I-LEAP (Integrated Learning Experiential Assessment Program) Community Partner Assessment of Student Performance Service Learning & Community Engagement Learning Outcomes Fall 2008 Recognizes political and social implications of actions

4.22 Respects diversity 4.22 Understands and works within the culture of the group 4.16 Acknowledges the value of diverse opinions, talents, and backgrounds 4.22 Ability to discuss social issues 3.97 Awareness of social issues

3.99 3.8 3.85 3.9 3.95 Note: The data in this chart includes the assessment of 68 undergraduate (multidisciplinary) students who participated in course-related service learning projects with 5 community partners (local and international). 4 4.05 Score 4.1 4.15

4.2 4.25 Scale: 5= Excellent 4= Good 3= Satisfactory 2= Unsatisfactory 1= Poor N/A= not applicable I-LEAP Study Abroad University of Cincinnati I-LEAP: Integrated Learning Experiential Assessment Program Faculty Assessment of Students' Study Abroad Experience Global Competence Learning Outcomes Spring 2009 Recognize political and social implications of actions 4.13 L e a r n in g O u tc o m e s

Respects diversity 4.47 Understand local culture through interactions and observations 4.10 Understand own culture within global context 4.11 Diverse cultural frame of reference 4.17 Acceptance of a different culture as a result of this experience 4.04 Accommodate cultural differences while interacting w/others

4.83 Acknowledge value of diverse opinions 4.47 Discuss cultural issues from an informed perspective 4.06 Awareness of global social issues 4.10 1.0 1.5 2.0 2.5 3.0

Mean Score This survey is a pilot program for I-LEAP. The data on this chart represents 34 students (14 Business, 20 College Conservatory of Music/Multi) who took part in a week-long study abroad experience. Business: European study of opportunities & challenges of doing business by exploring business/politics/culture. CCM: Study tour of Florence, Italy including CCM & multi-discipline honor students. 3.5 4.0 4.5 5.0 Scale: 5= Excellent 4= Above Average 3= Satisfactory 2= Unsatisfactory 1= Poor N/A= not applicable

Challenges & Lessons Learned With the goal of individual student learning outcome data, we will probably need to shorten the survey. (i.e. 20 individual surveys would take over 3 hours to complete) While university broad brush assessment data (rolling averages) maybe best for data validity, the program and course level information is essential for continuous curricular improvement Training, assessor buy-in, and university mission support of engaged learning are keys to success Assessors want to choose their questions (from a pool of questions) instead of selecting n/a for several questions

The overall performance score of the Study Abroad I-LEAP is lower than any of the other learning outcomes assessed. The question becomes Are there any questions that we have missed? The Service Learning students scored higher in acknowledging diverse opinions yet lower scores in the ability to discuss social issues. (When the faculty focus group met in fall 2008 to define the modifications to the I-LEAP survey, they had mentioned this challenge of teaching the student to articulate/think critically concerning social responsibility issues) Promises The ability to increase our sources of internal and external validation of student achievement of General Education baccalaureate competencies or specific skills The ability to track individual student progress in different disciplines and types of experiential learning

The ability to analyze touch points (FY, Mid-Collegiate, Capstone) for validation of value-added learning and for continuous curricular improvement The ability to authentically assess the big picture of UCs Integrated Core Learning and its impact on students growth and learning transformation

Recently Viewed Presentations

  • Keystone Review Day 4

    Keystone Review Day 4

    Characteristics of Life. 1. Organization- all organisms are organized into cells, compartments, organelles. 2. Response to stimuli - respond to touch, excess heat, internal or external factors . 3. Homeostasis - maintain stable internal conditions (heat, O2 levels, pH)
  • *When editing this presentation, remember to be compliant.

    *When editing this presentation, remember to be compliant.

    The nucleus holds the cell's DNA which is genetic material and the blueprint of life. Mitochondria provide the energy needed by the cell for life and the cell membrane ensures that the cell can maintain an internal environment that can...
  • Reproductive System - PC|MAC

    Reproductive System - PC|MAC

    Reproductive System Unit 6:14 pages 132 - 139
  • Theory of CONCERTIVE CONTROL - Testing

    Theory of CONCERTIVE CONTROL - Testing

    Theory of CONCERTIVE CONTROL Chapter 6 Anya Nazaroff Before Concertive Control Theory… Examples: Bureaucratic Control: Entourage: Ari Gold Simple Control: Family Guy Clip 3 Elements of Concertive Control Control Identification Discipline Concertive Control CONTROL Control shifts from management to workers...
  • HIV Post-Exposure Prophylaxis after sexual contact

    HIV Post-Exposure Prophylaxis after sexual contact

    Times New Roman Angsana New Arial Wingdings Tahoma Maple 1_Maple CorelDRAW HIV Post-Exposure Prophylaxis after Sexual Contact HIV Transmission Through Sexual Contact Number of People with HIV/AIDS by Region PowerPoint Presentation Facts Factors justify the administration of NONOPEP 1. Biological...
  • Section 1: Introduction and Rationale

    Section 1: Introduction and Rationale

    Both bureaus are working closely together to ensure that all public schools have resources to accomplish two objectives." ~Nikolai Vitti and Mary Jane Tappen, FLDOE Do: Discuss current challenges and needs, especially as related to problem solving. * Do: Discuss...
  • Business Continuity Planning Training Session for Business ...

    Business Continuity Planning Training Session for Business ...

    We plan for vacation, plan for an event, plan our weekly or daily activities. So must we do some pre-thinking when it comes to BUSINESS CONTINUITY PLANNING (BCP). Examples of pre-planning - we take FIRST AID or CPR training in...
  • 11 - 5 Volumes of Pyramids & Cones

    11 - 5 Volumes of Pyramids & Cones

    11 - 5 Volumes of Pyramids & Cones Objectives: 1) Find the volume of a right Pyramid. 2) Find the volume of right Cone. A Pyramid is a three dimensional figure with a regular polygon as its base and lateral...