Program Evaluation and Assessment Resources

Unless otherwise noted, all documents below are in PDF format and require the free Adobe Acrobat Reader.    

Materials To Assist with Assessment

• Aligning Student Learning Goals and IDEA Objectives 
• Excel Template for IDEA Summary Graphs (XLS)
• 2013 Assessment and IDEA Presentation 
• 2013 Assessment and IDEA Handouts
     

HLC Self-study Process for Reaccreditation

• HLC 2012 Self-study Process Presentation 
• HLC 2012 Self-study Process Handouts 
• HLC 2012 Self-study Process Paper  

Materials To Assist with Grading

• Requirements for Honors Thesis in Psychology 
• Oral Presentation Grading Rubric 
• APA-style Paper Grading Rubric 

Materials to Assist with Academic Advising

• Academic Advising Snapshot 
• Academic Advising Handbook for Students 

Dissemination of Assessment of Student Learning Outcomes

• Using AACU VALUE Rubrics to Assess Student Writing 
• Highlighting the Relevance of Statistics to Social Science Majors 
• Student Learning in Unpopular Courses 
• Psychology Assessment of Student Learning Outcomes 
• What do students learn in a massively interdisciplinary course about hope? 
• Fifteen years of mixed methods evaluation to inform curricular design  
• Feedback, feedback, feedback: Peer review, self-review, and grading rubrics improve student writing 
• Student experiences during a community-based sex education project 
• Evaluating undergraduate research experiences: Student and faculty mentor perceptions 
• Relationship between frequency and duration of textbook reading and effective reading habits 
• AVID RATER: Learning to make sense of primary source readings 
• Peer Review 3.1: The Saga Continues 
• What good is a course on ethics? 
• Sometimes the answer to program assessment is staring you right in the face! 
• Flipping a Statistics Class: Implementation and Assessment of Outcomes
   

Scholarship of Teaching and Learning (SOTL) Conducted by Department Faculty

• Karkowski, A. M., & Fournier, J. S. (2012). Undergraduate research as a catalyst for institutional change. CUR Quarterly, 32(5), 13-16.
• Karkowski, A. M., Hutchinson, K., & Howell, K. (2012). Advancing institutional assessment via undergraduate research journals. In A. D. Hart (Ed.), How To Start an Undergraduate Research Journal (pp. 34-40). Washington, DC: Council on Undergraduate Research.
• Karkowski, A. M., Howell, K., & Hutchinson, K. (May, 2012). Learning from students’ publications: Using AACU VALUE rubrics to assess student writing. Association for Psychological Science, Chicago, IL. 
• Wilson, S. G. (January, 2012). Keeping it real: Highlighting the relevance of statistics to social science majors. National Institute on the Teaching of Psychology, St. Pete Beach, FL.
• Sagaria, S. D., & Fournier, J. S. (January, 2011). Applying circadian rhythms, alertness, and individual differences to offer and to schedule courses to maximize learning. National Institute on the Teaching of Psychology, St. Petersburg, FL.
• Karkowski, A. M. (2010). Activities to help students appreciate committees that protect research participants. CUR Quarterly, 30(3), 11-14.
• Karkowski, A. M. (May, 2010). Feedback, feedback, feedback: Peer review, self-review, and grading rubrics improve student writing. Association for Psychological Science, Boston, MA.
• Ross, R., & Karkowski, A. M. (October, 2009). Faculty mentoring: Integrating social work knowledge, values, and skills via undergraduate research. National Association of Social Workers Ohio Chapter Conference, Worthington, OH.
• Dwyer, M., Aellig, A., Francis, C., Dickson, S., & Karkowski, A. M. (May, 2009). Measuring the nebulous: Psychometric properties of an academic advising assessment tool. Association for Psychological Science, San Francisco, CA.
• Sagaria, S., Fournier, J. S., & Karkowski, A. M. (January, 2009). Understanding effective characteristics and use of textbooks, from students’ perspective. National Institute on the Teaching of Psychology, St. Petersburg FL.
• Thomas, A., Karkowski, A. M., Whitehouse, S., Cooper, T., Lehmann, N., & Stevens, K. (November, 2008). Would it be okay if I asked a question? Sex Differences in Communication among Generation Y Students. 28th International Lilly Conference on College Teaching, Oxford, OH.
• Ashbrook, R., Bowden, M., Imar, T., Mack, K. Levine, K., Swenson, E., & Traver, M. (2008, October). Ethics roundtable: Psychological vignettes and case studies. Ohio Psychological Association Convention, Columbus, OH.
• Hansen, E., Lahm, T. D., & Karkowski, A. M. (June, 2008). Encouraging the transition from button pusher to research scientist. CUR National Conference, St. Joseph, MN. NOTE: Karkowski was a last minute replacement for a presenter that could not attend.
• Lahm. T. D., Douglas, A. Hemkin, S., & Karkowski, A. M. (June, 2008). Computational science as an organizing principle for cross-disciplinary, multi-institutional, and student-faculty collaborations. Enriching the Academic Experience of College Science Students, Ann Arbor, MI.
• Fournier, J. S., Karkowski, A. M., & Ashbrook, R. A. (May, 2008). Student experiences during a community-based sex education project. Association for Psychological Science annual meeting, Chicago, IL.
• Karkowski, A. M., & Lahm, T. D. (May, 2008). Evaluating undergraduate research experiences: Student and faculty mentor perceptions. Association for Psychological Science annual meeting, Chicago, IL.
• Sagaria, S., Fournier, J. S., & Karkowski, A. M. (May, 2008). Relationship between frequency and duration of textbook reading and effective reading habits. Association for Psychological Science annual meeting, Chicago, IL.
• Sagaria, S., & Karkowski, A. M. (January, 2007). How can you keep statistics students from voting you off of the island? Transformative learning in a statistics classroom. National Institute on the Teaching of Psychology, St. Petersburg Beach, FL.
• Karkowski, A. M. (January, 2007). Celebrating diversity: Using a natural jigsaw approach in computational psychology. National Institute on the Teaching of Psychology, St. Petersburg Beach, FL.
• Karkowski, A. M., & Lahm, T. D. (October, 2006). Modeling undergraduate research through computational science: Successes and pitfalls. Project Kaleidoscope National Assembly, Chicago, IL.
• Karkowski, A. M., & Lahm, T. D. (October, 2006). Transforming lives through undergraduate research. Project Kaleidoscope National Assembly, Chicago, IL.
• Karkowski, A. M. (June, 2006). Application of mathematics in the social and behavioral sciences. 3rd International Conference on the Teaching of Mathematics, Istanbul, Turkey.
• Ross, R., Fournier, J. S., Almos, K., & Karkowski, A. M. (May, 2006). AVID RATER: Learning to make sense of primary source readings. Association for Psychological Sciences, New York, NY.
• Vakalis, I., & Karkowski, A. M. (April, 2005). Integrating undergraduate research into an interdisciplinary computational science program. National Conference on Undergraduate Research, Lexington, VA.
• Fournier, J. S., Karkowski, A. M., Almos, K. A., Velkey, A., & Rilea, S. (January, 2005). Peer Review 3.1: The Saga Continues. National Institute on the Teaching of Psychology, St. Petersburg Beach, FL.
• Cunningham, J., Archdeacon, C., McMichael, N., Kanuckle, S., Fournier, J. S., & Karkowski, A. M. (August, 2004). Differences in undergraduate research. American Psychological Association, Waikiki, HA.
• Ashbrook, R. M., Carlson, A., Short, D., & McDonnel, T. (2004, October). Prior learning: More exploration. Conference session/task force report at the 24th Annual Adult Higher Education Alliance Conference, Long Beach, CA.
• Ashbrook, R. M. (2004). Exploring the boundaries of mandatory continuing education. The Ohio Psychologist, May, p. 3.
• Karkowski, A. M., & Tarlin, J. (May, 2004). What good is a course on ethics? American Psychological Society, Chicago, IL.
• Vakalis, I. E., & Karkowski, A. M. (March, 2004). Computational Science at the Undergraduate Curriculum. Ohio Commons for Digital Education, Columbus, OH.
• Karkowski, A. M., & Fournier, J. S. (January, 2004). Sometimes the answer to program assessment is staring you right in the face! National Institute on the Teaching of Psychology, St. Petersburg Beach, FL.
• Fournier, J. S., & Karkowski, A. M. (January, 2004). To peer review or not to peer review, that is the question. National Institute on the Teaching of Psychology, St. Petersburg Beach, FL.
• Karkowski, A. M., & Vakalis, I. E. (2004). Ohio educators respond to Governor Taft’s initiative for the third frontier: A call for action. Ohio Journal of Science, 104(5), 123-125.
• Karkowski, A. M. (2004). Curricular change can benefit the mind, body, and soul. CUR Quarterly, 24(4), 161.
• Karkowski, A. M., & Vakalis, I. E. (2004). What can computational studies offer high school students? Preparing students for the new science frontier. Ohio Journal of School Mathematics, 49, 18-21.
• Norris, M., Richter-Hauk, R., Kardaras, B. & Carlson, A. (November, 2003). The fourth dimension: What research skills for adult learners are important to students, alumni, faculty and employers? 2003 Assessment Institute, Indianapolis, IN.
• Norris, M., Richter-Hauk, R., Kardaras, B. & Carlson, A. (October, 2003). Applied research projects: What employers want, students will tolerate and IRBs will approve. National Conference of the Adult Higher Education Alliance, Asheville, NC.
• Ashbrook, R. M., Brewer, P., Carlson, A. J., Hartmann, R., McDonnell, T. (October, 2003). Prior learning assessment roundtable. National Conference of the Adult Higher Education Alliance, Extending the Boundaries of Adult Learning, Asheville, NC.
• Norris, M. (April, 2003). Using your research to teach. Ohio Canadian Studies Roundtable, Columbus, OH.
• Norris, M. (March, 2003). They will know what hit ‘em: Using your research to teach. North Central Sociological Association, Cincinnati, OH.
• Karkowski, A. M., Rosell, M. C., Fournier, J. S., & Lahm, T. (January, 2003). Techniques for improving students’ scientific writing: Peer review versus listening to another student read a paper draft. National Institute on the Teaching of Psychology conference, St. Petersburg Beach, FL.
• Fournier, J. S., Karkowski, A. M., Cunningham, K., & Spanko, K. (January, 2003). Survey says… Students want feedback and awards during a campus-wide research symposium! National Institute on the Teaching of Psychology conference, St. Petersburg Beach, FL.
• Sagaria, S. D. (January, 2003). Making statistics meaningful in students’ lives: Developing critical thinkers while reading the newspaper. National Institute on the Teaching of Psychology conference, St. Petersburg, FL.
• Ashbrook, R. M., Carlson, A. J., Johnson, R. S., McGary, D., & Carlson, D. G. (2002). Interdisciplinary learning as preparation for leadership. Creating New Meanings in Leading Learning (pp. 207-221). National Conference on Alternative and External Degree Programs for Adults, The Alliance & the American Council on Education.
• Norris, M. & Richter-Hauk, R. (October, 2002). Spinal adjustment: Using feedback from students and faculty to ensure consistency and continuity in spine courses of a Liberal and Professional Studies (LPS) adult major. National Conference of the Adult Higher Education Alliance, Pittsburgh, PA.
• Norris, M. (March, 2002). Job shadows and al Qaeda as strategies to rescue a core course in organizations. Annual Meeting of the Midwest Business Administration Association, Chicago, IL.
• Karkowski, A. M. & Fournier, J. S. (January, 2002). No textbook required? Student responses to textbooks versus primary source reading materials. National Institute on the Teaching of Psychology, conference, St. Petersburg Beach, FL.
• Sagaria, S.D., Fournier, J., & Karkowski, A. (January, 2002). Attending professional conferences: Making efficient use of time, money and resources. National Institute on the Teaching of Psychology conference, St. Petersburg, FL.
• Sagaria, S. D., & Allensworth, L. (2001). Adult learners and math anxiety: Overcoming the self‑defeating emotions and behavior. Annual Adult Higher Education Alliance/ACE Conference, Austin, TX.
• Carlson, A., & Ashbrook, R. (October, 2001). Experiential learning. 21st Annual AHEA/ACE Conference, Austin, TX.
• Karkowski, A. M. (October, 2001). Scientific writing in a research methods course. Project Kaleidoscope National Assembly, Madison, WI.
• Karkowski, A. M. (June, 2001). Using STELLA® to teach computational models in psychology. Annual Conference of the American Psychological Society, Toronto, Canada.
• Norris, M. (March, 2001). Team teaching criminal justice with an undergraduate assistant: Quantitative and qualitative analysis. Annual Meeting of the Midwest Business Administration Association, Chicago, IL.
• Bica, L. A., & Fournier, J. S. (January, 2001). “Build-a-Brain”: A small group activity for teaching the structures of the brain and its effects on interest level and retention of information. National Institute on the Teaching of Psychology, St. Petersburg Beach, FL.
• Karkowski, A. M., Moore, R., Bowes, K., & Rosell, M. C. (January, 2001). Miles to go before we sleep: Integrating feminist methodology into an undergraduate psychological research methods course. National Institute on the Teaching of Psychology conference, St. Petersburg Beach, FL.
• Ashbrook, R. M., Fournier, J., Poteet, T., & McDonald, J. (2000). Adult students with learning disorders and ADHD. In Access to Quality & Success: Applying Principles of Good Practice. National Conference on Alternative and External Degree Programs for Adults, The Alliance & the American Council on Education.
• Norris, M. (October, 2000). Team teaching with a student assistant - quantitative analysis. Indiana Academy of Social Sciences, Evansville, IN.
• Norris, M. (March, 2000). Team teaching criminal justice with an undergraduate student assistant: Some caveats. Academy of Criminal Justice Sciences, New Orleans, LA.
• Sagaria, S. D., & Allensworth, L. (January, 2000). Students’ incoming attitudes in psychological statistics. National Institute on the Teaching of Psychology conference, St. Petersburg, FL.
• Karkowski, A. M., Rosell, M. C., & Velkey, A. J. (January, 2000). Birds of a feather test hypotheses together. National Institute on the Teaching of Psychology conference, St. Petersburg Beach, FL.
• Rosell, M. C., Karkowski, A. M., & Fournier, J. S. (January, 2000). Origami brains and planes of dissection. National Institute on the Teaching of Psychology conference, St. Petersburg Beach, FL.
• Norris, M. (November, 1999). Killing them softly: Original criminological songs as an experimental teaching technique. American Society of Criminology, Toronto, CA.
• Torello, M. & Ashbrook, R. M. (October, 1999). Preserving community in the technological age. Eighteenth Annual Alliance/ACE Conference, San Diego, CA.
• Karkowski, A. M. & Velkey, A. J. (January, 1999). The pedagogy of mathematical modeling for psychology students: Achieving an understanding of theory and utility. National Institute on the Teaching of Psychology conference, St. Petersburg Beach, FL.
• Ashbrook, R. M. (August, 1998). Assessing prior learning outcomes. Steelcase Lecture Series, Aquinas College, Grand Rapids, MI.
• Travis, T. G. & Ashbrook, R. M. (1997). Learning’s primacy in PLA [Prior Learning Assessment]: Reflections from the C.A.E.L. 1996 International Conference. C.A.E.L. Forum, 20, 13-14, 39.
• Ashbrook, R. M. & Travis, T. G. (November, 1997). When experience counts. Creating A Nation of Lifelong Learners Conference, Council for Adult and Experiential Learning & The Alliance, Washington, D.C.
• Ashbrook, R. M. (1996). Narrative reasoning as assessment. In Visions and Revisions (pp. 1-10), Conference Proceedings of the Sixteenth National Conference on Alternative and External Degree Programs for Adults, The Alliance and the American Council on Education.
• Travis, T. G. & Ashbrook, R. M. (November, 1996). Contrasting Prior Learning Assessment Strategies: Assumptions, practices and implications. International Conference of the Council for Adult and Experiential Learning, New York, NY.
• Ashbrook, R. M. (October, 1996). Narrative reasoning as assessment. Alternative and External Degree Programs for Adults, The Alliance & The American Council on Education, St. Pete Beach, FL.
• Ashbrook, R. M., Cox, M., Dyck, R., Ghavami, F., Kent, E., Martens, K., McNary, L., Mellum, S., Olsen, V., Torello, M. (1995). Innovations in the assessment of experiential learning. In Celebrating Excellence: Learning & Teaching in Adult Higher Education (pp. 50-59), Conference Proceedings of the National Conference on Alternative and External Degree Programs for Adults, The Alliance & the American Council on Education.
• Ashbrook, R. M., Schalinske, R., & Patterson, R. (1995, October). Choice and consequence in the assessment of adult learner outcomes. Paper presented at the Fifteenth Annual National Conference on Alternative and External Degree Programs for Adults. The Alliance & The American Council on Education, Columbus, Ohio.
• Ashbrook, R. M. (1995, May). Strategies for assisting adult learners. Paper presented at the Southwestern Ohio Council for Higher Education Second Annual Faculty Retreat, Wright State University, Dayton, OH
• Ashbrook, R. M. & McGary, D. (1994, October). Transforming experience into learning outcomes. Paper presented at the Fourteenth Annual National Conference on Alternative and External Degree Programs, sponsored by The Alliance and The American Council on Education, San Francisco, California.
• Ashbrook, R. M. (1994, June). Are adults really different? A comparison of adult and traditional students. Paper presented at the 1994 International Conference on The Adult Learner, University of South Carolina, Columbia, SC.
• Ashbrook, R. M. (1994, April). Experiential learning and the core curriculum. Paper presented at Archelog­ue II, Capital University, Columbus, OH.
• Ashbrook, R. M., Smith, G. L. & McGary, D. (1993, October) Adult learning and social change. Paper presented at the Thirteenth National Conference on Alternative and External Degree Programs for Adults, Breckenridg­e, CO.
• Gray, J. & Ashbrook, R. M. (1993, March). The public forum component in UC230. Paper presented at Archelog­ue I, Rational Study of the Curriculum, Capital University, Columbus, OH.
• Ashbrook, R. M. (1993, March). Experiential learning and the core. Paper presented at Archelogue I, Rational Study of the Curriculum, Capital University, Columbus, OH.
• Ashbrook, R. M., & Smith, G. L. (1992, October). Who are we really teaching? Paper presented at the Twelfth National Conference on Alternative and External Degree Programs for Adults, Evanston, IL.
• Schalinske, R. A. & Ashbrook, R. M. (1992, May). Managing information for multipur­pose assessment. Paper presented at Tenth Annual Conference on Non-traditional and Interdisci­plinary Programs, School of Continuing and Alternative Learning, George Mason University, Virginia Beach, VA.
• Ashbrook, R. M., Schalinske, R. A., Laposky, A. D. & Smith, G. L. (1991, May). The application of adult education models to traditional programs. Paper presented at Ninth Annual Conference on Non-traditional and Interdisci­plinary Programs, School of Continuing and Alternative Learning, George Mason University, Virginia Beach, VA.
• Ashbrook, R. M. (1990, May). Advantages of diversity in the assessment of experiential learning. Paper presented at Eighth Annual Conference on Non-traditional and Interdisciplin­ary Programs, School of Continuing and Alterna­tive Learning, George Mason University.
• Ashbrook, R. M. (1989, April). Personality and academic profi­ciency: The search for variables to explain student outcome. Paper presented at Tenth Annual Conference on General Education Learning Outcomes Assessment and the Impact on Curriculum Devel­opment, Cherry Hill, NJ.
• Ashbrook, R. M., & Stukenberg, K. W. (1985, October). Human factors and social engineer­ing: Lessons for educators from psychology. Paper presented at Microcomputers and the Learning Process Conference. Clarkson University Center for Liberal Studies, Potsdam, NY.
• Ashbrook, R. M. (1984, October). The psychological and social effects of microcomputers on education. Paper presented at Microcomputers and the Learning Process Conference. Clarkson University Center for Liberal Studies, Potsdam, NY.
• Bell, K. (January, 2013). So you want to go to graduate school: Preparing students for success. Participant Idea Exchange. National Institute on the Teaching of Psychology Annual Conference, St. Pete Beach, FL.
• Wilson, S.G. (January, 2013). Flipping a statistics class: Implementation and assessment of outcomes. National Institute on the Teaching of Psychology Annual Conference, St. Pete Beach, FL.
• Wilson, S.G. (January, 2013). Flipping a classroom: Challenges, successes, and limitations. Participant Idea Exchange. National Institute on the Teaching of Psychology Annual Conference, St. Pete Beach, FL.