Assessment & Evaluation

Assessing Student Learning – Insight into Impact

Posted by

0

This post is provided by guest blogger, Lynn Urban, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

Educators put time and energy into preparing lessons, but the work does not end once class is over.  It is essential to evaluate student learning, ensuring information provides intended impact.  Especially in the online learning environment, instructors cannot rely upon in-person interaction, and should explore the use of online assessment tools.  Content creator, Helen Colman (2024) provides methods to assess student learning, while sharing eLearning insights and teaching strategies.  “Online assessments are a critical part of eLearning and should be undertaken with the same level of care and rigor that you put into creating your other learning content.” (Colman, 2024). 

I recommend this article for instructors seeking the latest information about online assessment tools.  The article is organized and provides a fresh look at modern methods and software.  The author shows eLearning knowledge, but does not push readers away with heavy technical terms.  Images provide helpful descriptions pointing out the simplicity, usefulness, and outcome of various tools.  While the article references iSpring Suite as a vendor to provide online courses and assessments, the information is helpful whether pursuing the vendor or not.  There are many options, and readers will surely gain insight into the impact of assessments for online learning.

Reference

Colman, H. (2024, January 16). 9 Ways to Assess Student Learning Online. iSpring Solutions. https://www.ispringsolutions.com/blog/8-ways-to-assess-online-student-learning

Interactive Learning Tools That Won’t Break Your Budget

Posted by

0

This post is provided by guest blogger, Brianna Richardson, graduate student University of St. Francis, MS Training and Development program.

The most effective eLearning courses utilize interactive components to drive engagement. However, training budgets may not always allow for the purchase of new technology. “15 Free Interactive eLearning Tools” by Hannah Malmstrom (2022) provides a list of interactive tools that won’t break the budget for trial and pilot adoption. The author provides a comprehensive review of a variety of platforms that can be used to increase engagement in online courses. Each review includes criteria such as highlights, best use, and cost. The tools named offer features that are in alignment with current eLearning trends like microlearning, social learning, and collaboration.


I recommend this article for instructors that are researching different learning management systems to help boost engagement in their online courses. The list of 15 free tools features a variety of platforms that creates a comparison view and allows the reader to identify those to research further. The solutions offer ways for learners to interact using quizzes, games, and progress reporting. Malmstrom (2022) goes the extra mile and even highlights who the best audience is for some of the tools. This allows the person researching to focus their attention on the features and audience that would best suit their need.

Reference

Malstrom, H. (2022, January 10). 15 free interactive eLearning tools. EdApp Microlearning. https://www.edapp.com/blog/10-interactive-elearning-tools/

Starting Up Online Medical Education?

Posted by

0

This post is provided by guest blogger, Tricia Padgurskis, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

Are medical schools using quality assurance guidelines to develop their online curriculum? If you were tasked to setup a new online medical education program, would you know how to start?

In the peer-reviewed, BMC Medical Education Journal, Wasfy et. al. (2021) felt there are gaps in the quality standards of online curriculum among medical schools.  They set out to create a list of criteria for best practice in online learning in medical education.  The criteria was based on the data collected from focus groups of novice and expert faculty in online higher medical education.  In this article, the authors list important guided questions to consider when developing online education, including: governance, administration, academic council, faculty and student online training needs, organizational capacity, resources, bylaws, course delivery, course design, learning assessment and human resource needs.  The list provides a nice overview of eLearning management considerations for most curriculum in higher education. However, future application of this tool still need to be studied.

If you need to take a closer look at your college’s online curriculum quality, I highly recommend reading this guide for evaluation of online learning in medical education. 

Reference:

Wasfy, N. F., Abouzeid, E., Nasser, A. A., Ahmed, S. A., Youssry, I., Hegazy, N. N., Shehata, M. H. K., Kamal, D., Atwa, H. (2021, June 10). A guide for evaluation of online learning in medical education: A qualitative reflective analysis. BMC Medical Education. BioMed Central. https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-021-02752-2

(L)earning (M)ade (S)upportive Through LMS Data 

Posted by

0

This post is provided by guest blogger, Sejdije Fejza, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

In this article, researchers from the University of Queensland in Australia analyzed whether LMS data is useful in understanding learners and their needs. Video based learning management systems were assessed by monitoring how many times a student clicked on a video and the amount of time that video played. Exam results were also reviewed to determine whether LMS data can assist student learning. First, it revealed students’ preferences for learning. Additionally, students can reference back information or work on their own time. They also revealed that shorter videos and content receive the best results when instructing through this LMS. 

This source is helpful for organizations who are deciding what factors to assess in their LMS to support student learning. If individuals adopt this form of analysis to support learning, it is important that they carefully choose the best LMS features to assess. This will avoid limitations in data. For instance, it’s important to consider how engaged students are when watching a video. Therefore, the number of times clicked on a video may not necessarily correlate to whether the viewer is actively paying attention to the video to assist in their learning. 

Reference 

Maloney, S., Axelsen, M., Galligan, L., Turner, J., Redmond, P., Brown, A., Basson, M., & Lawrence, J. (2022). Using LMS log data to explore student engagement with coursework videos. Online Learning, 26(4), 399–423.

Choice and Performance Relationship, Not Always Friendly

Posted by

0

This post is provided by guest blogger, E Ivy, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

A university faculty member studied the correlation between course registration timeliness & availability of choice in selecting courses, and achieving course completion with higher grades. When early registrants could choose an in-person or online course – and selected online – they completed the course and earned higher grades than their peers who registered late, with only the online option. One of the biggest performance gaps were with drop, fail and withdrawal students. The study concludes, if another face-to-face class was available, some students might have preferred and chosen it, and performed better. The study did not review specific student characteristics. 

I recommend postsecondary educators review this study as they may be interested in its literature review, hypotheses, and data analysis. I find this study conducted by a Judd Leighton School of Business and Economics faculty member to be credible. This study is helpful because it affirms that students have different learning preferences and compatibility with class modality. While some students have adapted to, and even prefer online education, in-person classes may best suit other learners. The findings highlight the importance of choice availability, as students may opt for e-learning courses only when the alternative is no class at all.

Pathak, B. K. (2019). Study of e-learning outcomes: The role of late-registration and self-selection. The e – Journal of Business Education & Scholarship of Teaching, 13(1), 13-19. Retrieved from EJ1239138.pdf (ed.gov)

Assessing Micro-Learning in a Healthcare Education Environment

Posted by

0

This post is provided by guest blogger, Theresa Anderson, graduate student University of St. Francis, MS Training and Development program.

This article on the healthcare education micro-learning environment measure (HEMLEM) is a research article aimed at creating an evidence-based measurement tool for assessing clinical micro-learning environments across several healthcare professional student groups. The authors suggest there may be gaps between what healthcare professional students should be learning and what they learn. The authors took a mixed methods approach to create a micro-learning environment measure. They acknowledge that teaching quality, staff attitudes, and behaviors are critical for a good micro-learning environment. 

The article is helpful for anyone attempting to measure how micro-learning within the education of a healthcare professional environment affects students’ learning. The authors created a measurement tool through a step-wise approach: literature analyzing existing tools, generating new items through thematic analysis of student experiences, the Delphi process involving healthcare educators, piloting the prototype, and item reduction. The item reduction tool was a twelve-question survey of the students with differing healthcare professions. HEMLEM seems to be an efficient way to measure success or what needs to be improved in a micro-learning environment. 

References

Isba, R., Rousseva, C., Wolf, K., & Byrne-Davis, L. (2020). Development of a brief learning environment measure for use in healthcare professions education: The healthcare education micro learning environment measure (HEMLEM). BMC Medical Education, 20(110). https://doi.org/10.1186/s12909-020-01996-8

Fe Δ  — aka The Iron Triangle

Posted by

0

This post is for your reading pleasure from guest blogger, Daniel Liestman a graduate student in the MS Training and Development program, University of St. Francis (Joliet, IL).

Open distance learning (ODL) universities in South Africa established clusters of facilities and activities known as study centers to improve learning.  One university considered the three variables of the Iron Triangle; access, cost, and quality in evaluating the initiative. The research focused on counting occupancy, questionnaire responses, and cost effectiveness. Students utilizing the new centers responded positively, however most students did not take advantage of the new opportunity. There was a cadre of regular users at the expense of the student body as a whole. The questionnaire queried about cleanliness and staff knowledge/ friendliness. The high occupancy demonstrated cost effectiveness.

The Iron Triangle is not necessarily an equilateral triangle. Circumstances may dictate extending one side at the expense of another. In this study, cost effectiveness was the short side of an Isosceles by being less rigorous and relying so heavily on the occupancy side. This study is less a triangle and more like parallel lines.  A more rigorous cost-effectiveness approach is needed. Perhaps comparing the center’s funding fee with the overall number of students utilizing the new service. Also, the only constituency considered were students. Staff, faculty, IT, business office, campus administrators’ input should also be included and considered. 

Nsamba, A., Bopaper, A., Bongi., L., & Lekay, L. (2021). Student support service excellence evaluation: Balancing the iron triangle of accessibility, cost-effectiveness and quality? Open Praxis, 13(1), 37–52. https://doi.org/10.5944/openpraxis.13.1.1168

Exploring Continuous Assessments

Posted by

0

This post is provided by guest blogger, Breanna Winters, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

This article provides insight into the transition from traditional assessment methods in higher education to continuous assessments with a focus on integrating multiple choice assessments multiple times throughout a semester. Additionally, there are four studies reviewed in the article that question continuous assessment and alternative learner needs. The results of these studies support that having continuous assessments can help recognize when learners are becoming disengaged or experiencing a major life event. The results also confirm that the use of continuous assessments does not create a significant negative learning struggle for those with alternative learning needs (Playfoot et al., 2022).

This article can be useful for anyone whether in higher education, the corporate world, or the non-profit sector. It explores continuous assessments and brings to light the importance of considering if your learners have alternative learning needs and how assessments can impact the learner and feedback provided.

Reference

Playfoot, D., Wilkinson, L. L., & Mead, J. (2022). Is continuous assessment inclusive? An analysis of factors influencing student grades. Assessment & Evaluation in Higher Education, 1–13. https://doi.org/10.1080/02602938.2022.2150834

E-learning Assessments Guide for Beginners

Posted by

0

This post is provided by guest blogger, Theresa Anderson, graduate student University of St. Francis, MS Training and Development program.

Wondering how to determine if your e-learning course is effective? Assessments, such as tests and quizzes, can provide valuable data. However, if you’re new to e-learning, you may be unsure of what constitutes a good assessment and what metrics are essential to measure. In this article, Bianca Woods (2022) addresses the most commonly asked questions about creating a practical e-learning quiz. Woods explains what e-learning assessments are, if assessments are always necessary, when learners should be assessed, what types of questions to include, and how to design effective assessment questions. 

If you’re new to online training and want to evaluate whether your course is well-designed, I highly recommend checking out this article. Woods (2022) recommends incorporating assessments at multiple points throughout the course if it aligns with the instructor’s goals. This article offers tips for beginners, and I plan to implement them in my work.

References

Woods, B. (2022). The beginner’s guide to effective e-learning assessments. E-Learning Heroes. Retrieved June 8, 2023, from https://community.articulate.com/articles/overview-of-e-learning-assessments

Traditional Assessments Gone Virtual

Posted by

0

This post is provided by guest blogger, Brianna Richardson, a graduate student at the University of St. Francis in Joliet, MS in the Training and Development program.

As technology continues to transform learning landscapes with e-learning, it is vital to stay aware of current technologies that can help educators track student understanding in online environments. In the article “7 Ways to Do Formative Assessments in Your Virtual Classroom” for Edutopia, Nora Fleming (2020) provides a thought-provoking take on how instructors can take familiar assessment strategies, that were once implemented in-person, and apply them in a digital space to verify how well students are learning. Fleming gives readers a number of creative ideas on how to add virtual value using digital platforms to deliver reflection and connection opportunities.

The article is a comprehensive overview of different online platforms that can help learners connect with their peers, complete learning objectives, and identify knowledge gaps. It is a great read for instructors, or trainers, that understand traditional assessment strategies and are looking for ways to apply them to an online learning environment. After reading, instructors will be aware of innovative solutions for assessing online learning outcomes. The article highlights platforms like Canva for online journal reflections, Padlet for live knowledge checks, or video conferencing platforms for peer-to-peer evaluation (Fleming, 2020). The strategies aren’t new, but the delivery method may be.

Reference

Fleming, N. (2020, October 1). 7 ways to do formative assessments in your virtual classroom. Edutopia. https://www.edutopia.org/article/7-ways-do-formative-assessments-your-virtual-classroom/