Assessing Student Learning – Insight into Impact

This post is provided by guest blogger, Lynn Urban, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

Educators put time and energy into preparing lessons, but the work does not end once class is over.  It is essential to evaluate student learning, ensuring information provides intended impact.  Especially in the online learning environment, instructors cannot rely upon in-person interaction, and should explore the use of online assessment tools.  Content creator, Helen Colman (2024) provides methods to assess student learning, while sharing eLearning insights and teaching strategies.  “Online assessments are a critical part of eLearning and should be undertaken with the same level of care and rigor that you put into creating your other learning content.” (Colman, 2024). 

I recommend this article for instructors seeking the latest information about online assessment tools.  The article is organized and provides a fresh look at modern methods and software.  The author shows eLearning knowledge, but does not push readers away with heavy technical terms.  Images provide helpful descriptions pointing out the simplicity, usefulness, and outcome of various tools.  While the article references iSpring Suite as a vendor to provide online courses and assessments, the information is helpful whether pursuing the vendor or not.  There are many options, and readers will surely gain insight into the impact of assessments for online learning.

Reference

Colman, H. (2024, January 16). 9 Ways to Assess Student Learning Online. iSpring Solutions. https://www.ispringsolutions.com/blog/8-ways-to-assess-online-student-learning

Self-Regulated Learning in Online Education Using AI

This post is provided by guest blogger, Erica LoBurgio, graduate student University of St. Francis, MS Training and Development Program.

In this article Supporting students’ self-regulated learning in online learning using artificial intelligence applications, authored by Yannis Vovides, Sara Sanchez-Alonso, Vasiliki Mitropoulou, and Gwendoline Nickmans, published in 2023 in the International Journal of Educational Technology in Higher Education, studies how the use of artificial intelligence can improve students in self-regulated learning during their online education. The article explains how utilizing artificial intelligence’s adaptive learning patterns, emotional assistance to students, and personalized responses help as tools and techniques required for the student’s needs.

The article delivers the importance of utilization of artificial intelligence for learning environments. There is a study that explains combined teacher support and constructed feedback, and the importance of it for the student. Specifically, learning outcomes in the online environments which help to assist the students in management of their learning processes more effectively.

Vovides, Y., Sanchez-Alonso, S., Mitropoulou, V., & Nickmans, G. (2023). Supporting students’ self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education. Retrieved from https://educationaltechnologyjournal.springeropen.com/articles/10.1186/s41239-023-00314-9

Mystery and History of Instructional Design

This post is provided by guest blogger, Lynn Urban, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

Instructional Design (ID) in Higher Education often holds a mysterious existence for students and educators accustomed to traditional learning.  To uncover mystery, it’s helpful to look back and understand how ID became part of what we now know as “e-learning” teaching strategies.  Sharon O’Malley (2017) points to a time in military training where the practice emerged during World War II, “when the military assembled groups of psychologists and academics to create training and assessment materials for troops”. (O’Malley, 2017).  The author traces ID over decades, landing on the popularity of online courses and remote learning infiltration to higher education practices.  

I recommend this article for anyone interested in beginnings of instructional design, and the journey to gain acceptance in higher education. The article is from 2017, when there was still mystery surrounding the field. While written pre-pandemic (and much has developed since that time), the references to ID entering higher education are relevant.  Providing quotes and backgrounds of students and educators, readers can glimpse online technology being new and adaptation being slow.  Post-pandemic we see that ID has taken a larger space in education, but there is value to understanding history behind technology – to appreciate how far we have come.

Reference

O’Malley, S. (2017, August). Still a mystery. Inside Higher Ed.com. https://www.insidehighered.com/digital-learning/article/2017/08/02/what-do-instructional-designers-do

Who Cares? The Affective Domain & Training

This post is provided by guest blogger, Daniel Liestman, graduate student University of St. Francis, MS Training and Development program

How well do new resident physicians manage their money?  Apparently, not too well.  Hence the need for training.  Learners reported positive responses to the training.  Trainers incorporated Level 2 multiple choice and open-ended questions to gauge attitudes and behaviors toward the training.  In follow up they also self-reported new behaviors in setting financial goals and other manifestations of financial planning ranging from acquiring insurance to systematic retirement planning.  They also self-reported improved habits of increased savings and long-term financial planning.  Incorporation of training is considered an operational measure of the degree to which learners respond positively within the affective domain.

This study realizes the affective domain does not stand on its own and acknowledges cognitive and behavioral factors are essential to training success.  However, the further the study moves from Level 1, the less clear the impact of affective motivation.  Moreover, the authors narrowly define affective as positive feelings in response to the training. Fear of failing financially could easily be an affective response.   This study is unique in its assessment of affective motivation.  Yet, there is much more to consider in assessing  how learners respond to training.  How do the basic emotions impact learning, retention, and behavior.

Shappell, E., Ahn, J., Park, Y. S., McKillip, R., Ernst, M., Pirotte, M., & Tekian, M.  (2021, July). Affective, cognitive, and behavioral outcomes from a resident personal finance curriculum pilot project. AEM Education and Training5(3), p.e10619-n/a. https://www-ncbi-nlm-nih-gov.libdb.heritage.edu/pmc/articles/PMC8246005/pdf/AET2-5-e10619.pdf.

The Impact of Technology on Student Outcomes: A Comparative Analysis

This post is provided by guest blogger, Erica LoBurgio, graduate student University of St. Francis, MS Training and Development Program.

In this article “The impact of technology integration on student learning outcomes: A comparative study,” authored by Chia Ming Hong, Chee Keong Ch’ng, and The Raihana Nazirah Roslan, published in 2023 in the International Journal of Social Sciences, Educational, Economics, Agriculture Research, and Technology (IJSET), studies how the integration of technology changes the effects of student learning outcomes and educational practices. The article explains how different technology settings can enhance the students’ learning, student engagement, learning outcomes, and overall performance when successfully added into the course program.

The article delivers a comparative evaluation between students who are already provided with technological equipment and those who learn in conventional learning conditions without the technological equipment. Hong et al. (2023) provides a literature review, benefits of technology integration, methodology, as well as impact and outcomes. It is argued that with the ever-evolving world, students are required to be equipped with the technological tools to be successful.

Reference:

Hong, C. M., Ch’ng, C. K., & Roslan, T. R. N. (2023). The impact of technology integration on student learning outcomes: A comparative study. International Journal of Social Science, Educational, Economics, Agriculture Research, and Technology (IJSET), 2(9). https://www.researchgate.net/publication/373266726_The_Impact_of_Technology_Integration_on_Studen _Learning_Outcomes_A_Comparative_Study/fulltext/64e47c6040289f7a0faaf157/The-Impact-of Technology-Integration-on-Student-Learning-Outcomes-A-Comparative-Study.pdf

Starting Up Online Medical Education?

This post is provided by guest blogger, Tricia Padgurskis, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

Are medical schools using quality assurance guidelines to develop their online curriculum? If you were tasked to setup a new online medical education program, would you know how to start?

In the peer-reviewed, BMC Medical Education Journal, Wasfy et. al. (2021) felt there are gaps in the quality standards of online curriculum among medical schools.  They set out to create a list of criteria for best practice in online learning in medical education.  The criteria was based on the data collected from focus groups of novice and expert faculty in online higher medical education.  In this article, the authors list important guided questions to consider when developing online education, including: governance, administration, academic council, faculty and student online training needs, organizational capacity, resources, bylaws, course delivery, course design, learning assessment and human resource needs.  The list provides a nice overview of eLearning management considerations for most curriculum in higher education. However, future application of this tool still need to be studied.

If you need to take a closer look at your college’s online curriculum quality, I highly recommend reading this guide for evaluation of online learning in medical education. 

Reference:

Wasfy, N. F., Abouzeid, E., Nasser, A. A., Ahmed, S. A., Youssry, I., Hegazy, N. N., Shehata, M. H. K., Kamal, D., Atwa, H. (2021, June 10). A guide for evaluation of online learning in medical education: A qualitative reflective analysis. BMC Medical Education. BioMed Central. https://bmcmededuc.biomedcentral.com/articles/10.1186/s12909-021-02752-2

Assessing Micro-Learning in a Healthcare Education Environment

This post is provided by guest blogger, Theresa Anderson, graduate student University of St. Francis, MS Training and Development program.

This article on the healthcare education micro-learning environment measure (HEMLEM) is a research article aimed at creating an evidence-based measurement tool for assessing clinical micro-learning environments across several healthcare professional student groups. The authors suggest there may be gaps between what healthcare professional students should be learning and what they learn. The authors took a mixed methods approach to create a micro-learning environment measure. They acknowledge that teaching quality, staff attitudes, and behaviors are critical for a good micro-learning environment. 

The article is helpful for anyone attempting to measure how micro-learning within the education of a healthcare professional environment affects students’ learning. The authors created a measurement tool through a step-wise approach: literature analyzing existing tools, generating new items through thematic analysis of student experiences, the Delphi process involving healthcare educators, piloting the prototype, and item reduction. The item reduction tool was a twelve-question survey of the students with differing healthcare professions. HEMLEM seems to be an efficient way to measure success or what needs to be improved in a micro-learning environment. 

References

Isba, R., Rousseva, C., Wolf, K., & Byrne-Davis, L. (2020). Development of a brief learning environment measure for use in healthcare professions education: The healthcare education micro learning environment measure (HEMLEM). BMC Medical Education20(110). https://doi.org/10.1186/s12909-020-01996-8

Traditional Assessments Gone Virtual

This post is provided by guest blogger, Brianna Richardson, a graduate student at the University of St. Francis in Joliet, MS in the Training and Development program.

As technology continues to transform learning landscapes with e-learning, it is vital to stay aware of current technologies that can help educators track student understanding in online environments. In the article “7 Ways to Do Formative Assessments in Your Virtual Classroom” for Edutopia, Nora Fleming (2020) provides a thought-provoking take on how instructors can take familiar assessment strategies, that were once implemented in-person, and apply them in a digital space to verify how well students are learning. Fleming gives readers a number of creative ideas on how to add virtual value using digital platforms to deliver reflection and connection opportunities.

The article is a comprehensive overview of different online platforms that can help learners connect with their peers, complete learning objectives, and identify knowledge gaps. It is a great read for instructors, or trainers, that understand traditional assessment strategies and are looking for ways to apply them to an online learning environment. After reading, instructors will be aware of innovative solutions for assessing online learning outcomes. The article highlights platforms like Canva for online journal reflections, Padlet for live knowledge checks, or video conferencing platforms for peer-to-peer evaluation (Fleming, 2020). The strategies aren’t new, but the delivery method may be.

Reference

Fleming, N. (2020, October 1). 7 ways to do formative assessments in your virtual classroom. Edutopia. https://www.edutopia.org/article/7-ways-do-formative-assessments-your-virtual-classroom/

Wholistic e-Learning Through e-Portfolios

This post is provided by guest blogger, Sejdije Fejza, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

Researcher Patience Kelebogile Mudau identifies perceptions of e-portfolios as a form of assessment. E-portfolios are digital spaces for a user to compile projects that highlight qualities about themselves. This assessment enables users to be actively involved in their learning. Students can also engage in the process of reflecting on feedback before they submit activities to their e-portfolio. Despite the possible need for technical training, Professors at University of South Africa agree that e-portfolios are effective in promoting student-centered learning and growth in digital literacy. 

This article’s data were gathered qualitatively through interviewing lecturers that have participated in administering e-portfolios as a requirement for their online students. This firsthand account of information will assist other instructors who are weighing the benefits and limitations of digital student-centered assessments. This entry also serves as an asset because it is published in the International Journal of Educational Methodology which provides readers with pedagogical techniques that succeed around the world. In a world where digital workplaces are on a rapid rise, it is beneficial to consider different techniques, needs, and outlooks in our ever-growing communities. 

Reference: 

Mudau, P. K. (2021). Lecturers’ Views on the Functionality of e-Portfolio as Alternative Assessment in an Open Distance e-Learning. International Journal of Educational Methodology, 8(1), 81–90. https://doi.org/10.12973/ijem.8.1.81

Winning Strategies for Online Learning

This post is provided by guest blogger, Brianna Richardson, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

During the pandemic, more courses began being offered online than ever before. However, some educators have been using proven teaching methods for online learning for quite some time. For Edutopia, Michael Ralph (2020) provides an insightful summary of a study that interviewed a group of eight award-winning online instructors, with more than 100 years combined experience, to identify key strategies that can make an online course more engaging. Strategies like student created content, intentional learning reflection opportunities, and current multimedia sources were used by these seasoned online educators. The article provides actionable suggestions for creating engaging and relevant online courses.

I would recommend this article for educators, or trainers, that are still adapting to the world of online learning. Ralph uses real world examples to create a clear roadmap for how to design an award-winning online course. I have even seen some of the listed recommendations utilized in our graduate program. One specific example is the use of discussion posts as an opportunity to reflect on what has been learned. Every course I’ve taken in the program uses this reflection activity. The article highlights how the subjects of the study intentionally created these opportunities in the lesson plan (Ralph, 2020).

Reference

Ralph, M. (2020, April 17). Teaching strategies of award-winning online instructors. Edutopia. https://www.edutopia.org/article/teaching-strategies-award-winning-online-instructors/