Assessing Student Learning – Insight into Impact

This post is provided by guest blogger, Lynn Urban, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

Educators put time and energy into preparing lessons, but the work does not end once class is over.  It is essential to evaluate student learning, ensuring information provides intended impact.  Especially in the online learning environment, instructors cannot rely upon in-person interaction, and should explore the use of online assessment tools.  Content creator, Helen Colman (2024) provides methods to assess student learning, while sharing eLearning insights and teaching strategies.  “Online assessments are a critical part of eLearning and should be undertaken with the same level of care and rigor that you put into creating your other learning content.” (Colman, 2024). 

I recommend this article for instructors seeking the latest information about online assessment tools.  The article is organized and provides a fresh look at modern methods and software.  The author shows eLearning knowledge, but does not push readers away with heavy technical terms.  Images provide helpful descriptions pointing out the simplicity, usefulness, and outcome of various tools.  While the article references iSpring Suite as a vendor to provide online courses and assessments, the information is helpful whether pursuing the vendor or not.  There are many options, and readers will surely gain insight into the impact of assessments for online learning.

Reference

Colman, H. (2024, January 16). 9 Ways to Assess Student Learning Online. iSpring Solutions. https://www.ispringsolutions.com/blog/8-ways-to-assess-online-student-learning

Self-Regulated Learning in Online Education Using AI

This post is provided by guest blogger, Erica LoBurgio, graduate student University of St. Francis, MS Training and Development Program.

In this article Supporting students’ self-regulated learning in online learning using artificial intelligence applications, authored by Yannis Vovides, Sara Sanchez-Alonso, Vasiliki Mitropoulou, and Gwendoline Nickmans, published in 2023 in the International Journal of Educational Technology in Higher Education, studies how the use of artificial intelligence can improve students in self-regulated learning during their online education. The article explains how utilizing artificial intelligence’s adaptive learning patterns, emotional assistance to students, and personalized responses help as tools and techniques required for the student’s needs.

The article delivers the importance of utilization of artificial intelligence for learning environments. There is a study that explains combined teacher support and constructed feedback, and the importance of it for the student. Specifically, learning outcomes in the online environments which help to assist the students in management of their learning processes more effectively.

Vovides, Y., Sanchez-Alonso, S., Mitropoulou, V., & Nickmans, G. (2023). Supporting students’ self-regulated learning in online learning using artificial intelligence applications. International Journal of Educational Technology in Higher Education. Retrieved from https://educationaltechnologyjournal.springeropen.com/articles/10.1186/s41239-023-00314-9

Mystery and History of Instructional Design

This post is provided by guest blogger, Lynn Urban, graduate student at the University of St. Francis in Joliet, MS in Training and Development program.

Instructional Design (ID) in Higher Education often holds a mysterious existence for students and educators accustomed to traditional learning.  To uncover mystery, it’s helpful to look back and understand how ID became part of what we now know as “e-learning” teaching strategies.  Sharon O’Malley (2017) points to a time in military training where the practice emerged during World War II, “when the military assembled groups of psychologists and academics to create training and assessment materials for troops”. (O’Malley, 2017).  The author traces ID over decades, landing on the popularity of online courses and remote learning infiltration to higher education practices.  

I recommend this article for anyone interested in beginnings of instructional design, and the journey to gain acceptance in higher education. The article is from 2017, when there was still mystery surrounding the field. While written pre-pandemic (and much has developed since that time), the references to ID entering higher education are relevant.  Providing quotes and backgrounds of students and educators, readers can glimpse online technology being new and adaptation being slow.  Post-pandemic we see that ID has taken a larger space in education, but there is value to understanding history behind technology – to appreciate how far we have come.

Reference

O’Malley, S. (2017, August). Still a mystery. Inside Higher Ed.com. https://www.insidehighered.com/digital-learning/article/2017/08/02/what-do-instructional-designers-do

Who Cares? The Affective Domain & Training

This post is provided by guest blogger, Daniel Liestman, graduate student University of St. Francis, MS Training and Development program

How well do new resident physicians manage their money?  Apparently, not too well.  Hence the need for training.  Learners reported positive responses to the training.  Trainers incorporated Level 2 multiple choice and open-ended questions to gauge attitudes and behaviors toward the training.  In follow up they also self-reported new behaviors in setting financial goals and other manifestations of financial planning ranging from acquiring insurance to systematic retirement planning.  They also self-reported improved habits of increased savings and long-term financial planning.  Incorporation of training is considered an operational measure of the degree to which learners respond positively within the affective domain.

This study realizes the affective domain does not stand on its own and acknowledges cognitive and behavioral factors are essential to training success.  However, the further the study moves from Level 1, the less clear the impact of affective motivation.  Moreover, the authors narrowly define affective as positive feelings in response to the training. Fear of failing financially could easily be an affective response.   This study is unique in its assessment of affective motivation.  Yet, there is much more to consider in assessing  how learners respond to training.  How do the basic emotions impact learning, retention, and behavior.

Shappell, E., Ahn, J., Park, Y. S., McKillip, R., Ernst, M., Pirotte, M., & Tekian, M.  (2021, July). Affective, cognitive, and behavioral outcomes from a resident personal finance curriculum pilot project. AEM Education and Training5(3), p.e10619-n/a. https://www-ncbi-nlm-nih-gov.libdb.heritage.edu/pmc/articles/PMC8246005/pdf/AET2-5-e10619.pdf.

The Importance of Performance Assessment in E-Learning

This post is provided by guest blogger, Cody Stock, graduate student University of St. Francis, MS Training and Development program.

Performance-based assessments are a great way for learners to apply new knowledge in real-world situations. In a recent article, Christopher Pappas (2023), discusses why performance-based assessments are a great way for students to enhance their critical thinking skills and display their understanding of new concepts. The author provides examples of four different types of performance assessments: project-based, portfolio, simulation, and authentic assessments. Learners need to be assessed according to their learning style and needs in order to showcase their performance and level of understanding.

I recommend this article for anyone who works in instructional design and is looking to implement new performance-based assessments in the classroom. This article provides useful tools by providing examples of various performance assessments and defining why they are effective when aligned properly to the learning material and learners themselves. These assessment methods are briefly described and are a great starting point for anyone looking to improve their performance assessments.

Reference:

Pappas, C. (2023, June). What is performance based assessment? https://elearningindustry.com/what-is-performance-based-assessment  

The Impact of Technology on Student Outcomes: A Comparative Analysis

This post is provided by guest blogger, Erica LoBurgio, graduate student University of St. Francis, MS Training and Development Program.

In this article “The impact of technology integration on student learning outcomes: A comparative study,” authored by Chia Ming Hong, Chee Keong Ch’ng, and The Raihana Nazirah Roslan, published in 2023 in the International Journal of Social Sciences, Educational, Economics, Agriculture Research, and Technology (IJSET), studies how the integration of technology changes the effects of student learning outcomes and educational practices. The article explains how different technology settings can enhance the students’ learning, student engagement, learning outcomes, and overall performance when successfully added into the course program.

The article delivers a comparative evaluation between students who are already provided with technological equipment and those who learn in conventional learning conditions without the technological equipment. Hong et al. (2023) provides a literature review, benefits of technology integration, methodology, as well as impact and outcomes. It is argued that with the ever-evolving world, students are required to be equipped with the technological tools to be successful.

Reference:

Hong, C. M., Ch’ng, C. K., & Roslan, T. R. N. (2023). The impact of technology integration on student learning outcomes: A comparative study. International Journal of Social Science, Educational, Economics, Agriculture Research, and Technology (IJSET), 2(9). https://www.researchgate.net/publication/373266726_The_Impact_of_Technology_Integration_on_Studen _Learning_Outcomes_A_Comparative_Study/fulltext/64e47c6040289f7a0faaf157/The-Impact-of Technology-Integration-on-Student-Learning-Outcomes-A-Comparative-Study.pdf

Regardless of Distance, Learning Prevails

E-learning existed prior to the coronavirus pandemic in 2020 but did not have as large a footprint in institutions as today.  Distance learning, hybrid learning, blended learning – all these methods gained momentum when educational systems had to stay connected without being physically together.  The pandemic stalled traditional methods of learning, but the need to move forward compelled technological advancements.  John Hamilton (2024) shines light on how development of distance learning has become a strong part of educational opportunities.  Resources are named and organized by platforms, learning management systems, online videos and textbooks.  The author provides ideas for use of accessories, artificial intelligence, extended reality, and gamification in teaching and learning. 

I recommend this article for anyone needing familiarity with e-learning technology, especially as it has grown over the years.  Leaning towards a novice view, the article provides easy-to-follow explanations of multiple developments.  The author also recognizes challenges – for example, describing solutions that help students limit distractions while engaged in online learning (like noise-cancellation headphones).  Providing resources, challenges and solutions, readers get a balanced view of opportunities present in distance learning.  Current e-learning technologies can be overwhelming for some, but fortunately articles such as this provide an organized view of how we can all be part of the digital age.

Reference

Hamilton, J. (2024, February). Technologies used in distance learning. Study.com. https://study.com/academy/popular/technologies-used-in-distance-learning.html

The online learning experience and students’ satisfaction

This post is provided by guest blogger, Arshpreet K Thind, graduate student University of St. Francis, MS Training and Development Program.

This study explores the impact of the sudden shift to online learning during COVID-19 on undergraduate students.  Researchers conducted surveys before and after a few semesters of online learning, with over 1300 participants total. Findings showed dissatisfaction among a third of students, who reported struggles with technology, mental health, time management, and balancing studies with life.  Further investigation using focus groups revealed key factors behind dissatisfaction: distractions, reduced focus, psychological strain, and management issues. The study proposes solutions to improve the online learning experience and student satisfaction. This study provides valuable insights with a relatively large sample size (1300+) across two surveys. However, the focus on student perspectives soon after the initial shift to online learning (first survey) may not capture long-term adjustments. Additionally, solutions are proposed but their effectiveness isn’t evaluated.

Despite these limitations, the research offers a good starting point for understanding student struggles during the pandemic shift to online learning.  Educators and administrators developing online programs, particularly those in undergraduate settings, would find this information useful.

Reference:

Maqableh, M., & Alia, M. (2021). Evaluation online learning of undergraduate students under lockdown amidst COVID-19 Pandemic: The online learning experience and students’ satisfaction. Children and Youth Services Review, 128, 106160. https://doi.org/10.1016/j.childyouth.2021.106160

A Comparative Study of the ADDIE Instructional Design Model in Distance Education

This post is provided by guest blogger, Arshpreet K Thind, graduate student University of St. Francis, MS Training and Development Program.

A study investigated the usefulness of the ADDIE instructional design model in online education. Researchers analyzed 58 articles on applying ADDIE in distance learning environments. Their findings showed the ADDIE model to be effective across various online educational settings, with a preference for asynchronous learning (without real-time interaction). The study also identified successful teaching practices within the ADDIE framework, such as using multimedia presentations, providing feedback, and encouraging interaction among learners. Overall, this research suggests that the ADDIE model remains a valuable tool for designing impactful online courses, particularly asynchronous ones.

This study’s reliance on a meta-analysis (analysis of existing research) offers a broad perspective, but the quality of the 58 articles included is unclear. While the ADDIE model’s effectiveness is supported, the focus on asynchronous learning might limit its generalizability.

Despite these limitations, the resource is valuable for educators considering the ADDIE model for online courses, especially asynchronous ones.  Instructors and instructional designers interested in incorporating multimedia, feedback, and interaction would also find this information useful.

Reference:

Spatioti, A. G., Kazanidis, I., & Pange, J. (2022). A comparative study of the ADDIE Instructional Design Model in distance education. Information, 13(9), 402. https://doi.org/10.3390/info13090402

Technology of deep brain stimulation: current status and future directions

This post is provided by guest blogger, Arshpreet K Thind, graduate student University of St. Francis, MS Training and Development Program.

In this article, the author talks about the deep brain stimulation. Deep brain stimulation (DBS) is a surgical procedure that uses implanted electrodes to deliver electrical signals to specific parts of the brain. It’s a common treatment for movement disorders like Parkinson’s disease and tremor. The technology behind DBS has been around for a while, but recent advances are making it more effective and adaptable. For example, new electrodes can target specific areas of the brain more precisely, and closed-loop systems can adjust stimulation automatically based on brain activity. These advancements are expected to improve the benefits of DBS for patients while reducing side effects. Additionally, future DBS systems might be wirelessly controlled by doctors, but this raises security concerns that need to be addressed.

A more critical analysis would acknowledge the inherent risks of brain surgery and potential side effects of stimulation. This review article, offers a credible source for understanding DBS technology’s evolution. While valuable for healthcare professionals and researchers due to its in-depth exploration of technical advancements, it lacks mention of risks, limitations, and broader ethical concerns. Patients seeking general DBS information might benefit more from a source discussing these aspects alongside the positive developments.

Reference:

Krauss, J. K., Lipsman, N., Aziz, T., Boutet, A., Brown, P., Chang, J. W., Davidson, B., Grill, W. M., Hariz, M. I., Horn, A., Schulder, M., Mammis, A., Tass, P. A., Volkmann, J., & Lozano, A. M. (2020). Technology of deep brain stimulation: current status and future directions. Nature Reviews. Neurology17(2), 75–87. https://doi.org/10.1038/s41582-020-00426-z