Sunday, July 3, 2016

Hospital Education - We're Doing it Wrong

For a long time, hospital educators have whispered about our frustrations. We've known that engagement & retention of knowledge are lacking in our industry. We're working diligently, but our results are inconsistent & mediocre. 
"Nobody told me about that policy" 
"We need education on..." 
These are frequent comments we hear within months of deploying education. 

Hospitals are spending billions of healthcare dollars on staff education, but it doesn't seem to stick. 
Wait, billions?
A hospital nurse spends approximately 3.5% of worked hours participating in educational activities (Suby, 2009). Inservice and mandatory education, for hospital based nurses alone, is responsible for approximately $3.3 billion dollars of healthcare spending each year (Peckman, 2015 & Nursing Fact Sheet 2011).

And, hospital nurses are only between 58-61% of the nurse workforce (Nursing Fact Sheet 2011). Healthcare workers, in general, represent 12% of U.S. employment (Bureau of Labor Statistics, 2015). 

With healthcare costs out of control, we have a responsibility to assure education dollars are spent on effective processes and tools that improve staff knowledge, skills, and abilities (KSA’s) and improve patient outcomes. 



But it isn't really that bad, is it? 

Let's look at one study on fire safety in the operating room setting: 
The study examined pre and post training test results of experienced healthcare providers for fire safety in the operating room, and found that mean pretest scores were 66% (Fisher 2015). Post training test scores of 92.8% (Fisher 2015). Sounds great, huh? Success! 

Well, maybe not. Let's look at the data through the lens of annual training. These were experienced staff. Fire safety training is a required, annual event. If, after years of training, the experienced staff had pre-test scores of only 66%, we know they are not retaining the KSA's taught.

We are doing something wrong.
For billions of dollars each year, we can do better than 66% KSA retention. 
Think about it, is this an isolated example? 

Modifying Our Approach:
Once upon a time, we educated staff by handing out Self-Learning Packets and tests. That day has passed. 

Now, we assign computer-based training (CBT) through learning management systems (LMS), quickly & efficiently distributing learning modules. We can easily track completions and provide reports to hospital leadership and accrediting bodies. We can show passing grades to surveyors & demonstrate that a high percentage of staff have completed the required training.
That sounds great, but we know the numbers we report don’t translate to knowledge & competence. We know that staff often click-through the educational slides without reading or engaging with them. Click-through is especially prevalent during annual education due to the repetitive nature of required material.  In addition, these simplified learning modules rarely support critical thinking and clinical reasoning skill development. 

What’s missing?
What has been missing in hospital based education is systematic instructional design (ID). As experts in our fields, we fall prey to the common assumption of “If I teach it they will learn it.” We put our knowledge in a shiny package & then are disappointed if staff do not learn. 

We're missing the basics of ID, which, surprisingly, are similar to the Nursing Process:

http://denvercoloradotraining.com


While the process is similar to the nursing process, it doesn't seem to be used frequently in hospital education. Unfortunately, we often skip the Analyze, Design and Evaluate steps, and are prone to jump directly into Development & Implementation.

Analysis helps us to realize the true gaps in KSA’s. 

A quick analysis of hospital training, reveals that engagement is an issue. We spend a lot of time & resources on education that is disengaging, rather than engaging. We provide repetitive information, often in click-through formats, like PowerPoint embedded into our LMS.

“Oh look, another PowerPoint.”  Click….click….click…open test…guess at answers.
Death By PowerPoint

Without learner engagement we miss the mark on retention of KSA's.

Good education design is based on adequate analysis of organizational needs, learners' needs, and available resources. Without an analysis, we cannot adequately design training. Once designed, developed & implemented, we must return to evaluate the effectiveness of our training, making adjustments as needed. These are best practices in education. 

If engagement is the issue, how can we fix it? 

Returning to our Fire in the OR education situation, a modification to the education from standard CBT click-through to interactive modalities is a relatively quick & easy solution to increase engagement. Software, such as Adobe Captivate, can be used to create hard stop quizzes and choices within the education module. A well designed, interactive lesson brings some increase in engagement, but we can improve from there. 

Can Simulation Improve Retention? 

Looking to other industries, we can see the trends towards immersive training and serious games. These engaging modalities have shown to be superior for retention of key KSA’s (Chittaro & Buttussi 2015).

It is time to embrace the emerging technologies of virtual reality (VR) for improved engagement and retention. VR can be either 2D or 3D, animated or video-based. These exciting and immersive technologies are being used in military training, and other industries. The applications for our industry are boundless & exciting

At present, immersive technology comes with a hefty price tag that can feel out of reach. In the current climate of healthcare costs, we are all aware of the need to be good stewards of the resources we have. If each hospital, independently, attempts to convert to immersive technology, the price and labor costs involved would soar. Realistically, investing in immersive technology for staff education at the hospital level may not be wise.

How can we accomplish this leap to our future? 

We need to look at ways to collaborate & cooperate, capitalizing on each other's work and resources. Working together to create amazing, immersive education through well designed simulation that is easily modified from one set of KSA’s to another is a lofty goal. Cooperation and collaboration are often foreign concepts in the competitive world of hospital business, but our patients and our staff deserve our best efforts.

Can we do it? Are we ready to bring our profession into the immersive education age? I hope so! 

References & Rabbit Holes: 
Carlson J., Rice S., (2014) Safety advocates push to curb hospital surgical fires. Modern Healthcare. Accessed 6/21/2016 athttp://www.modernhealthcare.com/article/20140712/MAGAZINE/307129987 (Links to an external site.) (Links to an external site.)

Chittaro, L., & Buttussi, F. (2015). Assessing Knowledge Retention of an Immersive Serious Game vs. a Traditional Education Method in Aviation Safety. IEEE Transactions On Visualization And Computer Graphics, 21(4), 529-538. doi:10.1109/TVCG.2015.2391853 

Employment Projections: 2014-2024 Summary. (2015) United States Department of Labor Bureau of Labor Statistics. Accessed July 3, 2014 at http://www.bls.gov/news.release/ecopro.nr0.htm

Fisher, M. (2015). Prevention of Surgical Fires: A Certification Course for Healthcare Providers. AANA Journal, August 2015, Vol. 83, No. 4, pp 271-274. Accessed 6/22/2016 at http://www.aana.com/newsandjournal/20102019/prevention-fires-0815-pp271-274.pdf (Links to an external site.) 

Mehta, S., Bhananker, S., Posner, K. Domino, K., (2013) Operating Room Fires A closed Claims Analysis. Anesthesiology, V118, No5. p1113-1139. Accessed 6/11/2016 at http://monitor.pubs.asahq.org/data/Journals/JASA/930994/20130500.0-00024.pdf?resultClick=1 (Links to an external site.) 

Nursing Fact Sheet. (2011). American Association of Colleges of Nursing. Accessed July 2, 2016 at http://www.aacn.nche.edu/media-relations/fact-sheets/nursing-fact-sheet

Peckham, C. (2015) Medscape Nurse Salary Report 2015. Medscape.  Accessed July 2, 2016 at http://www.medscape.com/features/slideshow/public/nurse-salary-report-2015#page=2


Suby, C. (2009). Indirect Care: The Measure of How We Support Our Staff. Creative Nursing15(2), 98-103.



6 comments:

  1. You're really on to something. After 23+ years of paper tests and web-based training, I would love to see a new interactive format. I know we could all engage and retain better through interaction and it could increase our empathy for the patient as well. Allows for greater combined senses engaged while learning.

    ReplyDelete
  2. Kim,

    Very engaging post, especially because I can relate to the click-through LMS modules that are used for on the job training and I do agree that hospital training needs to be more immersive. And yes, we’re ready! The stats on how poor retention is after years of training is fascinating. This definitely shows that something is missing when it comes to hospital education. Here is where your proposal of integrating VR comes in.
    In your example with fire, I feel that VR ,as a Modeling & Simulation technique, can be the perfect method to simulate this type of environment. I recently read an article about a mobile trailer that was used to train kids about fire safety using VR technology (Aspinall, 2016).
    Have you looked into VR tools such as Heads Up Displays (HUD’s) to deliver such training?

    Aspinall, Lyle (2016, May 25). Video: Kids get VR fire-safety training in new mobile trailer. Calgary Herald. Retrieved from http://calgaryherald.com/news/local-news/video-kids-get-vr-fire-safety-training-in-new-mobile-trailer

    ReplyDelete
  3. Kim,

    Very engaging post, especially because I can relate to the click-through LMS modules that are used for on the job training and I do agree that hospital training needs to be more immersive. And yes, we’re ready! The stats on how poor retention is after years of training is fascinating. This definitely shows that something is missing when it comes to hospital education. Here is where your proposal of integrating VR comes in.
    In your example with fire, I feel that VR ,as a Modeling & Simulation technique, can be the perfect method to simulate this type of environment. I recently read an article about a mobile trailer that was used to train kids about fire safety using VR technology (Aspinall, 2016).
    Have you looked into VR tools such as Heads Up Displays (HUD’s) to deliver such training?

    Aspinall, Lyle (2016, May 25). Video: Kids get VR fire-safety training in new mobile trailer. Calgary Herald. Retrieved from http://calgaryherald.com/news/local-news/video-kids-get-vr-fire-safety-training-in-new-mobile-trailer

    ReplyDelete
  4. Sashay- Thank you for that link! In excited to delve more into this area. I haven't looked into HUD's yet.

    ReplyDelete
  5. Kimberly,

    You are right! Simulation-based team training can improve clinical performance. I was reading this article in relation to your topic and based on their study, teamwork ratings using previously validated behaviorally anchored rating scales (BARS) were completed. They found that there was a trend towards improvement in the quality of team behavior (Shapiro, 2004). Having a more experiential learning approach is way more effective, I feel, than just presenting information using PowerPoint.

    Thanks for your wonderful post!

    Reference:
    Shapiro, M. J., Morey, J. C., Small, S. D., Langford, V., Kaylor, C. J. ... Jay, G. D. (2004). Simulation based teamwork training for emergency department staff: Does it improve clinical team performance when added to an existing didactic teamwork curriculum. Quality Safety Health Care, 13, 417-421. doi:10.1136/qshc.2003.005447

    ReplyDelete