Today on Insights. We go back to a conversation Host Bill Russell had with Taylor Davis, Research Manager at KLAS Research. The topic of discussion was A Look Back at the Arch Collaborative's Early Surveys of EHR Optimization. Epic understands that change management is critical. KLAS asks two different health systems about their experience using Epic. The survey results were polar opposite. What was the reason for this and how can this information be used to improve the clinician’s EHR experience?
This transcription is provided by artificial intelligence. We believe in technology but understand that even the smartest robots can sometimes get speech recognition wrong.
Hello and welcome to another episode of Insights. My name is Bill Russell. I'm a former CIO for a 16 hospital system and creator of This Weekin Health IT. A channel dedicated to keeping health IT staff current and engaged. Our hope is that these episodes serve as a resource for the advancement of your career and the continued success of your team. Now onto the show.
Today on Insights. We go back to our conversation host Bill Russell had with Taylor Davis Research Manager at KLAS. The topic of discussion was a look back at the Arch Collaborative's early surveys of EHR optimization.
Epic understands that change management is critical. KLAS asks two different health systems about their experience using Epic. The survey results were polar opposite. What was the reason for this? And how can this information be used to improve the clinicians EHR experience?
It seems like you guys have done the research that we've all been waiting for and really wanted, which is what leads to success and potentially what doesn't lead to success that we're spending an awful lot of time on. So let's start with the basic question. What is the Arch Collaborative and why does it exist?years. I joined KLAS in:
Right. So I've done thousands of interviews with healthcare leaders, with CMOs and CMIOs and and CEOs. And it's common that we get on the phone with them and we say, Hey, how are things going for you? And they say, well, we still are really struggling. A lot of people are really disliking our EHR. And we've hear that about every EHR.ars ago, it was late November:
We emailed out to 10 of our friends and said, Hey, what if we all, sorry, a couple months before that we had done a, a quick poll and announced about a hundred organizations, hey, do you measure the feedback of your end users about your EHR? And only 7% had done that. And most of those percentage points for organizations that have recently come live on Epic, and Epic requires you to do a post go live survey.
So there was only like 3% of organizations that were doing this themselves out of their own choice. Right. And that's the, almost nobody was doing this. And at the same time, we're spending millions of millions of dollars on optimizations and a bunch of work. And so we said to 10 organizations, what if you all send out the same EHR satisfaction survey to all of your users? Five of those organizations said, yeah.
And they took us up on it and we collected the feedback from those five organizations. And as it came back in, the feedback was so interesting. So we had two organizations that were using the same EHR. They were both using Epic. And the feedback was night and day difference. One was incredibly satisfied with it.
And one had their, their physicians just screaming angry about their experience. And it was at that point that we said, okay, there's something really interesting here. Two organizations using the same software, very different experiences. And It started out as a benchmarking effort two years ago, where we helped organizations kind of benchmark against each other. Today it's a collaborative and we're working, I'd say with, with some of the premier organizations, provider organizations, not just in the country, but in the world. And this survey that has been developed and continues to evolve has now been deployed at 154 organizations and seven countries around the world.
And and we're really starting to learn the science of what drives success. And then what's almost more exciting than anything else is, is that we've got 62, actually 63 this morning ongoing members who have committed to measuring every year and or 18 months, their experience. And we've now got six organizations that have remeasured their experiences.
And five of those six organizations saw improvements in their satisfaction. And two of them saw huge improvements in their satisfaction. So as we do this, we're starting to really learn what drives success.
Yeah. One of the things you talked about in the presentation was this whole idea of a playbook. So one of the reasons that I think Epic has done potentially better than some other EMRs or EHR implementations out there is they have a very defined playbook.
You will, you do these things on these things, but one of the things you've talked about is just having the right playbook doesn't necessarily lead to overall success. In fact, you talked about a bunch of things that didn't necessarily correlate that were potentially myths that we had grown to believe over the years.
Yeah. That's the problem with doing things but not measuring, is that you start kind of getting into ruts and you get those ruts deeper and deeper and you start thinking, Hey, this makes all the difference. So let me give you an example of one of those ruts is there's just an assumption that if we put at the elbow trainers with people, it's going to make a big difference for them.
Or if we give them voice recognition, it's going to make a big difference. And what we've learned is is that you could actually dig yourself deeper into a hole by doing that. If you don't have a great trainer that goes into cages with those clinicians, so if you're not measuring and if you deploy voice recognition in the wrong way or even scribes in the wrong way, it's going to end up taking you to the exact opposite directions.
So you're going to put a bunch of time, energy and money into making your EHR work better or your experience better. And it's going to be, it's going to be worse. On the Epic side, I think that this, this describes there's been a number of folks over the years who have described Judy Faulkner and her approach and, and that team's approach to the EHR is sometimes people would use a term. I've heard people use the term benevolently manipulative. So, they're, they're kind of pushing us in ways to help us be successful with ourselves. And I'd give that a different term. Change management. Epic understands in a lot of cases that that change management is critical.
And how do you incentivize human beings to make changes. And and there's a whole science behind this but Epic has done a lot of that. At the same time as we start to measure, we didn't have measurements for ethical organizations very much either and we're starting to really learn that there are some things that make a huge difference. There's some things that don't make a huge difference. So it has been such a fun journey for us over the past two years.
Wow, thanks for tuning in another great episode. If you have feedback for us regarding this content and materials, or if you would like to help us to amplify great thinking to propel healthcare forward, which is our ???? mission, please send us a note at firstname.lastname@example.org. Thanks for listening. That's all for now.