Artificial intelligence is rapidly reshaping the future of health care — from predictive early warning systems that detect patient deterioration to ambient AI tools that streamline clinical documentation. In this Leadership Dialogue conversation, Marc Boom, M.D., president and CEO of Houston Methodist and the 2026 AHA board chair, speaks with Amy Rockman, director of the Artificial Intelligence Center of Excellence, a systemwide initiative of Rutgers Health and RWJBarnabas Health. The two explore AI applications that are delivering measurable improvements in hospital mortality, safety, and clinician burnout, and how a “living lab” approach, interdisciplinary teams, and responsible AI integration are benefitting patients and the health care workforce.
View Transcript
00:00:00:09 - 00:00:21:15
Tom Haederle
Welcome to Advancing Health. March's Leadership Dialogue podcast explores how a collaboration between Rutgers Health and RWJ Barnabas Health is unleashing the power of AI - carefully and methodically - to improve patient safety and reduce clinician burnout.
00:00:21:18 - 00:00:44:23
Marc Boom, M.D.
I'm Marc Boom. I'm the president and CEO of Houston Methodist and the chair of the board of the American Hospital Association. So I want to continue this thread of our discussions this month. We're going to focus on innovation in patient safety. All hospitals and health systems we know put safe, high quality care first for their patients. And for decades now, we've been using innovation to improve outcomes.
00:00:44:23 - 00:01:06:27
Marc Boom, M.D.
And we know that we've seen really dramatic improvements. But we also know we can never be complacent. We need to continuously work to advance safety and quality, because we have a sacred responsibility to keep our patients safe at every single step, whether it's our physicians or nurses who are at the bedside or leadership shaping systemwide decisions. We always have the same goal, which is be safe, deliver safe care.
00:01:07:03 - 00:01:26:26
Marc Boom, M.D.
And innovation is a critically important tool in making that happen. And thankfully, we have a lot of new tools that help that happen. So, for example, small wearable devices that can monitor vital signs in real time and send updates directly to nurses, giving nurses more time at the patient's bedside, patients more time to recover and less sleep interruption.
00:01:26:29 - 00:01:53:17
Marc Boom, M.D.
Adopting innovative approaches is really, as I said, critically important, but it sometimes feels pretty challenging. And so I'm very excited to have a guest with me today who is expert and really doing exactly the kinds of things I was just talking about. So please join me in welcoming Amy Rockman. Amy is the director of the Artificial Intelligence Center of Excellence, which is a system wide collaborative initiative between RWJ Barnabas Health and Rutgers Health.
00:01:53:23 - 00:02:14:06
Marc Boom, M.D.
Amy, welcome. So, Amy, I want to begin by asking you to share a bit more about the partnership. I understand that your mission is to dedicate responsible development and integration of artificial intelligence to improve patient care and also a goal of reducing clinician burnout. So tell us a little bit about how it came to be and why it's notable for the work you're doing.
00:02:14:09 - 00:02:37:05
Amy Rockman
Thank you so much Dr. Boom. So we started this center and this group a few years back. So forward thinking leadership was really seeing the potential of these powerful AI tools. And so what we created is essentially an AI focused learning health system. So that's a system between our university and our health system in which research is informing practice and practice is
00:02:37:05 - 00:03:11:04
Amy Rockman
then again informing research. And so the idea between these two structures and bridging them together for the center is to bring those research experts, together with our everyday heroes, real clinicians in the health system, practicing medicine so that we can better inform the tools that we're introducing and how they can really drive change throughout our hospitals. So we brought together these two different sides of the health system and the university, and we did it with AI because it really requires this next level focus.
00:03:11:12 - 00:03:29:28
Amy Rockman
When you're bringing in and integrating these powerful artificial intelligence tools, there are so many things to think about from a safety perspective. There's safety and security, of course. Then there's validity and reliability of the tools. And that's with a lot of the technologies that you're bringing in. But AI introduces this whole new layer, since there's so much about it that we still don't understand.
00:03:30:00 - 00:03:53:14
Amy Rockman
So explainability for example, and transparency, interpretability of the tools. All of this we're still learning as AI is coming out. AI is looking at these huge sweeping statistical associations. And it's so incredibly powerful. It's able to do incredible speed, accuracy, so many changes that come with the tools, but we need to be able to understand them, validate them, evaluate them.
00:03:53:21 - 00:04:15:28
Amy Rockman
So there's actually a whole AI product lifecycle that we started to follow. And the Coalition for Health AI has really created this in detail, and it fit very closely with our work and how we think about how do we determine which area of our health system would most benefit from a tool right now? How do we then identify a tool?
00:04:16:00 - 00:04:40:13
Amy Rockman
Is it going to be homegrown internally, the university, or is it going to be vendor acquired and introduced? Then once we introduce it, there's a whole integration process of integrating it both technically into your infrastructure and into your clinical workflow. Then you need to monitor it, fully evaluate it, identify gaps, and the process restarts. So as we're following this AI lifecycle at each step there's a lot to think about.
00:04:40:14 - 00:04:57:10
Amy Rockman
And so it's not just so much that you need to think through. It's how interdisciplinary the work truly is. So how many people you really need on the team to be able to think through this in the most impactful way and in the safest way for our patients.
00:04:57:12 - 00:05:11:17
Marc Boom, M.D.
I hear that. It sounds like you're extremely intentional on how you're approaching this. I mean, you're not just sort of waiting for things to come to you. You're sitting there saying, what are the problems you want to solve? And how might we build something ourselves or go to look for a solution? Is that correct?
00:05:11:20 - 00:05:32:02
Amy Rockman
It's actually incredible how there's multiple different wavelengths coming together to make a lot of these decisions. And so a lot of it starts from our KPIs and drivers and risks and thinking through, you know, first we started introducing, for example, administrative tools as they were low, much lower risk. And there's still a lot of high reward even for patient safety, right?
00:05:32:02 - 00:05:50:03
Amy Rockman
If you're able to catch a lot of those documentation issues, you're able to address those. You have better documentation for your patient, you have a better patient history. So we introduce some of these low risk tools first and then started introducing the more high risk tools. We also we started introducing it by again looking at you know, those KPIs -
00:05:50:03 - 00:06:11:19
Amy Rockman
those drivers, our verticals, our horizontals. But as we're doing that, we're building these interdisciplinary teams. And as we're doing that, we're starting to learn from the teams and really get a deeper understanding of how the AI tools we started to introduce are affecting the clinical environment. And so now we're getting a grassroots input as well. And so the decision making is really, really thoughtful.
00:06:11:25 - 00:06:17:00
Amy Rockman
It involves a great number of people and a great interdisciplinary effort.
00:06:17:03 - 00:06:34:04
Marc Boom, M.D.
So I knew a lot of people would like to follow your lead and do things on his own. Can you walk me through an example of something you've tackled, and how big is the core personnel versus interdisciplinary team versus getting to the grassroots? Would you walk me through kind of an example of something that's worked and how that has been put together.
00:06:34:06 - 00:06:53:06
Amy Rockman
We've introduced dozens of tools at this point, and some of them really have taken these incredible team efforts. So I'd love to give you an example of one. And so I think the AI enabled Clinical Deterioration Index is an off the shelf EPIC tool that we introduced into RJW Barnabas Health. And we introduced it starting with a small pilot.
00:06:53:08 - 00:07:20:15
Amy Rockman
And it required a large interdisciplinary team of providers, administrators and tech experts who are really working, coming together on a weekly basis at one point to really review, as you introduced this tool. And so let me share what the tool is. It is a early warning system for clinical deterioration, flagging a patient for potential deterioration 24 hours before the deterioration is expected.
00:07:20:17 - 00:07:41:00
Amy Rockman
And so we all know that earlier intervention in many of these cases is essential. And so it's really a game changer to be able to have that much warning and be able to make a change and actually impacts the care. And you can impact the care in different ways. In our health system, we chose to impact the care by moving that person to the ICU in advance.
00:07:41:00 - 00:07:58:06
Amy Rockman
Other health systems have made different choices. But you have a choice people can make, and that's what matters. You can really respond sooner. And so in order to do this, though, and to make it work, a lot of thought needed to go into it. Because even though these products, many of these products, they're off the shelf, they should be easily implemented.
00:07:58:08 - 00:08:17:14
Amy Rockman
They might be easily implemented into your technical infrastructure if you have EPICF, for example. But that does not necessarily mean they're easily implemented into your work streams and your workflow. And so when we first implemented it, there was so much to think about as far as who is getting the flag? It's a rapid response team. How are we adjusting this team?
00:08:17:14 - 00:08:38:03
Amy Rockman
How is that getting to the providers? And then we're looking at constantly the sensitivity and specificity because we're getting false warnings. You know, we want to ensure we're not missing warnings. And so how do you adjust the algorithm when the algorithm is a complete black box? Most of the algorithms that we get, even when they're data analytics focus, we don't know everything about it because it's proprietary.
00:08:38:05 - 00:09:00:28
Amy Rockman
But in AI it's truly a black box in many of these situations. We don't know all how it's getting to the answers that it is. And so we need to create our own interpretability layer or explainability layer, if you will, to really try to understand. And so when we did that, we started to stratify and we started to see that there are different proportions in our population and in the population to which this was initially trained.
00:09:01:00 - 00:09:20:21
Amy Rockman
And so we can make some adjustments. We made some adjustments for hospice, for example, when we removed some of the stratum and we found that we could adjust it and really get it to an ideal sensitivity and specificity. Where now the 24 hour flags were so meaningful that we saw an over 18% reduction in in-hospital mortality.
00:09:20:23 - 00:09:35:29
Marc Boom, M.D.
Wow. That's very impressive. So that really meets that noble goal of what you're talking about with this. So when I've read up on your center and I think you already give us an example, but give us a little more around an inside of a living laboratory. What do you mean by that exactly?
00:09:36:01 - 00:09:56:04
Amy Rockman
Yeah. So we're, you know, exploring the world, and we're doing this work right in that real world health care setting. And so if you think about how we're moving research from bench to bedside, most of the work really is focused on that bedside space of integrating directly into the health care system. But as I mentioned, the AI life cycle earlier, right,
00:09:56:04 - 00:10:17:12
Amy Rockman
comes back to the bench. It comes back to homegrown at certain points. But it's a living lab because we're doing a lot of this evaluating and studying and all of this work together, interdisciplinary work in that real world space. And so what ended up happening is that we brought these interdisciplinary teams together to integrate into the workflow.
00:10:17:16 - 00:10:39:10
Amy Rockman
We also brought the interdisciplinary teams together to evaluate afterward as part of that lifecycle. And as we started bringing these different expertise and areas together, naturally, a research hub formed. And so you started to have everyone that I just mentioned who's in the health system trying to integrate and look toward those dashboards and those analytics and really make adjustments in the clinical workflow.
00:10:39:12 - 00:10:58:22
Amy Rockman
And now we're also introducing engineers and computer scientists and statisticians who are going to look even a little bit deeper from a research perspective. Now that we've fine tuned to a certain degree, let's look even deeper and really study and validate and ensure that we really know what we saw isn't due to confounders. What we saw is real, right?
00:10:58:23 - 00:11:15:28
Amy Rockman
That 18% drop is a real value that we're seeing, and that we took off line into a lab and studied it further. Once we have findings from that, which currently for the 20th Ethical Deterioration Index, we have a publication here under review with NEJM AI where we looked into all of those indicators.
00:11:16:00 - 00:11:32:26
Marc Boom, M.D.
You're impacting patient care and patient safety, and at the same time studying it and having the discipline to really make sure that it is indeed your interventions that are doing that and then sharing it with the rest of the world. So we can all move the needle forward. I mean, it's really wonderful the way the way you all do that.
00:11:32:26 - 00:11:37:18
Marc Boom, M.D.
So give me a couple other examples of some things you're working on these days.
00:11:37:21 - 00:11:57:07
Amy Rockman
Yeah, there's so many different tools and technologies out there and there's so many different areas where we're really trying to expand and understand this technology further. So we also introduced some different platforms that are ambient AI, which is really popular right now because it makes such a difference in our ability to practice medicine with our patients.
00:11:57:07 - 00:12:01:12
Marc Boom, M.D.
Yeah. You can count me as a fan. I use it in my primary care clinic, I love it.
00:12:01:15 - 00:12:19:28
Amy Rockman
That's great. Exactly. If you can have a tool that can record your conversations so that you can interact with the patient directly, then it's a game changer. And now they're even, you know, they're advancing so rapidly, able to take those notes and actually input it into the system for you. Now your documentation is potentially even better than before.
00:12:20:01 - 00:12:37:29
Amy Rockman
But with all these tools as we're introducing them, you really do need to think through those strengths and limitations. That's where that living lab model really comes into play. Because as we're introducing this, you can't take human in the loop out of that one, right? So at the moment you have your, you know, your analytics, your bridge, all of your different vendor products
00:12:37:29 - 00:12:58:06
Amy Rockman
that can do this ambient technology. When you get your notes back in your practice, you need to review it, right? It's like you got a trainee, right? Who's working on it. And they're great and they're amazing. But if you don't review those notes fully, something will get missed potentially. And that impacts the patient safety ultimately. So making sure human in the loop is there, especially as we move toward more advanced AI types.
00:12:58:06 - 00:13:17:23
Amy Rockman
And so there's a couple different ways that we're doing that. One is that as we start to build these homegrown technologies, we're moving toward agenda AI. And so now the AI is not only generating content, the AI is taking autonomous action potentially. And so human in the loop has become more important than ever. And ensuring that where that's needed, the human the loop is still there.
00:13:18:00 - 00:13:41:00
Amy Rockman
And there isn't a problem of overreliance, right? And that we're trying to reduce bias in the algorithm by reviewing thoroughly from a traditional practice perspective as well. Then there's also, again, as mentioned earlier, the explainability and transparency of the products themselves. And so we are trying to understand better because some of these tools are so powerful that we're introducing them due to the changes that we're seeing.
00:13:41:00 - 00:14:00:06
Amy Rockman
So we see, you know, that 18% drop in mortality and it's worth introducing that tool, right? But we also want to know how the AI is getting to the answers that it is. And so we're starting to think through in our AI learning lab, how do we actually make these tools more explainable. And starting to work with the vendors on how explainable is this tool and can we get there?
00:14:00:09 - 00:14:10:03
Amy Rockman
Do we only have post-hoc methods or we're looking at heatmaps? Do we have ante-hoc methods where the AI can actually show me its work, the same way that you would ask a person, a trainee or resident to show theirs.
00:14:10:06 - 00:14:20:18
Marc Boom, M.D.
I often hear that part of what AI is doing these days, nobody really totally understands in terms of some of that black box. So that that I imagine could be a little bit of a challenge, what you described there.
00:14:20:21 - 00:14:21:01
Amy Rockman
That's right.
00:14:21:09 - 00:14:26:07
Marc Boom, M.D.
If you could tackle something, what's the big something you'd like to tackle coming up?
00:14:26:10 - 00:14:47:24
Amy Rockman
There are so many different opportunities here. And this area is moving so fast. Everything is moving so quickly at lightning speed, and there's so little that we know at the moment. Right? We don't know, for example, there's not a lot of information about how this impacts your ROI when you first go to choose a tool. There's not a ton of information about how it might affect your patient population as you go to pick this tool.
00:14:47:28 - 00:15:05:03
Amy Rockman
All of these, you know, you need to some degree take a leap of faith and you need to invest in these tools. But these tools are the way of the future. And as we've seen, they're so incredibly powerful. And so I think one thing that we're working on is how do we maximize the strengths of these powerful tools while minimizing the limitations?
00:15:05:08 - 00:15:25:15
Amy Rockman
Right? And in many ways, it's both dual about how it's designed and how it's used, right? So we're introducing, for example, AI chat bots or for using automated response technologies. Speaking to a chat bot would seem like it's more empathetic, for example. Right. Because it never tires, or speaking to a chat bot that seem less empathetic because it feels like a robot, right?
00:15:25:15 - 00:15:41:02
Amy Rockman
Right. How the tool is designed and how that tool is used make such a difference? Same with the elements, right? So Open Evidence was released not so long ago, and it's a super powerful large language model to be using the clinical setting. But it really depends what prompts are entered into that.
00:15:41:08 - 00:15:42:07
Marc Boom, M.D.
Yeah. Input matters.
00:15:42:07 - 00:15:59:08
Amy Rockman
Yeah, exactly. Prompt engineering is an entire study of itself now. And what kind of you're going to use - is it going to be one shot or zero shot? You know, is it going to be structured? So training the next generation of providers to understand how to use these tools properly is a huge area for us. And how do we think through that.
00:15:59:08 - 00:16:26:03
Amy Rockman
How do we essentially ensure to the best of our ability that the tools are being used in a way that does minimize bias, that does minimize over reliance? MIT just came out with your Brain on ChatGPT study showing what a big cognitive debt you're seeing if there is overreliance on the tool. And so we're trying to avoid that by now educating the next generation on how to use this. By educating decisions that are in the hospital at this moment and are starting to get these tools.
00:16:26:03 - 00:16:44:18
Amy Rockman
And I will say that we've managed through this center, through this structure to drum up a lot of excitement about these tools. So we're seeing a lot of the providers are coming to us eager to get more and more and more of the tools. And so that's great. That's a great place to be. People are very interested in working on these interdisciplinary teams together, which is really important.
00:16:44:21 - 00:17:00:19
Amy Rockman
But so the key now is to ensure that every time we adopt one of these tools, we've thought through the process, we've thought through that AI life cycle. We've thought through how the providers are going to interact with it. How are you going to use it? We've thought through how is it designed. We have a sense of what the bias is for this tool.
00:17:00:22 - 00:17:22:24
Amy Rockman
Do we have a sense of what the explainability level is for this tool? And so we know to the best of our ability what we're acquiring and integrating into our health system. And we have an expectation of this powerful tool. What will be the change, the transformation we'll see? And then the super fun part for me with my epidemiology background is we're monitoring it and we're ensuring that that really happens.
00:17:22:26 - 00:17:38:12
Marc Boom, M.D.
Again, I'll say I love how structured and thoughtful you are and how you're liking it all of that, and now education as well. I mean, I know you have many residents. This is bringing up the next generation of physician residents, as well as obviously nurse trainees and others, which is great. Well, let me ask you one closing word.
00:17:38:12 - 00:17:55:21
Marc Boom, M.D.
If you had some closing thoughts to the colleagues who are watching this, you know, you all have a very impressive center. Not everybody is going to be quite as far along, but we're all on this very fast moving train. What would you say to those individuals about how to embrace change, how to invest in innovative technologies? What would be some key messages?
00:17:55:24 - 00:18:26:21
Amy Rockman
Absolutely. So communication is key and being honest, showing the excitement and potential of these transformative applications. But being practical about it, it's not always going to be easy. You're not going to see that transformation potential right away. I think some of the ambient technology is a great example of that. It also required a lot of tweaking before people felt like the output was to the same level as their own notes, and that they would take it without drafting, taking more time than if you just had written them on your own.
00:18:26:23 - 00:18:48:19
Amy Rockman
Right. So being really practical about that, but being supportive and excited. This is the first generation of these tools, right? We really put the investment into this. You'll see, as they continue to grow just more and more powerful to support our workforce. And that's a key piece of communication too, and the messaging is that AI is here to support and enhance our workforce, not to replace it.
00:18:48:21 - 00:19:04:03
Amy Rockman
And it has been enhancing it. You can tell it as you talk to a lot of the providers who are using it, they're excited. It's meaningful. There's change happening that makes them feel like they can have the joy of work back again. It makes them feel like they can really take care of their patients in a way that felt like it was gone for a while.
00:19:04:09 - 00:19:09:07
Amy Rockman
And these tools are there to make that difference in medicine.
00:19:09:09 - 00:19:31:12
Marc Boom, M.D.
I love that. You know, at Houston Methodist, we have kind of two overarching principles around new innovation in the work we do. And one is obsessive focus on the needs of our patients, the communities we serve. And then a close second is improve the lives of the people caring for those patients and connect them to the things human beings can do, you know, take away some of the drudgery and other things that prevent it.
00:19:31:13 - 00:19:51:12
Marc Boom, M.D.
Sounds like we're on a very similar page. So anyway, thank you, Amy, for your time today. What you're doing is really, really very impressive, very inspiring. And I know you all are already making a difference in people's lives. I can't even imagine as this promulgates across the field profession, you know, we all share that goal of keeping patients safe, keeping people at the center ready to do so.
00:19:51:12 - 00:20:01:09
Marc Boom, M.D.
Thank you again. Thank you, everybody, for finding time to listen. And I will be back in another month for another Leadership Dialog conversation. Thanks so much.
00:20:01:12 - 00:20:09:23
Tom Haederle
Thanks for listening to Advancing Health. Please subscribe and rate us five stars on Apple Podcasts, Spotify, or wherever you get your podcasts.



