In October 2022, Providence Saint John's Health Center invested in Project Ronin, an AI driven cancer intelligence platform to empower cancer patients and their clinical teams to manage treatment symptoms, care communications and clinical decision support. Their goal is to reduce ED visits and deliver better patient care and outcomes.

According to the American Cancer Society’s 2023 Cancer Statistics report, cancer remains the second highest cause of death after heart disease. This is an estimated 2 million newly diagnosed cancer cases resulting in about 610,000 deaths.

Dr. Martin, MD, CMO of Providence Saint John’s believes that providing a new “space where cancer people can engage with their physicians has some very real, tangible benefits.”  The digital tool is designed to support “patients with less-critical symptoms, which has the potential to reduce emergency department visits and improve clinical efficiency, which means a more efficient utilization of resources. Of course, we always advocate patients to come to the emergency department if they believe they are experiencing a medical emergency.”

Cancer Care Collaboration 

Successful treatment of cancer is multifaceted, requires a multi-disciplinary care team, entails managing different data sets with continuous capture and monitoring of data, and has data complexity given the non-linear nature of the disease (i.e. diagnosis, treatment, remission, recurrence, treatment, survivorship/death).

Patients struggle to manage their cancer, both mentally and physically. Patient treatment symptoms can be severe. Questions come up between treatments but care teams are extremely busy. Patients need to remain connected to care teams to stay engaged, better manage, and communicate side effects.

Providers try to navigate their inefficient clinical workflows, address the administrative burden due to documentation requirements, and deal with workforce shortages. Today, providers spend 20-40 minutes finding patient info to prepare for patient visits, sometimes missing key data.  Providers are overwhelmed to make needed decisions for cancer patients at the point of care.

AI Cancer Platform Delivers Care & Decision Support

The Ronin Cancer Platform enables patients to “take control of their care in a way that wasn't possible before and feel better connected to their care teams,” explains Dr. Neil Martin, MD, CMO of Providence Southern California Clinical Institutes and Executive Director of Saint John's Cancer Institute.  Clinicians utilize this cancer intelligence platform’s predictive analytics and clinical dashboard to define treatment pathways and support more informed care decisions.

How does this work? The Ronin cancer platform takes structured and unstructured data from different EHR silos, and then cleans, calibrates, contextualizes this information to present care insights. With predictive analytics, providers can identify at-risk patients and see a complete real-time view of the care journey for immediate actions.  

AI Data- Driven Cancer Platform: Patient Experience

Patient Patricia (patient persona), 74 years old, is newly diagnosed with breast cancer. While meeting with her new care team, Patricia learns about new resources including the free Ronin Symptom Monitoring App, to educate and support her as she navigates her cancer path. During her next appointment, Patricia notices the poster in her doctor’s office prompting her to download this patient app.

   Patient Symptom Monitoring App Poster:

We want to support you through your treatment. In between your visits, please let us know how you're feeling by using the Ronin Symptom Monitoring Application. This will help us catch any side effects that you may experience. Studies show that symptom monitoring can ...

• Help people live longer and improve their quality of life

• Help people stay on treatment longer

• Lower visits to the emergency room and reduce hospital stay

Patricia downloads and begins using the Symptom Monitoring app which captures her Patient Reported Outcomes (PROs), enables her to track and manage side effects for treatment tolerance, displays her symptom history and provides her with personalized education based on what she is reporting. Within the app, Patricia selects from a list of symptoms and then sees a message that her symptoms “are concerning”, that her care team is monitoring this and will reach out to her within 24 hours.

AI Data-Driven Cancer Platform: Provider Experience

Patricia’s care team receives a “symptom alert” through the EHR based on the information that she has entered. Her symptom information has required a response (e.g. new symptom, moderate or severe symptom). The Nurse Navigator reaches out electronically or telephonically to check in on Patricia to understand more about her symptoms.

When her Oncologist Dr. Davis initially set up Patricia’s personalized care pathway on the platform, he indicated her specific disease type, which triggered patient reported outcomes surveys and at-risk surveys which captures data and intelligently prioritizes for the care team to take quick action to course correct and preempt adverse events.

While preparing for an upcoming office visit with Patricia, Dr. Davis uses the Ronin Platform to view a longitudinal timeline of her cancer journey, filled with real-time data (e.g. labs, images, pathology, treatment, surgery notes, past encounters) to make informed, proactive and personalized treatment decisions.  Following the visit, Dr. Davis (or the clinical staff) pushes educational content to help Patricia to navigate her new symptoms or cancer stages.  

AI Driven Care Experience Value Proposition

At Providence Saint John's Health Center, both patients and providers are finding value using the AI Ronin Platform, including clinical efficiencies, better care and outcomes and higher satisfaction. Here are some comments from the patient and provider users:

 Patient Experience:

 “Ronin provided confidence someone was monitoring me.” 

 “Ronin made me feel like my care team was with me, even at home.”

 “I prefer not having to call the hospital. (With app) I am able to record side-effects right away as they are happening”. 

 “It’s (app) so easy to open up and write how I’m feeling…It’s a great reminder to me that even though I may think I’m fine, I need to pay attention to my symptoms.”

Provider/Staff Experience:

  “We were able to catch an immune- related toxicity early for a patient of mine. Without Ronin, I would not have caught it”.  Medical Oncologist

  “We want to make sure the patients are having the best quality of life. With Ronin, we can check in on them more frequently.”  Nurse Navigator

  “From the treatment team’s standpoint, it’s made it easy to follow patients. It’s a great way to stay hands-on.”  Nurse Navigator

  “I had a patient straight up tell me ‘If it wasn’t for the app, I would be calling you guys every day'.” Medical Oncologist

   “Visually, the Timeline tab makes it much easier to get up to speed on a patient. Especially compared to reading my colleague’s last notes.”  Medical Oncologist

 Success Metrics

In addition to gathering qualitative comments about the patient and provider/staff experience, Providence Saint John’s tracks quantitative success metrics for the AI driven Cancer Program. Some key metrics include:

● Reduced unnecessary ED admissions by >20% (early findings)

● Improved efficiencies with 35% decreased patient call volume and 32% patient-initiated messages.

● Strong patient satisfaction & experience

• 84% see positive impact on care experience
• 90% say app is easy to use
• 88% are satisfied with solution

Future for Providence with Ronin Cancer Platform

Moving beyond the patient mobile app and care communication from phase one, Providence Saint John's is planning to provide clinical decision support with oncology and risk dashboards and the capability to view comparative patient analytics in phase two.

"We are proud to implement evidence-based care solutions for patients in our community," said Brad Bott, Executive Director of the Southern California Clinical Institutes. "Our partnership with Ronin will help improve cancer care delivery while empowering our staff to practice more efficiently. It's a win-win."

Digital Medicine is a nationally recognized, clinically proven program revolutionizing how we treat chronic conditions combining digital tools and engagement with a dedicated care team.

Ochsner O Bar Supports Patient's Digital Health needsIn 2015, Ochsner Health launched its first Digital Medicine Program for Hypertension. Since publishing success outcome measures in The American Journal of Medicine, Ochsner’s Chief Clinical Transformation Officer Dr. Richard Milani, and his team have built on the framework to support patients with chronic conditions (e.g., Diabetes, COPD) and Maternal care. Over 30,000 patients have participated in an Ochsner Digital Medicine Program.

With the cost of chronic care, including indirect costs (productivity loss) reaching $3.7 trillion a year, Ochsner is focused on better managing chronic care through three key levers: medication management, behavioral change, and frequent data collection from home.

Milani believes that a successful Digital Medicine Program must:

• use the latest guidelines for medication management, important because ideal medications are always changing, and a certain medication may be more effective for one patient (profile) than another.
• be designed with behavioral science to impact lifestyle change, which includes everything from delivering the right type and timing for nudges to aligning patient needs with right level of high touch care support.
• leverage data captured and presented within a reasonable time so that clinicians can respond before the patient’s health becomes a problem.

Dedicated Team, Centralized Monitoring

Ochsner’s Digital Medicine programs are supported by a dedicated team of over 60 professionals, including clinicians, coaches, pharmacists, physical therapists, behavioral scientists, IT developers, technology engineers, user experience, content specialists, data scientists and advanced analytics.

Team members help patients throughout their program journey, with onboarding, educating and ongoing care support.  An important benefit of having one Digital Medicine team is that the program can be personalized to the patient’s specific needs (e.g., required monitoring devices) and supported by the same clinician and coach.

EMR Foundation  

“The technology foundation of our Digital Medicine Programs is the EMR Epic,” explains Milani.  “Our patients are given clinically validated devices approved for the program, with device data flowing into the EMR.”

Ochsner has evaluated and selected a set of devices for this program for each condition, which patients are required to use to connect into the Program. Ochsner distributes the devices and is the point of contact for any technical issues.

Patients access their Digital Medicine Program through the Epic portal My Chart (via website and patient mobile app), where they can view trends on device measures, access educational information, complete assessments, and exchange messages with the Digital Medicine Care team.

“For our clinicians, we have designed dashboards which help triage and prioritize patients based on incoming patient health data including Social Determinants of Health,” says Milani “We have set up alerts for our program care team based on selected physiological and inputted measures.  Other providers of the patient’s care can access information in Epic, including a Monthly Report.

Patient Digital Medicine Program Experience

Ochsner Digital Medicine Patient After a referral from his physician, patient Peter (not his real name) is invited through Epic to participate in Ochsner’s Hypertension Program. Participating in the program means that Peter can reduce time off from work and save time driving time for some appointments.

Peter has the option of having the device(s) and program setup information mailed to him, or if nearby, Peter can stop by Ochsner’s O Bar – a physical location that allows patients to test drive more than 100 Ochsner-approved health apps and purchase devices. There’s a technology specialist behind the counter to answer questions and give app demonstrations. (Think genius bar to support patient health technology).  

Once Peter sets up his blood pressure monitor, his measures are sent to his care team. If any measures are out of range, his care team will reach out to discuss any possible changes needed. Peter’s coach sets up personalized messages regarding lifestyle changes needed and reminders to keep him on track with taking his medication and taking his readings. Peter can communicate with his coach via SMS texting, My Chart messages or via phone.  

“We are seeing that patients prefer to communicate asynchronously with their clinicians and coaches, so we are giving them the tools to do so,” says Milani.

Digital Medicine Program Success

“We evaluate success based on a few key measures,” says Milani. “We look at outcomes and are seeing a consistent 2-3 times improvement in control rates with our program. We also look at Net Promoter Scores (NPS) and we are getting very high patient satisfaction scores of 87-90.”

Ochsner recently conducted a pilot program (beginning in June 2020 and ongoing) to investigate how digital medicine with remote patient management can improve outcomes for Medicaid patients battling chronic diseases like Hypertension and Type 2 Diabetes. The results were statistically and clinically significant. Enrollment in Ochsner Digital Medicine brought nearly half of all out-of-control Hypertension patients under control at only 90 days, which was 23% more likely than usual care. Control rates continued to improve as patients remained in the program during its first 18 months. More impressively, 59% of people with poorly-controlled diabetes achieved control over their condition as part of the digital program – a rate twice as high as usual care.

Most patients achieved control of their hypertension and diabetes within 90 days of beginning the program, even those who had poor control prior to enrollment.

In addition to improving health outcomes, participation in the digital medicine program resulted in high patient satisfaction, with a net promoter score greater than 91 for Medicaid participants. This is consistent with the high patient satisfaction with digital chronic disease management programs at Ochsner among non-Medicaid patients.

“We're offering patients compassionate human care combined with the power of technology, and we’ll continue to expand these programs to help more patient populations”, Milani concludes.

Success in their words

Patients:

“My care team has been really helpful. They’ve explained things to me… offered me suggestions. I really like the fact of daily accountability. I’ve lost about 103 pounds. I feel better. I have energy that I didn’t have a year ago.”

“I know I’m sleeping better–my hair, my skin, my vision–just different things that you start to notice that we take for granted that are all tied into our blood pressure and blood sugar. I’m a living testimony that it (the program) works! I know for a fact Ochsner Digital Medicine has saved my life.”

“I feel like this is more normal. Someone’s got my back and… I will be able to use [the program] for the rest of my life.”

“The Ochsner Digital Medicine Care Team helped me by guiding me in every way possible – giving me tips on my diet and adjusting my medication on the fly. They are a good support team.”

Staff:

“I love the Ochsner Digital Medicine program. As a physician, I love having the Digital Medicine team helping me because it’s like having other coaches on the team.”  Dr. Victoria Smith

Ochsner’s Digital Medicine Program is available to employees across their health system. 

“The Ochsner Digital Medicine program is one of the most important components of healthcare for our (employees). If I can offer better benefits and possibly reduce healthcare costs, why wouldn’t I? We have had employees sign up for the hypertension and Type 2 diabetes programs and have seen many positive results in a short period of time. The program lets your employees know how much they mean to you by investing in them”, Chief of Administration, Chris Kaufmann

Ochsner Mobile O BarOver five years ago, Ochsner Health launched their O Bar (Apple genius-like concept) to support patients getting started with digital health tools. Today, Ochsner has nine physical O Bars located in the bottom floor of their health centers and one mobile O Bar.

Although any Ochsner patient can visit the O Bar to begin using a curated set of digital health apps and devices, patients who are invited to join a digital medicine program can go to the O Bar to get set up with selected digital tools to manage and monitor their health journey.  Digital medicine program participants have the option to have their digital tools sent via the mail, without going to the O Bar and can call their program tech support for any assistance. Pre-Covid, about 5-10% of patients chose to receive their digital health tools by mail. During the pandemic, it is mostly all mail.

Ochsner Hypertension Digital Medicine ProgramTo date, Ochsner Health is offering digital management initiatives for hypertension, diabetes, pregnancy and the latest COPD program. Patients do not need to have access to WIFI to participate, just a smartphone or tablet. Less than 5% of patients participating in the digital medicine program use the tablet and instead have their apps downloaded to their smart phone. 

“Our digital medicine programs are realizing 2-3x better outcomes rates than the standard of care”, explains Dr. Richard Milani, Chief clinical transformation officer and innovationOchsner Medical Director, Ochsner Health. “In order to understand how these programs were designed, it is important to take a step back and think about how we need to help patients manage their chronic condition(s). First, we need more frequent data to know at any point in time if their chronic disease is under control. Second we must make sure individuals are prescribed guideline-directed pharmacotherapy.  With the number of new medications coming onto the market and medical research about the profile of patients experiencing the best outcomes, we must be sure patients are having the best chance to achieve an optimal outcome. Finally, we need engage our patients on the “right behaviors” (e.g. nutrition, fitness, stress reduction).”

"We set up our digital medicine programs to be supported by a dedicated team who interacts with and manages the patient’s condition(s)”, shares Dr. Milani. “Their doctor invites the patient to join the program, but it is a digital medicine team who responds to the incoming data and alerts from the digital health tools.” Ochsner’s digital medicine team consists of a pharmacist/APP to help the patient with the “right guideline-directed medicine” and a health coach to provide guidance on lifestyle decisions using behavioral health science techniques. Patients that are on two of Ochsner’s digital medicine programs engage with the same pharmacist/APP and health coach, creating a holistic approach to patient care.

Patients access all of digital health tools in the digital medicine program area with their patient portal. A patient logs in to access patient education information (videos), communicate with her team by scheduling a phone call or sending asynchronous messages and view monthly reports which shows how she is doing, and progress made over time. The patient can also contact the digital medicine team for technical support for their digital tools, which is rare because these connected devices are easy to use for even less tech savvy patients.

Ochsner Connected Mom Pregnancy Digital Medicine ProgramIn addition to appropriate connected devices given to patients to capture and transmit key measures (e.g. diabetes/wireless glucometer, hypertension/ wireless blood pressure cuff, COPD/wireless inhaler and pregnancy/ wireless blood pressure cuff & wireless scale), patients receive texts to capture changes in condition (e.g. COPD severity level), track self- efficacy measures or to be notified of a health concern (e.g. warning about the poor air quality level). Patients have the option of connecting in and sending more information such as weight measures from their own digital scale or steps from their fitness tracker to share with the digital medicine team.

Program Success Measures & Expansion Plans

Ochsner has enrolled more than 15,000 patients across their digital medicine programs.

Over the past 5 years, Ochsner has received positive feedback from their digital management team (e.g. Pharmacist, Health Coach) and from patients in the program.

 “The role of a clinical pharmacist isn’t always to add more medicine. We work with each person to incorporate lifestyle changes and medications that are right for them. This includes stopping or decreasing medicine doses when lifestyle changes lead to improved health.”  -- Carrie, Clinical Pharmacist

“I work with individuals to make small, achievable goals that will not only improve their health, but ultimately improve the way they feel mentally and physically. This allows the patient to feel confident in themselves to make healthier choices in any situation.” – Christina, Professional Health Coach

“I like that it is private. I don’t have to take a blood pressure reading at a Walgreens or CVS. It’s encouraging to know that the lifestyle choices I’m making as well as my compliance to my drug regiment is having a positive effect.” – Alan, Digital Medicine Hypertension Program 

“For anyone who has doubts about joining the program, I would say step out and take the journey.” – Lance, Digital Medicine Diabetes Program

“You get a lot out of Ochsner Digital Medicine. You get a family who is by your side every step of the way.”  - Gaylan, Digital Medicine Hypertension Program

In addition to patient and staff feedback, Ochsner uses a set of quantitative measures to evaluate success. Dr. Milani is proud to share the Net Promoter Score of patients in the digital medicine program of 87.5, which indicates a high level of recommending the program to others.

Dr. Milani explains, “the key success measure is the reengineering of chronic disease care into a new model of care delivery. Our metrics of success are control measures for the disease (i.e. better blood pressure control, better diabetes control, etc.).”

Ochsner has plans to grow their digital medicine programs in 2021.  “We are expanding the population we currently serve and will be adding more disease categories (like lipid management and others). We look at the prevalence of disease burden and the opportunities for better control when deciding on new digital medicine programs,” Dr Milani concludes. 

Buoy Health AI triage botTrue to their mission “Making health care easier, so life can be better”, Banner Health has invested in digital health technologies to support their patient experience.

Banner Health, a large regional health care system headquartered in Phoenix, manages 28 acute hospitals across 6 western states, with 5,000+ Banner Health doctors and specialists and over 50 urgent care centers.

Given trends towards consumerism and digital health usage, Banner understands that many patients begin their care journey with internet searches, at a time when these patients feel sick and most vulnerable. Sorting through search responses, patients have the burden of finding trusted health information, interpreting what they need and figuring out where to go to address their latest health issue.  Unfortunately the default care setting for patients in the United States is the emergency room, which results in $32 billion in annual avoidable ED visits.  

Banner Health Triage Bot

When Banner’s Digital Business group looked for potential solutions, they wanted to understand the patient’s journey and explore digital solutions to complement their high touch hospital experience.

“Through research, we learned that our patients often do not know what is causing their symptoms or what to do about it. They do not know whether to go see their primary care doctor, visit an urgent care facility or go directly to the hospital ER”, explains Dr. Jeff Johnson, Banner Health’s Vice President of Innovation and Digital Business.

With their commitment to delivering both a superior patient experience and reduce unnecessary spending, Banner has tested the idea of empowering customers with a digital tool containing clinical content to engage and triage them to the right care setting.

During the fall of 2019, Banner Health evaluated different digital triage tools and selected Buoy Health’s AI assisted chat bot after both an internal clinical leadership evaluation and patient testing for value and desirability.

As part of their solution evaluation, Banner recruited patients who had gone to a doctor, ER or Urgent Care in the last 30 days and asked them to think about the symptoms that had driven their visit while testing several digital triaging tools.

“Our patients commented that the Buoy bot was ‘easy to use’ and they liked not having to log in to use it. Patients felt the bot interaction was also ‘easy to understand’ and was ‘credible’. These patients did not ‘second guess’ the information that they received in the bot exchange”, shares Johnson.

While preparing for the launch, Banner worked closely with their clinical team, informing them about the triage tool and how it works. If the patient mentions using the bot, Banner wanted clinicians to be aware of the digital tool, acknowledge that the patient had invested time into learning about her condition before arriving and recognize that it is part of the Banner patient experience.

In early January, Banner soft launched the Buoy Health bot across all 28-hospitals with a “Get Care Now” link on their website, giving customers the option of interacting with this tool or calling their Nurse on Call.

After clicking on the “Get Health Now” button, patients are asked questions about their profile (e.g. gender, age) and specific symptoms (e.g. which ones, how long, better/same/worse than before).  Banner likes that the bot gets smarter with each patient interaction. Since the Buoy digital tool is available to consumers on the internet and patients across different health care systems, this bot has over 3 million interactions per month.

To evaluate this digital tool, Banner gathers feedback from patients about their bot interaction. Specifically the “Buoy bot askes the patient at the end of an exchange to rate the experience and share what she plans to do next (e.g. wait and see, doctor, urgent care, ER).  So far we have received excellent star ratings for the tool, 4.7 out of 5”, adds Johnson.

“Working closely with Buoy, we have learned about the patient’s expectations for their experience with this type of digital tool. The bot exchange cannot be too short so that the patient doesn’t trust the responses. And the text exchange cannot be too long so that the patient feels the tool doesn’t know what it is doing”, Johnson comments.

Banner’s Digital Business team is looking closely at bot tool usage and feedback to guide further development.  The bot reporting will give them insight into which care setting patients were directed, what questions they asked and which symptoms and conditions were discussed in the exchange with the patient.

In the first 3 weeks after launch, the Buoy triage bot has had 1,200+ users. Moving beyond the soft launch, Banner plans to incorporate the triage bot in their mobile app and to promote it as an option when patients call the Ask the Nurse line. Banner is discussing developing a Triage Summary Report which captures the information that the patient has already provided to share with her doctor. Banner is also looking to expand care settings to include directing the patient to a virtual visit in the right situation.

Banner Health Emergency Department (ED) Bot

Lifelink ED chabot

Like many of the ER experiences across the country, Banner Health patients want more information and communication about what is happening and what will be happening next to adjust their expectations.

The Banner Health team brainstormed about how to help patients get the information that they need throughout their visit without having to trying to find their doctor, walk up to the nurses station or wait for the nurse to come to their room.

Johnson shares that “we found an interesting chatbot solution from a start- up, Lifelink. We started slowly by having patients use the bot on their smart phones while in the ED and we manually responded to their questions. This gave us tremendous insight into what patients wanted to know and when. Based on this insight, we designed the chatbot (available both in English and Spanish) to give the patient a status from the time her labs (or images) are ordered to the time they are ready and then reviewed by her doctor. We needed to set expectations that the lab will take 45 mins before it is done. In order to enable these real time updates on labs and images, we integrated the LifeLink bot into our EMR. We promote that the patient signs up to our patient portal to access all of the notes, labs and images from her ED visit”.

Since the ED bot was rolled out across all 28 Banner Hospitals, there are over 100,000 patient users, one million plus conversations with an average of 5-10 conversations with the bot per person. 

“We have seen our patient satisfaction score for our EDs increase by up to 35%. This ED bot is such a satisfier”, Johnson explains. “Here are some patient comments about the value of using our ED bot”:

“It was nice to be given updates instead of just sitting in a chair and waiting for someone to get to me.”

“It gave me updates on my progress without bothering the nurses.”

“Very informative, relieved my husband’s worries by 90%”

In the near future, Banner Health is planning to “connect the dots” and engage the patient from the moment of interest and throughout their care journey. “We are looking to begin at the first part of the journey when the patient goes online to let us know that they are coming to the ED. Our ED bot will let the patient know that ‘we will be waiting for her’, provide map, picture of the entrance and parking directions. We also want to have the ED bot support the patient post discharge, reminding her to fill her medication, the date of her follow up visit, signs of what to look for and where to go if there is a relapse”, Johnson explains.

Later in this year, Banner Health is planning to extend the bot to inpatient care, with the goals of helping the patient get the highest outcomes and reducing their length of stay. This inpatient bot project is part of a bigger ‘patient flow’ initiative. Banner wants to get patient’s engaged at the beginning of their stay for a successful discharge. The bot will give guidance and recommendations so that the patient improves her eating, walking and bowel movement activities. Banner is also exploring ways to engage the family/care network to ensure an optimal recovery.