Skip to main content

How to skirt AI rules, according to the FDA

The ideas and innovators shaping health care
Jan 31, 2024 View in browser
 
Future Pulse

By Daniel Payne, Carmen Paun, Erin Schumaker and Ruth Reader

TECH MAZE

A doctor prepares a prescription on a computer screen on September 5, 2012 in Berlin, Germany.

Even AI that summarizes doctors' notes could affect care, a new JAMA paper argues. | Adam Berry/Getty Images

Did federal regulators give artificial intelligence developers a roadmap to avoid their oversight?

In a limited way, they did, according to University of Maryland researchers.

In a new paper in JAMA, the researchers say the FDA inadvertently revealed a loophole when it said that some AI products, such as those that summarize doctors’ notes, wouldn't be considered medical devices subject to FDA rules. The loophole was included in the FDA’s guidance for “clinical decision support software,” which it issued in September 2022.

The guidance, released just two months before ChatGPT revolutionized AI, suggested that the agency didn’t consider note-taking AI within its purview because such technology doesn’t make specific predictions or disease estimates.

That’s too bad, the researchers argue, because AI that merely tries to make sense of the mountains of clinical documentation could still need regulatory oversight and harm patients without it.

How so? The words the AI chooses to create the summaries could nudge clinicians in one direction or another.

AI systems have also exhibited bias toward producing what a target audience expects — which could reinforce a doctor’s own biases.

Meanwhile, even small errors in summarizing notes could adversely affect care delivery.

What’s next? The authors say that even if the FDA were to seek to write rules for AI that summarize doctors’ notes, it might fail without receiving explicit new authority from Congress.

 

CONGRESS OVERDRIVE: Since day one, POLITICO has been laser-focused on Capitol Hill, serving up the juiciest Congress coverage. Now, we’re upping our game to ensure you’re up to speed and in the know on every tasty morsel and newsy nugget from inside the Capitol Dome, around the clock. Wake up, read Playbook AM, get up to speed at midday with our Playbook PM halftime report, and fuel your nightly conversations with Inside Congress in the evening. Plus, never miss a beat with buzzy, real-time updates throughout the day via our Inside Congress Live feature. Learn more and subscribe here.

 
 
WELCOME TO FUTURE PULSE

Mt. Washington, N.H.

Mt. Washington, N.H. | Sam Oates

This is where we explore the ideas and innovators shaping health care.

Stop the spread? Maybe not. Three in four people say they've hidden a contagious illness, or would do so in the future, according to a new study. Why? They didn't want to miss work, upend travel plans or skip social events. A caveat: Only 1 in 5 people said they’d hide a Covid infection.

Share any thoughts, news, tips and feedback with Carmen Paun at cpaun@politico.com, Daniel Payne at dpayne@politico.com, Ruth Reader at rreader@politico.com or Erin Schumaker at eschumaker@politico.com.

Send tips securely through SecureDrop, Signal, Telegram or WhatsApp.  

FORWARD THINKING

Christophe, a former French soldier, holds a cup as he sits at the "Athos" house - a place that welcomes veterans with traumas - in Toulon, southern France, on May 26, 2021. - Some 2,800 French servicemen suffering from psychological injuries have been recorded from 2010 to 2019, five times more than the number of physically injured. In the army alone, 70% of the 1,000 wounded on long-term sick leave suffer from   post-traumatic stress disorder (PTSD). (Photo by Nicolas TUCAT / AFP) (Photo by NICOLAS TUCAT/AFP via Getty Images)

An avatar therapist can always find time for an appointment. | AFP via Getty Images

Virtual reality powered by AI could help close the gap between the number of people who could benefit from therapy and the number of therapists available to treat them.

That is, if people don’t mind meeting with a therapy bot, POLITICO’s Gregory Svirnovskiy reports.

Researchers at Cedars-Sinai Medical Center in Los Angeles say their small study in which 14 people met with a therapy avatar in relaxing settings shows promise. npj Digital Medicine published the study on Jan. 26.

The avatar relied on XAIA, short for the eXtended-reality Artificial Intelligence Assistant, a large language model, to guide its exchanges with the participants during 30-minute sessions.

The participants brought up issues such as divorce, job loss, and substance abuse and testified to the program’s benefits.

What did they like? The avatar’s accessibility, anonymity, empathy and calming demeanor.

Even so: Some people preferred the deeper and more nuanced engagement that comes from interaction with real therapists.

Why it matters: An estimated 57.8 million adults lived with mental illness in 2021, according to the National Survey on Drug Use and Health. But almost 55 percent of adults with mental illnesses don’t receive treatment, per Mental Health America’s 2023 Access to Care Ranking. Availability — and cost — continues to be a central issue.

“While this technology is not intended to replace psychologists — but rather augment them — we created XAIA with access in mind, ensuring the technology can provide meaningful mental health support across communities,” Brennan Spiegel, one of the study’s authors, said in a press release.

Of note: The technology could have merit, but the study is too small to draw definitive conclusions and more robust research is needed.

 

DON’T MISS POLITICO’S GOVERNORS SUMMIT: Join POLITICO on Feb. 22 to dive into how Governors are wielding immense power. While Washington remains gridlocked, governors are at the center of landmark decisions in AI and tech, economic development, infrastructure, housing, reproductive health and energy. How are they setting the stage for the future of American politics, policies and priorities? How are they confronting major challenges? Explore these questions and more at the 2024 Governors Summit. REGISTER HERE.

 
 
INNOVATORS

This illustration image shows tablets of opioid painkiller Oxycodone delivered on medical prescription taken on September 18, 2019 in Washington,DC. - Millions of Americans sank into addiction after using potent opioid painkillers that the companies churned out and doctors freely prescribed over the past two decades. Well over 400,000 people died of opioid overdoses in that period, while the companies involved   raked in billions of dollars in profits. And while the flood of prescription opioids into the black market has now been curtailed, addicts are turning to heroin and highly potent fentanyl to compensate, where the risk of overdose and death is even higher. (Photo by Eric BARADAT / AFP) (Photo by /AFP via Getty Images)

Researchers are pursuing new pain medications that don't pose an overdose risk. | ERIC BARADAT/AFP via Getty Images

Imagine a prescription opioid that alleviates pain but can’t cause an overdose.

California-based Ensysce Biosciences is working to bring one to market, and the Food and Drug Administration gave its efforts a boost this month when it granted its experimental opioid the agency’s breakthrough designation. That means the FDA wants the drug developed and reviewed faster than usual because preliminary evidence shows it could be better than similar medicines.

The drug has already cleared a Phase I clinical trial funded by the National Institute on Drug Abuse.

How it works: The experimental drug is an oxycodone derivative combined with an inhibitor of the digestive enzyme trypsin, which activates the opioid in the intestine.

If people take more than the prescribed amount, the inhibitor will block the enzyme, impeding the opioid from passing into the bloodstream.

“And that’s where you’re getting this overdose protection,” Ensysce CEO Lynn Kirkpatrick told Carmen.

Bragging rights: The company said it believes the drug is the first in any drug class to come with oral overdose protection.

“It’s quite incredible that the FDA granted a breakthrough status to an opioid product,” Kirkpatrick said, noting health care experts and politicians are wary of the pain relievers since overprescribing has caused hundreds of thousands of fatal overdoses over the past two decades.

“We do need opioids. We just need safer opioids, and I'm glad they recognized the fact that we have innovation in the opioid field,” Kirkpatrick said of the FDA.

 

Follow us on Twitter

Carmen Paun @carmenpaun

Daniel Payne @_daniel_payne

Ruth Reader @RuthReader

Erin Schumaker @erinlschumaker

 

Follow us

Follow us on Facebook Follow us on Twitter Follow us on Instagram Listen on Apple Podcast
 

To change your alert settings, please log in at https://www.politico.com/_login?base=https%3A%2F%2Fwww.politico.com/settings

This email was sent to rouf@idiot.cloudns.cc by: POLITICO, LLC 1000 Wilson Blvd. Arlington, VA, 22209, USA

Unsubscribe | Privacy Policy | Terms of Service

Comments

Popular Posts

The costs of Healey's budget cuts

Lisa Kashinsky and Kelly Garrity's must-read rundown of what's up on Beacon Hill and beyond. Jan 09, 2024 View in browser   By Kelly Garrity and Lisa Kashinsky MAKING ENDS MEET — Gov. Maura Healey’s plan to slash $375 million from the state budget to help plug a $1 billion revenue hole came as something of a surprise after she initially said she had no plans to scale back spending. But some budget watchers say the move to control costs was inevitable — and that the governor...

📷 Zaib Khan added a new photo

  See the photo that he shared.           Facebook                 📷 Zaib Khan added a new photo. 16 October at 20:23   View Photo       Abdul Karim Jam likes this.             This message was sent to ludomallam@idiot.cloudns.cc . If you don't want to receive these emails from Facebook in the future, please unsubscribe . Facebook, Inc., Attention: Community Support, 1 Facebook Way, Menlo Park, CA 94025         To help keep your account secure, please don't forward this email. Learn more.      

U.S. Cyber Command and NSA partner to shield midterms from hackers / Global ransomware damages set to exceed $30B / India's newest airline could have leaked customer data

Plus: Microsoft Azure Virtual Machines have suffered an outage Inside.com Part of   Network August 30, 2022 Presented by The U.S. Cyber Command has partnered with the NSA to shield midterm elections from hackers. The two federal agencies made the announcement in a joint statement. More: The two agencies have  created a joint task force named the Election Security Group. Officials from the NSA and U.S. Cyber Command have stated that the group comprises the best team members that the two agencies have. ESG will receive and share information with other domestic and international authorities to ensure it achieves its goal of protecting the midterm elections from foreign threat actors. The task force will also help U.S. allies to protect their electoral campaigns from actors that want to undermine them. Zoom Out: CISA has collaborated ...

Q&A: Bergman on pushing the FDA on psychedelics

The ideas and innovators shaping health care Aug 08, 2024 View in browser   By Ruth Reader , Erin Schumaker , Daniel Payne , Toni Odejimi and Carmen Paun WASHINGTON WATCH Bergman | Francis Chung/POLITICO ...

8 Best Diabetes-Friendly Meal Delivery Services in 2024

Plus: Identifying and Treating Diabetes Joint Pain ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌     ­ ͏ ‌   ...

📷 MD Monir Ambulance added a new photo

        📷 MD Monir Ambulance added a new photo. 12 April at 17:59   View Photo               Facebook                 📷 MD Monir Ambulance added a new photo. 12 April at 17:59   View Photo               This message was sent to ludomallam@idiot.cloudns.cc . If you don't want to receive these emails from Facebook in the future, please unsubscribe . Facebook, Inc., Attention: Community Support, 1 Facebook Way, Menlo Park, CA 94025         To help keep your account secure, please don't forward this email. Learn more.      

Sabir Khan wants to be friends on Facebook

  1 mutual friend - Works at Facebook - Islamia University - Bahawalpur - 2,123 friends - 5 photos - 7 groups           Facebook             Sabir Khan wants to be friends with you on Facebook.   Sabir Khan Works at Facebook · Islamia University · Bahawalpur 1 mutual friend · 2,123 friends · 5 photos · 7 groups               Confirm request     See all requests             This message was sent to ludomallam@idiot.cloudns.cc . If you don't want to receive these emails from Facebook in the future, please unsubscribe . Facebook, Inc., Attention: Community Support, 1 Facebook Way, Menlo Park, CA 94025         To help keep your account secure, please don't forward this email. Learn more.      

Spectrum Equity closes $2B fund

Plus, Audacity launches $60M fund Inside.com Part of   Network July 28, 2022 Presented by Spectrum Equity, an investment company based in Boston, has closed its new fund valued at $2B . The fund will be officially named Spectrum Equity X, L.P. More: The firm received funds from previous investors as well as first-time outside investors. Spectrum focuses on backing internet-based companies that aim to disrupt a number of different verticals such as education, financial services, healthcare, and logistics.  Founded in 1993, the company manages $8B in assets, while its average equity investment is $25M-$150M. Audacity has launched a new $60M fund. The India-based VC firm will focus on media tech companies that are raising their Series A round. More: Besides media tech, the firm will also focus on SaaS, g...

A 2022 recap of platform updates and new tools

Startups that raised funding in 2022 Inside.com Part of   Network December 28, 2022 Presented by Android and Apple updates announced in 2022:  Google introduced a pilot program with Spotify to explore user choice billing.  Google released Android 13 (Go edition) with improvements to user experience and technical functionalities.  Android 13 for TV was made available to developers on ADT-3 and the Android TV emulator.  Google announced memory safety vulnerabilities in Android dropped after announcing support for Rust last year.  Google shared its plans to launch the beta version of Privacy Sandbox for Android early next year.  Apple announced changes to its pricing structure, offering developers 700 additional price points and pricing tools.  Apple allowed reader apps to provide in-app links to alternative payment methods. In Apr...

Changes to Google’s end user-facing Terms of Service

Changes to our end user-facing Terms of Service effective March 31, 2020. Hello Administrator, We're writing to let you know about changes in our end user-facing Terms of Service (Terms) that may affect users in your domain. These changes do not impact the terms that govern the agreement between Google and your organization. If you have disabled Google Additional Services for users in your domain, these changes will not impact them. What's Changing? We're improving our Terms and making them easier to understand. The changes will take effect on March 31, 2020, and they won't impact the way your end users use Google services. As the United Kingdom (UK) is leaving the European Union (EU), Google LLC will be the service provider for end users in your domain that are based in the UK. Google LLC will be responsible for all user information and data in Additional Services, and for complying with applicable privacy laws. For more detail...