, , , , , , , , , , ,

AI does a poor job of diagnosing COVID-19 from coughs, study finds

Early in the pandemic, a number of researchers, startups and institutions developed AI systems that they claimed could diagnose COVID-19 from the sound of a person’s cough. At the time, we ourselves were enthusiastic about the prospect of AI that could be yielded as a weapon against the virus; in one headline, we endorsed cough-scrutinizing AI as “promising.”

But a recent study (first reported on by The Register) suggests that some cough-analyzing algorithms are less accurate than we — and the public — were led to believe. It serves as a cautionary tale for machine learning tech in healthcare, whose flaws aren’t always immediately apparent.

Researchers from the Alan Turing Institute and Royal Statistical Society, commissioned by the U.K. Health Security Agency, conducted an independent review of audio-based AI tech as a COVID-19 screening tool. Together with members from the University of Oxford, King’s College London, Imperial College London and University College London, they found that even the most accurate cough-detecting model performed worse than a model based on user-reported systems and demographic data, such as age and gender.

“The implications are that the AI models used by many apps add little or no value over and above the predictive accuracy offered by user-reported symptoms,” the coauthors of the report told TechCrunch in an email interview.

For the study, the researchers examined data from over 67,000 people recruited through the National Health Service’s Test and Trace and REACT-1 programs, which asked participants to send back nose and throat swab test results for COVID-19 along with recordings of them coughing, breathing and talking. Using the audio recordings and test results, the researchers trained an AI model, attempting to see whether coughs could serve as an accurate biomarker.

Ultimately, they found that they could not. The AI model’s diagnostic accuracy wasn’t much better than chance when controlling for confounders.

Partly to blame was recruitment bias in the the Test and Trace system, which required participants to have at least one COVID-19 symptom in order to take part. But professor Chris Holmes, lead author of the study and program director for health and medical science at The Alan Turing Institute, says the findings show coughs are a poor predictor of COVID-19 in general.

“It’s disappointing that this technology doesn’t work for COVID-19,” he told TechCrunch in an emailed statement. “Finding new ways to quickly and easily diagnose viruses like COVID-19 is really important to stop its spread.”

The study is a blow to commercial efforts like Fujitsu’s Cough in a Box, an app funded by the U.K.’s Department of Health and Social Care to collect and analyze audio recordings of COVID-19 symptoms. And it puts some scientific claims in doubt. One paper co-authored by researchers at the Massachusetts Institute of Technology pegged the accuracy of a cough-analyzing COVID-19 algorithm at 98.5% — a percentage that in retrospect seems dubiously high.

That isn’t to suggest the Turing Institute study is the last word on cough detection where it concerns COVID-19. Holmes leaves open the possibility that the tech may work for other respiratory viruses in the future.

But it wouldn’t be the first time healthcare AI has overpromised and underdelivered.

In 2018, STAT reported that IBM’s Watson supercomputer spit out erroneous cancer treatment advice, the result of training on a small number of synthetic cases. In a more recent example, a 2021 audit of healthcare system provider Epic’s AI algorithm for identifying patients with sepsis was found to miss nearly 70% of cases.

AI does a poor job of diagnosing COVID-19 from coughs, study finds by Kyle Wiggers originally published on TechCrunch

https://techcrunch.com/2023/02/14/ai-does-a-poor-job-of-diagnosing-covid-19-from-coughs-study-finds/


December 2024
M T W T F S S
 1
2345678
9101112131415
16171819202122
23242526272829
3031  

About Us

Welcome to encircle News! We are a cutting-edge technology news company that is dedicated to bringing you the latest and greatest in everything tech. From automobiles to drones, software to hardware, we’ve got you covered.

At encircle News, we believe that technology is more than just a tool, it’s a way of life. And we’re here to help you stay on top of all the latest trends and developments in this ever-evolving field. We know that technology is constantly changing, and that can be overwhelming, but we’re here to make it easy for you to keep up.

We’re a team of tech enthusiasts who are passionate about everything tech and love to share our knowledge with others. We believe that technology should be accessible to everyone, and we’re here to make sure it is. Our mission is to provide you with fun, engaging, and informative content that helps you to understand and embrace the latest technologies.

From the newest cars on the road to the latest drones taking to the skies, we’ve got you covered. We also dive deep into the world of software and hardware, bringing you the latest updates on everything from operating systems to processors.

So whether you’re a tech enthusiast, a business professional, or just someone who wants to stay up-to-date on the latest advancements in technology, encircle News is the place for you. Join us on this exciting journey and be a part of shaping the future.

Podcasts

TWiT 1011: The Year in Review – A Look at the Top Stories of 2024 This Week in Tech (Audio)

What's behind the tech industry's mass layoffs in 2024? : NPR Rabbit R1 AI Assistant: Price, Specs, Release Date | WIRED Stealing everything you've ever typed or viewed on your own Windows PC is now possible with two lines of code — inside the Copilot+ Recall disaster. Microsoft delays Recall after security concerns, and asks Windows Insiders for help The Qualcomm Snapdragon X Architecture Deep Dive: Getting To Know Oryon and Adreno X1 Elon Musk: First Human Receives Neuralink Brain Chip Apple hit with €1.8bn fine for breaking EU law over music streaming Bluesky emerges The hidden high cost of return-to-office mandates Apple's Car Was Doomed by Its Lofty Ambitions to Outdo Tesla SpaceX pulls off unprecedented feat, grabs descending rocket with mechanical arms U.S. versus Apple: A first reaction Google Says It Won't Force Gemini on Partners in Antitrust Remedy Proposal U.S. Accuses Chinese Hackers of Targeting Critical Infrastructure in America U.S. Agency Warns Employees About Phone Use Amid Ongoing China Hack AT&T says criminals stole phone records of 'nearly all' customers in new data breach National Public Data confirms breach exposing Social Security numbers Schools Want to Ban Phones. Parents Say No. New York passes legislation that would ban 'addictive' social media algorithms for kids GPT-4o (omni) + new "Her"-style AI assistant (it's nuts) Google emissions jump nearly 50% over five years as AI use surges Trump proposes strategic national crypto stockpile at Bitcoin Conference Ten additional US states join DOJ antitrust lawsuit looking to break up Live Nation and TicketmasterThe Internet Archive just lost its appeal over ebook lending Hezbollah Pagers Explode in Apparent Attack Across Lebanon OpenAI raises $6.6 billion in largest VC round ever Painting by A.I.-Powered Robot Sells for $1.1 Million Netflix's Live Mike Tyson Vs. Jake Paul Fight Battling Sound & Streaming Glitches In Lead-Up To Main Event Infowars Sale to The Onion Rejected by Federal Bankruptcy Judge Supreme Court agrees to hear challenge to TikTok ban So You Want to Solve the NJ Drone Mystery? Our Expert Has Some Ideas Beeper's push for iMessage on Android is really over The Quiet Death of Ello's Big Dreams Japan finally ends mandatory form submission on floppy disks We'll Miss You: Pioneering instant messaging program ICQ is finally shutting down after nearly 30 years Spotify is going to break every Car Thing gadget it ever sold Game Informer to Shut Down After 33 Years In Memoriam Host: Leo Laporte Guests: Fr. Robert Ballecer, SJ, Richard Campbell, and Mikah Sargent Download or subscribe to This Week in Tech at https://twit.tv/shows/this-week-in-tech Get episodes ad-free with Club TWiT at https://twit.tv/clubtwit Sponsor: bitwarden.com/twit
  1. TWiT 1011: The Year in Review – A Look at the Top Stories of 2024
  2. TWiT 1010: The Densest State in the US – TikTok Ban, Drones Over Jersey, GM Quits Robotaxis
  3. TWiT 1009: Andy Giveth & Bill Taketh Away – Trump's Tech Titans, Crypto Boom, TikTok's US Ban, Intel CEO Exits
  4. TWiT 1008: Internet Legal – Australia's Social Media Ban for Kids, Smart Home Nightmare, Bluesky's Ascent
  5. TWiT 1007: All the Hotdogs in the World – China's "Salt Typhoon" Hack, Google on the Chopping Block, Recall AI