AI language models open a potential Pandora’s box of medical research fraud

AI language models open a potential Pandora’s box of medical research fraud
Credit: Unsplash/CC0 Public Domain

Medical student and researcher Faisal Elali of the State University of New York Downstate Health Sciences University and medical scribe and researcher Leena Rachid from the New York-Presbyterian/Weill Cornell Medical Center wanted to see if artificial intelligence could write a fabricated research paper and then investigate how best to detect it.

Artificial intelligence is an increasingly valuable and vital part of scientific research. It is used as a tool to analyze complicated data sets, but it is never used to generate the actual paper for publication. AI-generated research papers, on the other hand, can look convincing even when based on an entirely fabricated study. But exactly how convincing?

In a paper published in the open-access journal Patterns, the research duo demonstrated the feasibility of fabricating a research paper using ChatGPT, an AI-based language model. Simply by asking, they were able to have ChatGPT produce a number of well-written, entirely made-up abstracts. A hypothetical fraudster could then submit these fake abstracts to multiple journals seeking publication. If accepted, the same process could be used to write an entire study with false data, nonexistent participants and meaningless results. However, it could appear legitimate, especially if the subject is particularly abstract or not screened by an expert in the specific field.

In a previous experiment cited in the current paper, humans were given both human-created and AI-generated abstracts to consider. In that experiment, humans incorrectly identified 32{bf0515afdcaddba073662ceb89fbb62b6b1bf123143c0e06b788e1946e8c353f} of the AI-generated research abstracts as real and 14{bf0515afdcaddba073662ceb89fbb62b6b1bf123143c0e06b788e1946e8c353f} of the human-written abstracts as fake.

The current research team decided to test their ChatGPT fabricated study against three online AI detectors. The texts were overwhelmingly identified as AI-generated, suggesting the adoption of AI detection tools by journals could be a successful diverter of fraudulent applications. However, when they took the same text and ran it through a free, online, AI-powered rephrasing tool first—the consensus unanimously flipped to “likely human,” suggesting we need better AI detection tools.

Actual science is hard work, and communicating the details of that work is a crucial aspect of science requiring substantial effort. But any mostly hairless ape can string sensible sounding words together given enough time and coffee—as the writer of this article can firmly attest. Creating a fake study with enough detail to seem credible would take tremendous effort, requiring hours of researching how best to sound believable, and might be too tedious a task for someone interested in malicious mischief. With AI completing the task in minutes, that mischief could become an entirely achievable objective. As the researchers point out in their paper, that mischief could have terrible consequences.

They give an example of a legitimate study that supports the use of drug A over drug B for treating a medical condition. Now, suppose a fabricated study makes the opposite claim and is not detected (as a side note, even if it is detected, clawing back citations and reprints of retracted studies is notoriously difficult). It could impact subsequent meta-analyses and systematic reviews of these studies—studies that guide health care policies, standards of care and clinical recommendations.

Beyond the simple mischief motive, the authors of the paper point to the pressure on medical professionals to quickly produce a high volume of publications to gain research funding or entry into higher career positions. In part, they point out that the United States Medical Licensing Examination recently switched from a graded exam to a pass/fail model, meaning ambitious students rely more heavily on published research to distinguish them from the pack. This raises the stakes for a trustworthy AI detection system to remove potentially fraudulent medical research that could pollute the publishing environment—or worse still, practitioners who submit fraudulent papers from practicing on patients.

The goal of AI language models has long been to produce texts that are indistinguishable from human text. That we need AI that can detect when a human is using AI to produce fraudulent work indistinguishable from reality should not come as a surprise. What might be surprising is just that we may need it so soon.

More information:
Faisal R. Elali et al, AI-generated research paper fabrication and plagiarism in the scientific community, Patterns (2023). DOI: 10.1016/j.patter.2023.100706

© 2023 Science X Network

Citation:
AI language models open a potential Pandora’s box of medical research fraud (2023, March 14)
retrieved 14 March 2023
from https://medicalxpress.com/news/2023-03-ai-language-potential-pandora-medical.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Health care organization plans to convert former hotel in Seaside into housing

Oregon’s largest Medicaid provider, CareOregon, announced this week that it has purchased an old Red Lion Inn in Seaside for $8 million.

The hotel will be turned into housing for two different populations: there will be units for people with behavioral health needs and workforce housing for health care professionals.

Health care organization plans to convert former hotel in Seaside into housing

CareOregon, the state’s largest Medicaid provider, has purchased a former Red Lion Hotel in Seaside with the goal of turning it into both workforce housing and permanent supportive housing for people with behavioral health needs.

care of CareOr

CareOregon’s Columbia Pacific Coordinated Care Organization will run the building in partnership with Clatsop Behavioral Health.

“There’s no question about that and the shortage of housing on the North Coast is acute,” said Mimi Haley, executive director of Columbia Pacific CCO. “Being able to solve the housing shortage issue by adding these 50 or 60 new apartments is a big deal.”

Clatsop County has the highest per capita homelessness rate in the state, and Haley pointed out that finding housing for this population could also improve their health outcomes.

“People who are unhappily housed have much higher rates of hospitalizations for situations that could have been handled in primary care,” said Haley. “They have much lower rates of engagement with the primary care system. They will often pass away at a much younger age, and they often have mental illnesses or substance use disorders that can’t be really addressed without stable housing.”

The facility will be staffed by people who have lived experience with homelessness or behavioral health issues 16 hours a day, seven days a week. There will also be a live-in resident manager who’s there 24/7.

Forty of the hotel rooms will be converted into permanent supportive housing for people with behavioral health needs, such as treatment for substance use disorder. The remaining 20 units will be turned into housing for another population that has had difficulty finding housing on the coast: healthcare professionals.

Amy Baker, the executive director of Clatsop Behavioral Health, says the agency has lost multiple employees who were unable to find housing.

“We actually rented a cottage so that we could relocate folks into that cottage while they tried to find more permanent housing,” said Baker. “Unfortunately, that one cottage isn’t even nearly enough.”

Haley hopes these units begin to address some of the challenges providers across Clatsop County have been experiencing with recruitment and retention.

“We know from our partners that they cannot recruit the providers that they need,” she said.. “We hear it all the time from all of our partners across all provider levels and types.”

The old hotel should start getting a makeover sometime this year, and Haley hopes it will be ready to open in spring of next year.

“The piece that gives me hope and faith is that you go into this work because you care about people,” said Baker, “and ultimately having a place for somebody to live, it’s just a good thing.”

Texas fitness influencer Brittany Dawn accused of scamming clients vows to ‘fight back’

A Texas social media influencer accused of scamming clients who purchased her online fitness and nutrition program is now facing trial in Dallas, and she says she’s ready to “fight back.”

Brittany Dawn Davis, a fitness influencer and owner of Brittany Dawn Fitness LLC who has since adopted a more faith-based approach to her social media presence, is accused of misleading clients who signed up to receive her customized fitness and nutrition packages.

“[M]y time to fight back is here,” Davis, who now goes by Brittany Dawn Nelson on her social media pages, wrote in a Monday Instagram post. “…[J]ust over 4 years. [T]hat’s how long I’ve remained composed, silent and have patiently waited on the Lord. 35,856 hours of my life that I have wept with reverence for Him as I kept hearing ‘do not speak up yet’ as I sat wayside while strangers on the internet slandered, harassed, defamed, stalked, and destroyed my reputation.”

Davis added that though she has “remained silent” while social media users “invent narratives” about her and “come after” her home, family and life, “they have no idea who they’re messing with.”

FITNESS INFLUENCER UNDER FIRE FOR ALLEGEDLY SCAMMING CLIENTS

Texas fitness influencer Brittany Dawn accused of scamming clients vows to ‘fight back’

Brittany Dawn Davis is a former fitness influencer facing trial for allegedly scamming clients who purchased her online fitness and nutrition program.

“[T]here is a fire building within my heart – like a lion roaring on the inside of me,” she wrote. “[I]f you think you’ll never be found behind an anonymous account and be held accountable for damages, threats, defamation, and slander… think again. Christians might be gentle, but we are not soft.”

READ ON THE FOX NEWS APP

The lawsuit filed against Davis and her fitness company alleges Davis did not deliver on the personalized fitness packages, coaching and check-ins that she promised those who purchased one of her plans.

BODY POSITIVITY MOVEMENT REJECTED BY HEALTH INFLUENCER ON WEIGHT LOSS JOURNEY: ‘MORBID OBESITY IS NOT HEALTHY’

“Beginning in 2014, Defendants profited from the sale of online fitness packages to thousands of consumers with the promise of personalized nutritional guidance and individualized fitness coaching. Specifically, Defendants’ online fitness packages offered ‘macro’ nutritional assessments and, depending on the plan purchased, daily or weekly email training and one-on-one coaching. Defendants’ online nutrition and fitness packages ranged from $92.00 for onetime macro consultation to $300.00 for three-months of personalized macros, trainings, and coaching,” the complaint against Davis states.

Brittany Dawn Davis

The lawsuit filed against Davis and her fitness company alleges Brittany Dawn Davis did not deliver on the personalized fitness packages, coaching and check-ins that she promised those who purchased one of her plans.

But the packages for clients “were not individualized,” plaintiffs allege, and Dawn “failed to provide the promised coaching and check-ins” to her clients.

BEWARE OF RISE IN SHORT-TERM VACATION RENTAL SCAMS

“Defendants largely ignored consumer complaints or, if they did respond, offered only partial refunds. In 2019, consumers’ complaints on social media garnered media attention prompting Defendant Davis to make video apology posted to YouTube. Defendants promptly took the website down,” the lawsuit says.

Brittany Dawn court filings

Court filings in the case further state that “the vast majority” of more than $1.5 million deposits to Brittany Dawn Davis’ PayPayl account “derived from consumer payments through Defendants’ website.”

Court filings in the case further state that “the vast majority” of more than $1.5 million deposits to Davis’ PayPayl account “derived from consumer payments through Defendants’ website,” but her legal team has apparently only handed over receipts for a total of $169,000 in payments. The state is arguing that they left thousands of clients out of their discovery.

Davis allegedly posted an apology video and then deleted it, according to prosecutors.

Brittany Dawn Davis

Brittany Dawn Davis has embarked on a new entrepreneurial journey as the founder of She Lives Freed – a team of 14 women who organize women’s faith retreats that cost $600 per person.

Her trial was scheduled to begin on March 6 but was postponed indefinitely.

Meanwhile, Davis has embarked on a new entrepreneurial journey as the founder of She Lives Freed – a team of 14 women who organize women’s faith retreats that cost $600 per person.

“She Lives Freed was founded by Brittany Dawn after the Lord radically changed her life in 2019, from darkness to light. Her mission is to share the gospel of Jesus, cultivate a community of sisters, and walk alongside women into freedom through the love of our Savior,” the She Lives Freed website states.

The first women’s retreat took place in Austin in January 2021. Since then, the organization has hosted five more retreats, with the next taking place in Oklahoma, according to the website.

Neuralink competitor launches platform to accelerate medical innovation

A Science employee at work in the lab.

Courtesy: Science Corporation

Biotechnology startup and Neuralink competitor Science on Monday launched a new platform that aims to make it easier for other companies to quickly develop and produce medical devices. 

The platform, called Science Foundry, allows companies to utilize and build upon Science’s internal infrastructure by offering access to more than 80 of its tools and services, like the company’s thin-film electrode technologies.

related investing news

Neuralink competitor launches platform to accelerate medical innovation

CNBC Pro

The cost of the technology required to develop medical devices is often “prohibitive” for early-stage startups, Science Co-Founder and CEO Max Hodak told CNBC in an interview. Individual tools can cost anywhere from $200,000 to $2 million, and Hodak said companies could easily spend hundreds of millions building a manufacturing line. 

For many startups, that cost is too much to bear, but Hodak is hoping Science Foundry can help.

“Hopefully, we bring down the barriers to innovation,” Hodak said. “There’s a bunch of smart people out there that have a bunch of different ideas than the ones that we have, and we would like to enable them.” 

Science is part of the growing brain-computer interface, or BCI, industry. A BCI is a system that deciphers brain signals and translates them into commands for external technologies. Perhaps the best-known name in the space is Neuralink, thanks to the high profile of founder Elon Musk, who is also the CEO of Tesla, SpaceX and Twitter.

Hodak co-founded Neuralink and served as the company’s president until he announced his departure in 2021. At Neuralink, Hodak helped develop a BCI system that is designed to be implanted directly into the brain, but at Science, he is working on an implant that doesn’t directly touch the brain at all.

Science’s flagship BCI system is the Science Eye– a visual prosthesis that aims to help patients with two forms of serious blindness restore some visual input to their brains. 

The Science Eye relies on a thin, flexible micro-LED array that is surgically implanted over the retina. The implant controls a group of light-sensitive cells in the optic nerve that Science alters through a form of optogenetic gene therapy. When one pixel is turned on in the array, a cell is turned on in the optic nerve, which can be used to drive the nerve and send vision into the brain. 

Science’s implant is powered by special glasses that are outfitted with tiny sensors and cameras. The LED array translates the images it receives from the glasses and sends them up to the optic nerve. 

Hodak said the resulting images will look different than what people with healthy eyes are used to – at least for the first iteration of the technology – but that it will be very restorative for patients with no light sensitivity. Eventually, he said thinks Science will be able to reproduce high-resolution color vision. 

Science has been testing the technology in rabbits, and Hodak said the company hopes to eventually conduct trials with human patients as soon as next year.

The company’s new platform Science Foundry aims to support companies working on similarly ambitious ideas. Hodak said he expects to see demand from other neurotechnology companies, but that other medical technology startups and even quantum computing companies represent growth opportunities. 

The cost of using Science Foundry is comparable to the cost of working with academic facilities, which are “cheap to get started,” Hodak said. But while academic facilities typically do not allow companies to test devices on patients or sell them on the market, Hodak said it will be easier for Science Foundry customers to commercialize their products.

Hodak said the platform will benefit Science and the broader industry as a whole.

“This enables us to afford larger-scale and more capabilities that then we can use to enable the community and ourselves even further,” he said. 

No age cap: Two different generations strive for healthy lifestyle in Austin senior living community

AUSTIN (KXAN) — A group of older adults in Austin are proof that there is no age cap when it comes to lifestyle. There is a community in Austin where people in their 70s, and some nearing 100 years of age, are thriving.

If you walk into Brookdale Gaines Ranch, 4409 Gaines Ranch Loop, a community home for older adults, you will find men and women gathering into what looks like an ordinary room. The ringleader of the group is Gail Peterson.

“You get to know people in a different way here than you do at dinner or, you know, other places,” Peterson said.

She rallies the troops and walks with them to their workout class.

“The biggest thing that hurts the seniors, is them falling and breaking their hip or getting a bruise that basically debilitates them, and then they can’t live their life,” Ross Tschirn said, co-owner of Gratitism.

The Centers for Disease Control and Prevention said falls are the leading cause of injury-related deaths among people age 65 and older.

Peterson, 74, does not want to be part of that statistic. She said she has big plans, and it involves a lot of walking. Peterson’s goal is to strengthen her legs and work on her endurance.

“My children, I have two, Sheila and Dawn. And they kind of kind of gave me a goal. You need to get back into shape where you really can walk better, and have more stamina, and then you can go anywhere with us in the world,” Peterson said. “Kind of a good carrot, don’t you think?”

In the same room a couple of chairs away is her friend Donald Oliver.

“I have been a dancer most of my life. And I’ve taught dancing for many years. And I’m used to moving around and keeping myself limber,” Oliver said.

The 93-year-old is still active today, just as he was before he lost his vision due to macular degeneration, but he did not lose his spirit.

“There is a certain amount of elation after doing those kinds of exercises. And you feel as though you’re a little nimbler and can move a little bit better,” Oliver said.

No age cap: Two different generations strive for healthy lifestyle in Austin senior living community
A group of older adults at Brookdale Gaines Ranch work on their core during their weekly fitness class. (Jose Torres KXAN Photo.)

Oliver’s coach tells KXAN the success of the 93-year-old is his consistent routine: Water, food, movement, sleep and community.

“My focus is on ankle strength, knee strength, hip strength, and then core strength so that the seniors can walk around and feel confident,” Tschirn said.

“This class gives you is confidence,” Peterson agreed. “It’s all about balance here. And if you can’t get stronger, and your legs don’t get stronger than you’re not confident about walking or doing any of those things. And falling is the number one thing that happens here.”

The co-leader of the class, Marcel Rosenberg, a personal trainer, and co-owner of Gratitism. Rosenberg noticed the group is getting stronger in the last couple of months.

“The classes have gotten so easy for them. Now I’m having to, like, throw curveballs so that I, we, can challenge them a little bit more,” Rosenberg said.

“And then when they feel like they can stretch you, and they do,” Peterson said while raising her eyebrow. “Sometimes I give him a wisecrack back. But yes, it’s good for you.”

“They always raise the eyebrow to me always. But they love it. They love a good challenge,” Rosenberg said.

“They catch on!” Tschirn said as he explained his coaching style. “I’m the guy who says just a couple more seconds, and then we’ll go for like, another minute, you know, but I know that they’re capable. And I’m the coach that’s supposed to push.”

Oliver has this advice for anyone who is not feeling the motivation to invest in exercise: “Get up!” he said as he laughed. “Don’t sit in the chair, get up and move!

A recent study found that skipping exercise in favor of sitting can worsen brain function. The study went on to show that even small changes in how much physical activity a person gets each day can affect cognitive abilities.

Secret to higher productivity: How healthy eating can help you reach your goals | Health

In today’s fast-paced world, productivity is often considered the key to success. We all want to accomplish more in less time and achieve our goals efficiently. While there are several factors that can affect productivity, one that is often overlooked is nutrition. A healthy diet is critical for improved productivity. What you eat has a direct impact on your energy levels, focus, and overall productivity. In other words, a healthy diet is not just good for your physical health, but also for your professional success. Choose well-balanced meals that include lean proteins, complex carbohydrates and healthy fats to maximize your productivity. (Also read: Top 10 productivity tips )

Vasundhara Agrawal, diet and lifestyle consultant, Co-Founder of Instahealth.in, shared with HT Lifestyle, the link between nutrition and productivity, and how you can fuel your productivity with a healthy diet.

1. Productivity and blood glucose levels go hand-in-hand

Our bodies convert the majority of the food we consume into glucose. The energy we require for daily activities, such as those related to our brain, is provided by glucose. Therefore, one of the primary reasons we sometimes struggle to concentrate when we are hungry is the low levels of glucose associated with it. According to studies, eating fruits and vegetables throughout the day is extremely beneficial to both the body and the mind. Individuals who consumed fruits and vegetables on a regular basis tended to be more engaged and creative.

2. It helps you stay active both mentally and physically

The nutrients in your food are required to carry out your body’s metabolism, without which your physical and mental health can deteriorate. Omega-3 fatty acids and complex carbohydrates support the brain’s overall functioning, allowing you to focus and think creatively, which are necessary for increased productivity.

3. It boosts productivity by reducing stress

Eating healthy foods helps you reduce stress and focus better. Healthy nutrients improve brain function, making it easier to handle work challenges. According to studies, people who maintain healthy eating habits are less likely to suffer from stress, which results in improved performance.

4. It improves sleep, enhancing productivity

A healthy meal helps you sleep better, allowing you to think more creatively and effectively. Your body has a natural internal clock, and the more you do to align your diet with it, the more you will be able to use your full potential during the day. This is because foods influence your circadian rhythms, which are a natural internal process that regulates your sleep-wake cycle.

Follow more stories on Facebook & Twitter