Reforming U.S. Healthcare: Even Research Statistics Are Rigged

https://fixushealthcare.blog/2019/04/13/reforming-u-s-healthcare-even-research-statistics-are-rigged/

Slide1

To paraphrase Elizabeth Barrett Browning, How do I rig thee? Let me count the ways.

Even research statistics are all too often rigged, according to a commentary in this month’s Journal of the A.M.A.  These rigged statistics are being applied to clinical studies of new drugs, devices, and treatments to put them just far enough over the line of “significance” to win Food and Drug Administration approval.

And to win big dollar profits for research companies and the researchers themselves – my claim, not the Journal’s.

This goes beyond what Mark Twain called “lies, damned lies, and statistics.” Twain was referring to “spinning” legitimate statistics to show results in a favorable light.

But Stanford’s John P. A. Ioannidis MD, ScD, calls out statisticians-for-hire for actually cherry-picking, distorting, and manipulating post-hoc the statistical analyses themselves in scientific publications, in the service of Big Pharma.

Ioannidis’s Observations

Here are some of his observations:

  • Some policy makers have an exaggerated sense of certainty about research results based simply of a P-value less than 0.05 (P-value is a statistical construct that estimates the probability that an observed difference between the study group and control group is a true difference rather than a coincidental difference caused by random factors alone.)
  • Some policy makers hype results based on statistical differences that are technically correct but weak at best
  • Some policy makers focus on “statistical significance” only and fail to consider “clinical significance” as well as other practical considerations when interpreting study results
  • “Some fields that claim to work with large, actionable effects (eg, nutritional epidemiology) may simply have larger, uncontrolled biases.” That is, just because a study appears to have a robust statistical effect does not mean the conclusion is iron-clad. An observed difference might have another hidden explanation that contradicts the study conclusion.
  • “Absent pre-specified rules, most research designs and analyses have enough leeway to manipulate the data and hack the results to claim important signals.”
  • “Studies have shown that unless an analysis is prespecified, analytical choice (eg, different adjustments for covariates in nonrandomized studies) may allow obtaining a wide range of results.”
  • “In a recent survey completed by 390 consulting statisticians, a large percentage perceived that they had received inappropriate requests from investigators to analyze data in ways that obtain desirable results.”
  • “Passing the threshold of “statistical significance” … such as P < .05 is typically too easy…”
  • “Clinical, monetary, and other considerations may often have more importance than statistical findings.”

Ioannidis’s Solution

Dr. Ioannidis’s offers a solution to keep honest statisticians honest:  Require researchers to post in advance, such as at ClinicalTrials.gov, not only the overall research design but also detailed descriptions of

  • numbers of subjects to be studied (since cohort size affects the “power” of the statistical analysis)
  • which statistical methodologies will be used
  • advance definition of subgroups designated for separate analysis
  • specification of the threshold for statistical significance (choice of P value)
  • criteria for altering statistical methods in the face of unexpected problems occurring during the course of a study
  • plans to post raw data for all to see and analyze.

Comment:

Prestigious medical journals could adopt Ioannidis’s solutions without waiting for comprehensive reform of the whole health system. But the Journal’s surfacing of issues around abuse of research statistics illustrates the extent to which that system has fallen under the pall of profits, the depth to which the system has been rigged, and the degree to which Hippocratically-pledged professionals have been coopted. And this means that the full weight of our society, government and nation will be needed to fix it.

Take Action

Now, take action.

 

 

 

ELITE HOSPITALS PLUNGE INTO UNPROVEN STEM CELL TREATMENTS

https://www.healthleadersmedia.com/clinical-care/elite-hospitals-plunge-unproven-stem-cell-treatments?utm_source=silverpop&utm_medium=email&utm_campaign=ENL_190402_LDR_BRIEFING%20(1)&spMailingID=15395736&spUserID=MTY3ODg4NTg1MzQ4S0&spJobID=1620119090&spReportId=MTYyMDExOTA5MAS2

Hospitals say they’re providing options to patients who have exhausted standard treatments. But critics suggest the hospitals are exploiting desperate patients and profiting from trendy but unproven treatments.

The online video seems to promise everything an arthritis patient could want.

The six-minute segment mimics a morning talk show, using a polished TV host to interview guests around a coffee table. Dr. Adam Pourcho extols the benefits of stem cells and “regenerative medicine” for healing joints without surgery. Pourcho, a sports medicine specialist, says he has used platelet injections to treat his own knee pain, as well as a tendon injury in his elbow. Extending his arm, he says, “It’s completely healed.”

Brendan Hyland, a gym teacher and track coach, describes withstanding intense heel pain for 18 months before seeing Pourcho. Four months after the injections, he says, he was pain-free and has since gone on a 40-mile hike.

“I don’t have any pain that stops me from doing anything I want,” Hyland says.

The video’s cheerleading tone mimics the infomercials used to promote stem cell clinics, several of which have recently gotten into hot water with federal regulators, said Dr. Paul Knoepfler, a professor of cell biology and human anatomy at the University of California-Davis School of Medicine. But the marketing video wasn’t filmed by a little-known operator.

It was sponsored by Swedish Medical Center, the largest nonprofit health provider in the Seattle area.

Swedish is one of a growing number of respected hospitals and health systems — including the Mayo Clinic, the Cleveland Clinicand the University of Miami — that have entered the lucrative business of stem cells and related therapies, including platelet injections. Typical treatments involve injecting patients’ joints with their own fat or bone marrow cells, or with extracts of platelets, the cell fragments known for their role in clotting blood. Many patients seek out regenerative medicine to stave off surgery, even though the evidence supporting these experimental therapies is thin at best, Knoepfler said.

Hospitals say they’re providing options to patients who have exhausted standard treatments. But critics suggest the hospitals are exploiting desperate patients and profiting from trendy but unproven treatments.

The Food and Drug Administration is attempting to shut down clinics that hawk unapproved stem cell therapies, which have been linked to several cases of blindness and at least 12 serious infections. Although doctors usually need preapproval to treat patients with human cells, the FDA has carved out a handful of exceptions, as long as the cells meet certain criteria, said Barbara Binzak Blumenfeld, an attorney who specializes in food and drug law at Buchanan Ingersoll & Rooney in Washington.

Hospitals like Mayo are careful to follow these criteria, to avoid running afoul of the FDA, said Dr. Shane Shapiro, program director for the Regenerative Medicine Therapeutics Suites at Mayo Clinic’s campus in Florida.

‘EXPENSIVE PLACEBOS’

While hospital-based stem cell treatments may be legal, there’s no strong evidence they work, said Leigh Turner, an associate professor at the University of Minnesota’s Center for Bioethics who has published a series of articles describing the size and dynamics of the stem cell market.

“FDA approval isn’t needed and physicians can claim they aren’t violating federal regulations,” Turner said. “But just because something is legal doesn’t make it ethical.”

For doctors and hospitals, stem cells are easy money, Turner said. Patients typically pay more than $700 a treatment for platelets and up to $5,000 for fat and bone marrow injections. As a bonus, doctors don’t have to wrangle with insurance companies, which view the procedures as experimental and largely don’t cover them.

“It’s an out-of-pocket, cash-on-the-barrel economy,” Turner said. Across the country, “clinicians at elite medical facilities are lining their pockets by providing expensive placebos.”

Some patient advocates worry that hospitals are more interested in capturing a slice of the stem-cell market than in proving their treatments actually work.

“It’s lucrative. It’s easy to do. All these reputable institutions, they don’t want to miss out on the business,” said Dr. James Rickert, president of the Society for Patient Centered Orthopedics, which advocates for high-quality care. “It preys on people’s desperation.”

In a joint statement, Pourcho and Swedish defended the online video.

“The terminology was kept simple and with analogies that the lay person would understand,” according to the statement. “As with any treatment that we provide, we encourage patients to research and consider all potential treatment options before deciding on what is best for them.”

But Knoepfler said the guests on the video make several “unbelievable” claims.

At one point, Dr. Pourcho says that platelets release growth factorsthat tell the brain which types of stem cells to send to the site of an injury. According to Pourcho, these instructions make sure that tissues are repaired with the appropriate type of cell, and “so you don’t get, say, eyeball in your hand.”

Knoepfler, who has studied stem cell biology for two decades, said he has never heard of “any possibility of growing eyeball or other random tissues in your hand.” Knoepfler, who wrote about the video in February on his blog, The Niche, said, “There’s no way that the adult brain could send that kind of stem cells anywhere in the body.”

The marketing video debuted in July on KING-TV, a Seattle station, as part of a local lifestyles show called “New Day Northwest.” Although much of the show is produced by the KING 5 news team, some segments — like Pourcho’s interview — are sponsored by local advertisers, said Jim Rose, president and general manager of KING 5 Media Group.

After being contacted by KHN, Rose asked Swedish to remove the video from YouTube because it wasn’t labeled as sponsored content. Omitting that label could allow the video to be confused with news programming. The video now appears only on the KING-TV website, where Swedish is labeled as the sponsor.

“The goal is to clearly inform viewers of paid content so they can distinguish editorial and news content from paid material,” Rose said. “We value the public’s trust.”

INCREASING SCRUTINY

Federal authorities have recently begun cracking down on doctors who make unproven claims or sell unapproved stem cell products.

In October, the Federal Trade Commission fined stem cell clinics millions of dollars for deceptive advertising, noting that the companies claimed to be able to treat or cure autism, Parkinson’s disease and other serious diseases.

In a recent interview Scott Gottlieb, the FDA commissioner, said the agency will continue to go after what he called “bad actors.”

With more than 700 stem cell clinics in operation, the FDA is first targeting those posing the biggest threat, such as doctors who inject stem cells directly into the eye or brain.

“There are clearly bad actors who are well over the line and who are creating significant risks for patients,” Gottlieb said.

Gottlieb, set to leave office April 5, said he’s also concerned about the financial exploitation of patients in pain.

“There’s economic harm here, where products are being promoted that aren’t providing any proven benefits and where patients are paying out-of-pocket,” Gottlieb said.

Dr. Peter Marks, director of the FDA’s Center for Biologics Evaluation and Research, said there is a broad “spectrum” of stem cell providers, ranging from university scientists leading rigorous clinical trials to doctors who promise stem cells are “for just about anything.” Hospitals operate somewhere in the middle, Marks said.

“The good news is that they’re somewhat closer to the most rigorous academics,” he said.

The Mayo Clinic’s regenerative medicine program, for example, focuses conditions such as arthritis, where injections pose few serious risks, even if that’s not yet the standard of care, Shapiro said.

Rickert said it’s easy to see why hospitals are eager to get in the game.

The market for arthritis treatment is huge and growing. At least 30 million Americans have the most common form of arthritis, with diagnoses expected to soar as the population ages. Platelet injections for arthritis generated more than $93 million in revenue in 2015, according to an article last year in The Journal of Knee Surgery.

“We have patients in our offices demanding these treatments,” Shapiro said. “If they don’t get them from us, they will get them somewhere else.”

Doctors at the Mayo Clinic try to provide stem cell treatments and similar therapies responsibly, Shapiro said. In a paper published this year, Shapiro described the hospital’s consultation service, in which doctors explain patients’ options and clear up misconceptions about what stem cells and other injections can do. Doctors can refer patients to treatment or clinical trials.

“Most of the patients do not get a regenerative [stem cell] procedure,” Shapiro said. “They don’t get it because after we have a frank conversation, they decide, ‘Maybe it’s not for me.'”

LOTS OF HYPE, LITTLE PROOF

Although some hospitals boast of high success rates for their stem cell procedures, published research often paints a different story.

The Mayo Clinic website says that 40 to 70% of patients “find some level of pain relief.” Atlanta-based Emory Healthcare claims that 75 to 80% of patients “have had significant pain relief and improved function.” In the Swedish video, Pourcho claims “we can treat really any tendon or any joint” with PRP.

The strongest evidence for PRP is in pain relief for arthritic knees and tennis elbow, where it appears to be safe and perhaps helpful, said Dr. Nicolas Piuzzi, an orthopedic surgeon at the Cleveland Clinic.

But PRP hasn’t been proven to help every part of the body, he said.

PRP has been linked to serious complications when injected to treat patellar tendinitis, an injury to the tendon connecting the kneecap to the shinbone. In a 2013 paper, researchers described the cases of three patients whose pain got dramatically worse after PRP injections. One patient lost bone and underwent surgery to repair the damage.

“People will say, ‘If you inject PRP, you will return to sports faster,'” said Dr. Freddie Fu, chairman of orthopedic surgery at the University of Pittsburgh Medical Center. “But that hasn’t been proven.”

2017 study of PRP found it relieved knee pain slightly better than injections of hyaluronic acid. But that’s nothing to brag about, Rickert said, given that hyaluronic acid therapy doesn’t work, either. While some PRP studies have shown more positive results, Rickert notes that most were so small or poorly designed that their results aren’t reliable.

In its 2013 guidelines for knee arthritis, the American Academy of Orthopaedic Surgeons said it is “unable to recommend for or against” PRP.

“PRP is sort of a ‘buyer beware’ situation,” said Dr. William Li, president and CEO of the Angiogenesis Foundation, whose research focuses on blood vessel formation. “It’s the poor man’s approach to biotechnology.”

Tests of other stem cell injections also have failed to live up to expectations.

Shapiro published a rigorously designed study last year in Cartilage, a medical journal, that found bone marrow injections were no better at relieving knee pain than saltwater injections. Rickert noted that patients who are in pain often get relief from placebos. The more invasive the procedure, the stronger the placebo effect, he said, perhaps because patients become invested in the idea that an intervention will really help. Even saltwater injections help 70% of patients, Fu said.

A 2016 review in the Journal of Bone and Joint Surgery concluded that “the value and effective use of cell therapy in orthopaedics remain unclear.” The following year, a review in the British Journal of Sports Medicine concluded, “We do not recommend stem cell therapy” for knee arthritis.

Shapiro said hospitals and health plans are right to be cautious.

“The insurance companies don’t pay for fat grafting or bone-marrow aspiration, and rightly so,” Shapiro said. “That’s because we don’t have enough evidence.”

Rickert, an orthopedist in Bedford, Ind., said fat, bone marrow and platelet injections should be offered only through clinical trials, which carefully evaluate experimental treatments. Patients shouldn’t be charged for these services until they’ve been tested and shown to work.

Orthopedists — surgeons who specialize in bones and muscles — have a history of performing unproven procedures, including spinal fusion, surgery for rotator cuff disease and arthroscopy for worn-out knees, Turner said. Recently, studies have shown them to be no more effective than placebos.

MISLEADING MARKETING

Some argue that joint injections shouldn’t be marketed as stem cell treatments at all.

Piuzzi said he prefers to call the injections “orthobiologics,”noting that platelets are not even cells, let alone stem cells. The number of stem cells in fat and bone marrow injections is extremely small, he said. In fat tissue, only about 1 in 2,000 cells is a stem cell, according to a March paper in The Bone & Joint Journal. Stem cells are even rarer in bone marrow, where 1 in 10,000 to 20,000 cells is a stem cell.

Patients are attracted to regenerative medicine because they assume it will regrow their lost cartilage, Piuzzi said. There’s no solid evidence that the commercial injections used today spur tissue growth, Piuzzi said. Although doctors hope that platelets will release anti-inflammatory substances, which could theoretically help calm an inflamed joint, they don’t know why some patients who receive platelet injections feel better, but others don’t.

So, it comes as no surprise that many patients have trouble sorting through the hype.

Florida resident Kathy Walsh, 61, said she wasted nearly $10,000 on stem cell and platelet injections at a Miami clinic, hoping to avoid knee replacement surgery.

When Walsh heard about a doctor in Miami claiming to regenerate knee cartilage with stem cells, “it seemed like an answer to a prayer,” said Walsh, of Stuart, Fla. “You’re so much in pain and so frustrated that you cling to every bit of hope you can get, even if it does cost you a lot of money.”

The injections eased her pain for only a few months. Eventually, she had both knees replaced. She has been nearly pain-free ever since. “My only regret,” she said, “is that I wasted so much time and money.”

 

 

 

Healthcare Triage: Money Isn’t the Only Thing That Can Bias Research

Healthcare Triage: Money Isn’t the Only Thing That Can Bias Research

Image result for Healthcare Triage: Money Isn’t the Only Thing That Can Bias Research

Recent news articles have brought renewed attention to financial conflicts of interest in medical science but that should not lead us to ignore other conflicts that may be equally or even more important. Career advancement and reputation are real things that can drive people to make surprising choices in research and publication.

This episode was adapted from a column I wrote for the Upshot. Links to sources can be found there.

 

 

 

 

Gene therapy having big sickle-cell disease results

Image result for These Patients Had Sickle-Cell Disease. Experimental Therapies Might Have Cured Them.

Success against sickle-cell would be “the first genetic cure of a common genetic disease” and could free tens of thousands of Americans from agonizing pain.

Researchers are trying to address sickle-cell disease at the genetic level, and it’s having drastic results so far among the patients participating in clinical trials, the New York Times reports.

  • The experimental gene therapy treatments are still in their early stages, and it could be at least 3 years before one is approved. But a handful of the enrollees no longer show signs of the disease.
  • Currently, the only way to treat those with sickle-cell is through a bone marrow transplant, which is dangerous, expensive and uncommon.

The bottom line: This would be the first genetic cure of a common genetic disease,” Dr. Edward Benz, a professor at Harvard Medical School, told the NYT.

Congratulations on the Promotion. But Did Science Get a Demotion?

Congratulations on the Promotion. But Did Science Get a Demotion?

Image result for conflicts of interest

number of recent news articles have brought renewed attention to financial conflicts of interest in medical science. Physicians and medical administrators had financial links to companies that went undeclared to medical journals even when they were writing on topics in which they clearly had monetary interests.

Most agree such lapses damage the medical and scientific community. But our focus on financial conflicts of interest should not lead us to ignore other conflicts that may be equally or even more important. Such biases need not be explicit, like fraud.

“I believe a more worrisome source of research bias derives from the researchers seeking to fund and publish their work, and advance their academic careers,” said Dr. Jeffrey Flier, a former dean of Harvard Medical School who has written on this topic a number of times.

How might grant funding and career advancement — even the potential for fame — be biasing researchers? How might the desire to protect reputations affect the willingness to accept new information that reverses prior findings?

I’m a full professor at Indiana University School of Medicine. Perhaps the main reason I’ve been promoted to that rank is that I’ve been productive in obtaining large federal grants. Successfully completing each project, then getting that research published in high-profile journals, is what allows me to continue to get more funding.

A National Institutes of Health regulation sets a “significant financial interest” as any amount over $5,000. It’s not hard to imagine that being given thousands of dollars could influence your thinking about research or medicine. But let’s put things in perspective. Many scientists have been awarded millions of dollars in grant funding. This is incredibly valuable not only to them but also to their employers. Journals and grant funders like to see eye-catching work. It would be silly not to think that this might also subtly influence thinking and actions. In my own work, I do my best to remain conscious of these subtle forces and how they may operate, but it’s a continuing battle.

Getting positive results, or successfully completing projects, can sometimes feel like the only way to achieve success in research careers. Just as those drivers can lead people to publish those results, it can also nudge them not to publish null ones.

As a pediatrician, I’ve been acutely aware of concerns that relationships between formula companies and the American Academy of Pediatrics might be influencing policies on feeding infants. But biases can occur even without direct financial contributions.

If an organization has spent decades recommending low-fat diets, it can be hard for that group to acknowledge the potential benefits of a low-carb diet (and vice versa). If a group has been pushing for very low-sodium diets for years, it can be hard for it to acknowledge that this might have been a waste of time, or even worse, bad advice.

 

 

Protein Engineering May Be the Future of Science

https://www.bloomberg.com/view/articles/2018-03-27/protein-engineering-may-be-the-future-of-science

Some scientists think designing new proteins could become as significant as tweaking DNA.

Scientists are increasingly betting their time and effort that the way to control the world is through proteins. Proteins are what makes life animated. They take information encoded in DNA and turn it into intricate three-dimensional structures, many of which act as tiny machines. Proteins work to ferry oxygen through the bloodstream, extract energy from food, fire neurons, and attack invaders. One can think of DNA as working in the service of the proteins, carrying the information on how, when and in what quantities to make them.

Living things make thousands of different proteins, but soon there could be many more, as scientists are starting to learn to design new ones from scratch with specific purposes in mind. Some are looking to design new proteins for drugs and vaccines, while others are seeking cleaner catalysts for the chemical industry and new materials.

David Baker, director for the Institute for Protein Design at the University of Washington, compares protein design to the advent of custom tool-making. At some point, proto-humans went beyond merely finding uses for pieces of wood, rock or bone, and started designing tools to suit specific needs — from screwdrivers to sports cars.

Now it’s possible to make a similar transition on a molecular scale, since scientists can create proteins with structures that nature never produced. “They can transcend the natural protein universe,” said William DeGrado, a chemist at the University of California, San Francisco.

People have been talking about protein engineering for decades. But until the last couple of years, carrying it out was a dauntingly complex problem. There are no simple rules to predict how proteins fold into their various three-dimensional structures. So even if you could design a protein with just the right shape for some job, there would be no obvious way to know how make it from protein’s building blocks, the amino acids.

But over many years, scientists have been chipping away at the problem, DeGrado said. Unlike in other more widely publicized fields, there haven’t been any celebrated milestones (such as the completion of the $3 billion human genome project). Nor have there been any single, surprise breakthroughs such as CRISPR -– a component of yogurt bacteria that revolutionized the ability to manipulate genes. But now some scientists think designing proteins will become at least as important as manipulating DNA has been in the past couple of decades.

What’s recently changed is the ability to decipher the complex language of protein shapes. There’s a very simple way that the linear chemical code carried by strands of DNA translates into strings of amino acids in proteins. But then the laws of physics come into play. The proteins snap into folded structures because amino acids are attracted or repelled by others many places down the chain.

University of Washington’s Baker said that when he was starting his career some 30 years ago, senior scientists tried to steer him away from protein engineering because there was no guarantee he would make any appreciable progress in his lifetime. But he said he liked the challenge and the interdisciplinary nature of the quest, which combined computer science, biology, chemistry and physics.

Since then, scientists have advanced their understanding of the physics of proteins, and computing power has increased. Baker started a translation system called Rosetta, but — realizing that he was running out of computer power at his university — he engaged citizens to lend their computers in a project called Rosetta@home.

Baker and colleagues then devised a sort of game called Foldit, in which citizen scientists could try figure out how certain proteins would fold. They eventually enlisted the help of more than a million people, he told me. That won them the ability to predict how smaller proteins would fold, but larger ones were still too complex. According to a news feature in the magazine Science, they got a boost from scientists studying how evolution has led to the proteins we already have. Most genetic mutations that affect the structure of proteins will lead to something that doesn’t work, and the death of whatever inherited it. But certain combinations of different mutations will lead to a modified version of the same thing, allowing new proteins to evolve.

And finally, their biological Rosetta stone is working. UCSF’s DeGrado said his lab is looking at how to create new medicines with better stability — on the shelf and in the body. He’s also studying Alzheimer’s disease and similar neurological conditions, which are characterized by brain proteins that fold up incorrectly into toxic deposits.

Baker’s lab is working on an equally diverse set of applications, including a vaccine that would simultaneously protect against all strains of the influenza virus, and a system to break down the common grain protein gluten, in the hope of helping people with celiac disease. Others are looking for proteins that help convert solar energy to fuel. Baker pointed out that there are 20 to the 200th possible proteins — which is more than the number of atoms in the universe. Evolution has produced just a minute fraction. So there’s plenty of room to expand.

Top 6 Books Health Execs Should Read in 2018

http://managedhealthcareexecutive.modernmedicine.com/managed-healthcare-executive/news/top-6-books-health-execs-should-read-2018?cfcache=true&rememberme=1&elq_mid=394&elq_cid=876742&GUID=A13E56ED-9529-4BD1-98E9-318F5373C18F

 

 

 

 

 

 

Cancer vaccine made from stem cells could open another door in immunotherapy

Cancer vaccine made from stem cells could open another door in immunotherapy

With a special type of stem cell that can be spun from skin or blood, researchers have developed a vaccine that helped stave off cancer in mice, opening up another branch in the booming field of immunotherapy.

Cancer cells and stem cells share some of the same molecules on their surfaces. In the new research, which was described Thursday in the journal Cell Stem Cell, scientists injected mice with their own stem cells, essentially training their immune systems to launch attacks when they identified those molecules — called antigens — elsewhere, including on cancer cells.