PHILADELPHIA— Yelp reviews reveal that emergency departments are viewed as being higher quality but lacking in service as compared to urgent care centers, which patients rate the opposite, according to a new study from researchers in the Perelman School of Medicine at the University of Pennsylvania. The study results, published this month in the Annals of Emergency Medicine, provide a unique opportunity for researchers and clinicians to learn from online reviews, which provide a raw narrative from consumers.
“Today’s world is very digital, and it’s very common for consumers to rate a restaurant, hotel or service online, a practice that is spilling over into health care,” said the study’s lead author, Anish Agarwal, MD, a National Clinician Scholars fellow and Emergency Medicine physician at Penn Medicine. “As an emergency department physician, patients often tell me that the internet is the first place they go for information about medical conditions and to research providers. Health systems and clinicians can learn a lot about the communities they treat and how people experience the services they provide by looking to online ratings and reviews.”
In this new study, researchers, with the help of an automated system, analyzed high (five-star) and low (one-star) Yelp reviews for both emergency departments and urgent care centers, two venues that patients can select from when in need of acute care.
Researchers identified key themes in the five-star reviews of emergency departments, including bedside manner, treatment of family members, and access to care on nights and weekends. Urgent care centers were unique in receiving five-star reviews more often for factors including ease of refilling prescriptions and being positively recommended by others.
On the other side, emergency departments received negative remarks for speed of care, while urgent care centers received one-star reviews as a result of poor reception experiences and patients lacking confidence in the care received.
“We are seeing more and more that patients are sharing their experiences online, and they’re looking to social media platforms and online communities to help inform their decision-making,” said Kevin B. Mahoney, executive vice president and chief administrative officer of the University of Pennsylvania Health System. “Within these review and rating websites lies a trove of decision-making data that we can and should be culling through to help inform how care is delivered, and what matters most to our patients in emergency situations.”
Urgent care centers have proliferated widely across the country in the past 15 years. Between 2007 and 2016, visits increased by more than 1,700 percent. But while emergency departments have established surveys for patients and their families to report their experiences, there is not a clear equivalent for gathering direct feedback from patients who visit urgent care centers.
The study’s senior author, Raina Merchant, MD, director of the Penn Medicine Center for Digital Health and an associate professor in Emergency Medicine, believes Yelp reviews could fill a knowledge gap.
“Online reviews provide a rapid way of taking the pulse of how this acute care market is emerging and what consumers look for in these settings” said Merchant. “These platforms can also help us identify new focus areas, in an effort to provide better, more efficient care to patients based on their expressed needs.”
The researchers analyzed more than 100,000 Yelp reviews, posted between 2005 and 2017—in the midst of the urgent care boom—tied to 1,566 emergency departments and 5,601 from urgent care centers. During the study period, an average of one new review for an emergency department or an urgent care center appeared every hour of every day.
The reviews fell largely on one end of the spectrum or the other: five stars or one star. Roughly 47 percent of emergency department and 30 percent of urgent care center reviews fell in the one-star category. The disproportionate amount of negative reviews for acute care facilities, compared to other entities reviewed online, like hotels or restaurants, could be a result of what is at stake for the consumer.
“If a restaurant provides you with a quick meal exactly as advertised, they meet your expectations,” Merchant said. “With healthcare, things are different. People are often critically ill, the outcomes are uncertain, and the wait can be long—which are all things that sometimes can’t be controlled.”
The research team found that each type of facility received similar five-star reviews for comfort, cleanliness of facilities, pediatric care, and professionalism. One-star reviews for poor phone experiences, long wait times, billing difficulties, and pain management were tied to both emergency departments and urgent care centers.
Moving forward, the researchers hope to find more nontraditional sources to provide clues about patient experiences and use them to enhance care quality.
Other Penn Medicine authors of the study include Amy Lanza, Elissa Klinger, David Asch, Nick Fausti, and Christopher Tufts.
Penn Medicine is one of the world’s leading academic medical centers, dedicated to the related missions of medical education, biomedical research, and excellence in patient care. Penn Medicine consists of the Raymond and Ruth Perelman School of Medicine at the University of Pennsylvania (founded in 1765 as the nation’s first medical school) and the University of Pennsylvania Health System, which together form a $8.9 billion enterprise.
The Perelman School of Medicine has been ranked among the top medical schools in the United States for more than 20 years, according to U.S. News & World Report's survey of research-oriented medical schools. The School is consistently among the nation's top recipients of funding from the National Institutes of Health, with $496 million awarded in the 2020 fiscal year.
The University of Pennsylvania Health System’s patient care facilities include: the Hospital of the University of Pennsylvania and Penn Presbyterian Medical Center—which are recognized as one of the nation’s top “Honor Roll” hospitals by U.S. News & World Report—Chester County Hospital; Lancaster General Health; Penn Medicine Princeton Health; and Pennsylvania Hospital, the nation’s first hospital, founded in 1751. Additional facilities and enterprises include Good Shepherd Penn Partners, Penn Medicine at Home, Lancaster Behavioral Health Hospital, and Princeton House Behavioral Health, among others.
Penn Medicine is powered by a talented and dedicated workforce of more than 44,000 people. The organization also has alliances with top community health systems across both Southeastern Pennsylvania and Southern New Jersey, creating more options for patients no matter where they live.
Penn Medicine is committed to improving lives and health through a variety of community-based programs and activities. In fiscal year 2020, Penn Medicine provided more than $563 million to benefit our community.