Filed Under:

Online Review Too Good To Be True? Sometimes It Is

Play associated audio

From local plumbers to luxury hotels, just about everyone selling a service these days has an online reputation. Increasingly, that reputation is shaped by online reviews. Customer ratings on sites such as Yelp and Urbanspoon can, for example, make or break a new restaurant.

It's no wonder, then, that some businesses are trying to fake us out. On Craigslist and online forums, posters are offering to buy and sell gushing reviews for just a few bucks; potential customers aren't able to tell the difference.

To help sort the genuinely delighted customers from profit-driven praise, Cornell University researcher Jeff Hancock and his colleagues have developed software that successfully unmasks fake online hotel reviews.

Hancock tells Laura Sullivan, guest host of weekends on All Things Considered, that too many bogus ratings could undermine the system.

"It gets at the very basic idea of what these reviews are about: trust," Hancock says.

The researchers started by "training" their computer algorithm on both fake reviews written for the study and real online reviews. Their software then went head-to-head against real humans and summarily defeated them: The computer was 90 percent accurate while the humans were correct three out of five times at best.

It turns out humans are just bad at telling when people are lying.

"This is consistent with about 40 years of psychological research on deception detection," Hancock says.

Part of the reason is that the clues to deceptive reviews are often found in the function words.

"[These are] the 'the's and 'ah's, the prepositions, the pronouns — all the little words. We as humans, we completely ignore those," Hancock says. Fake reviews, for example, were more likely to include self-reference and often came up short on specific spatial information.

This type of deception is not new to the Internet.

"We've been lying as long as we've been talking," Hancock says, "and that's about 60,000 years, so we have lots of practice."

The difference is that online deception, like these hotel reviews, relies on text.

"It's much more of a tell-me world rather than a show-me world," Hancock says.

Copyright 2011 National Public Radio. To see more, visit http://www.npr.org/.

NPR

For Penn & Teller's Magical Partnership, The Trick Is Telling The Truth

The duo Penn Jillette and Raymond Teller are back on Broadway. They both talk — yes, even Teller — with NPR's Scott Simon about magic, danger and the remarkable endurance of their 40-year partnership.
NPR

At The Purple Pie Place, Where The Crusts Are Just Sweet Enough

Bobkat's Purple Pie Place is a fixture in Custer, S.D. From chicken pot pie to strawberry rhubarb, Trevor Yehlie and his family have been baking and serving pies at the local favorite since 2009.
NPR

Empire Strikes PAC And Other Punny SuperPAC Names

My Cat Xavier For a Better Tomorrow, Tomorrow superPAC backed Hank the Cat in the 2012 Virginia Senate election. Xavier also cared about naps, treats, and prison reform.
NPR

Despite Host Controversy, Amazon Takes A Chance On 'Top Gear'

The trio that made Top Gear the world's biggest car show will return to the small screen in a new show for Amazon Prime. The BBC canned one of its hosts last year after a fight with a producer.

Leave a Comment

Help keep the conversation civil. Please refer to our Terms of Use and Code of Conduct before posting your comments.