5 Reputation Fallacies (And How to Avoid Them)

F. Randall "Randy" Farmer (MSB Associates), Bryce Glass (Manta Media, Inc.)
Design & User Experience
Location: 2001 Level:
Average rating: ****.
(4.19, 16 ratings)

Designing a reputation system is hard. Do it right, and you’re likely to draw from disciplines as disparate as computer science, sociology, user experience design and behavioral economics. Do it wrong, and you could wreak horrible downstream effects on the morale, motivations and mindset of your community.

We often design web reputation systems by drawing from easily-available examples on the Web, but this is an impoverished approach; it often leads the designer to settle on a design solution before they’ve properly understood the context, and framed the design problem. This is cargo-cult design at its worst, and leads to such “common sense” fallacies as…

  • “It’s The People, Dummy!”

When you think of reputation on the Web, do you just assume that it applies chiefly to people? This is only partially true. Reputation applies to things as well, and—in fact—it’s almost impossible to know a person’s reputation without evaluating the reputation of things.

  • “One Reputation To Rule Them All”

Do you think that someone’s Ebay Seller Reputation should follow them onto Facebook? Should Slashdot karma matter over on Reddit? Some very smart people have fallen victim to this fallacy: the belief that one reputation is enough to accurately convey “the measure of a man.”

  • “All I Need is Five Stars”

Ratings input mechanisms fall into, and out of, vogue. Once it was 5-Stars, then it was Digg-style upvoting, now Facebook’s ‘Like’ holds the crown. If you’re tempted to start with a ratings scheme in mind, and then back-design a system to justify it, proceed with caution. (Includes a bonus fallacy: “Of course I need a down-vote!”)

  • “Competition is Always Good”

Feeling inspired by game-like elements? Levels, points and leaderboards? Just make sure that they influence the right kind of behavior, and don’t assume a level of community competition that may, or may not, be appropriate.

  • “Negative Karma Will Out the Bad Guys”

What’s the best way to identify the bad actors in your community? Why, label them, of course! Wrong—you should employ negative karma sparingly, and display it almost never.

The authors of Building Web Reputation Systems (O’Reilly, 2010) will debunk these fallacies, and a couple of others besides, drawing on real-life examples of actual deployed reputation systems from some of our industry’s biggest names: EA, Google, Yahoo! and Ebay. You might be surprised at how pervasive, and persistent, these fallacies have been through the years. But don’t worry—we’ll also tell you how to avoid falling into the same old traps!

Photo of F. Randall "Randy" Farmer

F. Randall "Randy" Farmer

MSB Associates

F. Randall “Randy” Farmer is the co-author of the new O’Reilly/Yahoo! Press
book: Building Web Reputation Systems. He has been creating online community
systems for over 30 years, and has co-invented many of the basic structures
for both virtual worlds and social software. His accomplishments include
numerous industry firsts (such as the first virtual world, the first
avatars, and the first online marketplace). Randy worked as the community
strategic analyst for Yahoo!, advising Yahoo properties on construction of
their online communities. Randy was the principal designer of Yahoo’s global
reputation platform and the reputation models that were deployed on it which
provided the core lessons detailed in the new book.

Photo of Bryce Glass

Bryce Glass

Manta Media, Inc.

Bryce Glass is a Principal Interaction Designer at Manta Media, Inc. and has worked on Internet community products and platforms for more than 10 years, with some of the Internet’s best-known brands (Netscape, America Online and Yahoo!). Bryce is the co-author, with F. Randall Farmer, of Building Web Reputation Systems (O’Reilly 2010).

Comments on this page are now closed.

Comments

Picture of Elaine Rudis-Jackson
Elaine Rudis-Jackson
05/09/2010 6:55am PDT

Actually a sobering view of how reputations can be made or ruined on the web. This is not a subject to be taken lightly.

Picture of Michael Smith
Michael Smith
05/06/2010 10:58am PDT

Really great information. I had never given reputation systems too much of a thought/consideration, and I’m about to implement one on my site redesign. Your session had a direct impact on my ops: afterward I called my developer to change our system based on the info I learned!

Picture of Christian Crumlish
Christian Crumlish
05/04/2010 8:37am PDT

great preso… solid advice, well delivered, readily applicable. kudos!

Silverlight Showcase
Sponsors
  • Microsoft Corporation
  • .CO
  • Adobe Systems, Inc.
  • Ericsson
  • Germany Trade & Invest
  • IBM
  • Berlin Partner
  • blueKiwi
  • EffectiveUI
  • HP
  • Neustar, Inc.
  • OpenSRS
  • OpenText
  • PayPal
  • Pearltrees
  • The Planet
  • SOASTA

Rob Koziura
(415) 947-6111
rkoziura@techweb.com

Kaitlin Pike
(415) 947-6306
kpike@techweb.com

View a complete list of Web 2.0 Expo contacts.