|

Home

About Us


Buying Cameras &
Electronics Online

• Search-sites
and ratings

• A tale of two
search-sites

• An argument
against balance

• You
can
play, too

• Some well-known
dealers

• Dealer strategies:
a few examples

• All those
pretty logos

• The fine print

• Relevant reading

|
|

Merchant ratings are an important factor in a shopper's
choice of dealer. On a previous page we
discussed two shortcomings of many ratings systems --
the
weight given
to relatively
unimportant
factors,
and the reliance on unverified (often clearly phony) customer reviews. On this
page we suggest that two other factors serve to bias most ratings in favor
of the less ethical dealers.
Does Bad Equal Good?
The arithmetic of ratings based on customer reviews bothers
us. When bad reviews are given equal weight with good ones, the casual reader
may be too willing to do business with a troublesome dealer.
We'll illustrate with a real example. On PriceGrabber, DealerX's
"Scorecard" has these statistics:
Total Reviews (all-time): 320
Positive Reviews: 208
Neutral Reviews: 23
Negative Reviews: 89
Average Rating: 3.48 (out of 5)
DealerX is awarded 3.5 stars. Seeing only that score (which is all that shows
up on the price comparison page for any particular camera), a shopper might
conclude that this dealer is a reasonably good one to do business with. An
analysis shows otherwise.
| |
• 28% of the reviewers
were unhappy with their experience. Would you shop at Sears if you knew that
28% of their customers were dissatisfied?
• Negative reviews were defined as ones on which customers gave "1
or 2 stars"; in fact, of the 89 negative reviewers, 79 gave only 1 star.
So 25% of the reviewers were extremely unhappy.
• Even the worst of the reviews counted as one star rather than zero. If the dealer
shipped a toilet seat instead of a $2000 camera, and refused to exchange it, he would still get
a star!
• While most of the positive reviews cite the minimum service we should
expect from any merchant -- the correct product, at the price quoted, in a
reasonable time -- most of the negative ones reflect either rude mistreatment
or behavior that borders on illegal.
|
In short, a good review should not balance out a bad one.
Our radical suggestion
would be to give moderately bad reviews and
very bad reviews more weight by counting them as negative points. DealerX, under
our system, would be scored
like this:
Total Reviews (all-time): 320
Positive
Reviews (5 stars): 126 [count as 4 points each]
Positive
Reviews (4 stars): 82 [count as 3 points each]
Neutral Reviews
(3 stars): 23 [count as 2 points each]
Negative
Reviews (2 stars): 10 [count as -2 points each]
Negative Reviews
(1 star): 79 [count as -4 points each]
Calculated
Rating: 1.44 (out of 4)
Should Price Count?
Price is the first thing most shoppers look at when searching
for a dealer, and low prices are easy for ratings sites to reward
with a star or a smiley-face. But some of the most notorious dealers publish
low prices with no intention of actually honoring them. Their well-known strategies
include requiring the purchase of overpriced or deceptively-labeled accessories,
substituting refurbished or gray-market products for the advertised ones, and
charging inflated shipping and mandatory insurance fees. Giving these particular
dealers credit for low prices favors them unfairly over their more honest rivals.
On most shopping comparison sites, the first page the shopper
goes to is a list of prices for the NEOD-2006 [Newest Electronic Object of
my Dreams-2006]. Before he clicks on the link to a dealer's ratings, he already
knows how that dealer's price compares with the others on the list. What
the shopper needs is a rating that reflects a summary of the merchant's general
policies and, most importantly, previous customers' experiences and satisfaction.
So we think advertised prices ought to be considered separately
from the other aspects of the buying experience, not blended with them in
a merchant's rating. (In the DealerX example above, price and overall
service are correctly kept separate.) When low prices effectively "balance
out" low
marks on customer service in a ratings score, consumers get a misleading impression.
Should Buying be Gambling?
Everybody takes risks with purchases. You may buy a $2 lottery
ticket knowing that the odds are high you will lose that money. You may spend
$5 on a new item at the supermarket knowing that there's some chance you'll
hate it. But the higher the price, and the less the potential payoff, the
less we're willing to take the risk. The decision is based on knowing the
odds, the cost, and the potential payoff.
We think the dealer ratings sites distort the risk by making
both the odds and the cost less clear, and the consumer distorts it by
not being mindful of the limited size of the payoff. In the example on this
page, this is what a shopper should understand before making any purchase:
• There is a 25% chance that I will be very unhappy with
this transaction.
• The potential cost is uncertain, but could amount to significant money
and inconvenience.
• The potential payoff is the amount I stand to save by buying
here instead of at a proven, reputable store or online dealer. On a $2000
camera, this may be only $200 or $300.
Answers to Our Questions
| |
1. Despite the methods of some ratings sites, good and bad reviews do not balance each other out.
The bad ones should make you cautious.
2. Ratings should reflect a dealer's overall service. Good
prices do not balance out poor service or dishonesty, and should be considered
independently.
3. When you understand the imbalance between the potential
cost and the payoff, and appreciate the odds revealed by a careful look at
reviews, buying should not be gambling. |
Website and all contents ©2008 by sheddingsomelight.com. All Rights Reserved.
|
|