Negative Bias in the iTunes App Store Reviews

by Frankie on June 21, 2009

Asking users who are deleting an application for their opinion skews reporting.

Asking users who are deleting an application for their opinion skews reporting.

Recently while clearing Apps off my phone I don’t use very often, I came across a very peculiar “feature.” The iPhone asks for a review of the application you are deleting. While the app store suffers from self selection bias, only people who care very much about the outcome either positively or negatively will take the time necessary to review an app, this introduces a new form of bias. Since users who are deleting an application are hypothetically more critical of an application than someone who uses the application on a daily basis, asking this group for reviews will negatively skew the ratings lower than is the actual customer sentiment.  While this is being applied equally across applications, it may give a negative first impression of any given application since satisfied users are never given a “call-to-review.”

  • I completely agree. I have also thought about how the default "1-star" rating will cause many people who do not care to tap "rate" whether they meant to rate the app 1-star or not.
  • Just to follow up on this... I don't believe the default is 1 Star anymore (if it was in the past; I didn't explicitly check it, but from my screenshot I think that was the default). Currently the default is 0 stars with the "Rate" button greyed out.
blog comments powered by Disqus

Previous post:

Next post: