Why you should read the one-star reviews first
Five-star reviews confirm that an app works for happy customers in common scenarios. One-star reviews tell you what breaks, who it breaks for, and how the company responds when something goes wrong. For subscription apps specifically, the themes in negative reviews that matter most are: unexpected billing charges, support that doesn't respond to billing-critical issues, merchants unable to cancel their own subscriptions, and migration failures that cost active subscribers.
- Unexpected fees or billing charges mentioned in multiple reviews: a red flag
- Support response complaints clustered in recent months: check if it's a trend
- 'Can't cancel my own plan' in reviews: check the contract terms before installing
- Migration failures in reviews: ask specifically about your current app if switching
The recency filter: star ratings over the last 90 days
An app's overall star rating is a lagging indicator. It reflects the cumulative experience of every merchant who ever installed the app, including early adopters from years ago when the product was different. The last 90 days of reviews reflect the current product, current support, and current pricing. An app with a 4.7 overall and a 3.4 in the last 90 days is telling you something has changed recently — and it's worth asking what before installing.
What subscription-specific review signals to look for
General app reviews focus on installation, support, and feature requests. For subscription apps, look specifically for reviews that mention billing reliability, failed payment handling, and what happened when the reviewer had a problem with a real customer order. These edge-case reviews reveal the operational quality of the platform — and subscription operations are full of edge cases.
- Billing reliability: did orders renew correctly and on schedule?
- Failed payment handling: did dunning work, did customers get notified?
- Portal quality: did customers complain about the self-service experience?
- Migration experience: did the reviewer switch from another app and what happened?
Vendor response quality as a trust signal
How a company responds to negative reviews reveals as much as the review itself. Responses that acknowledge the specific issue, explain what was fixed, and provide a contact path indicate an organisation that takes merchant problems seriously. Boilerplate responses ('We're sorry to hear this, please contact support') applied to every negative review suggest a company that treats reviews as reputation management rather than product feedback.
Supplementing reviews with your own trial evidence
Reviews provide second-hand evidence. Your own 30-day trial provides first-hand evidence. The most important things to personally verify during a trial are the things that reviews only indirectly tell you: billing accuracy on the first renewal cycle, support response time to a real ticket, portal behaviour for a real subscriber (use a personal email), and analytics accuracy against your known order data. These four data points, gathered yourself, are worth more than 200 reviews from stores with different products and different problems.
- Process a real test subscription through to first renewal — verify billing accuracy
- Submit a support ticket and measure time to first substantive response
- Use the portal as a subscriber: skip, swap, update payment method
- Compare analytics MRR figure to Shopify's order data — they should match