How we test e-commerce apps

Each Pilot Score comes from hands-on use, not from feature lists or vendor demos. This page explains what we do before we publish a review.

1. Install on a real test store

We install the app on a live test store with real products, real checkout and realistic data, then set it up the way its documentation recommends.

2. Run it for days, not minutes

We use the app day to day for the period shown on each review as “Days tested”, and record what happens in a dated test log you can read at the end of the review.

3. Score five areas

• Setup: how long it takes to get working, and how much help you need.
• Features: whether the core features do what the listing says.
• Pricing: what you actually pay at realistic store sizes, including add-ons.
• Support: response time and quality when we contact the vendor as a normal customer.
• Value for money: what you get for the price compared with alternatives we have tested.

The Pilot Score out of 10 sums up these five areas. Pros, cons and who the app is best for are written from the test log.

4. Keep it current

Apps change pricing and features often. We recheck reviews and update the date when something material changes.

What vendors cannot do

Vendors cannot pay for a review, a higher score or a better position in a list. Affiliate commissions never change a score. See our affiliate disclosure.