How to Test a Shopify Discount Before Black Friday With Rollouts

Since 2 October 2026, you can add a Shopify discount to a rollout, which lets you schedule it, show it to part of your traffic as an experiment, or run it as an event that switches off by itself. Rollouts work on the Basic plan and higher, and experiments need the Grow plan or higher.

With Black Friday on 27 November 2026, there's just enough time to test an offer on a slice of your visitors for two weeks, pick the winner, and launch it as an event that ends after Cyber Monday. This guide shows how, with the rules that catch people out and the cases where a rollout isn't worth it.

Key takeaways

• A rollout is a scheduled set of changes to your theme, checkout, discounts or catalogs. You find it under Markets > Rollouts.

• There are three types: Launch (permanent), Event (for a set period, then rolled back) and Experiment (treatment against control).

• In an experiment, the control group gets no discount, and a discount keeps its own start and end dates.

• Run a test for at least two whole weeks. Small stores should test bold offers, not small tweaks.

• Rollout analytics show conversion, add-to-cart, and checkout rates, but no discount-specific numbers. Work out margin yourself.

• Wholesale stores can schedule a holiday catalog with an Event, with some limits for B2B catalogs.

What are Shopify Rollouts?

Shopify Rollouts let you schedule changes to your store and decide whether they apply permanently, for a set period, or only to part of your visitors as a test. Shopify describes a rollout as "a scheduled set of changes" in its Help Center. You create and manage them in your Shopify admin under Markets > Rollouts.

One rollout can include changes to your main theme, your checkout and account pages, your discounts, your product catalogs, or a mix of these. Discounts were added on 2 October 2026, according to the Shopify changelog.

Which Shopify plans can use Rollouts?

You don't need Shopify Plus. Many guides still say split testing needs the Advanced plan or Plus, as agency Charle points out, but Shopify's requirements page says otherwise.

Store owners and administrators can create rollouts. Other staff need the Markets > Rollouts permission, plus the Discounts permission to add a discount, and the Catalogs permissions to add a catalog.

How discounts behave inside a rollout

Most surprises come from the way a rollout and a discount's own settings work together. These rules come from Shopify's requirements page and its developer docs on discounts in rollouts.

The last row is the one that causes support tickets. A discount's status in your admin only reads its own start and end dates. While a rollout is running, what shoppers actually get can be different, and as Shopify's developer docs put it, "nothing on the discount itself says so". Before you tell your team a discount is off, check Markets > Rollouts too.

Pick the right rollout type for each holiday job

Step by step: test a Black Friday offer in November

Here's a timeline that works if you start this week. It gives you two full weeks of normal traffic before the holiday rush.

1. Write down one question. For example: "Does free shipping on orders over $50 bring more profit per visitor than our normal store?" One question per test, because an experiment compares one treatment with one control. If you change the offer, the banner, and the checkout at once, you won't know which one made the difference.

2. Create the discount you want to test. In Discounts, create it as usual. Shopify's docs say a discount is active whenever its own dates apply, so set its own start date after the test ends. Its status will show "Scheduled", and the rollout switches it on for the test group only. If its own dates cover the test, every visitor gets it, and the test is meaningless.

3. Create the rollout. Go to Markets > Rollouts > Create rollout. Give it a name you'll recognize later, such as "BF test 20% vs current". Choose Experiment.

4. Add the discount as the treatment. The control group sees your store as it is today, with no discount.

5. Set the traffic. Agency Charle, which tested Rollouts in October 2026, suggests starting with 10 to 25% of traffic for the first few days to catch mistakes, then raising it (Charle's Rollouts guide). Allocation and split are separate settings: 50% allocation with a 50/50 split puts 25% of eligible visitors in the treatment.

6. Check it as a shopper. Open your store in a private window a few times, or on two devices, and confirm you see the right offer. Shopify puts each visitor in a group before the page loads and remembers it in a cookie, so a new browser may land you in the other group.

7. Let it run for 14 days, in whole weeks. Weekend shoppers often behave differently from weekday shoppers.

8. Read the results, then decide. See the next two sections.

9. Launch the winner as an Event from 27 to 30 November. Choose Event, add the winning discount, and set the end date after Cyber Monday. If the test showed no clear gain in profit, choose a smaller offer, or keep the one you know.

How much traffic do you need for a fair test?

This is where most small stores go wrong. A test only tells you something if enough people go through it.

Charle's rule of thumb, at 95% confidence: if your store converts at 2.5%, spotting a 10% improvement needs about 62,000 visitors per version. That's around four months at 1,000 sessions a day. Spotting a 30% improvement needs about 7,000 visitors per version, which is closer to two weeks. These are their estimates, not Shopify's, and Shopify's own docs don't say how significance is calculated.

These bands are our guidance, based on the figures above. If your test ends with a small gap and a small sample, treat it as a tie.

Reading the results without fooling yourself

After a rollout runs, you compare it with your live store in its analytics. Shopify's rollout analytics page lists what you get, and what you don't.

Two things follow from this. First, a discount almost always lifts conversion rate, because a cheaper price is easier to say yes to. That doesn't mean it made you more money. Second, Shopify counts every visitor who reached a stage where the discount could apply, even if they weren't eligible for it. So read the numbers as "this offer, shown to this group", not as "this discount, used by these people".

Work out the margin yourself

Export your orders for the test dates and split them by the discount used. Then compare profit per visitor, not conversion rate. Here's a made-up example to show the maths, with two possible treatments. Each would be its own experiment against the same kind of control. These aren't real store numbers.

In this example, 20% off wins on conversion and loses on profit. Free shipping roughly matches your normal profit while bringing in 15 more orders. Your numbers will differ. The point is to look at the last row.

What happens when an Event ends

An Event rolls its changes back at the end date you set. In practice, that means three things:

• Discounts go back to their own dates. If a discount's own dates have passed, it stops. If they're still running, it stays live, so set the discount's own end date too, or leave its dates outside the event.

• Catalogs go back to their previous status. Shopify notes that edits you made to prices during the rollout stay saved. They only show again when the catalog is active.

• Other channels catch up on their next sync. Shopify POS and Google and YouTube feeds may show event prices for a short while after the online store has switched back.

A launch-day checklist for your Black Friday Event

1. Open Markets > Rollouts and confirm the Event's start and end times in your store's time zone.

2. Check the discount's own dates, so it doesn't start early or keep running after Cyber Monday.

3. Visit your store in a private window as a new shopper and as a logged-in customer. Add a product to the cart and check the price at checkout.

4. If you sell wholesale, log in as a test B2B customer and check their catalog prices too.

5. Tell your support team which offer is live and when it ends, so they can answer "why didn't my discount apply?" quickly.

B2B and wholesale: schedule a holiday price list with a catalog rollout

Rollouts aren't only for shopper promotions. If you sell wholesale, a rollout can switch a catalog on or off on a schedule. Since 2 April 2026, Shopify gives catalogs, volume pricing and quantity rules to Basic, Grow and Advanced stores at no extra cost, with up to three catalogs below Plus (Shopify News).

A common use: a "December reorder" catalog with lower prices on gift items, active from 1 to 31 December. Put it in an Event rollout, and it goes back to its previous status by itself. Before you do, know these limits from Shopify's requirements page:

• A rollout only changes the catalog's status. Price and product edits save straight away and apply whenever the catalog is active. So set the prices first, then let the rollout control when it's active.

• Catalogs assigned directly to a company location can't be added. Those are the per-company catalogs, which are a Plus feature anyway.

• Your plan's catalog cap still applies. Activating a catalog can't take you over your plan's limit. Switching another catalog to draft in the same rollout can free a slot.

• A catalog change can reach more than your online store. At 100%, it can also affect Shopify POS and Google and YouTube feeds, which update on their next sync. So they may show old prices for a while after the event ends.

• One unfinished rollout per catalog, just like discounts.

If you need more than three price lists below Plus, or prices by customer tag rather than by company, a pricing app is still the answer. We cover where the native setup stops in Shopify B2B volume pricing vs DiscountRay.

Do app discounts work in Rollouts?

Yes, on Shopify's side. Shopify's developer docs list app-made discounts, both automatic and code discounts, among the types a rollout can include. That covers apps that create discounts through Shopify's discount system, such as DiscountRay.

Two practical points for merchants:

• The app's own screen may not know about the rollout. Shopify asks app developers to read rollout data and show it next to their discounts, but that needs app updates, and the status problem above applies to app discounts too. Check Markets > Rollouts as the source of truth.

• App automatic discounts have an active limit. Shopify allows up to 25 active automatic discounts from apps, a limit it raised from 5 in November 2024 (Shopify.dev changelog). A rollout can hold 250 discounts, but you still can't have more than 25 app automatic discounts live at once. We explain the limit in Shopify's 25 automatic discount limit.

Using a rollout with DiscountRay

DiscountRay creates automatic discounts that run at Shopify checkout. Shopify's documentation says app discounts can be part of a rollout, but we haven't published our own rollout test results yet. If you want to test a DiscountRay offer this way, run a small experiment first, at 10% of traffic for a day or two, and check in a private window that the offer appears only for the shoppers you expect. Our support team can help you set it up.

If you only need an offer to start and end on set dates, you don't need a rollout. DiscountRay's Growth plan lets you schedule discounts in advance.

Prices and features are from the DiscountRay App Store listing on 2 November 2026. Growth and Pro include a 14-day free trial.

When not to use a rollout

• You're on the Basic plan and want an A/B test. Experiments need Grow or higher. Use an Event for the sale, and test after the holidays.

• You only need a start and end time. A discount's own dates, or an app's schedule, are simpler and easier for your team to read.

• Your traffic is low. Under a few hundred sessions a day, an experiment won't give you a clear answer in two weeks.

• It's BFCM week. Don't test during the sale itself. Shopper behaviour is too unusual, and a mistake costs the most.

• You sell mainly through POS or a headless storefront. Experiments and partial rollouts only apply to the online store, and the analytics leave POS and headless visitors out.

• You rely on Google Shopping prices. During an experiment, Shopify warns that your store can show a different offer from your ads, feeds and listings.

Five mistakes to avoid

1. Leaving the discount's own dates active, so every visitor gets it and the test is pointless.

2. Expecting the control group to get a different discount. In an experiment, the control always gets no discount.

3. Calling a winner after three days.

4. Judging by conversion rate instead of profit.

5. Forgetting that a code in a test can be shared on coupon sites, so people outside the test group use it too.

The bottom line

Rollouts give every Shopify store from the Basic plan up a safer way to launch holiday offers, and Grow stores and above can test before they commit. Start this week: one question, one experiment, two weeks of traffic, then launch the winner as an Event that ends on its own after Cyber Monday. Judge it on profit, not conversion. If you need tiered, wholesale or customer-specific pricing on top, try DiscountRay free on the Shopify App Store, and plan the rest of your season with our BFCM discount calendar.

FAQs