The best time to answer your biggest Black Friday questions is before the holiday rush. These seven tests will help you build your Q4 plan around what your customers and your numbers are already telling you.
Every year, ecommerce teams arrive in October with the same urgent questions:
- Which products should we feature?
- How deep should the discount be?
- What should we put at the top of the sale page?
- How many emails should we send?
- Which messages will get people to click and buy?
You can make educated guesses in October. You can also answer most of those questions ahead of time, using tests that are small enough to run during the quieter months.
That is the real advantage of starting Q4 planning early. You get to replace a stressful pile of opinions with evidence from your own business.
Holiday shoppers often show stronger buying intent, but the signals behind their decisions are already present. Products that attract attention now can attract more attention during Q4. Offers that increase cart value now can give you more room when traffic gets expensive. Messages that consistently earn clicks now can become the foundation of your holiday creative.
The seven tests below will help you find those signals. You do not need to run all seven at once. Pick the three that could change the most important decisions in your Q4 plan, then start there.
Before You Test Anything, Get Your Product Costs Into Shopify
If your cost of goods sold data is missing or unreliable, your reports can tell a convincing story that happens to be wrong.
Revenue shows what customers paid. Contribution profit gives you a clearer picture of what the business kept after product costs, discounts, refunds, fulfillment, and other variable expenses. A product can look like a winner in a revenue report while quietly draining margin every time it sells.
That becomes especially dangerous during Q4. Bigger discounts and higher order volume can magnify weak economics very quickly.
Before you build your testing plan, make sure your COGS data is mapped as accurately as possible. If complete cost data is unavailable, build a documented gross-margin proxy. Label it clearly and use the same method across every product so your comparisons stay useful.
Start here: Confirm product cost, fulfillment cost, refund treatment, discount treatment, and any variable fees that materially affect contribution profit.
1. Find Your Profit Hero
Your highest-revenue product and your most profitable product may be two different things.
A high-priced SKU can lead the revenue report while converting slowly, attracting heavy discounts, generating refunds, or tying up expensive inventory. A lower-priced product may produce less revenue per order while converting more visitors, creating healthier margins, and bringing in customers who buy again.
Your first test is designed to find the products that create the most useful profit at scale.
What to measure
- Revenue by SKU and product category
- Contribution profit by SKU and category
- Contribution profit per 1,000 sessions
- Conversion rate
- Refund rate
- Average discount
- Inventory sell-through
Compare the revenue rankings with the profit rankings. Look for products with high revenue and weak profit, plus products with healthy profit that have received limited traffic or merchandising support.
Then give one promising profit hero more visibility in a controlled promotion. Place it higher in a collection, feature it in an email, or build a focused product story around it. The goal is to learn whether its profitability holds when exposure increases.
This test can also answer a critical merchandising question for your holiday sale page. The first two or three rows usually receive far more attention than the bottom of the page. Your most valuable placement should go to a product that can convert that attention into useful profit.
Prompt to try with your analytics agent: Using the last 12 months of Shopify data, rank SKUs and product categories by revenue, contribution profit, contribution profit per 1,000 sessions, conversion rate, refund rate, average discount, and inventory sell-through. Flag major gaps between revenue rank and profit rank. Identify three products that may deserve more exposure before Q4, and explain the evidence for each recommendation.
What you want to learn: Which products deserve the most valuable space in your Q4 merchandising plan?
2. Find the Products That Create Valuable Customers
A profitable first order is useful. A profitable customer relationship is even more valuable.
Group new customers by the first product or category they purchased, then follow what happens next. Compare repeat purchase rates at 30, 90, and 180 days. Adjust those windows for your category. A consumable may reveal its repeat behavior quickly, while jewelry or other considered purchases may require a longer view.
Clean the data before drawing conclusions. Wholesale orders, unusually large purchases, discontinued products, and other outliers can make a weak path look stronger than it is. An interquartile-range filter is a practical way to flag extreme values for review.
Questions this test should answer
- Which first product creates the highest repeat purchase rate?
- Which first product creates the strongest 90-day and 180-day contribution value?
- What do customers buy second?
- How long does the second purchase usually take?
- Does the best follow-up offer vary by the first product purchased?
This analysis should lead directly into an upsell and cross-sell test. Try more of the same product against a complementary product. Run that test at the product level instead of sending every customer to one blanket offer.
During the training behind this article, John shared a Boom test where an offer for more of the same product converted at roughly 24%, compared with roughly 14% for a different product. In other categories, especially subscription-heavy businesses, a complementary product can win because the customer already has another shipment of the original item coming.
The useful lesson is simple: test the next best offer for each important product. Your default assumption may be wrong, and the answer can change from one SKU to another.
What you want to learn: Which first purchase and follow-up offer create the strongest customer value over time?
3. Validate Demand for a New Product
A new product can be one of the strongest Q4 growth levers available to an established brand.
Your best customers already trust you, and they cannot own a product that did not exist before. A new product also gives hesitant prospects a fresh reason to look at the brand, especially when the new item solves a problem your hero product does not address.
The challenge is timing. Product selection, sourcing, packaging, sampling, inventory, messaging, and customer feedback all take time. Waiting until October leaves very little room for a strong launch.
Start by mining demand from the conversations your customers are already having:
- Product reviews
- Customer support tickets
- On-site search terms
- Social comments
- Survey responses
- Marketplace reviews
- Questions asked before purchase
Look for repeated problems, desired outcomes, packaging complaints, missing sizes or shades, and requests for complementary products.
Pay close attention to the difference between a customer’s problem and the solution they suggest. Customers are excellent at describing frustration. Your product team still needs to find the most useful, distinctive way to solve it.
One example involved a product people liked but found messy to use. The problem lived in the delivery system, so improving the packaging created a meaningful relaunch opportunity. In another case, Boom’s audience had been signaling demand for more stick variety for years. Boom Rose Nude went on to sell through 14,000 units, then sold through another 14,000 units after it restocked.
You do not need to commit to a full production run based on text analysis alone. Use the demand themes to create concepts, mockups, samples, waitlists, or small-batch tests. You are looking for enough evidence to make the next investment with confidence.
Prompt to try with your research agent: Analyze customer reviews, support tickets, on-site search terms, survey responses, and social comments from the last 12 months. Group recurring problems and requests by theme. Separate requests for specific products from broader unmet needs. Score each opportunity by frequency, customer intensity, fit with our current catalog, margin potential, sourcing complexity, and likely time to launch before Q4.
What you want to learn: Which customer problem gives you the strongest, most realistic product opportunity before the holiday season?
4. Test Offer Economics Instead of Chasing a Discount Number
There is no universal perfect Black Friday discount.
The right offer depends on your margins, products, customer mix, inventory goals, traffic costs, and the behavior you want to encourage. A straight 20% discount may create volume. A spending threshold, tiered discount, bundle, or gift can produce a healthier cart.
Compare offers using profit per visitor. Campaign revenue alone can mislead you because some promotions receive more emails, more adspend, stronger seasonal demand, or better traffic.
Offer structures worth testing
- A flat percentage discount
- A higher discount after a spending threshold
- A gift with purchase after a threshold
- Two gifts at two different thresholds
- A curated bundle with a clear use case
- A product stack designed to increase cart value
Run these tests before Q4 during planned promotional windows. Keep traffic sources and promotional effort as comparable as possible. Measure conversion rate, average order value, contribution profit per order, contribution profit per visitor, units moved, and the mix of inventory sold.
Thresholds often work because they give customers a reason to add one more item. Product stacks can also change the economics of paid traffic. A nail polish brand shifted the story from choosing one or two colors to buying coordinated palettes. The bundle gave customers a complete look and roughly doubled average cart value, which created far more room for acquisition.
What you want to learn: Which offer creates the strongest profit per visitor while moving the products you actually want to sell?
5. Find the Message That Earns the Click
Most email tests are designed to pick a winner for today’s campaign. The learning disappears after the send.
Use the months before Q4 to build a message library you can reuse when the stakes are higher. Choose one question each week and test it across multiple sends, ads, or landing-page placements.
Questions worth answering
- Do ingredient stories outperform benefit-led stories?
- Do customer reviews outperform product claims?
- Does customer language outperform internal brand language?
- Do animated GIFs outperform static images for this product?
- Does gift framing outperform self-purchase framing?
- Which problem or desired outcome earns the strongest response?
Track clicks, post-click conversion, revenue per recipient, and contribution profit when the data is available. Record the audience, product, creative format, and context so the learning stays usable.
One strong message can become a Q4 workhorse. Boom had always used high-quality ingredients, but the phrase “ingredients so clean you can eat them” turned a generic trust point into a memorable reason to pay attention. The value came from finding a vivid way to communicate an existing strength.
Your customers can help you find language like this. Reviews, surveys, and support conversations often contain sharper descriptions of the problem than a marketing brainstorm.
Build a simple learning library for every test:
- Question
- Audience
- Product
- Control and variation
- Primary metric
- Result
- Confidence level
- How the result should affect Q4 creative
What you want to learn: Which messages and creative formats deserve a place in your holiday playbook?
6. Remove One High-Value Site Friction Point
Speed is useful when a shopper already knows what they want. Other visitors need product detail, comparison, reassurance, and multiple ways to pay.
This is why a “faster” shopping experience can sometimes reduce revenue per visitor.
In our analysis of two Boom Black Friday experiences, a highly streamlined, add-to-cart-focused version generated about $7.40 in revenue per visitor and 2.6 page views per session. An earlier version that encouraged more product-detail exploration generated about $11.78 in revenue per visitor and 5.5 page views per session.
The faster experience produced shorter sessions. The more exploratory experience gave shoppers enough context to build larger carts.
That does not mean every brand should send every visitor through a long product-detail path. High-intent customers may appreciate direct add-to-cart buttons. Broader or less familiar audiences may need the depth of a PDP. A hybrid experience can serve both, with a clear quick-buy option plus an obvious path to product details.
Other site tests to consider
- Add a second buy box near the bottom of long product pages
- Increase font size and readability
- Keep express payment options visible
- Test expanded offer details against collapsed accordions
- Make product images clickable while preserving a fast add-to-cart option
- Add badges that clarify the product’s role without covering important imagery
Pick one friction point with a plausible connection to revenue. Define the primary metric before launch, and avoid changing five things at once. A clean test gives you a decision you can carry into the holiday build.
What you want to learn: Which experience helps each audience buy with the right balance of speed and confidence?
7. Build Your Q4 Audience Before Acquisition Gets Expensive
Black Friday traffic is valuable, and the competition for it makes acquisition expensive.
One way to create more selling opportunities is to acquire qualified leads before the rush, then give them time to learn about your products and your brand.
Test this with cohort analysis. Group profiles by how many days before Black Friday they joined your list, then measure:
- Cost per lead
- Black Friday and Cyber Monday revenue per profile
- Total Q4 revenue per profile
- Conversion rate
- Time to first purchase
- Repeat purchase rate
- Contribution value over the next three to six months
Break the cohorts down by acquisition source and lead magnet. A giveaway lead, quiz lead, content lead, and product-interest lead may behave very differently.
In the Boom analysis, profiles acquired 31 to 60 days before Black Friday and Cyber Monday produced the strongest balance of value and timing. That window is a useful hypothesis to test in your own business. It is not a universal rule.
Start by testing lead sources and welcome content. Scale the sources that attract qualified people at an acceptable cost. Then nurture those subscribers with education, product discovery, proof, and a clear reason to stay engaged until the holiday offer arrives.
What you want to learn: How early should you acquire a lead, and which source produces the most valuable Q4 customer?
Turn the Seven Tests Into a Practical Pre-Q4 Plan
You do not need a 40-hour analytics project to get value from this framework. You need a few important questions, clean-enough data, and a place to store the answers.
This week
- Confirm your COGS and margin inputs
- Choose the three tests most likely to change a Q4 decision
- Define one primary metric for each test
- Create a shared learning library
Over the next 30 days
- Run a profit-hero promotion
- Test a product-specific upsell or cross-sell
- Run one message test each week
- Analyze customer demand for a product or packaging opportunity
Before holiday production begins
- Choose the products that deserve the most sale-page visibility
- Select the offer structure with the strongest profit per visitor
- Carry proven messages into email, paid creative, and landing pages
- Ship the site experience that performed best in testing
- Scale the lead sources that created qualified Q4 buyers
Best practices are useful starting points. Your business can give you a better answer when you give it enough time to produce evidence.
Start with three tests. Learn what your customers respond to. Keep the results where your team can find them. When Q4 arrives, you will have a plan built from real behavior instead of a last-minute debate.
That is how you make Black Friday feel less like a gamble and more like an execution window.
