Guide

Promotion and Media Incrementality

A campaign can coincide with strong sales without causing them. Customers may have bought anyway, seasonality may have raised demand, or targeting may have selected people already likely to purchase. Management therefore needs to estimate the outcome that would have occurred without the promotion or media activity.

Marketways designs experiments and causal analyses that compare observed performance with a credible counterfactual. We then trace the effect across products, periods and customers, deduct the complete commercial cost and identify which finding should change the next allocation.

Define the intervention and decision

The evaluation must state what changed, who could receive it, when exposure occurred and which management decision the result will inform. A price promotion, loyalty offer, search campaign and television campaign create different exposure and response mechanisms.

Marketways defines the treatment, eligible population, outcome period and decision threshold before analysing results. This prevents the campaign from being judged through whichever metric happened to improve.

Separate attribution from causation

Attribution assigns a transaction to a touchpoint under a chosen rule. Incrementality asks whether the transaction would have occurred without the intervention. A customer who clicks an advertisement shortly before buying may still have intended to purchase.

Marketways uses attribution to describe observed journeys, not to prove causal value. A credible comparison must represent the missing outcome for treated customers. This distinction prevents platform or last-click reports from becoming unsupported return-on-investment claims.

Establish the baseline before calculating uplift

Sales can change because of seasonality, holidays, competitor activity, distribution, price, weather and product availability. A before-and-after comparison assigns these changes to the campaign unless the design accounts for them.

Marketways defines the baseline through a control group or a justified counterfactual model. We test whether treatment and comparison units behaved similarly before the intervention and whether another material event affected only one group. Uplift is then the difference between observed performance and the outcome the comparison supports.

Prefer randomisation when operations permit it

Random assignment gives eligible customers, stores or regions a known chance of receiving the intervention. If the groups are large enough and execution preserves the assignment, their outcome difference provides a direct estimate of incremental effect.

Marketways selects the randomisation unit to limit spillover and contamination. We calculate the minimum detectable effect and required duration before launch. An underpowered test can consume budget and still leave management unable to distinguish a useful effect from ordinary variation.

Use geographic experiments for broad media

Individual randomisation may be impossible for television, outdoor media or campaigns bought by region. Geographic experiments can compare matched markets assigned to different media conditions.

Marketways examines market similarity, travel between regions, media leakage and the number of usable geographic units. We preserve the planned analysis and test placebo periods where appropriate. The design makes broad media measurable without pretending that geographic separation is perfect.

Use observational designs with explicit assumptions

Sometimes management cannot withhold an activity or randomise exposure. Matched controls, difference-in-differences, synthetic controls and time-series methods may then estimate a counterfactual.

Each design depends on assumptions about selection, prior trends and unobserved events. Marketways states and tests those assumptions where possible, conducts sensitivity analysis and limits the claim when the evidence remains weak. Model complexity cannot repair a comparison that never represented what would have happened without the campaign.

Verify that the campaign was executed as designed

An experiment can fail even when the statistical analysis is correct. Stores may apply the wrong price, media may reach control regions, products may be unavailable or customer identifiers may misclassify exposure.

Marketways checks assignment, delivery, availability and contamination before interpreting outcomes. We distinguish failure of the commercial idea from failure to execute the intended treatment. Management can then decide whether to reject the intervention, correct delivery or run a valid test.

Separate immediate uplift from stockpiling

A promotion can bring future purchases forward. Sales rise during the offer and fall afterwards because customers consume the inventory they already bought. The campaign has changed purchase timing rather than total demand.

Marketways extends the outcome period far enough to observe relevant post-promotion behaviour. We estimate acceleration, increased consumption and genuinely additional purchases separately where the evidence permits. This prevents a temporary spike from being reported as lasting growth.

Measure cannibalisation across products and channels

A promoted pack can gain sales because customers switch from another size, product or channel owned by the same business. The promoted item looks successful while total category or company value changes little.

Marketways defines the substitution set before analysis and tracks affected products and channels. We distinguish competitor switching from internal cannibalisation and category expansion. The result shows whether the intervention created demand or merely moved it within the portfolio.

Include availability and fulfilment constraints

A campaign cannot produce recorded sales when the advertised product is unavailable. Conversely, constrained supply can shift customers to substitutes and make the observed product mix difficult to interpret.

Marketways links exposure and outcome data with inventory, distribution and fulfilment evidence. We estimate the effect among customers or locations that could receive the proposition and report the lost opportunity separately. This protects the causal estimate from an operating failure while keeping the failure visible to management.

Convert incremental sales into incremental profit

Additional revenue does not establish commercial value. Discounts, media cost, supplier funding, fulfilment, returns, service and displaced margin can absorb the apparent gain.

Marketways calculates incremental contribution over the relevant period and shows uncertainty around the estimate. We distinguish return on incremental spend from attributed revenue divided by cost. Management can then compare the intervention with alternative uses of the same budget.

Identify customers whose outcomes can change

Average lift can conceal material differences. An offer may persuade one group, subsidise customers who would buy anyway and irritate another group through excessive contact.

Marketways estimates heterogeneous treatment effects only when the design and sample support them. We validate proposed targeting rules on held-out or later evidence and include treatment cost and operating capacity. The objective is to find customers whose outcome a feasible action changes, not merely customers with a high purchase probability.

Distinguish short-term response from longer-term value

Media can affect awareness or consideration before transactions appear, while repeated discounting can change reference prices and future behaviour. A narrow sales window may therefore miss benefits or costs that matter to the decision.

Marketways defines leading and downstream outcomes without claiming that every later change came from the campaign. We use experiments, repeated measurement or calibrated models appropriate to the horizon. The final claim remains proportionate to the evidence.

Turn evaluation into the next allocation decision

The purpose of incrementality analysis is not to issue a retrospective score. Management needs to decide which audience, offer, channel, frequency and spending level should receive the next unit of investment.

Marketways translates effect estimates and uncertainty into allocation options under budget and delivery constraints. We identify which result is sufficiently strong to scale, which requires another test and which activity should stop. The learning plan preserves comparability across successive decisions.

Use Agentic AI to coordinate approved experiments

An Agentic AI workflow can assemble assignment records, exposure, sales, inventory and cost data; detect execution failures; and prepare scheduled analyses. It can also monitor whether a planned holdout remains intact.

Marketways tests identity errors, late data, contaminated controls, missing costs and conflicting experiment rules. The agent cannot change treatment allocation, budget or success criteria outside approved authority. It coordinates the measurement process and preserves a reproducible record for management review.

A retail promotion illustrates the complete decision

Suppose a retailer discounts a large pack and records a strong sales increase. The same period includes a holiday, several control stores run low on stock and smaller packs lose sales. Sales fall below normal after the promotion.

Marketways would reconstruct availability, use a valid comparison, measure cross-pack switching and extend the analysis through the post-promotion period. We would then deduct discount and execution costs from incremental margin. Management would learn whether the campaign expanded demand, changed timing or subsidised movement within the brand.

How Marketways measures incremental commercial value

Marketways combines Decision Assurance, Customer Satisfaction and Experience Research and Causal Inference and Experimentation. We design the comparison, verify execution, estimate incremental effects, trace substitution and timing, and calculate commercial value.

The result tells management what the intervention caused, for whom, at what cost and whether the evidence justifies the next allocation.

Related guides and evidence

References

  1. Measuring Ad Effectiveness Using Geo Experiments
  2. Ghost Ads: Improving the Economics of Measuring Online Ad Effectiveness
  3. Brand-Pack Size Cannibalization Arising from Temporary Price Promotions
  4. Decomposition of the Sales Impact of Promotion-Induced Stockpiling
  5. Forecast Adjustments During Post-Promotional Periods
  6. Estimating Cannibalizing Effects of Sales Promotions